2026-02-23T10:11:26.775 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-23T10:11:26.799 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T10:11:26.879 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66051 branch: main description: crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} tasks/rados_python} email: null first_in_suite: false flavor: debug job_id: '66051' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd pool default crimson: true osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug ms: 20 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd objectstore: seastore osd shutdown pgref assert: true seastore cachepin size pershard: 64M seastore cachepin type: 2Q seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(PG_ - \(OSD_ - \(OBJECT_ - \(POOL_APP_NOT_ENABLED\) sha1: e371433fcd1390a0b82cfb18effc422c1f5d8c1d ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: extra_system_packages: - python3-pytest flavor: debug sha1: e371433fcd1390a0b82cfb18effc422c1f5d8c1d workunit: branch: wip-shraddhaag-enable-cephadm-tests env: CRIMSON_COMPAT: '1' sha1: e371433fcd1390a0b82cfb18effc422c1f5d8c1d owner: scheduled_shraddhaag@soko04.front.sepia.ceph.com priority: 49 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 66 sha1: e371433fcd1390a0b82cfb18effc422c1f5d8c1d sleep_before_teardown: 0 suite: crimson-rados suite_branch: wip-shraddhaag-enable-cephadm-tests suite_path: /home/teuthworker/src/github.com_shraddhaag_ceph_e371433fcd1390a0b82cfb18effc422c1f5d8c1d/qa suite_relpath: qa suite_repo: https://github.com/shraddhaag/ceph.git suite_sha1: e371433fcd1390a0b82cfb18effc422c1f5d8c1d targets: trial044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJMCgeLkn31yx43MnVuva4j6Xks7ITN4h1eQj61X5UT/Hj+TJC8gFNm+w+icF2VTaADP70JJZ8VzKlfslt3cqgM= trial198.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOHwvpTfCvG2EPGOeKJWsBwRo+BIGGaKtxPQ7QNTeCuTACuYKTPzBAlohb+iynR4VXtu6zHJSMvY/w/lxPXs5kc= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 - workunit: clients: client.0: - rados/test_python.sh -m 'not (wait or tier or ec)' timeout: 1h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-23_09:58:48 tube: trial user: shraddhaag verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653 2026-02-23T10:11:26.879 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_shraddhaag_ceph_e371433fcd1390a0b82cfb18effc422c1f5d8c1d/qa; will attempt to use it 2026-02-23T10:11:26.879 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_shraddhaag_ceph_e371433fcd1390a0b82cfb18effc422c1f5d8c1d/qa/tasks 2026-02-23T10:11:26.880 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-23T10:11:26.881 INFO:teuthology.task.internal:Checking packages... 2026-02-23T10:11:26.881 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d' 2026-02-23T10:11:26.881 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-23T10:11:26.881 INFO:teuthology.packaging:ref: None 2026-02-23T10:11:26.881 INFO:teuthology.packaging:tag: None 2026-02-23T10:11:26.881 INFO:teuthology.packaging:branch: main 2026-02-23T10:11:26.881 INFO:teuthology.packaging:sha1: e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T10:11:26.881 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=main 2026-02-23T10:11:27.016 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5253.g5ccdd6ad 2026-02-23T10:11:27.018 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-23T10:11:27.029 INFO:teuthology.task.internal:no buildpackages task found 2026-02-23T10:11:27.029 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-23T10:11:27.042 INFO:teuthology.task.internal:Saving configuration 2026-02-23T10:11:27.056 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-23T10:11:27.068 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-23T10:11:27.149 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial044.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66051', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-23 10:07:59.027338', 'locked_by': 'scheduled_shraddhaag@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJMCgeLkn31yx43MnVuva4j6Xks7ITN4h1eQj61X5UT/Hj+TJC8gFNm+w+icF2VTaADP70JJZ8VzKlfslt3cqgM='} 2026-02-23T10:11:27.204 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial198.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66051', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-23 10:07:59.026719', 'locked_by': 'scheduled_shraddhaag@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOHwvpTfCvG2EPGOeKJWsBwRo+BIGGaKtxPQ7QNTeCuTACuYKTPzBAlohb+iynR4VXtu6zHJSMvY/w/lxPXs5kc='} 2026-02-23T10:11:27.204 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-23T10:11:27.215 INFO:teuthology.task.internal:roles: ubuntu@trial044.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2026-02-23T10:11:27.215 INFO:teuthology.task.internal:roles: ubuntu@trial198.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2026-02-23T10:11:27.215 INFO:teuthology.run_tasks:Running task console_log... 2026-02-23T10:11:27.350 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x72097bf10ae0>, signals=[15]) 2026-02-23T10:11:27.350 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-23T10:11:27.361 INFO:teuthology.task.internal:Opening connections... 2026-02-23T10:11:27.361 DEBUG:teuthology.task.internal:connecting to ubuntu@trial044.front.sepia.ceph.com 2026-02-23T10:11:27.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T10:11:27.423 DEBUG:teuthology.task.internal:connecting to ubuntu@trial198.front.sepia.ceph.com 2026-02-23T10:11:27.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T10:11:27.484 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-23T10:11:27.496 DEBUG:teuthology.orchestra.run.trial044:> uname -m 2026-02-23T10:11:27.511 INFO:teuthology.orchestra.run.trial044.stdout:x86_64 2026-02-23T10:11:27.511 DEBUG:teuthology.orchestra.run.trial044:> cat /etc/os-release 2026-02-23T10:11:27.567 INFO:teuthology.orchestra.run.trial044.stdout:NAME="CentOS Stream" 2026-02-23T10:11:27.567 INFO:teuthology.orchestra.run.trial044.stdout:VERSION="9" 2026-02-23T10:11:27.567 INFO:teuthology.orchestra.run.trial044.stdout:ID="centos" 2026-02-23T10:11:27.567 INFO:teuthology.orchestra.run.trial044.stdout:ID_LIKE="rhel fedora" 2026-02-23T10:11:27.567 INFO:teuthology.orchestra.run.trial044.stdout:VERSION_ID="9" 2026-02-23T10:11:27.567 INFO:teuthology.orchestra.run.trial044.stdout:PLATFORM_ID="platform:el9" 2026-02-23T10:11:27.567 INFO:teuthology.orchestra.run.trial044.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T10:11:27.567 INFO:teuthology.orchestra.run.trial044.stdout:ANSI_COLOR="0;31" 2026-02-23T10:11:27.567 INFO:teuthology.orchestra.run.trial044.stdout:LOGO="fedora-logo-icon" 2026-02-23T10:11:27.567 INFO:teuthology.orchestra.run.trial044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T10:11:27.567 INFO:teuthology.orchestra.run.trial044.stdout:HOME_URL="https://centos.org/" 2026-02-23T10:11:27.567 INFO:teuthology.orchestra.run.trial044.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T10:11:27.567 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T10:11:27.567 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T10:11:27.568 INFO:teuthology.lock.ops:Updating trial044.front.sepia.ceph.com on lock server 2026-02-23T10:11:27.637 DEBUG:teuthology.orchestra.run.trial198:> uname -m 2026-02-23T10:11:27.653 INFO:teuthology.orchestra.run.trial198.stdout:x86_64 2026-02-23T10:11:27.653 DEBUG:teuthology.orchestra.run.trial198:> cat /etc/os-release 2026-02-23T10:11:27.709 INFO:teuthology.orchestra.run.trial198.stdout:NAME="CentOS Stream" 2026-02-23T10:11:27.709 INFO:teuthology.orchestra.run.trial198.stdout:VERSION="9" 2026-02-23T10:11:27.709 INFO:teuthology.orchestra.run.trial198.stdout:ID="centos" 2026-02-23T10:11:27.709 INFO:teuthology.orchestra.run.trial198.stdout:ID_LIKE="rhel fedora" 2026-02-23T10:11:27.709 INFO:teuthology.orchestra.run.trial198.stdout:VERSION_ID="9" 2026-02-23T10:11:27.710 INFO:teuthology.orchestra.run.trial198.stdout:PLATFORM_ID="platform:el9" 2026-02-23T10:11:27.710 INFO:teuthology.orchestra.run.trial198.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T10:11:27.710 INFO:teuthology.orchestra.run.trial198.stdout:ANSI_COLOR="0;31" 2026-02-23T10:11:27.710 INFO:teuthology.orchestra.run.trial198.stdout:LOGO="fedora-logo-icon" 2026-02-23T10:11:27.710 INFO:teuthology.orchestra.run.trial198.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T10:11:27.710 INFO:teuthology.orchestra.run.trial198.stdout:HOME_URL="https://centos.org/" 2026-02-23T10:11:27.710 INFO:teuthology.orchestra.run.trial198.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T10:11:27.710 INFO:teuthology.orchestra.run.trial198.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T10:11:27.710 INFO:teuthology.orchestra.run.trial198.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T10:11:27.710 INFO:teuthology.lock.ops:Updating trial198.front.sepia.ceph.com on lock server 2026-02-23T10:11:27.788 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-23T10:11:27.800 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-23T10:11:27.812 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-23T10:11:27.812 DEBUG:teuthology.orchestra.run.trial044:> test '!' -e /home/ubuntu/cephtest 2026-02-23T10:11:27.814 DEBUG:teuthology.orchestra.run.trial198:> test '!' -e /home/ubuntu/cephtest 2026-02-23T10:11:27.829 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-23T10:11:27.842 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-23T10:11:27.843 DEBUG:teuthology.orchestra.run.trial044:> test -z $(ls -A /var/lib/ceph) 2026-02-23T10:11:27.869 DEBUG:teuthology.orchestra.run.trial198:> test -z $(ls -A /var/lib/ceph) 2026-02-23T10:11:27.887 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-23T10:11:28.048 INFO:teuthology.run_tasks:Running task kernel... 2026-02-23T10:11:28.068 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-23T10:11:28.068 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-23T10:11:28.068 DEBUG:teuthology.orchestra.run.trial044:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-23T10:11:28.069 DEBUG:teuthology.orchestra.run.trial198:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-23T10:11:28.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T10:11:28.083 DEBUG:teuthology.orchestra.run.trial044:> uname -r 2026-02-23T10:11:28.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T10:11:28.083 DEBUG:teuthology.orchestra.run.trial198:> uname -r 2026-02-23T10:11:28.139 INFO:teuthology.orchestra.run.trial198.stdout:5.14.0-681.el9.x86_64 2026-02-23T10:11:28.139 INFO:teuthology.task.kernel:Running kernel on trial198: 5.14.0-681.el9.x86_64 2026-02-23T10:11:28.139 DEBUG:teuthology.orchestra.run.trial198:> sudo yum install -y kernel 2026-02-23T10:11:28.140 INFO:teuthology.orchestra.run.trial044.stdout:5.14.0-681.el9.x86_64 2026-02-23T10:11:28.140 INFO:teuthology.task.kernel:Running kernel on trial044: 5.14.0-681.el9.x86_64 2026-02-23T10:11:28.140 DEBUG:teuthology.orchestra.run.trial044:> sudo yum install -y kernel 2026-02-23T10:11:29.465 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - BaseOS 9.4 MB/s | 8.9 MB 00:00 2026-02-23T10:11:32.805 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 27 MB 00:02 2026-02-23T10:11:35.747 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - CRB 14 MB/s | 7.8 MB 00:00 2026-02-23T10:11:36.939 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 20 kB 00:00 2026-02-23T10:11:37.100 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-23T10:11:38.450 INFO:teuthology.orchestra.run.trial198.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2026-02-23T10:11:39.639 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-23T10:11:41.651 INFO:teuthology.orchestra.run.trial198.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-23T10:11:42.663 INFO:teuthology.orchestra.run.trial198.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-23T10:11:42.663 INFO:teuthology.orchestra.run.trial198.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-23T10:11:42.682 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-23T10:11:42.682 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-23T10:11:42.683 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-23T10:11:42.707 DEBUG:teuthology.orchestra.run.trial198:> echo no | sudo yum reinstall kernel || true 2026-02-23T10:11:43.009 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:02 ago on Mon 23 Feb 2026 10:11:41 AM UTC. 2026-02-23T10:11:43.090 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-23T10:11:43.091 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-23T10:11:43.092 INFO:teuthology.orchestra.run.trial198.stdout: Package Architecture Version Repository Size 2026-02-23T10:11:43.092 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-23T10:11:43.092 INFO:teuthology.orchestra.run.trial198.stdout:Reinstalling: 2026-02-23T10:11:43.092 INFO:teuthology.orchestra.run.trial198.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-23T10:11:43.092 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:11:43.092 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-23T10:11:43.092 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-23T10:11:43.092 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:11:43.092 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 803 k 2026-02-23T10:11:43.092 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 0 2026-02-23T10:11:43.093 INFO:teuthology.orchestra.run.trial198.stderr:Operation aborted. 2026-02-23T10:11:43.111 INFO:teuthology.orchestra.run.trial198.stdout:Is this ok [y/N]: 2026-02-23T10:11:43.112 DEBUG:teuthology.orchestra.run.trial198:> sudo yum reinstall -y kernel || true 2026-02-23T10:11:43.413 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:02 ago on Mon 23 Feb 2026 10:11:41 AM UTC. 2026-02-23T10:11:43.493 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-23T10:11:43.493 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-23T10:11:43.493 INFO:teuthology.orchestra.run.trial198.stdout: Package Architecture Version Repository Size 2026-02-23T10:11:43.493 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-23T10:11:43.493 INFO:teuthology.orchestra.run.trial198.stdout:Reinstalling: 2026-02-23T10:11:43.493 INFO:teuthology.orchestra.run.trial198.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-23T10:11:43.493 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:11:43.493 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-23T10:11:43.493 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-23T10:11:43.493 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:11:43.493 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 803 k 2026-02-23T10:11:43.494 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 0 2026-02-23T10:11:43.494 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-23T10:11:43.712 INFO:teuthology.orchestra.run.trial198.stdout:kernel-5.14.0-681.el9.x86_64.rpm 6.0 MB/s | 803 kB 00:00 2026-02-23T10:11:43.712 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-23T10:11:43.712 INFO:teuthology.orchestra.run.trial198.stdout:Total 3.6 MB/s | 803 kB 00:00 2026-02-23T10:11:43.722 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-23T10:11:43.756 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-23T10:11:43.756 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-23T10:11:43.761 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-23T10:11:43.761 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-23T10:11:43.784 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-23T10:11:43.788 INFO:teuthology.orchestra.run.trial198.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-23T10:11:43.788 INFO:teuthology.orchestra.run.trial198.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-23T10:11:43.896 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-23T10:11:43.896 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-23T10:11:43.950 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-23T10:11:43.951 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:11:43.951 INFO:teuthology.orchestra.run.trial198.stdout:Reinstalled: 2026-02-23T10:11:43.951 INFO:teuthology.orchestra.run.trial198.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-23T10:11:43.951 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:11:43.951 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-23T10:11:43.980 DEBUG:teuthology.orchestra.run.trial198:> rpm -q kernel | sort -rV | head -n 1 2026-02-23T10:11:44.004 INFO:teuthology.orchestra.run.trial198.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-23T10:11:44.005 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-23T10:11:44.006 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-23T10:11:44.006 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-23T10:11:44.006 DEBUG:teuthology.orchestra.run.trial198:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-23T10:11:44.069 INFO:teuthology.orchestra.run.trial198.stdout:ttyS1 2026-02-23T10:11:44.089 DEBUG:teuthology.parallel:result is None 2026-02-23T10:11:48.985 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - CRB 1.1 MB/s | 7.8 MB 00:06 2026-02-23T10:11:49.906 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - Extras packages 106 kB/s | 20 kB 00:00 2026-02-23T10:11:51.297 INFO:teuthology.orchestra.run.trial044.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2026-02-23T10:11:54.507 INFO:teuthology.orchestra.run.trial044.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-23T10:11:55.521 INFO:teuthology.orchestra.run.trial044.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-23T10:11:55.521 INFO:teuthology.orchestra.run.trial044.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-23T10:11:55.540 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-23T10:11:55.541 INFO:teuthology.orchestra.run.trial044.stdout:Nothing to do. 2026-02-23T10:11:55.541 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-23T10:11:55.563 DEBUG:teuthology.orchestra.run.trial044:> echo no | sudo yum reinstall kernel || true 2026-02-23T10:11:55.860 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:00:01 ago on Mon 23 Feb 2026 10:11:54 AM UTC. 2026-02-23T10:11:55.941 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-23T10:11:55.943 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-23T10:11:55.943 INFO:teuthology.orchestra.run.trial044.stdout: Package Architecture Version Repository Size 2026-02-23T10:11:55.943 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-23T10:11:55.943 INFO:teuthology.orchestra.run.trial044.stdout:Reinstalling: 2026-02-23T10:11:55.943 INFO:teuthology.orchestra.run.trial044.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-23T10:11:55.943 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:11:55.944 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-23T10:11:55.944 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-23T10:11:55.944 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:11:55.944 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 803 k 2026-02-23T10:11:55.944 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 0 2026-02-23T10:11:55.945 INFO:teuthology.orchestra.run.trial044.stderr:Operation aborted. 2026-02-23T10:11:55.962 INFO:teuthology.orchestra.run.trial044.stdout:Is this ok [y/N]: 2026-02-23T10:11:55.962 DEBUG:teuthology.orchestra.run.trial044:> sudo yum reinstall -y kernel || true 2026-02-23T10:11:56.264 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:00:02 ago on Mon 23 Feb 2026 10:11:54 AM UTC. 2026-02-23T10:11:56.345 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-23T10:11:56.345 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-23T10:11:56.346 INFO:teuthology.orchestra.run.trial044.stdout: Package Architecture Version Repository Size 2026-02-23T10:11:56.346 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-23T10:11:56.346 INFO:teuthology.orchestra.run.trial044.stdout:Reinstalling: 2026-02-23T10:11:56.346 INFO:teuthology.orchestra.run.trial044.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-23T10:11:56.346 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:11:56.346 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-23T10:11:56.346 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-23T10:11:56.346 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:11:56.346 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 803 k 2026-02-23T10:11:56.346 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 0 2026-02-23T10:11:56.346 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-23T10:11:57.623 INFO:teuthology.orchestra.run.trial044.stdout:kernel-5.14.0-681.el9.x86_64.rpm 675 kB/s | 803 kB 00:01 2026-02-23T10:11:57.624 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-23T10:11:57.624 INFO:teuthology.orchestra.run.trial044.stdout:Total 628 kB/s | 803 kB 00:01 2026-02-23T10:11:57.635 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-23T10:11:57.669 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-23T10:11:57.669 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-23T10:11:57.674 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-23T10:11:57.674 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-23T10:11:57.698 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-23T10:11:57.702 INFO:teuthology.orchestra.run.trial044.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-23T10:11:57.702 INFO:teuthology.orchestra.run.trial044.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-23T10:11:57.807 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-23T10:11:57.807 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-23T10:11:57.859 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-23T10:11:57.860 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:11:57.860 INFO:teuthology.orchestra.run.trial044.stdout:Reinstalled: 2026-02-23T10:11:57.860 INFO:teuthology.orchestra.run.trial044.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-23T10:11:57.860 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:11:57.860 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-23T10:11:57.887 DEBUG:teuthology.orchestra.run.trial044:> rpm -q kernel | sort -rV | head -n 1 2026-02-23T10:11:57.910 INFO:teuthology.orchestra.run.trial044.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-23T10:11:57.912 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-23T10:11:57.912 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-23T10:11:57.912 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-23T10:11:57.912 DEBUG:teuthology.orchestra.run.trial044:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-23T10:11:57.975 INFO:teuthology.orchestra.run.trial044.stdout:ttyS1 2026-02-23T10:11:57.999 DEBUG:teuthology.parallel:result is None 2026-02-23T10:11:57.999 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-23T10:11:58.010 INFO:teuthology.task.internal:Creating test directory... 2026-02-23T10:11:58.010 DEBUG:teuthology.orchestra.run.trial044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-23T10:11:58.042 DEBUG:teuthology.orchestra.run.trial198:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-23T10:11:58.059 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-23T10:11:58.073 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-23T10:11:58.087 INFO:teuthology.task.internal:Creating archive directory... 2026-02-23T10:11:58.088 DEBUG:teuthology.orchestra.run.trial044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-23T10:11:58.100 DEBUG:teuthology.orchestra.run.trial198:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-23T10:11:58.126 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-23T10:11:58.137 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-23T10:11:58.137 DEBUG:teuthology.orchestra.run.trial044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-23T10:11:58.157 DEBUG:teuthology.orchestra.run.trial198:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-23T10:11:58.180 INFO:teuthology.orchestra.run.trial044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T10:11:58.185 INFO:teuthology.orchestra.run.trial198.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T10:11:58.189 INFO:teuthology.orchestra.run.trial044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T10:11:58.193 INFO:teuthology.orchestra.run.trial198.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T10:11:58.194 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-23T10:11:58.206 INFO:teuthology.task.internal:Configuring sudo... 2026-02-23T10:11:58.206 DEBUG:teuthology.orchestra.run.trial044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-23T10:11:58.233 DEBUG:teuthology.orchestra.run.trial198:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-23T10:11:58.260 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-23T10:11:58.275 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-23T10:11:58.276 DEBUG:teuthology.orchestra.run.trial044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-23T10:11:58.297 DEBUG:teuthology.orchestra.run.trial198:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-23T10:11:58.316 DEBUG:teuthology.orchestra.run.trial044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T10:11:58.471 DEBUG:teuthology.orchestra.run.trial044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T10:11:58.496 DEBUG:teuthology.orchestra.run.trial044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T10:11:58.647 DEBUG:teuthology.orchestra.run.trial044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T10:11:58.672 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:11:58.672 DEBUG:teuthology.orchestra.run.trial044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-23T10:11:58.735 DEBUG:teuthology.orchestra.run.trial198:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T10:11:58.839 DEBUG:teuthology.orchestra.run.trial198:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T10:11:58.865 DEBUG:teuthology.orchestra.run.trial198:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T10:11:58.993 DEBUG:teuthology.orchestra.run.trial198:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T10:11:59.016 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-23T10:11:59.016 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-23T10:11:59.079 DEBUG:teuthology.orchestra.run.trial044:> sudo service rsyslog restart 2026-02-23T10:11:59.081 DEBUG:teuthology.orchestra.run.trial198:> sudo service rsyslog restart 2026-02-23T10:11:59.108 INFO:teuthology.orchestra.run.trial044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-23T10:11:59.146 INFO:teuthology.orchestra.run.trial198.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-23T10:11:59.583 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-23T10:11:59.595 INFO:teuthology.task.internal:Starting timer... 2026-02-23T10:11:59.595 INFO:teuthology.run_tasks:Running task pcp... 2026-02-23T10:11:59.617 INFO:teuthology.run_tasks:Running task selinux... 2026-02-23T10:11:59.635 DEBUG:teuthology.orchestra.run.trial044:> sudo service auditd rotate 2026-02-23T10:11:59.663 INFO:teuthology.orchestra.run.trial044.stdout:Rotating logs: 2026-02-23T10:11:59.666 DEBUG:teuthology.orchestra.run.trial198:> sudo service auditd rotate 2026-02-23T10:11:59.695 INFO:teuthology.orchestra.run.trial198.stdout:Rotating logs: 2026-02-23T10:11:59.697 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-23T10:11:59.697 DEBUG:teuthology.orchestra.run.trial044:> /usr/sbin/getenforce 2026-02-23T10:11:59.721 INFO:teuthology.orchestra.run.trial044.stdout:Permissive 2026-02-23T10:11:59.722 DEBUG:teuthology.orchestra.run.trial198:> /usr/sbin/getenforce 2026-02-23T10:11:59.753 INFO:teuthology.orchestra.run.trial198.stdout:Permissive 2026-02-23T10:11:59.753 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial044.front.sepia.ceph.com': 'permissive', 'ubuntu@trial198.front.sepia.ceph.com': 'permissive'} 2026-02-23T10:11:59.754 DEBUG:teuthology.orchestra.run.trial044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-23T10:11:59.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T10:11:59.788 DEBUG:teuthology.orchestra.run.trial198:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-23T10:11:59.820 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T10:11:59.821 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-23T10:11:59.821 DEBUG:teuthology.orchestra.run.trial044:> sudo /usr/sbin/setenforce permissive 2026-02-23T10:11:59.852 DEBUG:teuthology.orchestra.run.trial198:> sudo /usr/sbin/setenforce permissive 2026-02-23T10:11:59.885 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-23T10:11:59.900 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-23T10:11:59.919 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-23T10:11:59.921 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial044.front.sepia.ceph.com,trial198.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-23T10:14:44.243 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial044.front.sepia.ceph.com'), Remote(name='ubuntu@trial198.front.sepia.ceph.com')] 2026-02-23T10:14:44.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial044.front.sepia.ceph.com' 2026-02-23T10:14:44.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T10:14:44.318 DEBUG:teuthology.orchestra.run.trial044:> true 2026-02-23T10:14:44.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial044.front.sepia.ceph.com' 2026-02-23T10:14:44.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial198.front.sepia.ceph.com' 2026-02-23T10:14:44.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T10:14:44.459 DEBUG:teuthology.orchestra.run.trial198:> true 2026-02-23T10:14:44.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial198.front.sepia.ceph.com' 2026-02-23T10:14:44.530 INFO:teuthology.run_tasks:Running task clock... 2026-02-23T10:14:44.542 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-23T10:14:44.542 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-23T10:14:44.542 DEBUG:teuthology.orchestra.run.trial044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-23T10:14:44.544 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-23T10:14:44.544 DEBUG:teuthology.orchestra.run.trial198:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-23T10:14:44.569 INFO:teuthology.orchestra.run.trial044.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-23T10:14:44.581 INFO:teuthology.orchestra.run.trial044.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-23T10:14:44.596 INFO:teuthology.orchestra.run.trial198.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-23T10:14:44.601 INFO:teuthology.orchestra.run.trial044.stderr:sudo: ntpd: command not found 2026-02-23T10:14:44.608 INFO:teuthology.orchestra.run.trial198.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-23T10:14:44.611 INFO:teuthology.orchestra.run.trial044.stdout:506 Cannot talk to daemon 2026-02-23T10:14:44.622 INFO:teuthology.orchestra.run.trial044.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-23T10:14:44.629 INFO:teuthology.orchestra.run.trial198.stderr:sudo: ntpd: command not found 2026-02-23T10:14:44.633 INFO:teuthology.orchestra.run.trial044.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-23T10:14:44.639 INFO:teuthology.orchestra.run.trial198.stdout:506 Cannot talk to daemon 2026-02-23T10:14:44.650 INFO:teuthology.orchestra.run.trial198.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-23T10:14:44.662 INFO:teuthology.orchestra.run.trial198.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-23T10:14:44.677 INFO:teuthology.orchestra.run.trial044.stderr:bash: line 1: ntpq: command not found 2026-02-23T10:14:44.679 INFO:teuthology.orchestra.run.trial044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-23T10:14:44.679 INFO:teuthology.orchestra.run.trial044.stdout:=============================================================================== 2026-02-23T10:14:44.706 INFO:teuthology.orchestra.run.trial198.stderr:bash: line 1: ntpq: command not found 2026-02-23T10:14:44.708 INFO:teuthology.orchestra.run.trial198.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-23T10:14:44.708 INFO:teuthology.orchestra.run.trial198.stdout:=============================================================================== 2026-02-23T10:14:44.709 INFO:teuthology.run_tasks:Running task install... 2026-02-23T10:14:44.723 DEBUG:teuthology.task.install:project ceph 2026-02-23T10:14:44.724 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d'}} 2026-02-23T10:14:44.724 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d'} 2026-02-23T10:14:44.724 INFO:teuthology.task.install:Using flavor: debug 2026-02-23T10:14:44.733 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-23T10:14:44.733 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-23T10:14:44.734 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d', 'tag': None, 'wait_for_package': False} 2026-02-23T10:14:44.735 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T10:14:44.737 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d', 'tag': None, 'wait_for_package': False} 2026-02-23T10:14:44.737 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T10:14:44.946 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/ 2026-02-23T10:14:44.946 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5439.ge371433f 2026-02-23T10:14:44.955 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/ 2026-02-23T10:14:44.955 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5439.ge371433f 2026-02-23T10:14:45.661 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-23T10:14:45.661 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:14:45.661 DEBUG:teuthology.orchestra.run.trial044:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-23T10:14:45.687 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo, python3-pytest on remote rpm x86_64 2026-02-23T10:14:45.687 DEBUG:teuthology.orchestra.run.trial044:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-23T10:14:45.751 DEBUG:teuthology.orchestra.run.trial044:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-23T10:14:45.823 DEBUG:teuthology.orchestra.run.trial044:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-23T10:14:45.886 INFO:teuthology.orchestra.run.trial044.stdout:check_obsoletes = 1 2026-02-23T10:14:45.887 DEBUG:teuthology.orchestra.run.trial044:> sudo yum clean all 2026-02-23T10:14:46.008 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-23T10:14:46.009 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-23T10:14:46.009 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-23T10:14:46.035 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo, python3-pytest on remote rpm x86_64 2026-02-23T10:14:46.035 DEBUG:teuthology.orchestra.run.trial198:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-23T10:14:46.045 INFO:teuthology.orchestra.run.trial044.stdout:41 files removed 2026-02-23T10:14:46.059 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-osd-crimson ceph-osd-crimson-debuginfo python3-pytest 2026-02-23T10:14:46.100 DEBUG:teuthology.orchestra.run.trial198:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-23T10:14:46.172 DEBUG:teuthology.orchestra.run.trial198:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-23T10:14:46.236 INFO:teuthology.orchestra.run.trial198.stdout:check_obsoletes = 1 2026-02-23T10:14:46.237 DEBUG:teuthology.orchestra.run.trial198:> sudo yum clean all 2026-02-23T10:14:46.396 INFO:teuthology.orchestra.run.trial198.stdout:41 files removed 2026-02-23T10:14:46.411 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-osd-crimson ceph-osd-crimson-debuginfo python3-pytest 2026-02-23T10:14:46.846 INFO:teuthology.orchestra.run.trial044.stdout:ceph packages for x86_64 143 kB/s | 92 kB 00:00 2026-02-23T10:14:47.208 INFO:teuthology.orchestra.run.trial198.stdout:ceph packages for x86_64 142 kB/s | 92 kB 00:00 2026-02-23T10:14:47.457 INFO:teuthology.orchestra.run.trial044.stdout:ceph noarch packages 40 kB/s | 24 kB 00:00 2026-02-23T10:14:47.875 INFO:teuthology.orchestra.run.trial198.stdout:ceph noarch packages 37 kB/s | 24 kB 00:00 2026-02-23T10:14:48.396 INFO:teuthology.orchestra.run.trial198.stdout:ceph source packages 4.1 kB/s | 2.1 kB 00:00 2026-02-23T10:14:48.485 INFO:teuthology.orchestra.run.trial044.stdout:ceph source packages 2.1 kB/s | 2.1 kB 00:01 2026-02-23T10:14:50.634 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.9 MB 00:02 2026-02-23T10:14:52.497 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 8.9 MB 00:04 2026-02-23T10:14:55.638 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-23T10:14:58.741 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - AppStream 3.5 MB/s | 27 MB 00:07 2026-02-23T10:14:59.554 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 7.8 MB 00:01 2026-02-23T10:15:00.640 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 20 kB 00:00 2026-02-23T10:15:01.919 INFO:teuthology.orchestra.run.trial198.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2026-02-23T10:15:02.131 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 7.8 MB 00:01 2026-02-23T10:15:03.503 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 20 kB 00:00 2026-02-23T10:15:04.118 INFO:teuthology.orchestra.run.trial044.stdout:Extra Packages for Enterprise Linux 37 MB/s | 20 MB 00:00 2026-02-23T10:15:05.112 INFO:teuthology.orchestra.run.trial198.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-23T10:15:06.303 INFO:teuthology.orchestra.run.trial198.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-23T10:15:06.303 INFO:teuthology.orchestra.run.trial198.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-23T10:15:06.330 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-23T10:15:06.334 INFO:teuthology.orchestra.run.trial198.stdout:======================================================================================= 2026-02-23T10:15:06.334 INFO:teuthology.orchestra.run.trial198.stdout: Package Arch Version Repository Size 2026-02-23T10:15:06.334 INFO:teuthology.orchestra.run.trial198.stdout:======================================================================================= 2026-02-23T10:15:06.334 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-23T10:15:06.334 INFO:teuthology.orchestra.run.trial198.stdout: ceph x86_64 2:20.3.0-5439.ge371433f.el9 ceph 6.5 k 2026-02-23T10:15:06.334 INFO:teuthology.orchestra.run.trial198.stdout: ceph-base x86_64 2:20.3.0-5439.ge371433f.el9 ceph 5.1 M 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-fuse x86_64 2:20.3.0-5439.ge371433f.el9 ceph 914 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5439.ge371433f.el9 ceph 149 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr x86_64 2:20.3.0-5439.ge371433f.el9 ceph 937 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 184 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 51 M 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 7.4 M 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-rook noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 50 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-osd x86_64 2:20.3.0-5439.ge371433f.el9 ceph 164 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-osd-classic x86_64 2:20.3.0-5439.ge371433f.el9 ceph 15 M 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-osd-crimson x86_64 2:20.3.0-5439.ge371433f.el9 ceph 87 M 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5439.ge371433f.el9 ceph 429 M 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-radosgw x86_64 2:20.3.0-5439.ge371433f.el9 ceph 11 M 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-test x86_64 2:20.3.0-5439.ge371433f.el9 ceph 126 M 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-volume noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 301 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: cephadm noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 1.0 M 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: libcephfs-devel x86_64 2:20.3.0-5439.ge371433f.el9 ceph 37 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: libcephfs2 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 860 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: librados-devel x86_64 2:20.3.0-5439.ge371433f.el9 ceph 124 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: python3-cephfs x86_64 2:20.3.0-5439.ge371433f.el9 ceph 204 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: python3-pytest noarch 6.2.2-7.el9 appstream 519 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: python3-rados x86_64 2:20.3.0-5439.ge371433f.el9 ceph 324 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: python3-rbd x86_64 2:20.3.0-5439.ge371433f.el9 ceph 305 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: python3-rgw x86_64 2:20.3.0-5439.ge371433f.el9 ceph 100 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: rbd-fuse x86_64 2:20.3.0-5439.ge371433f.el9 ceph 86 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: rbd-mirror x86_64 2:20.3.0-5439.ge371433f.el9 ceph 2.6 M 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: rbd-nbd x86_64 2:20.3.0-5439.ge371433f.el9 ceph 166 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout:Upgrading: 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: librados2 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 3.3 M 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: librbd1 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 2.7 M 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout:Installing dependencies: 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-common x86_64 2:20.3.0-5439.ge371433f.el9 ceph 21 M 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 57 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mds x86_64 2:20.3.0-5439.ge371433f.el9 ceph 2.0 M 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 298 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mon x86_64 2:20.3.0-5439.ge371433f.el9 ceph 4.9 M 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 17 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: ceph-selinux x86_64 2:20.3.0-5439.ge371433f.el9 ceph 25 k 2026-02-23T10:15:06.335 INFO:teuthology.orchestra.run.trial198.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 26 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: libcephsqlite x86_64 2:20.3.0-5439.ge371433f.el9 ceph 153 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: libradosstriper1 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 263 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: librgw2 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 5.6 M 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-23T10:15:06.336 INFO:teuthology.orchestra.run.trial198.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-ceph-argparse x86_64 2:20.3.0-5439.ge371433f.el9 ceph 45 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-ceph-common x86_64 2:20.3.0-5439.ge371433f.el9 ceph 186 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-iniconfig noarch 1.1.1-7.el9 appstream 17 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-pluggy noarch 0.13.1-7.el9 appstream 41 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-py noarch 1.10.0-6.el9 appstream 477 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-23T10:15:06.337 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout:Installing weak dependencies: 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout:======================================================================================= 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout:Install 144 Packages 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout:Upgrade 2 Packages 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 848 M 2026-02-23T10:15:06.338 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-23T10:15:07.280 INFO:teuthology.orchestra.run.trial044.stdout:lab-extras 1.1 MB/s | 50 kB 00:00 2026-02-23T10:15:07.308 INFO:teuthology.orchestra.run.trial198.stdout:(1/146): ceph-20.3.0-5439.ge371433f.el9.x86_64. 36 kB/s | 6.5 kB 00:00 2026-02-23T10:15:08.273 INFO:teuthology.orchestra.run.trial198.stdout:(2/146): ceph-fuse-20.3.0-5439.ge371433f.el9.x8 947 kB/s | 914 kB 00:00 2026-02-23T10:15:08.383 INFO:teuthology.orchestra.run.trial198.stdout:(3/146): ceph-immutable-object-cache-20.3.0-543 1.3 MB/s | 149 kB 00:00 2026-02-23T10:15:08.465 INFO:teuthology.orchestra.run.trial044.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-23T10:15:08.466 INFO:teuthology.orchestra.run.trial044.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-23T10:15:08.492 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-23T10:15:08.496 INFO:teuthology.orchestra.run.trial044.stdout:======================================================================================= 2026-02-23T10:15:08.496 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repository Size 2026-02-23T10:15:08.496 INFO:teuthology.orchestra.run.trial044.stdout:======================================================================================= 2026-02-23T10:15:08.497 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-23T10:15:08.497 INFO:teuthology.orchestra.run.trial044.stdout: ceph x86_64 2:20.3.0-5439.ge371433f.el9 ceph 6.5 k 2026-02-23T10:15:08.497 INFO:teuthology.orchestra.run.trial044.stdout: ceph-base x86_64 2:20.3.0-5439.ge371433f.el9 ceph 5.1 M 2026-02-23T10:15:08.497 INFO:teuthology.orchestra.run.trial044.stdout: ceph-fuse x86_64 2:20.3.0-5439.ge371433f.el9 ceph 914 k 2026-02-23T10:15:08.497 INFO:teuthology.orchestra.run.trial044.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5439.ge371433f.el9 ceph 149 k 2026-02-23T10:15:08.497 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr x86_64 2:20.3.0-5439.ge371433f.el9 ceph 937 k 2026-02-23T10:15:08.497 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 184 k 2026-02-23T10:15:08.497 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 51 M 2026-02-23T10:15:08.497 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 7.4 M 2026-02-23T10:15:08.497 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-rook noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 50 k 2026-02-23T10:15:08.497 INFO:teuthology.orchestra.run.trial044.stdout: ceph-osd x86_64 2:20.3.0-5439.ge371433f.el9 ceph 164 k 2026-02-23T10:15:08.498 INFO:teuthology.orchestra.run.trial044.stdout: ceph-osd-classic x86_64 2:20.3.0-5439.ge371433f.el9 ceph 15 M 2026-02-23T10:15:08.498 INFO:teuthology.orchestra.run.trial044.stdout: ceph-osd-crimson x86_64 2:20.3.0-5439.ge371433f.el9 ceph 87 M 2026-02-23T10:15:08.498 INFO:teuthology.orchestra.run.trial044.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5439.ge371433f.el9 ceph 429 M 2026-02-23T10:15:08.498 INFO:teuthology.orchestra.run.trial044.stdout: ceph-radosgw x86_64 2:20.3.0-5439.ge371433f.el9 ceph 11 M 2026-02-23T10:15:08.498 INFO:teuthology.orchestra.run.trial044.stdout: ceph-test x86_64 2:20.3.0-5439.ge371433f.el9 ceph 126 M 2026-02-23T10:15:08.498 INFO:teuthology.orchestra.run.trial044.stdout: ceph-volume noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 301 k 2026-02-23T10:15:08.498 INFO:teuthology.orchestra.run.trial044.stdout: cephadm noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 1.0 M 2026-02-23T10:15:08.498 INFO:teuthology.orchestra.run.trial044.stdout: libcephfs-devel x86_64 2:20.3.0-5439.ge371433f.el9 ceph 37 k 2026-02-23T10:15:08.498 INFO:teuthology.orchestra.run.trial044.stdout: libcephfs2 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 860 k 2026-02-23T10:15:08.498 INFO:teuthology.orchestra.run.trial044.stdout: librados-devel x86_64 2:20.3.0-5439.ge371433f.el9 ceph 124 k 2026-02-23T10:15:08.498 INFO:teuthology.orchestra.run.trial044.stdout: python3-cephfs x86_64 2:20.3.0-5439.ge371433f.el9 ceph 204 k 2026-02-23T10:15:08.498 INFO:teuthology.orchestra.run.trial044.stdout: python3-pytest noarch 6.2.2-7.el9 appstream 519 k 2026-02-23T10:15:08.499 INFO:teuthology.orchestra.run.trial044.stdout: python3-rados x86_64 2:20.3.0-5439.ge371433f.el9 ceph 324 k 2026-02-23T10:15:08.499 INFO:teuthology.orchestra.run.trial044.stdout: python3-rbd x86_64 2:20.3.0-5439.ge371433f.el9 ceph 305 k 2026-02-23T10:15:08.499 INFO:teuthology.orchestra.run.trial044.stdout: python3-rgw x86_64 2:20.3.0-5439.ge371433f.el9 ceph 100 k 2026-02-23T10:15:08.499 INFO:teuthology.orchestra.run.trial044.stdout: rbd-fuse x86_64 2:20.3.0-5439.ge371433f.el9 ceph 86 k 2026-02-23T10:15:08.499 INFO:teuthology.orchestra.run.trial044.stdout: rbd-mirror x86_64 2:20.3.0-5439.ge371433f.el9 ceph 2.6 M 2026-02-23T10:15:08.499 INFO:teuthology.orchestra.run.trial044.stdout: rbd-nbd x86_64 2:20.3.0-5439.ge371433f.el9 ceph 166 k 2026-02-23T10:15:08.499 INFO:teuthology.orchestra.run.trial044.stdout:Upgrading: 2026-02-23T10:15:08.499 INFO:teuthology.orchestra.run.trial044.stdout: librados2 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 3.3 M 2026-02-23T10:15:08.499 INFO:teuthology.orchestra.run.trial044.stdout: librbd1 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 2.7 M 2026-02-23T10:15:08.499 INFO:teuthology.orchestra.run.trial044.stdout:Installing dependencies: 2026-02-23T10:15:08.499 INFO:teuthology.orchestra.run.trial044.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-23T10:15:08.499 INFO:teuthology.orchestra.run.trial044.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-23T10:15:08.500 INFO:teuthology.orchestra.run.trial044.stdout: ceph-common x86_64 2:20.3.0-5439.ge371433f.el9 ceph 21 M 2026-02-23T10:15:08.500 INFO:teuthology.orchestra.run.trial044.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 57 k 2026-02-23T10:15:08.500 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mds x86_64 2:20.3.0-5439.ge371433f.el9 ceph 2.0 M 2026-02-23T10:15:08.500 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 298 k 2026-02-23T10:15:08.500 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mon x86_64 2:20.3.0-5439.ge371433f.el9 ceph 4.9 M 2026-02-23T10:15:08.500 INFO:teuthology.orchestra.run.trial044.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 17 k 2026-02-23T10:15:08.500 INFO:teuthology.orchestra.run.trial044.stdout: ceph-selinux x86_64 2:20.3.0-5439.ge371433f.el9 ceph 25 k 2026-02-23T10:15:08.500 INFO:teuthology.orchestra.run.trial044.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-23T10:15:08.500 INFO:teuthology.orchestra.run.trial044.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-23T10:15:08.500 INFO:teuthology.orchestra.run.trial044.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-23T10:15:08.500 INFO:teuthology.orchestra.run.trial044.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-23T10:15:08.500 INFO:teuthology.orchestra.run.trial044.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-23T10:15:08.501 INFO:teuthology.orchestra.run.trial044.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-23T10:15:08.501 INFO:teuthology.orchestra.run.trial044.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-23T10:15:08.501 INFO:teuthology.orchestra.run.trial044.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-23T10:15:08.501 INFO:teuthology.orchestra.run.trial044.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-23T10:15:08.501 INFO:teuthology.orchestra.run.trial044.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-23T10:15:08.501 INFO:teuthology.orchestra.run.trial044.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-23T10:15:08.501 INFO:teuthology.orchestra.run.trial044.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-23T10:15:08.501 INFO:teuthology.orchestra.run.trial044.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 26 k 2026-02-23T10:15:08.501 INFO:teuthology.orchestra.run.trial044.stdout: libcephsqlite x86_64 2:20.3.0-5439.ge371433f.el9 ceph 153 k 2026-02-23T10:15:08.501 INFO:teuthology.orchestra.run.trial044.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-23T10:15:08.501 INFO:teuthology.orchestra.run.trial044.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-23T10:15:08.501 INFO:teuthology.orchestra.run.trial044.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-23T10:15:08.501 INFO:teuthology.orchestra.run.trial044.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-23T10:15:08.502 INFO:teuthology.orchestra.run.trial044.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-23T10:15:08.502 INFO:teuthology.orchestra.run.trial044.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-23T10:15:08.502 INFO:teuthology.orchestra.run.trial044.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-23T10:15:08.502 INFO:teuthology.orchestra.run.trial044.stdout: libradosstriper1 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 263 k 2026-02-23T10:15:08.502 INFO:teuthology.orchestra.run.trial044.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-23T10:15:08.502 INFO:teuthology.orchestra.run.trial044.stdout: librgw2 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 5.6 M 2026-02-23T10:15:08.502 INFO:teuthology.orchestra.run.trial044.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-23T10:15:08.502 INFO:teuthology.orchestra.run.trial044.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-23T10:15:08.502 INFO:teuthology.orchestra.run.trial044.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-23T10:15:08.502 INFO:teuthology.orchestra.run.trial044.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-23T10:15:08.502 INFO:teuthology.orchestra.run.trial044.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-23T10:15:08.502 INFO:teuthology.orchestra.run.trial044.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-23T10:15:08.503 INFO:teuthology.orchestra.run.trial044.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-23T10:15:08.503 INFO:teuthology.orchestra.run.trial044.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-23T10:15:08.503 INFO:teuthology.orchestra.run.trial044.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-23T10:15:08.503 INFO:teuthology.orchestra.run.trial044.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-23T10:15:08.503 INFO:teuthology.orchestra.run.trial044.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-23T10:15:08.503 INFO:teuthology.orchestra.run.trial044.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-23T10:15:08.503 INFO:teuthology.orchestra.run.trial044.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-23T10:15:08.503 INFO:teuthology.orchestra.run.trial044.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-23T10:15:08.503 INFO:teuthology.orchestra.run.trial044.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-23T10:15:08.503 INFO:teuthology.orchestra.run.trial044.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-23T10:15:08.503 INFO:teuthology.orchestra.run.trial044.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-23T10:15:08.503 INFO:teuthology.orchestra.run.trial044.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-23T10:15:08.504 INFO:teuthology.orchestra.run.trial044.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-23T10:15:08.504 INFO:teuthology.orchestra.run.trial044.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-23T10:15:08.504 INFO:teuthology.orchestra.run.trial044.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-23T10:15:08.504 INFO:teuthology.orchestra.run.trial044.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-23T10:15:08.504 INFO:teuthology.orchestra.run.trial044.stdout: python3-ceph-argparse x86_64 2:20.3.0-5439.ge371433f.el9 ceph 45 k 2026-02-23T10:15:08.504 INFO:teuthology.orchestra.run.trial044.stdout: python3-ceph-common x86_64 2:20.3.0-5439.ge371433f.el9 ceph 186 k 2026-02-23T10:15:08.504 INFO:teuthology.orchestra.run.trial044.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-23T10:15:08.504 INFO:teuthology.orchestra.run.trial044.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-23T10:15:08.504 INFO:teuthology.orchestra.run.trial044.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-23T10:15:08.504 INFO:teuthology.orchestra.run.trial044.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-23T10:15:08.504 INFO:teuthology.orchestra.run.trial044.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-23T10:15:08.504 INFO:teuthology.orchestra.run.trial044.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-23T10:15:08.505 INFO:teuthology.orchestra.run.trial044.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-23T10:15:08.505 INFO:teuthology.orchestra.run.trial044.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-23T10:15:08.505 INFO:teuthology.orchestra.run.trial044.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-23T10:15:08.505 INFO:teuthology.orchestra.run.trial044.stdout: python3-iniconfig noarch 1.1.1-7.el9 appstream 17 k 2026-02-23T10:15:08.505 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-23T10:15:08.505 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-23T10:15:08.505 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-23T10:15:08.505 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-23T10:15:08.505 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-23T10:15:08.505 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-23T10:15:08.505 INFO:teuthology.orchestra.run.trial044.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-23T10:15:08.505 INFO:teuthology.orchestra.run.trial044.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-23T10:15:08.506 INFO:teuthology.orchestra.run.trial044.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-23T10:15:08.506 INFO:teuthology.orchestra.run.trial044.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-23T10:15:08.506 INFO:teuthology.orchestra.run.trial044.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-23T10:15:08.506 INFO:teuthology.orchestra.run.trial044.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-23T10:15:08.506 INFO:teuthology.orchestra.run.trial044.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-23T10:15:08.506 INFO:teuthology.orchestra.run.trial044.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-23T10:15:08.506 INFO:teuthology.orchestra.run.trial044.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-23T10:15:08.506 INFO:teuthology.orchestra.run.trial044.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-23T10:15:08.506 INFO:teuthology.orchestra.run.trial044.stdout: python3-pluggy noarch 0.13.1-7.el9 appstream 41 k 2026-02-23T10:15:08.506 INFO:teuthology.orchestra.run.trial044.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-23T10:15:08.506 INFO:teuthology.orchestra.run.trial044.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-23T10:15:08.506 INFO:teuthology.orchestra.run.trial044.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-23T10:15:08.507 INFO:teuthology.orchestra.run.trial044.stdout: python3-py noarch 1.10.0-6.el9 appstream 477 k 2026-02-23T10:15:08.507 INFO:teuthology.orchestra.run.trial044.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-23T10:15:08.507 INFO:teuthology.orchestra.run.trial044.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-23T10:15:08.507 INFO:teuthology.orchestra.run.trial044.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-23T10:15:08.507 INFO:teuthology.orchestra.run.trial044.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-23T10:15:08.507 INFO:teuthology.orchestra.run.trial044.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-23T10:15:08.507 INFO:teuthology.orchestra.run.trial044.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-23T10:15:08.507 INFO:teuthology.orchestra.run.trial044.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-23T10:15:08.507 INFO:teuthology.orchestra.run.trial044.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-23T10:15:08.507 INFO:teuthology.orchestra.run.trial044.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-23T10:15:08.507 INFO:teuthology.orchestra.run.trial044.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-23T10:15:08.507 INFO:teuthology.orchestra.run.trial044.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-23T10:15:08.507 INFO:teuthology.orchestra.run.trial044.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-23T10:15:08.508 INFO:teuthology.orchestra.run.trial044.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-23T10:15:08.508 INFO:teuthology.orchestra.run.trial044.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-23T10:15:08.508 INFO:teuthology.orchestra.run.trial044.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-23T10:15:08.508 INFO:teuthology.orchestra.run.trial044.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-23T10:15:08.508 INFO:teuthology.orchestra.run.trial044.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-23T10:15:08.508 INFO:teuthology.orchestra.run.trial044.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-23T10:15:08.508 INFO:teuthology.orchestra.run.trial044.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-23T10:15:08.508 INFO:teuthology.orchestra.run.trial044.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-23T10:15:08.508 INFO:teuthology.orchestra.run.trial044.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-23T10:15:08.508 INFO:teuthology.orchestra.run.trial044.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-23T10:15:08.508 INFO:teuthology.orchestra.run.trial044.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-23T10:15:08.508 INFO:teuthology.orchestra.run.trial044.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-23T10:15:08.508 INFO:teuthology.orchestra.run.trial044.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-23T10:15:08.509 INFO:teuthology.orchestra.run.trial044.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-23T10:15:08.509 INFO:teuthology.orchestra.run.trial044.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-23T10:15:08.509 INFO:teuthology.orchestra.run.trial044.stdout:Installing weak dependencies: 2026-02-23T10:15:08.509 INFO:teuthology.orchestra.run.trial044.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-23T10:15:08.509 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:15:08.509 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-23T10:15:08.509 INFO:teuthology.orchestra.run.trial044.stdout:======================================================================================= 2026-02-23T10:15:08.509 INFO:teuthology.orchestra.run.trial044.stdout:Install 144 Packages 2026-02-23T10:15:08.509 INFO:teuthology.orchestra.run.trial044.stdout:Upgrade 2 Packages 2026-02-23T10:15:08.509 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:15:08.510 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 848 M 2026-02-23T10:15:08.510 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-23T10:15:09.312 INFO:teuthology.orchestra.run.trial198.stdout:(4/146): ceph-mds-20.3.0-5439.ge371433f.el9.x86 2.2 MB/s | 2.0 MB 00:00 2026-02-23T10:15:09.352 INFO:teuthology.orchestra.run.trial044.stdout:(1/146): ceph-20.3.0-5439.ge371433f.el9.x86_64. 28 kB/s | 6.5 kB 00:00 2026-02-23T10:15:09.608 INFO:teuthology.orchestra.run.trial198.stdout:(5/146): ceph-mgr-20.3.0-5439.ge371433f.el9.x86 3.1 MB/s | 937 kB 00:00 2026-02-23T10:15:09.912 INFO:teuthology.orchestra.run.trial044.stdout:(2/146): ceph-fuse-20.3.0-5439.ge371433f.el9.x8 1.6 MB/s | 914 kB 00:00 2026-02-23T10:15:09.972 INFO:teuthology.orchestra.run.trial044.stdout:(3/146): ceph-immutable-object-cache-20.3.0-543 2.4 MB/s | 149 kB 00:00 2026-02-23T10:15:10.342 INFO:teuthology.orchestra.run.trial198.stdout:(6/146): ceph-base-20.3.0-5439.ge371433f.el9.x8 1.6 MB/s | 5.1 MB 00:03 2026-02-23T10:15:10.567 INFO:teuthology.orchestra.run.trial198.stdout:(7/146): ceph-osd-20.3.0-5439.ge371433f.el9.x86 727 kB/s | 164 kB 00:00 2026-02-23T10:15:10.592 INFO:teuthology.orchestra.run.trial198.stdout:(8/146): ceph-mon-20.3.0-5439.ge371433f.el9.x86 4.9 MB/s | 4.9 MB 00:00 2026-02-23T10:15:10.684 INFO:teuthology.orchestra.run.trial044.stdout:(4/146): ceph-mds-20.3.0-5439.ge371433f.el9.x86 2.8 MB/s | 2.0 MB 00:00 2026-02-23T10:15:11.073 INFO:teuthology.orchestra.run.trial044.stdout:(5/146): ceph-mgr-20.3.0-5439.ge371433f.el9.x86 2.4 MB/s | 937 kB 00:00 2026-02-23T10:15:11.126 INFO:teuthology.orchestra.run.trial044.stdout:(6/146): ceph-base-20.3.0-5439.ge371433f.el9.x8 2.5 MB/s | 5.1 MB 00:02 2026-02-23T10:15:11.185 INFO:teuthology.orchestra.run.trial044.stdout:(7/146): ceph-osd-20.3.0-5439.ge371433f.el9.x86 2.7 MB/s | 164 kB 00:00 2026-02-23T10:15:11.528 INFO:teuthology.orchestra.run.trial198.stdout:(9/146): ceph-common-20.3.0-5439.ge371433f.el9. 4.7 MB/s | 21 MB 00:04 2026-02-23T10:15:12.593 INFO:teuthology.orchestra.run.trial044.stdout:(8/146): ceph-osd-classic-20.3.0-5439.ge371433f 10 MB/s | 15 MB 00:01 2026-02-23T10:15:13.089 INFO:teuthology.orchestra.run.trial044.stdout:(9/146): ceph-mon-20.3.0-5439.ge371433f.el9.x86 2.4 MB/s | 4.9 MB 00:02 2026-02-23T10:15:16.978 INFO:teuthology.orchestra.run.trial044.stdout:(10/146): ceph-common-20.3.0-5439.ge371433f.el9 2.6 MB/s | 21 MB 00:07 2026-02-23T10:15:19.140 INFO:teuthology.orchestra.run.trial044.stdout:(11/146): ceph-osd-crimson-20.3.0-5439.ge371433 13 MB/s | 87 MB 00:06 2026-02-23T10:15:19.526 INFO:teuthology.orchestra.run.trial044.stdout:(12/146): ceph-selinux-20.3.0-5439.ge371433f.el 65 kB/s | 25 kB 00:00 2026-02-23T10:15:20.688 INFO:teuthology.orchestra.run.trial198.stdout:(10/146): ceph-osd-classic-20.3.0-5439.ge371433 1.5 MB/s | 15 MB 00:10 2026-02-23T10:15:21.447 INFO:teuthology.orchestra.run.trial044.stdout:(13/146): ceph-radosgw-20.3.0-5439.ge371433f.el 2.5 MB/s | 11 MB 00:04 2026-02-23T10:15:21.845 INFO:teuthology.orchestra.run.trial044.stdout:(14/146): libcephfs-devel-20.3.0-5439.ge371433f 94 kB/s | 37 kB 00:00 2026-02-23T10:15:21.922 INFO:teuthology.orchestra.run.trial044.stdout:(15/146): libcephfs-proxy2-20.3.0-5439.ge371433 340 kB/s | 26 kB 00:00 2026-02-23T10:15:22.335 INFO:teuthology.orchestra.run.trial044.stdout:(16/146): libcephfs2-20.3.0-5439.ge371433f.el9. 2.0 MB/s | 860 kB 00:00 2026-02-23T10:15:22.397 INFO:teuthology.orchestra.run.trial044.stdout:(17/146): libcephsqlite-20.3.0-5439.ge371433f.e 2.4 MB/s | 153 kB 00:00 2026-02-23T10:15:22.458 INFO:teuthology.orchestra.run.trial044.stdout:(18/146): librados-devel-20.3.0-5439.ge371433f. 2.0 MB/s | 124 kB 00:00 2026-02-23T10:15:22.628 INFO:teuthology.orchestra.run.trial044.stdout:(19/146): libradosstriper1-20.3.0-5439.ge371433 1.5 MB/s | 263 kB 00:00 2026-02-23T10:15:25.214 INFO:teuthology.orchestra.run.trial044.stdout:(20/146): librgw2-20.3.0-5439.ge371433f.el9.x86 2.2 MB/s | 5.6 MB 00:02 2026-02-23T10:15:25.272 INFO:teuthology.orchestra.run.trial044.stdout:(21/146): python3-ceph-argparse-20.3.0-5439.ge3 782 kB/s | 45 kB 00:00 2026-02-23T10:15:25.390 INFO:teuthology.orchestra.run.trial044.stdout:(22/146): python3-ceph-common-20.3.0-5439.ge371 1.5 MB/s | 186 kB 00:00 2026-02-23T10:15:25.509 INFO:teuthology.orchestra.run.trial044.stdout:(23/146): python3-cephfs-20.3.0-5439.ge371433f. 1.7 MB/s | 204 kB 00:00 2026-02-23T10:15:25.681 INFO:teuthology.orchestra.run.trial044.stdout:(24/146): python3-rados-20.3.0-5439.ge371433f.e 1.8 MB/s | 324 kB 00:00 2026-02-23T10:15:25.836 INFO:teuthology.orchestra.run.trial044.stdout:(25/146): python3-rbd-20.3.0-5439.ge371433f.el9 1.9 MB/s | 305 kB 00:00 2026-02-23T10:15:25.885 INFO:teuthology.orchestra.run.trial044.stdout:(26/146): python3-rgw-20.3.0-5439.ge371433f.el9 2.0 MB/s | 100 kB 00:00 2026-02-23T10:15:25.942 INFO:teuthology.orchestra.run.trial044.stdout:(27/146): rbd-fuse-20.3.0-5439.ge371433f.el9.x8 1.5 MB/s | 86 kB 00:00 2026-02-23T10:15:26.727 INFO:teuthology.orchestra.run.trial198.stdout:(11/146): ceph-radosgw-20.3.0-5439.ge371433f.el 1.9 MB/s | 11 MB 00:06 2026-02-23T10:15:26.773 INFO:teuthology.orchestra.run.trial198.stdout:(12/146): ceph-selinux-20.3.0-5439.ge371433f.el 546 kB/s | 25 kB 00:00 2026-02-23T10:15:26.829 INFO:teuthology.orchestra.run.trial044.stdout:(28/146): rbd-mirror-20.3.0-5439.ge371433f.el9. 2.9 MB/s | 2.6 MB 00:00 2026-02-23T10:15:26.931 INFO:teuthology.orchestra.run.trial044.stdout:(29/146): rbd-nbd-20.3.0-5439.ge371433f.el9.x86 1.6 MB/s | 166 kB 00:00 2026-02-23T10:15:26.985 INFO:teuthology.orchestra.run.trial044.stdout:(30/146): ceph-grafana-dashboards-20.3.0-5439.g 1.0 MB/s | 57 kB 00:00 2026-02-23T10:15:27.100 INFO:teuthology.orchestra.run.trial044.stdout:(31/146): ceph-mgr-cephadm-20.3.0-5439.ge371433 1.6 MB/s | 184 kB 00:00 2026-02-23T10:15:50.968 INFO:teuthology.orchestra.run.trial044.stdout:(32/146): ceph-mgr-dashboard-20.3.0-5439.ge3714 2.1 MB/s | 51 MB 00:23 2026-02-23T10:15:51.208 INFO:teuthology.orchestra.run.trial198.stdout:(13/146): ceph-osd-crimson-20.3.0-5439.ge371433 2.1 MB/s | 87 MB 00:40 2026-02-23T10:15:51.280 INFO:teuthology.orchestra.run.trial198.stdout:(14/146): libcephfs-devel-20.3.0-5439.ge371433f 524 kB/s | 37 kB 00:00 2026-02-23T10:15:51.352 INFO:teuthology.orchestra.run.trial198.stdout:(15/146): libcephfs-proxy2-20.3.0-5439.ge371433 367 kB/s | 26 kB 00:00 2026-02-23T10:15:51.963 INFO:teuthology.orchestra.run.trial198.stdout:(16/146): libcephfs2-20.3.0-5439.ge371433f.el9. 1.4 MB/s | 860 kB 00:00 2026-02-23T10:15:52.101 INFO:teuthology.orchestra.run.trial198.stdout:(17/146): libcephsqlite-20.3.0-5439.ge371433f.e 1.1 MB/s | 153 kB 00:00 2026-02-23T10:15:52.229 INFO:teuthology.orchestra.run.trial198.stdout:(18/146): librados-devel-20.3.0-5439.ge371433f. 968 kB/s | 124 kB 00:00 2026-02-23T10:15:52.425 INFO:teuthology.orchestra.run.trial198.stdout:(19/146): libradosstriper1-20.3.0-5439.ge371433 1.3 MB/s | 263 kB 00:00 2026-02-23T10:15:54.348 INFO:teuthology.orchestra.run.trial044.stdout:(33/146): ceph-mgr-diskprediction-local-20.3.0- 2.2 MB/s | 7.4 MB 00:03 2026-02-23T10:15:54.464 INFO:teuthology.orchestra.run.trial044.stdout:(34/146): ceph-mgr-modules-core-20.3.0-5439.ge3 2.5 MB/s | 298 kB 00:00 2026-02-23T10:15:54.521 INFO:teuthology.orchestra.run.trial044.stdout:(35/146): ceph-mgr-rook-20.3.0-5439.ge371433f.e 878 kB/s | 50 kB 00:00 2026-02-23T10:15:54.578 INFO:teuthology.orchestra.run.trial044.stdout:(36/146): ceph-prometheus-alerts-20.3.0-5439.ge 305 kB/s | 17 kB 00:00 2026-02-23T10:15:54.695 INFO:teuthology.orchestra.run.trial044.stdout:(37/146): ceph-volume-20.3.0-5439.ge371433f.el9 2.5 MB/s | 301 kB 00:00 2026-02-23T10:15:55.106 INFO:teuthology.orchestra.run.trial044.stdout:(38/146): cephadm-20.3.0-5439.ge371433f.el9.noa 2.5 MB/s | 1.0 MB 00:00 2026-02-23T10:15:55.474 INFO:teuthology.orchestra.run.trial198.stdout:(20/146): librgw2-20.3.0-5439.ge371433f.el9.x86 1.8 MB/s | 5.6 MB 00:03 2026-02-23T10:15:55.532 INFO:teuthology.orchestra.run.trial198.stdout:(21/146): python3-ceph-argparse-20.3.0-5439.ge3 782 kB/s | 45 kB 00:00 2026-02-23T10:15:55.648 INFO:teuthology.orchestra.run.trial198.stdout:(22/146): python3-ceph-common-20.3.0-5439.ge371 1.6 MB/s | 186 kB 00:00 2026-02-23T10:15:55.766 INFO:teuthology.orchestra.run.trial198.stdout:(23/146): python3-cephfs-20.3.0-5439.ge371433f. 1.7 MB/s | 204 kB 00:00 2026-02-23T10:15:55.898 INFO:teuthology.orchestra.run.trial044.stdout:(39/146): cryptsetup-2.8.1-3.el9.x86_64.rpm 444 kB/s | 351 kB 00:00 2026-02-23T10:15:55.943 INFO:teuthology.orchestra.run.trial198.stdout:(24/146): python3-rados-20.3.0-5439.ge371433f.e 1.8 MB/s | 324 kB 00:00 2026-02-23T10:15:56.122 INFO:teuthology.orchestra.run.trial198.stdout:(25/146): python3-rbd-20.3.0-5439.ge371433f.el9 1.7 MB/s | 305 kB 00:00 2026-02-23T10:15:56.182 INFO:teuthology.orchestra.run.trial198.stdout:(26/146): python3-rgw-20.3.0-5439.ge371433f.el9 1.6 MB/s | 100 kB 00:00 2026-02-23T10:15:56.243 INFO:teuthology.orchestra.run.trial198.stdout:(27/146): rbd-fuse-20.3.0-5439.ge371433f.el9.x8 1.4 MB/s | 86 kB 00:00 2026-02-23T10:15:57.454 INFO:teuthology.orchestra.run.trial198.stdout:(28/146): rbd-mirror-20.3.0-5439.ge371433f.el9. 2.1 MB/s | 2.6 MB 00:01 2026-02-23T10:15:57.590 INFO:teuthology.orchestra.run.trial198.stdout:(29/146): rbd-nbd-20.3.0-5439.ge371433f.el9.x86 1.2 MB/s | 166 kB 00:00 2026-02-23T10:15:57.654 INFO:teuthology.orchestra.run.trial198.stdout:(30/146): ceph-grafana-dashboards-20.3.0-5439.g 889 kB/s | 57 kB 00:00 2026-02-23T10:15:57.785 INFO:teuthology.orchestra.run.trial198.stdout:(31/146): ceph-mgr-cephadm-20.3.0-5439.ge371433 1.4 MB/s | 184 kB 00:00 2026-02-23T10:15:58.309 INFO:teuthology.orchestra.run.trial044.stdout:(40/146): hwloc-libs-2.4.1-6.el9.x86_64.rpm 891 kB/s | 2.1 MB 00:02 2026-02-23T10:15:58.392 INFO:teuthology.orchestra.run.trial044.stdout:(41/146): ledmon-libs-1.1.0-3.el9.x86_64.rpm 489 kB/s | 40 kB 00:00 2026-02-23T10:15:58.475 INFO:teuthology.orchestra.run.trial044.stdout:(42/146): libatomic-11.5.0-14.el9.x86_64.rpm 277 kB/s | 23 kB 00:00 2026-02-23T10:15:58.634 INFO:teuthology.orchestra.run.trial044.stdout:(43/146): libconfig-1.7.2-9.el9.x86_64.rpm 451 kB/s | 72 kB 00:00 2026-02-23T10:15:58.874 INFO:teuthology.orchestra.run.trial044.stdout:(44/146): libgfortran-11.5.0-14.el9.x86_64.rpm 3.2 MB/s | 794 kB 00:00 2026-02-23T10:15:58.958 INFO:teuthology.orchestra.run.trial044.stdout:(45/146): libquadmath-11.5.0-14.el9.x86_64.rpm 2.2 MB/s | 184 kB 00:00 2026-02-23T10:15:59.041 INFO:teuthology.orchestra.run.trial044.stdout:(46/146): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2026-02-23T10:15:59.123 INFO:teuthology.orchestra.run.trial044.stdout:(47/146): mailcap-2.1.49-5.el9.noarch.rpm 402 kB/s | 33 kB 00:00 2026-02-23T10:15:59.206 INFO:teuthology.orchestra.run.trial044.stdout:(48/146): pciutils-3.7.0-7.el9.x86_64.rpm 1.1 MB/s | 93 kB 00:00 2026-02-23T10:15:59.291 INFO:teuthology.orchestra.run.trial044.stdout:(49/146): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 253 kB 00:00 2026-02-23T10:15:59.454 INFO:teuthology.orchestra.run.trial044.stdout:(50/146): python3-cryptography-36.0.1-5.el9.x86 7.6 MB/s | 1.2 MB 00:00 2026-02-23T10:15:59.538 INFO:teuthology.orchestra.run.trial044.stdout:(51/146): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2026-02-23T10:15:59.622 INFO:teuthology.orchestra.run.trial044.stdout:(52/146): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2026-02-23T10:15:59.706 INFO:teuthology.orchestra.run.trial044.stdout:(53/146): python3-pyparsing-2.4.7-9.el9.noarch. 1.8 MB/s | 150 kB 00:00 2026-02-23T10:15:59.789 INFO:teuthology.orchestra.run.trial044.stdout:(54/146): python3-requests-2.25.1-10.el9.noarch 1.5 MB/s | 126 kB 00:00 2026-02-23T10:15:59.874 INFO:teuthology.orchestra.run.trial044.stdout:(55/146): python3-urllib3-1.26.5-7.el9.noarch.r 2.5 MB/s | 218 kB 00:00 2026-02-23T10:15:59.957 INFO:teuthology.orchestra.run.trial044.stdout:(56/146): unzip-6.0-59.el9.x86_64.rpm 2.1 MB/s | 182 kB 00:00 2026-02-23T10:16:00.041 INFO:teuthology.orchestra.run.trial044.stdout:(57/146): zip-3.0-35.el9.x86_64.rpm 3.1 MB/s | 266 kB 00:00 2026-02-23T10:16:00.166 INFO:teuthology.orchestra.run.trial044.stdout:(58/146): boost-program-options-1.75.0-13.el9.x 835 kB/s | 104 kB 00:00 2026-02-23T10:16:00.194 INFO:teuthology.orchestra.run.trial044.stdout:(59/146): flexiblas-3.0.4-9.el9.x86_64.rpm 1.0 MB/s | 30 kB 00:00 2026-02-23T10:16:00.342 INFO:teuthology.orchestra.run.trial044.stdout:(60/146): flexiblas-netlib-3.0.4-9.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2026-02-23T10:16:00.368 INFO:teuthology.orchestra.run.trial044.stdout:(61/146): flexiblas-openblas-openmp-3.0.4-9.el9 585 kB/s | 15 kB 00:00 2026-02-23T10:16:00.396 INFO:teuthology.orchestra.run.trial044.stdout:(62/146): libasan8-15.2.1-7.el9.x86_64.rpm 18 MB/s | 525 kB 00:00 2026-02-23T10:16:00.423 INFO:teuthology.orchestra.run.trial044.stdout:(63/146): libnbd-1.20.3-4.el9.x86_64.rpm 5.8 MB/s | 164 kB 00:00 2026-02-23T10:16:00.471 INFO:teuthology.orchestra.run.trial044.stdout:(64/146): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.3 MB/s | 160 kB 00:00 2026-02-23T10:16:00.496 INFO:teuthology.orchestra.run.trial044.stdout:(65/146): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 45 kB 00:00 2026-02-23T10:16:00.525 INFO:teuthology.orchestra.run.trial044.stdout:(66/146): librdkafka-1.6.1-102.el9.x86_64.rpm 23 MB/s | 662 kB 00:00 2026-02-23T10:16:00.553 INFO:teuthology.orchestra.run.trial044.stdout:(67/146): libstoragemgmt-1.10.1-1.el9.x86_64.rp 8.8 MB/s | 246 kB 00:00 2026-02-23T10:16:00.580 INFO:teuthology.orchestra.run.trial044.stdout:(68/146): libubsan-11.5.0-14.el9.x86_64.rpm 6.4 MB/s | 176 kB 00:00 2026-02-23T10:16:00.607 INFO:teuthology.orchestra.run.trial044.stdout:(69/146): libxslt-1.1.34-12.el9.x86_64.rpm 8.3 MB/s | 233 kB 00:00 2026-02-23T10:16:00.635 INFO:teuthology.orchestra.run.trial044.stdout:(70/146): lttng-ust-2.12.0-6.el9.x86_64.rpm 10 MB/s | 292 kB 00:00 2026-02-23T10:16:00.691 INFO:teuthology.orchestra.run.trial044.stdout:(71/146): lua-5.4.4-4.el9.x86_64.rpm 3.3 MB/s | 188 kB 00:00 2026-02-23T10:16:00.716 INFO:teuthology.orchestra.run.trial044.stdout:(72/146): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-23T10:16:00.796 INFO:teuthology.orchestra.run.trial044.stdout:(73/146): openblas-openmp-0.3.29-1.el9.x86_64.r 67 MB/s | 5.3 MB 00:00 2026-02-23T10:16:00.825 INFO:teuthology.orchestra.run.trial044.stdout:(74/146): protobuf-3.14.0-17.el9.x86_64.rpm 34 MB/s | 1.0 MB 00:00 2026-02-23T10:16:00.890 INFO:teuthology.orchestra.run.trial044.stdout:(75/146): python3-babel-2.9.1-2.el9.noarch.rpm 93 MB/s | 6.0 MB 00:00 2026-02-23T10:16:00.924 INFO:teuthology.orchestra.run.trial044.stdout:(76/146): python3-devel-3.9.25-3.el9.x86_64.rpm 7.0 MB/s | 244 kB 00:00 2026-02-23T10:16:00.952 INFO:teuthology.orchestra.run.trial044.stdout:(77/146): python3-iniconfig-1.1.1-7.el9.noarch. 623 kB/s | 17 kB 00:00 2026-02-23T10:16:00.982 INFO:teuthology.orchestra.run.trial044.stdout:(78/146): python3-jinja2-2.11.3-8.el9.noarch.rp 8.1 MB/s | 249 kB 00:00 2026-02-23T10:16:01.010 INFO:teuthology.orchestra.run.trial044.stdout:(79/146): python3-jmespath-1.0.1-1.el9.noarch.r 1.6 MB/s | 48 kB 00:00 2026-02-23T10:16:01.038 INFO:teuthology.orchestra.run.trial044.stdout:(80/146): python3-libstoragemgmt-1.10.1-1.el9.x 6.2 MB/s | 177 kB 00:00 2026-02-23T10:16:01.066 INFO:teuthology.orchestra.run.trial044.stdout:(81/146): python3-markupsafe-1.1.1-12.el9.x86_6 1.2 MB/s | 35 kB 00:00 2026-02-23T10:16:01.186 INFO:teuthology.orchestra.run.trial044.stdout:(82/146): python3-numpy-1.23.5-2.el9.x86_64.rpm 51 MB/s | 6.1 MB 00:00 2026-02-23T10:16:01.216 INFO:teuthology.orchestra.run.trial044.stdout:(83/146): python3-numpy-f2py-1.23.5-2.el9.x86_6 14 MB/s | 442 kB 00:00 2026-02-23T10:16:01.247 INFO:teuthology.orchestra.run.trial044.stdout:(84/146): python3-packaging-20.9-5.el9.noarch.r 2.5 MB/s | 77 kB 00:00 2026-02-23T10:16:01.276 INFO:teuthology.orchestra.run.trial044.stdout:(85/146): python3-pluggy-0.13.1-7.el9.noarch.rp 1.4 MB/s | 41 kB 00:00 2026-02-23T10:16:01.304 INFO:teuthology.orchestra.run.trial044.stdout:(86/146): python3-protobuf-3.14.0-17.el9.noarch 9.3 MB/s | 267 kB 00:00 2026-02-23T10:16:01.348 INFO:teuthology.orchestra.run.trial044.stdout:(87/146): python3-py-1.10.0-6.el9.noarch.rpm 11 MB/s | 477 kB 00:00 2026-02-23T10:16:01.380 INFO:teuthology.orchestra.run.trial044.stdout:(88/146): python3-pyasn1-0.4.8-6.el9.noarch.rpm 4.9 MB/s | 159 kB 00:00 2026-02-23T10:16:01.413 INFO:teuthology.orchestra.run.trial044.stdout:(89/146): python3-pyasn1-modules-0.4.8-6.el9.no 8.2 MB/s | 279 kB 00:00 2026-02-23T10:16:01.446 INFO:teuthology.orchestra.run.trial044.stdout:(90/146): python3-pytest-6.2.2-7.el9.noarch.rpm 15 MB/s | 519 kB 00:00 2026-02-23T10:16:01.473 INFO:teuthology.orchestra.run.trial044.stdout:(91/146): python3-requests-oauthlib-1.3.0-12.el 2.0 MB/s | 54 kB 00:00 2026-02-23T10:16:01.689 INFO:teuthology.orchestra.run.trial044.stdout:(92/146): python3-scipy-1.9.3-2.el9.x86_64.rpm 89 MB/s | 19 MB 00:00 2026-02-23T10:16:01.716 INFO:teuthology.orchestra.run.trial044.stdout:(93/146): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 42 kB 00:00 2026-02-23T10:16:01.742 INFO:teuthology.orchestra.run.trial044.stdout:(94/146): qatlib-25.08.0-2.el9.x86_64.rpm 8.8 MB/s | 240 kB 00:00 2026-02-23T10:16:01.768 INFO:teuthology.orchestra.run.trial044.stdout:(95/146): qatlib-service-25.08.0-2.el9.x86_64.r 1.4 MB/s | 37 kB 00:00 2026-02-23T10:16:01.794 INFO:teuthology.orchestra.run.trial044.stdout:(96/146): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.5 MB/s | 66 kB 00:00 2026-02-23T10:16:01.821 INFO:teuthology.orchestra.run.trial044.stdout:(97/146): socat-1.7.4.1-8.el9.x86_64.rpm 11 MB/s | 303 kB 00:00 2026-02-23T10:16:01.847 INFO:teuthology.orchestra.run.trial044.stdout:(98/146): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 64 kB 00:00 2026-02-23T10:16:01.891 INFO:teuthology.orchestra.run.trial044.stdout:(99/146): lua-devel-5.4.4-4.el9.x86_64.rpm 507 kB/s | 22 kB 00:00 2026-02-23T10:16:01.931 INFO:teuthology.orchestra.run.trial044.stdout:(100/146): protobuf-compiler-3.14.0-17.el9.x86_ 21 MB/s | 862 kB 00:00 2026-02-23T10:16:02.402 INFO:teuthology.orchestra.run.trial044.stdout:(101/146): abseil-cpp-20211102.0-4.el9.x86_64.r 1.1 MB/s | 551 kB 00:00 2026-02-23T10:16:02.488 INFO:teuthology.orchestra.run.trial044.stdout:(102/146): gperftools-libs-2.9.1-3.el9.x86_64.r 3.5 MB/s | 308 kB 00:00 2026-02-23T10:16:02.550 INFO:teuthology.orchestra.run.trial044.stdout:(103/146): grpc-data-1.46.7-10.el9.noarch.rpm 311 kB/s | 19 kB 00:00 2026-02-23T10:16:02.817 INFO:teuthology.orchestra.run.trial044.stdout:(104/146): libarrow-9.0.0-15.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2026-02-23T10:16:02.879 INFO:teuthology.orchestra.run.trial044.stdout:(105/146): libarrow-doc-9.0.0-15.el9.noarch.rpm 396 kB/s | 25 kB 00:00 2026-02-23T10:16:02.942 INFO:teuthology.orchestra.run.trial044.stdout:(106/146): liboath-2.6.12-1.el9.x86_64.rpm 780 kB/s | 49 kB 00:00 2026-02-23T10:16:03.005 INFO:teuthology.orchestra.run.trial044.stdout:(107/146): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2026-02-23T10:16:03.070 INFO:teuthology.orchestra.run.trial044.stdout:(108/146): luarocks-3.9.2-5.el9.noarch.rpm 2.3 MB/s | 151 kB 00:00 2026-02-23T10:16:03.148 INFO:teuthology.orchestra.run.trial044.stdout:(109/146): parquet-libs-9.0.0-15.el9.x86_64.rpm 10 MB/s | 838 kB 00:00 2026-02-23T10:16:03.216 INFO:teuthology.orchestra.run.trial044.stdout:(110/146): python3-asyncssh-2.13.2-5.el9.noarch 7.9 MB/s | 548 kB 00:00 2026-02-23T10:16:03.279 INFO:teuthology.orchestra.run.trial044.stdout:(111/146): python3-autocommand-2.2.2-8.el9.noar 468 kB/s | 29 kB 00:00 2026-02-23T10:16:03.342 INFO:teuthology.orchestra.run.trial044.stdout:(112/146): python3-backports-tarfile-1.2.0-1.el 952 kB/s | 60 kB 00:00 2026-02-23T10:16:03.405 INFO:teuthology.orchestra.run.trial044.stdout:(113/146): python3-bcrypt-3.2.2-1.el9.x86_64.rp 690 kB/s | 43 kB 00:00 2026-02-23T10:16:03.468 INFO:teuthology.orchestra.run.trial044.stdout:(114/146): python3-cachetools-4.2.4-1.el9.noarc 515 kB/s | 32 kB 00:00 2026-02-23T10:16:03.530 INFO:teuthology.orchestra.run.trial044.stdout:(115/146): python3-certifi-2023.05.07-4.el9.noa 225 kB/s | 14 kB 00:00 2026-02-23T10:16:03.595 INFO:teuthology.orchestra.run.trial044.stdout:(116/146): python3-cheroot-10.0.1-4.el9.noarch. 2.6 MB/s | 173 kB 00:00 2026-02-23T10:16:03.664 INFO:teuthology.orchestra.run.trial044.stdout:(117/146): python3-cherrypy-18.6.1-2.el9.noarch 5.1 MB/s | 358 kB 00:00 2026-02-23T10:16:03.729 INFO:teuthology.orchestra.run.trial044.stdout:(118/146): python3-google-auth-2.45.0-1.el9.noa 3.8 MB/s | 254 kB 00:00 2026-02-23T10:16:03.833 INFO:teuthology.orchestra.run.trial044.stdout:(119/146): python3-grpcio-1.46.7-10.el9.x86_64. 20 MB/s | 2.0 MB 00:00 2026-02-23T10:16:03.898 INFO:teuthology.orchestra.run.trial044.stdout:(120/146): python3-grpcio-tools-1.46.7-10.el9.x 2.2 MB/s | 144 kB 00:00 2026-02-23T10:16:03.960 INFO:teuthology.orchestra.run.trial044.stdout:(121/146): python3-jaraco-8.2.1-3.el9.noarch.rp 171 kB/s | 11 kB 00:00 2026-02-23T10:16:04.023 INFO:teuthology.orchestra.run.trial044.stdout:(122/146): python3-jaraco-classes-3.2.1-5.el9.n 281 kB/s | 18 kB 00:00 2026-02-23T10:16:04.086 INFO:teuthology.orchestra.run.trial044.stdout:(123/146): python3-jaraco-collections-3.0.0-8.e 368 kB/s | 23 kB 00:00 2026-02-23T10:16:04.149 INFO:teuthology.orchestra.run.trial044.stdout:(124/146): python3-jaraco-context-6.0.1-3.el9.n 312 kB/s | 20 kB 00:00 2026-02-23T10:16:04.212 INFO:teuthology.orchestra.run.trial044.stdout:(125/146): python3-jaraco-functools-3.5.0-2.el9 310 kB/s | 19 kB 00:00 2026-02-23T10:16:04.275 INFO:teuthology.orchestra.run.trial044.stdout:(126/146): python3-jaraco-text-4.0.0-2.el9.noar 420 kB/s | 26 kB 00:00 2026-02-23T10:16:04.348 INFO:teuthology.orchestra.run.trial044.stdout:(127/146): python3-kubernetes-26.1.0-3.el9.noar 14 MB/s | 1.0 MB 00:00 2026-02-23T10:16:04.412 INFO:teuthology.orchestra.run.trial044.stdout:(128/146): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2026-02-23T10:16:04.475 INFO:teuthology.orchestra.run.trial044.stdout:(129/146): python3-natsort-7.1.1-5.el9.noarch.r 911 kB/s | 58 kB 00:00 2026-02-23T10:16:04.538 INFO:teuthology.orchestra.run.trial044.stdout:(130/146): python3-portend-3.1.0-2.el9.noarch.r 262 kB/s | 16 kB 00:00 2026-02-23T10:16:04.602 INFO:teuthology.orchestra.run.trial044.stdout:(131/146): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.4 MB/s | 90 kB 00:00 2026-02-23T10:16:04.665 INFO:teuthology.orchestra.run.trial044.stdout:(132/146): python3-repoze-lru-0.7-16.el9.noarch 487 kB/s | 31 kB 00:00 2026-02-23T10:16:04.729 INFO:teuthology.orchestra.run.trial044.stdout:(133/146): python3-routes-2.5.1-5.el9.noarch.rp 2.9 MB/s | 188 kB 00:00 2026-02-23T10:16:04.792 INFO:teuthology.orchestra.run.trial044.stdout:(134/146): python3-rsa-4.9-2.el9.noarch.rpm 931 kB/s | 59 kB 00:00 2026-02-23T10:16:04.855 INFO:teuthology.orchestra.run.trial044.stdout:(135/146): python3-tempora-5.0.0-2.el9.noarch.r 569 kB/s | 36 kB 00:00 2026-02-23T10:16:04.919 INFO:teuthology.orchestra.run.trial044.stdout:(136/146): python3-typing-extensions-4.15.0-1.e 1.3 MB/s | 86 kB 00:00 2026-02-23T10:16:04.983 INFO:teuthology.orchestra.run.trial044.stdout:(137/146): python3-websocket-client-1.2.3-2.el9 1.4 MB/s | 90 kB 00:00 2026-02-23T10:16:05.046 INFO:teuthology.orchestra.run.trial044.stdout:(138/146): python3-xmltodict-0.12.0-15.el9.noar 352 kB/s | 22 kB 00:00 2026-02-23T10:16:05.109 INFO:teuthology.orchestra.run.trial044.stdout:(139/146): python3-zc-lockfile-2.0-10.el9.noarc 318 kB/s | 20 kB 00:00 2026-02-23T10:16:05.172 INFO:teuthology.orchestra.run.trial044.stdout:(140/146): re2-20211101-20.el9.x86_64.rpm 2.9 MB/s | 191 kB 00:00 2026-02-23T10:16:05.250 INFO:teuthology.orchestra.run.trial044.stdout:(141/146): thrift-0.15.0-4.el9.x86_64.rpm 20 MB/s | 1.6 MB 00:00 2026-02-23T10:16:05.314 INFO:teuthology.orchestra.run.trial044.stdout:(142/146): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.9 MB/s | 122 kB 00:00 2026-02-23T10:16:07.196 INFO:teuthology.orchestra.run.trial044.stdout:(143/146): librados2-20.3.0-5439.ge371433f.el9. 1.7 MB/s | 3.3 MB 00:01 2026-02-23T10:16:08.844 INFO:teuthology.orchestra.run.trial044.stdout:(144/146): librbd1-20.3.0-5439.ge371433f.el9.x8 1.6 MB/s | 2.7 MB 00:01 2026-02-23T10:16:25.108 INFO:teuthology.orchestra.run.trial044.stdout:(145/146): ceph-test-20.3.0-5439.ge371433f.el9. 1.9 MB/s | 126 MB 01:05 2026-02-23T10:16:26.536 INFO:teuthology.orchestra.run.trial198.stdout:(32/146): ceph-test-20.3.0-5439.ge371433f.el9.x 2.1 MB/s | 126 MB 00:59 2026-02-23T10:16:30.936 INFO:teuthology.orchestra.run.trial198.stdout:(33/146): ceph-mgr-diskprediction-local-20.3.0- 1.7 MB/s | 7.4 MB 00:04 2026-02-23T10:16:31.137 INFO:teuthology.orchestra.run.trial198.stdout:(34/146): ceph-mgr-modules-core-20.3.0-5439.ge3 1.4 MB/s | 298 kB 00:00 2026-02-23T10:16:31.236 INFO:teuthology.orchestra.run.trial198.stdout:(35/146): ceph-mgr-dashboard-20.3.0-5439.ge3714 1.5 MB/s | 51 MB 00:33 2026-02-23T10:16:31.237 INFO:teuthology.orchestra.run.trial198.stdout:(36/146): ceph-mgr-rook-20.3.0-5439.ge371433f.e 506 kB/s | 50 kB 00:00 2026-02-23T10:16:31.304 INFO:teuthology.orchestra.run.trial198.stdout:(37/146): ceph-prometheus-alerts-20.3.0-5439.ge 255 kB/s | 17 kB 00:00 2026-02-23T10:16:31.440 INFO:teuthology.orchestra.run.trial198.stdout:(38/146): ceph-volume-20.3.0-5439.ge371433f.el9 1.5 MB/s | 301 kB 00:00 2026-02-23T10:16:31.505 INFO:teuthology.orchestra.run.trial198.stdout:(39/146): cryptsetup-2.8.1-3.el9.x86_64.rpm 5.2 MB/s | 351 kB 00:00 2026-02-23T10:16:31.543 INFO:teuthology.orchestra.run.trial198.stdout:(40/146): hwloc-libs-2.4.1-6.el9.x86_64.rpm 56 MB/s | 2.1 MB 00:00 2026-02-23T10:16:31.552 INFO:teuthology.orchestra.run.trial198.stdout:(41/146): ledmon-libs-1.1.0-3.el9.x86_64.rpm 4.3 MB/s | 40 kB 00:00 2026-02-23T10:16:31.561 INFO:teuthology.orchestra.run.trial198.stdout:(42/146): libatomic-11.5.0-14.el9.x86_64.rpm 2.6 MB/s | 23 kB 00:00 2026-02-23T10:16:31.571 INFO:teuthology.orchestra.run.trial198.stdout:(43/146): libconfig-1.7.2-9.el9.x86_64.rpm 7.4 MB/s | 72 kB 00:00 2026-02-23T10:16:31.583 INFO:teuthology.orchestra.run.trial198.stdout:(44/146): libgfortran-11.5.0-14.el9.x86_64.rpm 63 MB/s | 794 kB 00:00 2026-02-23T10:16:31.594 INFO:teuthology.orchestra.run.trial198.stdout:(45/146): libquadmath-11.5.0-14.el9.x86_64.rpm 17 MB/s | 184 kB 00:00 2026-02-23T10:16:31.604 INFO:teuthology.orchestra.run.trial198.stdout:(46/146): lksctp-tools-1.0.19-2.el9.x86_64.rpm 9.3 MB/s | 94 kB 00:00 2026-02-23T10:16:31.614 INFO:teuthology.orchestra.run.trial198.stdout:(47/146): mailcap-2.1.49-5.el9.noarch.rpm 3.2 MB/s | 33 kB 00:00 2026-02-23T10:16:31.623 INFO:teuthology.orchestra.run.trial198.stdout:(48/146): pciutils-3.7.0-7.el9.x86_64.rpm 10 MB/s | 93 kB 00:00 2026-02-23T10:16:31.635 INFO:teuthology.orchestra.run.trial198.stdout:(49/146): python3-cffi-1.14.5-5.el9.x86_64.rpm 21 MB/s | 253 kB 00:00 2026-02-23T10:16:31.650 INFO:teuthology.orchestra.run.trial198.stdout:(50/146): python3-cryptography-36.0.1-5.el9.x86 87 MB/s | 1.2 MB 00:00 2026-02-23T10:16:31.661 INFO:teuthology.orchestra.run.trial198.stdout:(51/146): python3-ply-3.11-14.el9.noarch.rpm 9.5 MB/s | 106 kB 00:00 2026-02-23T10:16:31.672 INFO:teuthology.orchestra.run.trial198.stdout:(52/146): python3-pycparser-2.20-6.el9.noarch.r 12 MB/s | 135 kB 00:00 2026-02-23T10:16:31.683 INFO:teuthology.orchestra.run.trial198.stdout:(53/146): python3-pyparsing-2.4.7-9.el9.noarch. 13 MB/s | 150 kB 00:00 2026-02-23T10:16:31.695 INFO:teuthology.orchestra.run.trial198.stdout:(54/146): python3-requests-2.25.1-10.el9.noarch 11 MB/s | 126 kB 00:00 2026-02-23T10:16:31.708 INFO:teuthology.orchestra.run.trial198.stdout:(55/146): python3-urllib3-1.26.5-7.el9.noarch.r 17 MB/s | 218 kB 00:00 2026-02-23T10:16:31.719 INFO:teuthology.orchestra.run.trial198.stdout:(56/146): unzip-6.0-59.el9.x86_64.rpm 15 MB/s | 182 kB 00:00 2026-02-23T10:16:31.730 INFO:teuthology.orchestra.run.trial198.stdout:(57/146): zip-3.0-35.el9.x86_64.rpm 24 MB/s | 266 kB 00:00 2026-02-23T10:16:31.748 INFO:teuthology.orchestra.run.trial198.stdout:(58/146): boost-program-options-1.75.0-13.el9.x 5.9 MB/s | 104 kB 00:00 2026-02-23T10:16:31.752 INFO:teuthology.orchestra.run.trial198.stdout:(59/146): flexiblas-3.0.4-9.el9.x86_64.rpm 7.1 MB/s | 30 kB 00:00 2026-02-23T10:16:31.777 INFO:teuthology.orchestra.run.trial198.stdout:(60/146): flexiblas-netlib-3.0.4-9.el9.x86_64.r 122 MB/s | 3.0 MB 00:00 2026-02-23T10:16:31.781 INFO:teuthology.orchestra.run.trial198.stdout:(61/146): flexiblas-openblas-openmp-3.0.4-9.el9 3.7 MB/s | 15 kB 00:00 2026-02-23T10:16:31.787 INFO:teuthology.orchestra.run.trial198.stdout:(62/146): libasan8-15.2.1-7.el9.x86_64.rpm 79 MB/s | 525 kB 00:00 2026-02-23T10:16:31.793 INFO:teuthology.orchestra.run.trial198.stdout:(63/146): libnbd-1.20.3-4.el9.x86_64.rpm 28 MB/s | 164 kB 00:00 2026-02-23T10:16:31.799 INFO:teuthology.orchestra.run.trial198.stdout:(64/146): libpmemobj-1.12.1-1.el9.x86_64.rpm 27 MB/s | 160 kB 00:00 2026-02-23T10:16:31.804 INFO:teuthology.orchestra.run.trial198.stdout:(65/146): librabbitmq-0.11.0-7.el9.x86_64.rpm 9.6 MB/s | 45 kB 00:00 2026-02-23T10:16:31.810 INFO:teuthology.orchestra.run.trial198.stdout:(66/146): librdkafka-1.6.1-102.el9.x86_64.rpm 101 MB/s | 662 kB 00:00 2026-02-23T10:16:31.817 INFO:teuthology.orchestra.run.trial198.stdout:(67/146): libstoragemgmt-1.10.1-1.el9.x86_64.rp 37 MB/s | 246 kB 00:00 2026-02-23T10:16:31.823 INFO:teuthology.orchestra.run.trial198.stdout:(68/146): libubsan-11.5.0-14.el9.x86_64.rpm 29 MB/s | 176 kB 00:00 2026-02-23T10:16:31.829 INFO:teuthology.orchestra.run.trial198.stdout:(69/146): libxslt-1.1.34-12.el9.x86_64.rpm 39 MB/s | 233 kB 00:00 2026-02-23T10:16:31.835 INFO:teuthology.orchestra.run.trial198.stdout:(70/146): lttng-ust-2.12.0-6.el9.x86_64.rpm 45 MB/s | 292 kB 00:00 2026-02-23T10:16:31.841 INFO:teuthology.orchestra.run.trial198.stdout:(71/146): lua-5.4.4-4.el9.x86_64.rpm 31 MB/s | 188 kB 00:00 2026-02-23T10:16:31.846 INFO:teuthology.orchestra.run.trial198.stdout:(72/146): openblas-0.3.29-1.el9.x86_64.rpm 9.5 MB/s | 42 kB 00:00 2026-02-23T10:16:31.866 INFO:teuthology.orchestra.run.trial198.stdout:(73/146): openblas-openmp-0.3.29-1.el9.x86_64.r 255 MB/s | 5.3 MB 00:00 2026-02-23T10:16:31.875 INFO:teuthology.orchestra.run.trial198.stdout:(74/146): protobuf-3.14.0-17.el9.x86_64.rpm 120 MB/s | 1.0 MB 00:00 2026-02-23T10:16:31.899 INFO:teuthology.orchestra.run.trial198.stdout:(75/146): python3-babel-2.9.1-2.el9.noarch.rpm 250 MB/s | 6.0 MB 00:00 2026-02-23T10:16:31.906 INFO:teuthology.orchestra.run.trial198.stdout:(76/146): python3-devel-3.9.25-3.el9.x86_64.rpm 34 MB/s | 244 kB 00:00 2026-02-23T10:16:31.910 INFO:teuthology.orchestra.run.trial198.stdout:(77/146): python3-iniconfig-1.1.1-7.el9.noarch. 3.9 MB/s | 17 kB 00:00 2026-02-23T10:16:31.917 INFO:teuthology.orchestra.run.trial198.stdout:(78/146): python3-jinja2-2.11.3-8.el9.noarch.rp 39 MB/s | 249 kB 00:00 2026-02-23T10:16:31.922 INFO:teuthology.orchestra.run.trial198.stdout:(79/146): python3-jmespath-1.0.1-1.el9.noarch.r 9.5 MB/s | 48 kB 00:00 2026-02-23T10:16:31.928 INFO:teuthology.orchestra.run.trial198.stdout:(80/146): python3-libstoragemgmt-1.10.1-1.el9.x 29 MB/s | 177 kB 00:00 2026-02-23T10:16:31.933 INFO:teuthology.orchestra.run.trial198.stdout:(81/146): python3-markupsafe-1.1.1-12.el9.x86_6 7.2 MB/s | 35 kB 00:00 2026-02-23T10:16:31.959 INFO:teuthology.orchestra.run.trial198.stdout:(82/146): python3-numpy-1.23.5-2.el9.x86_64.rpm 234 MB/s | 6.1 MB 00:00 2026-02-23T10:16:31.967 INFO:teuthology.orchestra.run.trial198.stdout:(83/146): python3-numpy-f2py-1.23.5-2.el9.x86_6 56 MB/s | 442 kB 00:00 2026-02-23T10:16:31.972 INFO:teuthology.orchestra.run.trial198.stdout:(84/146): python3-packaging-20.9-5.el9.noarch.r 14 MB/s | 77 kB 00:00 2026-02-23T10:16:31.977 INFO:teuthology.orchestra.run.trial198.stdout:(85/146): python3-pluggy-0.13.1-7.el9.noarch.rp 8.9 MB/s | 41 kB 00:00 2026-02-23T10:16:31.982 INFO:teuthology.orchestra.run.trial198.stdout:(86/146): python3-protobuf-3.14.0-17.el9.noarch 52 MB/s | 267 kB 00:00 2026-02-23T10:16:31.990 INFO:teuthology.orchestra.run.trial198.stdout:(87/146): python3-py-1.10.0-6.el9.noarch.rpm 61 MB/s | 477 kB 00:00 2026-02-23T10:16:31.996 INFO:teuthology.orchestra.run.trial198.stdout:(88/146): python3-pyasn1-0.4.8-6.el9.noarch.rpm 24 MB/s | 159 kB 00:00 2026-02-23T10:16:32.006 INFO:teuthology.orchestra.run.trial198.stdout:(89/146): python3-pyasn1-modules-0.4.8-6.el9.no 29 MB/s | 279 kB 00:00 2026-02-23T10:16:32.014 INFO:teuthology.orchestra.run.trial198.stdout:(90/146): python3-pytest-6.2.2-7.el9.noarch.rpm 66 MB/s | 519 kB 00:00 2026-02-23T10:16:32.019 INFO:teuthology.orchestra.run.trial198.stdout:(91/146): python3-requests-oauthlib-1.3.0-12.el 11 MB/s | 54 kB 00:00 2026-02-23T10:16:32.084 INFO:teuthology.orchestra.run.trial198.stdout:(92/146): python3-scipy-1.9.3-2.el9.x86_64.rpm 298 MB/s | 19 MB 00:00 2026-02-23T10:16:32.089 INFO:teuthology.orchestra.run.trial198.stdout:(93/146): python3-toml-0.10.2-6.el9.noarch.rpm 7.7 MB/s | 42 kB 00:00 2026-02-23T10:16:32.095 INFO:teuthology.orchestra.run.trial198.stdout:(94/146): qatlib-25.08.0-2.el9.x86_64.rpm 44 MB/s | 240 kB 00:00 2026-02-23T10:16:32.099 INFO:teuthology.orchestra.run.trial198.stdout:(95/146): qatlib-service-25.08.0-2.el9.x86_64.r 8.5 MB/s | 37 kB 00:00 2026-02-23T10:16:32.104 INFO:teuthology.orchestra.run.trial198.stdout:(96/146): qatzip-libs-1.3.1-1.el9.x86_64.rpm 14 MB/s | 66 kB 00:00 2026-02-23T10:16:32.110 INFO:teuthology.orchestra.run.trial198.stdout:(97/146): socat-1.7.4.1-8.el9.x86_64.rpm 46 MB/s | 303 kB 00:00 2026-02-23T10:16:32.115 INFO:teuthology.orchestra.run.trial198.stdout:(98/146): xmlstarlet-1.6.1-20.el9.x86_64.rpm 13 MB/s | 64 kB 00:00 2026-02-23T10:16:32.178 INFO:teuthology.orchestra.run.trial198.stdout:(99/146): cephadm-20.3.0-5439.ge371433f.el9.noa 1.2 MB/s | 1.0 MB 00:00 2026-02-23T10:16:32.552 INFO:teuthology.orchestra.run.trial198.stdout:(100/146): lua-devel-5.4.4-4.el9.x86_64.rpm 51 kB/s | 22 kB 00:00 2026-02-23T10:16:32.954 INFO:teuthology.orchestra.run.trial198.stdout:(101/146): protobuf-compiler-3.14.0-17.el9.x86_ 1.1 MB/s | 862 kB 00:00 2026-02-23T10:16:33.047 INFO:teuthology.orchestra.run.trial198.stdout:(102/146): abseil-cpp-20211102.0-4.el9.x86_64.r 1.1 MB/s | 551 kB 00:00 2026-02-23T10:16:33.264 INFO:teuthology.orchestra.run.trial198.stdout:(103/146): grpc-data-1.46.7-10.el9.noarch.rpm 89 kB/s | 19 kB 00:00 2026-02-23T10:16:33.388 INFO:teuthology.orchestra.run.trial198.stdout:(104/146): gperftools-libs-2.9.1-3.el9.x86_64.r 710 kB/s | 308 kB 00:00 2026-02-23T10:16:33.596 INFO:teuthology.orchestra.run.trial198.stdout:(105/146): libarrow-doc-9.0.0-15.el9.noarch.rpm 119 kB/s | 25 kB 00:00 2026-02-23T10:16:33.936 INFO:teuthology.orchestra.run.trial198.stdout:(106/146): liboath-2.6.12-1.el9.x86_64.rpm 144 kB/s | 49 kB 00:00 2026-02-23T10:16:34.225 INFO:teuthology.orchestra.run.trial198.stdout:(107/146): libunwind-1.6.2-1.el9.x86_64.rpm 233 kB/s | 67 kB 00:00 2026-02-23T10:16:34.263 INFO:teuthology.orchestra.run.trial198.stdout:(108/146): libarrow-9.0.0-15.el9.x86_64.rpm 4.4 MB/s | 4.4 MB 00:00 2026-02-23T10:16:34.586 INFO:teuthology.orchestra.run.trial198.stdout:(109/146): luarocks-3.9.2-5.el9.noarch.rpm 419 kB/s | 151 kB 00:00 2026-02-23T10:16:34.770 INFO:teuthology.orchestra.run.trial198.stdout:(110/146): parquet-libs-9.0.0-15.el9.x86_64.rpm 1.6 MB/s | 838 kB 00:00 2026-02-23T10:16:34.979 INFO:teuthology.orchestra.run.trial198.stdout:(111/146): python3-autocommand-2.2.2-8.el9.noar 141 kB/s | 29 kB 00:00 2026-02-23T10:16:35.073 INFO:teuthology.orchestra.run.trial198.stdout:(112/146): python3-asyncssh-2.13.2-5.el9.noarch 1.1 MB/s | 548 kB 00:00 2026-02-23T10:16:35.266 INFO:teuthology.orchestra.run.trial198.stdout:(113/146): python3-backports-tarfile-1.2.0-1.el 210 kB/s | 60 kB 00:00 2026-02-23T10:16:35.290 INFO:teuthology.orchestra.run.trial198.stdout:(114/146): python3-bcrypt-3.2.2-1.el9.x86_64.rp 199 kB/s | 43 kB 00:00 2026-02-23T10:16:35.430 INFO:teuthology.orchestra.run.trial198.stdout:(115/146): python3-certifi-2023.05.07-4.el9.noa 101 kB/s | 14 kB 00:00 2026-02-23T10:16:35.475 INFO:teuthology.orchestra.run.trial198.stdout:(116/146): python3-cachetools-4.2.4-1.el9.noarc 154 kB/s | 32 kB 00:00 2026-02-23T10:16:35.792 INFO:teuthology.orchestra.run.trial198.stdout:(117/146): python3-cheroot-10.0.1-4.el9.noarch. 479 kB/s | 173 kB 00:00 2026-02-23T10:16:35.917 INFO:teuthology.orchestra.run.trial198.stdout:(118/146): python3-cherrypy-18.6.1-2.el9.noarch 811 kB/s | 358 kB 00:00 2026-02-23T10:16:36.238 INFO:teuthology.orchestra.run.trial198.stdout:(119/146): python3-google-auth-2.45.0-1.el9.noa 570 kB/s | 254 kB 00:00 2026-02-23T10:16:36.600 INFO:teuthology.orchestra.run.trial198.stdout:(120/146): python3-grpcio-tools-1.46.7-10.el9.x 399 kB/s | 144 kB 00:00 2026-02-23T10:16:36.617 INFO:teuthology.orchestra.run.trial198.stdout:(121/146): python3-grpcio-1.46.7-10.el9.x86_64. 2.9 MB/s | 2.0 MB 00:00 2026-02-23T10:16:36.746 INFO:teuthology.orchestra.run.trial198.stdout:(122/146): python3-jaraco-8.2.1-3.el9.noarch.rp 73 kB/s | 11 kB 00:00 2026-02-23T10:16:36.832 INFO:teuthology.orchestra.run.trial198.stdout:(123/146): python3-jaraco-classes-3.2.1-5.el9.n 82 kB/s | 18 kB 00:00 2026-02-23T10:16:36.963 INFO:teuthology.orchestra.run.trial198.stdout:(124/146): python3-jaraco-collections-3.0.0-8.e 106 kB/s | 23 kB 00:00 2026-02-23T10:16:37.042 INFO:teuthology.orchestra.run.trial198.stdout:(125/146): python3-jaraco-context-6.0.1-3.el9.n 93 kB/s | 20 kB 00:00 2026-02-23T10:16:37.178 INFO:teuthology.orchestra.run.trial198.stdout:(126/146): python3-jaraco-functools-3.5.0-2.el9 90 kB/s | 19 kB 00:00 2026-02-23T10:16:37.253 INFO:teuthology.orchestra.run.trial198.stdout:(127/146): python3-jaraco-text-4.0.0-2.el9.noar 125 kB/s | 26 kB 00:00 2026-02-23T10:16:37.535 INFO:teuthology.orchestra.run.trial198.stdout:(128/146): python3-more-itertools-8.12.0-2.el9. 280 kB/s | 79 kB 00:00 2026-02-23T10:16:37.750 INFO:teuthology.orchestra.run.trial198.stdout:(129/146): python3-kubernetes-26.1.0-3.el9.noar 1.8 MB/s | 1.0 MB 00:00 2026-02-23T10:16:37.824 INFO:teuthology.orchestra.run.trial198.stdout:(130/146): python3-natsort-7.1.1-5.el9.noarch.r 199 kB/s | 58 kB 00:00 2026-02-23T10:16:37.966 INFO:teuthology.orchestra.run.trial198.stdout:(131/146): python3-portend-3.1.0-2.el9.noarch.r 76 kB/s | 16 kB 00:00 2026-02-23T10:16:38.113 INFO:teuthology.orchestra.run.trial198.stdout:(132/146): python3-pyOpenSSL-21.0.0-1.el9.noarc 311 kB/s | 90 kB 00:00 2026-02-23T10:16:38.176 INFO:teuthology.orchestra.run.trial198.stdout:(133/146): python3-repoze-lru-0.7-16.el9.noarch 146 kB/s | 31 kB 00:00 2026-02-23T10:16:38.455 INFO:teuthology.orchestra.run.trial198.stdout:(134/146): python3-rsa-4.9-2.el9.noarch.rpm 212 kB/s | 59 kB 00:00 2026-02-23T10:16:38.465 INFO:teuthology.orchestra.run.trial198.stdout:(135/146): python3-routes-2.5.1-5.el9.noarch.rp 536 kB/s | 188 kB 00:00 2026-02-23T10:16:38.670 INFO:teuthology.orchestra.run.trial198.stdout:(136/146): python3-tempora-5.0.0-2.el9.noarch.r 166 kB/s | 36 kB 00:00 2026-02-23T10:16:38.746 INFO:teuthology.orchestra.run.trial198.stdout:(137/146): python3-typing-extensions-4.15.0-1.e 308 kB/s | 86 kB 00:00 2026-02-23T10:16:38.949 INFO:teuthology.orchestra.run.trial198.stdout:(138/146): python3-websocket-client-1.2.3-2.el9 322 kB/s | 90 kB 00:00 2026-02-23T10:16:38.956 INFO:teuthology.orchestra.run.trial198.stdout:(139/146): python3-xmltodict-0.12.0-15.el9.noar 105 kB/s | 22 kB 00:00 2026-02-23T10:16:39.161 INFO:teuthology.orchestra.run.trial198.stdout:(140/146): python3-zc-lockfile-2.0-10.el9.noarc 95 kB/s | 20 kB 00:00 2026-02-23T10:16:39.318 INFO:teuthology.orchestra.run.trial198.stdout:(141/146): re2-20211101-20.el9.x86_64.rpm 529 kB/s | 191 kB 00:00 2026-02-23T10:16:39.679 INFO:teuthology.orchestra.run.trial198.stdout:(142/146): yaml-cpp-0.6.3-5.el9.x86_64.rpm 337 kB/s | 122 kB 00:00 2026-02-23T10:16:39.810 INFO:teuthology.orchestra.run.trial198.stdout:(143/146): thrift-0.15.0-4.el9.x86_64.rpm 2.4 MB/s | 1.6 MB 00:00 2026-02-23T10:16:42.644 INFO:teuthology.orchestra.run.trial198.stdout:(144/146): librados2-20.3.0-5439.ge371433f.el9. 1.1 MB/s | 3.3 MB 00:02 2026-02-23T10:16:44.291 INFO:teuthology.orchestra.run.trial198.stdout:(145/146): librbd1-20.3.0-5439.ge371433f.el9.x8 615 kB/s | 2.7 MB 00:04 2026-02-23T10:17:55.466 INFO:teuthology.orchestra.run.trial198.stdout:(146/146): ceph-osd-crimson-debuginfo-20.3.0-54 2.6 MB/s | 429 MB 02:43 2026-02-23T10:17:55.469 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-23T10:17:55.469 INFO:teuthology.orchestra.run.trial198.stdout:Total 5.0 MB/s | 848 MB 02:49 2026-02-23T10:17:55.983 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-23T10:17:56.032 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-23T10:17:56.032 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-23T10:17:58.777 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-23T10:17:58.777 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-23T10:18:01.529 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-23T10:18:01.532 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/148 2026-02-23T10:18:01.543 INFO:teuthology.orchestra.run.trial198.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/148 2026-02-23T10:18:01.555 INFO:teuthology.orchestra.run.trial198.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/148 2026-02-23T10:18:01.703 INFO:teuthology.orchestra.run.trial198.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/148 2026-02-23T10:18:01.705 INFO:teuthology.orchestra.run.trial198.stdout: Upgrading : librados2-2:20.3.0-5439.ge371433f.el9.x86_64 5/148 2026-02-23T10:18:01.733 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librados2-2:20.3.0-5439.ge371433f.el9.x86_64 5/148 2026-02-23T10:18:01.741 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-rados-2:20.3.0-5439.ge371433f.el9.x86_64 6/148 2026-02-23T10:18:01.743 INFO:teuthology.orchestra.run.trial198.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/148 2026-02-23T10:18:01.746 INFO:teuthology.orchestra.run.trial198.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/148 2026-02-23T10:18:01.748 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/148 2026-02-23T10:18:01.754 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 10/148 2026-02-23T10:18:01.870 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 11/148 2026-02-23T10:18:01.871 INFO:teuthology.orchestra.run.trial198.stdout: Upgrading : librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 12/148 2026-02-23T10:18:01.888 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 12/148 2026-02-23T10:18:01.889 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libcephsqlite-2:20.3.0-5439.ge371433f.el9.x86_64 13/148 2026-02-23T10:18:01.910 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5439.ge371433f.el9.x86_64 13/148 2026-02-23T10:18:01.911 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libradosstriper1-2:20.3.0-5439.ge371433f.el9.x86 14/148 2026-02-23T10:18:01.923 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5439.ge371433f.el9.x86 14/148 2026-02-23T10:18:01.927 INFO:teuthology.orchestra.run.trial198.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 15/148 2026-02-23T10:18:01.957 INFO:teuthology.orchestra.run.trial198.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/148 2026-02-23T10:18:01.963 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 17/148 2026-02-23T10:18:01.966 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 18/148 2026-02-23T10:18:01.988 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 19/148 2026-02-23T10:18:01.994 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/148 2026-02-23T10:18:01.997 INFO:teuthology.orchestra.run.trial198.stdout: Installing : lua-5.4.4-4.el9.x86_64 21/148 2026-02-23T10:18:02.001 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 22/148 2026-02-23T10:18:02.002 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 23/148 2026-02-23T10:18:02.014 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 23/148 2026-02-23T10:18:02.019 INFO:teuthology.orchestra.run.trial198.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 24/148 2026-02-23T10:18:02.043 INFO:teuthology.orchestra.run.trial198.stdout: Installing : unzip-6.0-59.el9.x86_64 25/148 2026-02-23T10:18:02.056 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 26/148 2026-02-23T10:18:02.062 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 27/148 2026-02-23T10:18:02.066 INFO:teuthology.orchestra.run.trial198.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 28/148 2026-02-23T10:18:02.071 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 29/148 2026-02-23T10:18:02.073 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 30/148 2026-02-23T10:18:02.075 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 31/148 2026-02-23T10:18:02.085 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 32/148 2026-02-23T10:18:02.120 INFO:teuthology.orchestra.run.trial198.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 33/148 2026-02-23T10:18:02.124 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-ceph-common-2:20.3.0-5439.ge371433f.el9. 34/148 2026-02-23T10:18:02.126 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-ceph-argparse-2:20.3.0-5439.ge371433f.el 35/148 2026-02-23T10:18:02.126 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libcephfs-proxy2-2:20.3.0-5439.ge371433f.el9.x86 36/148 2026-02-23T10:18:02.172 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5439.ge371433f.el9.x86 36/148 2026-02-23T10:18:02.173 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 37/148 2026-02-23T10:18:02.194 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 37/148 2026-02-23T10:18:02.205 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cephfs-2:20.3.0-5439.ge371433f.el9.x86_6 38/148 2026-02-23T10:18:02.212 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 39/148 2026-02-23T10:18:02.236 INFO:teuthology.orchestra.run.trial198.stdout: Installing : zip-3.0-35.el9.x86_64 40/148 2026-02-23T10:18:02.239 INFO:teuthology.orchestra.run.trial198.stdout: Installing : luarocks-3.9.2-5.el9.noarch 41/148 2026-02-23T10:18:02.289 INFO:teuthology.orchestra.run.trial198.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/148 2026-02-23T10:18:02.302 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 43/148 2026-02-23T10:18:02.309 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-rsa-4.9-2.el9.noarch 44/148 2026-02-23T10:18:02.312 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 45/148 2026-02-23T10:18:02.329 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 46/148 2026-02-23T10:18:02.334 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-rbd-2:20.3.0-5439.ge371433f.el9.x86_64 47/148 2026-02-23T10:18:02.341 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/148 2026-02-23T10:18:02.348 INFO:teuthology.orchestra.run.trial198.stdout: Installing : librados-devel-2:20.3.0-5439.ge371433f.el9.x86_6 49/148 2026-02-23T10:18:02.360 INFO:teuthology.orchestra.run.trial198.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 50/148 2026-02-23T10:18:02.365 INFO:teuthology.orchestra.run.trial198.stdout: Installing : thrift-0.15.0-4.el9.x86_64 51/148 2026-02-23T10:18:02.368 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/148 2026-02-23T10:18:02.383 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 53/148 2026-02-23T10:18:02.387 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/148 2026-02-23T10:18:02.392 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 55/148 2026-02-23T10:18:02.404 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 56/148 2026-02-23T10:18:02.413 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 57/148 2026-02-23T10:18:02.417 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/148 2026-02-23T10:18:02.425 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 59/148 2026-02-23T10:18:02.464 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/148 2026-02-23T10:18:02.788 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 61/148 2026-02-23T10:18:02.798 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 62/148 2026-02-23T10:18:02.802 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 63/148 2026-02-23T10:18:02.807 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 64/148 2026-02-23T10:18:02.813 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 65/148 2026-02-23T10:18:02.817 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 66/148 2026-02-23T10:18:02.820 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 67/148 2026-02-23T10:18:02.826 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 68/148 2026-02-23T10:18:02.828 INFO:teuthology.orchestra.run.trial198.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 69/148 2026-02-23T10:18:02.830 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 70/148 2026-02-23T10:18:02.860 INFO:teuthology.orchestra.run.trial198.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 71/148 2026-02-23T10:18:02.903 INFO:teuthology.orchestra.run.trial198.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 72/148 2026-02-23T10:18:02.912 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 73/148 2026-02-23T10:18:02.959 INFO:teuthology.orchestra.run.trial198.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 74/148 2026-02-23T10:18:02.988 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-py-1.10.0-6.el9.noarch 75/148 2026-02-23T10:18:03.000 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 76/148 2026-02-23T10:18:03.007 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 77/148 2026-02-23T10:18:03.014 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pluggy-0.13.1-7.el9.noarch 78/148 2026-02-23T10:18:03.021 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 79/148 2026-02-23T10:18:03.025 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 80/148 2026-02-23T10:18:03.060 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-iniconfig-1.1.1-7.el9.noarch 81/148 2026-02-23T10:18:03.283 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 82/148 2026-02-23T10:18:03.307 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 83/148 2026-02-23T10:18:03.311 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 84/148 2026-02-23T10:18:03.370 INFO:teuthology.orchestra.run.trial198.stdout: Installing : openblas-0.3.29-1.el9.x86_64 85/148 2026-02-23T10:18:03.372 INFO:teuthology.orchestra.run.trial198.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 86/148 2026-02-23T10:18:03.393 INFO:teuthology.orchestra.run.trial198.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 87/148 2026-02-23T10:18:03.719 INFO:teuthology.orchestra.run.trial198.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 88/148 2026-02-23T10:18:03.792 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 89/148 2026-02-23T10:18:04.466 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 90/148 2026-02-23T10:18:04.483 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 91/148 2026-02-23T10:18:04.487 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 92/148 2026-02-23T10:18:04.489 INFO:teuthology.orchestra.run.trial198.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 93/148 2026-02-23T10:18:04.495 INFO:teuthology.orchestra.run.trial198.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 94/148 2026-02-23T10:18:04.752 INFO:teuthology.orchestra.run.trial198.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 95/148 2026-02-23T10:18:04.753 INFO:teuthology.orchestra.run.trial198.stdout: Installing : librgw2-2:20.3.0-5439.ge371433f.el9.x86_64 96/148 2026-02-23T10:18:04.771 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librgw2-2:20.3.0-5439.ge371433f.el9.x86_64 96/148 2026-02-23T10:18:04.773 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-rgw-2:20.3.0-5439.ge371433f.el9.x86_64 97/148 2026-02-23T10:18:05.736 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 98/148 2026-02-23T10:18:05.739 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 98/148 2026-02-23T10:18:05.755 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 98/148 2026-02-23T10:18:05.765 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 99/148 2026-02-23T10:18:05.772 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-packaging-20.9-5.el9.noarch 100/148 2026-02-23T10:18:05.786 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-ply-3.11-14.el9.noarch 101/148 2026-02-23T10:18:05.801 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 102/148 2026-02-23T10:18:05.877 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 103/148 2026-02-23T10:18:05.886 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 104/148 2026-02-23T10:18:05.909 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 105/148 2026-02-23T10:18:05.939 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 106/148 2026-02-23T10:18:05.989 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 107/148 2026-02-23T10:18:05.995 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 108/148 2026-02-23T10:18:05.999 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 109/148 2026-02-23T10:18:06.003 INFO:teuthology.orchestra.run.trial198.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 110/148 2026-02-23T10:18:06.005 INFO:teuthology.orchestra.run.trial198.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 111/148 2026-02-23T10:18:06.006 INFO:teuthology.orchestra.run.trial198.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 112/148 2026-02-23T10:18:06.023 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 112/148 2026-02-23T10:18:06.281 INFO:teuthology.orchestra.run.trial198.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 113/148 2026-02-23T10:18:06.284 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 114/148 2026-02-23T10:18:06.323 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 114/148 2026-02-23T10:18:06.323 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-23T10:18:06.323 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-23T10:18:06.323 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:18:06.328 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-selinux-2:20.3.0-5439.ge371433f.el9.x86_64 115/148 2026-02-23T10:18:10.999 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5439.ge371433f.el9.x86_64 115/148 2026-02-23T10:18:10.999 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /sys 2026-02-23T10:18:10.999 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /proc 2026-02-23T10:18:10.999 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /mnt 2026-02-23T10:18:11.000 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /var/tmp 2026-02-23T10:18:11.000 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /home 2026-02-23T10:18:11.000 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /root 2026-02-23T10:18:11.000 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /tmp 2026-02-23T10:18:11.000 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:18:11.092 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mds-2:20.3.0-5439.ge371433f.el9.x86_64 116/148 2026-02-23T10:18:11.114 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mds-2:20.3.0-5439.ge371433f.el9.x86_64 116/148 2026-02-23T10:18:11.114 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T10:18:11.114 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-23T10:18:11.114 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-23T10:18:11.115 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-23T10:18:11.115 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:18:11.327 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mon-2:20.3.0-5439.ge371433f.el9.x86_64 117/148 2026-02-23T10:18:11.347 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mon-2:20.3.0-5439.ge371433f.el9.x86_64 117/148 2026-02-23T10:18:11.348 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T10:18:11.348 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-23T10:18:11.348 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-23T10:18:11.348 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-23T10:18:11.348 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:18:11.354 INFO:teuthology.orchestra.run.trial198.stdout: Installing : mailcap-2.1.49-5.el9.noarch 118/148 2026-02-23T10:18:11.355 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 119/148 2026-02-23T10:18:11.373 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 120/148 2026-02-23T10:18:11.373 INFO:teuthology.orchestra.run.trial198.stdout:Creating group 'qat' with GID 992. 2026-02-23T10:18:11.373 INFO:teuthology.orchestra.run.trial198.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-23T10:18:11.373 INFO:teuthology.orchestra.run.trial198.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-23T10:18:11.373 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:18:11.380 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 120/148 2026-02-23T10:18:11.403 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 120/148 2026-02-23T10:18:11.404 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-23T10:18:11.404 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:18:11.438 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 121/148 2026-02-23T10:18:12.044 INFO:teuthology.orchestra.run.trial198.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 122/148 2026-02-23T10:18:17.439 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86 123/148 2026-02-23T10:18:17.503 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86 124/148 2026-02-23T10:18:17.505 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch 125/148 2026-02-23T10:18:17.518 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch 125/148 2026-02-23T10:18:17.518 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T10:18:17.518 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-23T10:18:17.518 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:18:17.529 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 126/148 2026-02-23T10:18:17.551 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 126/148 2026-02-23T10:18:17.552 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T10:18:17.552 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-23T10:18:17.552 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-23T10:18:17.552 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-23T10:18:17.552 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:18:17.607 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: cephadm-2:20.3.0-5439.ge371433f.el9.noarch 127/148 2026-02-23T10:18:17.609 INFO:teuthology.orchestra.run.trial198.stdout: Installing : cephadm-2:20.3.0-5439.ge371433f.el9.noarch 127/148 2026-02-23T10:18:17.618 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5439.ge371433f.e 128/148 2026-02-23T10:18:17.642 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5439.ge371433f. 129/148 2026-02-23T10:18:17.643 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noa 130/148 2026-02-23T10:18:20.584 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noa 130/148 2026-02-23T10:18:20.591 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.n 131/148 2026-02-23T10:18:21.052 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.n 131/148 2026-02-23T10:18:21.052 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5439.ge37 132/148 2026-02-23T10:18:21.115 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5439.ge37 132/148 2026-02-23T10:18:21.156 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5439.ge371433f.el 133/148 2026-02-23T10:18:21.158 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 134/148 2026-02-23T10:18:21.178 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 134/148 2026-02-23T10:18:21.178 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T10:18:21.178 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-23T10:18:21.178 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-23T10:18:21.178 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-23T10:18:21.178 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:18:21.189 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch 135/148 2026-02-23T10:18:21.197 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch 135/148 2026-02-23T10:18:21.687 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-2:20.3.0-5439.ge371433f.el9.x86_64 136/148 2026-02-23T10:18:21.689 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 137/148 2026-02-23T10:18:21.709 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 137/148 2026-02-23T10:18:21.709 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T10:18:21.709 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-23T10:18:21.709 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-23T10:18:21.709 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-23T10:18:21.709 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:18:21.718 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5439.ge3714 138/148 2026-02-23T10:18:21.737 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5439.ge3714 138/148 2026-02-23T10:18:21.737 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T10:18:21.737 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-23T10:18:21.737 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:18:21.852 INFO:teuthology.orchestra.run.trial198.stdout: Installing : rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 139/148 2026-02-23T10:18:21.873 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 139/148 2026-02-23T10:18:21.873 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T10:18:21.873 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-23T10:18:21.873 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-23T10:18:21.874 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-23T10:18:21.874 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:18:28.925 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pytest-6.2.2-7.el9.noarch 140/148 2026-02-23T10:18:28.932 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-test-2:20.3.0-5439.ge371433f.el9.x86_64 141/148 2026-02-23T10:18:28.937 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libcephfs-devel-2:20.3.0-5439.ge371433f.el9.x86_ 142/148 2026-02-23T10:18:28.946 INFO:teuthology.orchestra.run.trial198.stdout: Installing : rbd-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 143/148 2026-02-23T10:18:28.988 INFO:teuthology.orchestra.run.trial198.stdout: Installing : rbd-nbd-2:20.3.0-5439.ge371433f.el9.x86_64 144/148 2026-02-23T10:18:51.789 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 145/148 2026-02-23T10:18:51.792 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5439.ge37143 146/148 2026-02-23T10:18:51.792 INFO:teuthology.orchestra.run.trial198.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 147/148 2026-02-23T10:18:51.806 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 147/148 2026-02-23T10:18:51.806 INFO:teuthology.orchestra.run.trial198.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 148/148 2026-02-23T10:18:51.817 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 148/148 2026-02-23T10:18:51.824 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86 148/148 2026-02-23T10:18:51.846 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86 148/148 2026-02-23T10:18:55.476 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 148/148 2026-02-23T10:18:55.476 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-2:20.3.0-5439.ge371433f.el9.x86_64 1/148 2026-02-23T10:18:55.476 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 2/148 2026-02-23T10:18:55.476 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 3/148 2026-02-23T10:18:55.476 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 4/148 2026-02-23T10:18:55.476 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5439.ge3714 5/148 2026-02-23T10:18:55.476 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mds-2:20.3.0-5439.ge371433f.el9.x86_64 6/148 2026-02-23T10:18:55.476 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 7/148 2026-02-23T10:18:55.476 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mon-2:20.3.0-5439.ge371433f.el9.x86_64 8/148 2026-02-23T10:18:55.477 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 9/148 2026-02-23T10:18:55.477 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86 10/148 2026-02-23T10:18:55.477 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86 11/148 2026-02-23T10:18:55.477 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5439.ge37143 12/148 2026-02-23T10:18:55.477 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 13/148 2026-02-23T10:18:55.477 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-selinux-2:20.3.0-5439.ge371433f.el9.x86_64 14/148 2026-02-23T10:18:55.477 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-test-2:20.3.0-5439.ge371433f.el9.x86_64 15/148 2026-02-23T10:18:55.477 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libcephfs-devel-2:20.3.0-5439.ge371433f.el9.x86_ 16/148 2026-02-23T10:18:55.477 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5439.ge371433f.el9.x86 17/148 2026-02-23T10:18:55.477 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 18/148 2026-02-23T10:18:55.477 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libcephsqlite-2:20.3.0-5439.ge371433f.el9.x86_64 19/148 2026-02-23T10:18:55.477 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librados-devel-2:20.3.0-5439.ge371433f.el9.x86_6 20/148 2026-02-23T10:18:55.478 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libradosstriper1-2:20.3.0-5439.ge371433f.el9.x86 21/148 2026-02-23T10:18:55.478 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librgw2-2:20.3.0-5439.ge371433f.el9.x86_64 22/148 2026-02-23T10:18:55.478 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5439.ge371433f.el 23/148 2026-02-23T10:18:55.478 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-ceph-common-2:20.3.0-5439.ge371433f.el9. 24/148 2026-02-23T10:18:55.478 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cephfs-2:20.3.0-5439.ge371433f.el9.x86_6 25/148 2026-02-23T10:18:55.478 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-rados-2:20.3.0-5439.ge371433f.el9.x86_64 26/148 2026-02-23T10:18:55.478 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-rbd-2:20.3.0-5439.ge371433f.el9.x86_64 27/148 2026-02-23T10:18:55.478 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-rgw-2:20.3.0-5439.ge371433f.el9.x86_64 28/148 2026-02-23T10:18:55.478 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : rbd-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 29/148 2026-02-23T10:18:55.478 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 30/148 2026-02-23T10:18:55.478 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : rbd-nbd-2:20.3.0-5439.ge371433f.el9.x86_64 31/148 2026-02-23T10:18:55.478 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5439.ge371433f. 32/148 2026-02-23T10:18:55.479 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noa 33/148 2026-02-23T10:18:55.479 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.n 34/148 2026-02-23T10:18:55.479 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5439.ge37 35/148 2026-02-23T10:18:55.479 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5439.ge371433f.el 36/148 2026-02-23T10:18:55.479 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch 37/148 2026-02-23T10:18:55.479 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5439.ge371433f.e 38/148 2026-02-23T10:18:55.479 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch 39/148 2026-02-23T10:18:55.479 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : cephadm-2:20.3.0-5439.ge371433f.el9.noarch 40/148 2026-02-23T10:18:55.479 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 41/148 2026-02-23T10:18:55.479 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 42/148 2026-02-23T10:18:55.479 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 43/148 2026-02-23T10:18:55.480 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 44/148 2026-02-23T10:18:55.480 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 45/148 2026-02-23T10:18:55.480 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 46/148 2026-02-23T10:18:55.480 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 47/148 2026-02-23T10:18:55.480 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 48/148 2026-02-23T10:18:55.480 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 49/148 2026-02-23T10:18:55.480 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 50/148 2026-02-23T10:18:55.480 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 51/148 2026-02-23T10:18:55.480 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 52/148 2026-02-23T10:18:55.480 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-ply-3.11-14.el9.noarch 53/148 2026-02-23T10:18:55.480 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 54/148 2026-02-23T10:18:55.480 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 55/148 2026-02-23T10:18:55.481 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 56/148 2026-02-23T10:18:55.481 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 57/148 2026-02-23T10:18:55.481 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : unzip-6.0-59.el9.x86_64 58/148 2026-02-23T10:18:55.481 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : zip-3.0-35.el9.x86_64 59/148 2026-02-23T10:18:55.481 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 60/148 2026-02-23T10:18:55.481 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 61/148 2026-02-23T10:18:55.481 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 62/148 2026-02-23T10:18:55.481 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 63/148 2026-02-23T10:18:55.481 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 64/148 2026-02-23T10:18:55.481 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 65/148 2026-02-23T10:18:55.481 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 66/148 2026-02-23T10:18:55.481 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 67/148 2026-02-23T10:18:55.481 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 68/148 2026-02-23T10:18:55.482 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 69/148 2026-02-23T10:18:55.482 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 70/148 2026-02-23T10:18:55.482 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 71/148 2026-02-23T10:18:55.482 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 72/148 2026-02-23T10:18:55.482 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : lua-5.4.4-4.el9.x86_64 73/148 2026-02-23T10:18:55.482 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 74/148 2026-02-23T10:18:55.482 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 75/148 2026-02-23T10:18:55.482 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 76/148 2026-02-23T10:18:55.482 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/148 2026-02-23T10:18:55.482 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 78/148 2026-02-23T10:18:55.482 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-iniconfig-1.1.1-7.el9.noarch 79/148 2026-02-23T10:18:55.482 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 80/148 2026-02-23T10:18:55.482 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 81/148 2026-02-23T10:18:55.483 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 82/148 2026-02-23T10:18:55.483 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/148 2026-02-23T10:18:55.483 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 84/148 2026-02-23T10:18:55.483 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 85/148 2026-02-23T10:18:55.483 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/148 2026-02-23T10:18:55.483 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pluggy-0.13.1-7.el9.noarch 87/148 2026-02-23T10:18:55.483 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 88/148 2026-02-23T10:18:55.483 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-py-1.10.0-6.el9.noarch 89/148 2026-02-23T10:18:55.483 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/148 2026-02-23T10:18:55.483 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/148 2026-02-23T10:18:55.483 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pytest-6.2.2-7.el9.noarch 92/148 2026-02-23T10:18:55.483 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/148 2026-02-23T10:18:55.483 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 94/148 2026-02-23T10:18:55.483 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/148 2026-02-23T10:18:55.484 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 96/148 2026-02-23T10:18:55.484 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 97/148 2026-02-23T10:18:55.484 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 98/148 2026-02-23T10:18:55.484 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 99/148 2026-02-23T10:18:55.484 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 100/148 2026-02-23T10:18:55.484 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 101/148 2026-02-23T10:18:55.484 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 102/148 2026-02-23T10:18:55.484 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 103/148 2026-02-23T10:18:55.484 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 104/148 2026-02-23T10:18:55.484 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 105/148 2026-02-23T10:18:55.484 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 106/148 2026-02-23T10:18:55.485 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 107/148 2026-02-23T10:18:55.485 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 108/148 2026-02-23T10:18:55.485 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 109/148 2026-02-23T10:18:55.485 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 110/148 2026-02-23T10:18:55.485 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 111/148 2026-02-23T10:18:55.485 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 112/148 2026-02-23T10:18:55.485 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 113/148 2026-02-23T10:18:55.485 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 114/148 2026-02-23T10:18:55.485 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/148 2026-02-23T10:18:55.485 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/148 2026-02-23T10:18:55.485 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 117/148 2026-02-23T10:18:55.485 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 118/148 2026-02-23T10:18:55.485 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/148 2026-02-23T10:18:55.486 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 120/148 2026-02-23T10:18:55.486 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 121/148 2026-02-23T10:18:55.486 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 122/148 2026-02-23T10:18:55.486 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 123/148 2026-02-23T10:18:55.486 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 124/148 2026-02-23T10:18:55.486 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 125/148 2026-02-23T10:18:55.486 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 126/148 2026-02-23T10:18:55.486 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 127/148 2026-02-23T10:18:55.486 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 128/148 2026-02-23T10:18:55.486 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 129/148 2026-02-23T10:18:55.486 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 130/148 2026-02-23T10:18:55.486 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 131/148 2026-02-23T10:18:55.486 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 132/148 2026-02-23T10:18:55.487 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 133/148 2026-02-23T10:18:55.487 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 134/148 2026-02-23T10:18:55.487 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 135/148 2026-02-23T10:18:55.487 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 136/148 2026-02-23T10:18:55.487 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 137/148 2026-02-23T10:18:55.487 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 138/148 2026-02-23T10:18:55.487 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 139/148 2026-02-23T10:18:55.487 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 140/148 2026-02-23T10:18:55.487 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 141/148 2026-02-23T10:18:55.487 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : re2-1:20211101-20.el9.x86_64 142/148 2026-02-23T10:18:55.487 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 143/148 2026-02-23T10:18:55.487 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 144/148 2026-02-23T10:18:55.487 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librados2-2:20.3.0-5439.ge371433f.el9.x86_64 145/148 2026-02-23T10:18:55.487 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 146/148 2026-02-23T10:18:55.487 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 147/148 2026-02-23T10:18:55.541 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 148/148 2026-02-23T10:18:55.541 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:18:55.541 INFO:teuthology.orchestra.run.trial198.stdout:Upgraded: 2026-02-23T10:18:55.541 INFO:teuthology.orchestra.run.trial198.stdout: librados2-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.541 INFO:teuthology.orchestra.run.trial198.stdout: librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.541 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-23T10:18:55.541 INFO:teuthology.orchestra.run.trial198.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-23T10:18:55.542 INFO:teuthology.orchestra.run.trial198.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-23T10:18:55.542 INFO:teuthology.orchestra.run.trial198.stdout: ceph-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.542 INFO:teuthology.orchestra.run.trial198.stdout: ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.542 INFO:teuthology.orchestra.run.trial198.stdout: ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.542 INFO:teuthology.orchestra.run.trial198.stdout: ceph-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.542 INFO:teuthology.orchestra.run.trial198.stdout: ceph-grafana-dashboards-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:18:55.542 INFO:teuthology.orchestra.run.trial198.stdout: ceph-immutable-object-cache-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.542 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mds-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.542 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.542 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:18:55.542 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:18:55.543 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:18:55.543 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-modules-core-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:18:55.543 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:18:55.543 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mon-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.543 INFO:teuthology.orchestra.run.trial198.stdout: ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.543 INFO:teuthology.orchestra.run.trial198.stdout: ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.543 INFO:teuthology.orchestra.run.trial198.stdout: ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.543 INFO:teuthology.orchestra.run.trial198.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.543 INFO:teuthology.orchestra.run.trial198.stdout: ceph-prometheus-alerts-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:18:55.543 INFO:teuthology.orchestra.run.trial198.stdout: ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.543 INFO:teuthology.orchestra.run.trial198.stdout: ceph-selinux-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.544 INFO:teuthology.orchestra.run.trial198.stdout: ceph-test-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.544 INFO:teuthology.orchestra.run.trial198.stdout: ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:18:55.544 INFO:teuthology.orchestra.run.trial198.stdout: cephadm-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:18:55.544 INFO:teuthology.orchestra.run.trial198.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-23T10:18:55.544 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-23T10:18:55.544 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-23T10:18:55.544 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-23T10:18:55.544 INFO:teuthology.orchestra.run.trial198.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-23T10:18:55.544 INFO:teuthology.orchestra.run.trial198.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-23T10:18:55.544 INFO:teuthology.orchestra.run.trial198.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-23T10:18:55.544 INFO:teuthology.orchestra.run.trial198.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-23T10:18:55.544 INFO:teuthology.orchestra.run.trial198.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-23T10:18:55.545 INFO:teuthology.orchestra.run.trial198.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-23T10:18:55.545 INFO:teuthology.orchestra.run.trial198.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-23T10:18:55.545 INFO:teuthology.orchestra.run.trial198.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-23T10:18:55.545 INFO:teuthology.orchestra.run.trial198.stdout: libcephfs-devel-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.545 INFO:teuthology.orchestra.run.trial198.stdout: libcephfs-proxy2-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.545 INFO:teuthology.orchestra.run.trial198.stdout: libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.545 INFO:teuthology.orchestra.run.trial198.stdout: libcephsqlite-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.545 INFO:teuthology.orchestra.run.trial198.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-23T10:18:55.545 INFO:teuthology.orchestra.run.trial198.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-23T10:18:55.545 INFO:teuthology.orchestra.run.trial198.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-23T10:18:55.545 INFO:teuthology.orchestra.run.trial198.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-23T10:18:55.545 INFO:teuthology.orchestra.run.trial198.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-23T10:18:55.545 INFO:teuthology.orchestra.run.trial198.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-23T10:18:55.546 INFO:teuthology.orchestra.run.trial198.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-23T10:18:55.546 INFO:teuthology.orchestra.run.trial198.stdout: librados-devel-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.546 INFO:teuthology.orchestra.run.trial198.stdout: libradosstriper1-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.546 INFO:teuthology.orchestra.run.trial198.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-23T10:18:55.546 INFO:teuthology.orchestra.run.trial198.stdout: librgw2-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.546 INFO:teuthology.orchestra.run.trial198.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-23T10:18:55.546 INFO:teuthology.orchestra.run.trial198.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-23T10:18:55.546 INFO:teuthology.orchestra.run.trial198.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-23T10:18:55.546 INFO:teuthology.orchestra.run.trial198.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-23T10:18:55.546 INFO:teuthology.orchestra.run.trial198.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-23T10:18:55.546 INFO:teuthology.orchestra.run.trial198.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-23T10:18:55.546 INFO:teuthology.orchestra.run.trial198.stdout: lua-5.4.4-4.el9.x86_64 2026-02-23T10:18:55.547 INFO:teuthology.orchestra.run.trial198.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-23T10:18:55.547 INFO:teuthology.orchestra.run.trial198.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-23T10:18:55.547 INFO:teuthology.orchestra.run.trial198.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-23T10:18:55.547 INFO:teuthology.orchestra.run.trial198.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-23T10:18:55.547 INFO:teuthology.orchestra.run.trial198.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-23T10:18:55.547 INFO:teuthology.orchestra.run.trial198.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-23T10:18:55.547 INFO:teuthology.orchestra.run.trial198.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-23T10:18:55.547 INFO:teuthology.orchestra.run.trial198.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-23T10:18:55.547 INFO:teuthology.orchestra.run.trial198.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-23T10:18:55.547 INFO:teuthology.orchestra.run.trial198.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-23T10:18:55.547 INFO:teuthology.orchestra.run.trial198.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-23T10:18:55.547 INFO:teuthology.orchestra.run.trial198.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-23T10:18:55.547 INFO:teuthology.orchestra.run.trial198.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-23T10:18:55.548 INFO:teuthology.orchestra.run.trial198.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-23T10:18:55.548 INFO:teuthology.orchestra.run.trial198.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-23T10:18:55.548 INFO:teuthology.orchestra.run.trial198.stdout: python3-ceph-argparse-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.548 INFO:teuthology.orchestra.run.trial198.stdout: python3-ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.548 INFO:teuthology.orchestra.run.trial198.stdout: python3-cephfs-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.548 INFO:teuthology.orchestra.run.trial198.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-23T10:18:55.548 INFO:teuthology.orchestra.run.trial198.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-23T10:18:55.548 INFO:teuthology.orchestra.run.trial198.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-23T10:18:55.548 INFO:teuthology.orchestra.run.trial198.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-23T10:18:55.548 INFO:teuthology.orchestra.run.trial198.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-23T10:18:55.548 INFO:teuthology.orchestra.run.trial198.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-23T10:18:55.548 INFO:teuthology.orchestra.run.trial198.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-23T10:18:55.548 INFO:teuthology.orchestra.run.trial198.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-23T10:18:55.549 INFO:teuthology.orchestra.run.trial198.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-23T10:18:55.549 INFO:teuthology.orchestra.run.trial198.stdout: python3-iniconfig-1.1.1-7.el9.noarch 2026-02-23T10:18:55.549 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-23T10:18:55.549 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-23T10:18:55.549 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-23T10:18:55.549 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-23T10:18:55.549 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-23T10:18:55.549 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-23T10:18:55.549 INFO:teuthology.orchestra.run.trial198.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-23T10:18:55.549 INFO:teuthology.orchestra.run.trial198.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-23T10:18:55.549 INFO:teuthology.orchestra.run.trial198.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-23T10:18:55.549 INFO:teuthology.orchestra.run.trial198.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-23T10:18:55.550 INFO:teuthology.orchestra.run.trial198.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-23T10:18:55.550 INFO:teuthology.orchestra.run.trial198.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-23T10:18:55.550 INFO:teuthology.orchestra.run.trial198.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-23T10:18:55.550 INFO:teuthology.orchestra.run.trial198.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-23T10:18:55.550 INFO:teuthology.orchestra.run.trial198.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-23T10:18:55.550 INFO:teuthology.orchestra.run.trial198.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-23T10:18:55.550 INFO:teuthology.orchestra.run.trial198.stdout: python3-pluggy-0.13.1-7.el9.noarch 2026-02-23T10:18:55.550 INFO:teuthology.orchestra.run.trial198.stdout: python3-ply-3.11-14.el9.noarch 2026-02-23T10:18:55.550 INFO:teuthology.orchestra.run.trial198.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-23T10:18:55.550 INFO:teuthology.orchestra.run.trial198.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-23T10:18:55.550 INFO:teuthology.orchestra.run.trial198.stdout: python3-py-1.10.0-6.el9.noarch 2026-02-23T10:18:55.550 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-23T10:18:55.551 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-23T10:18:55.551 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-23T10:18:55.551 INFO:teuthology.orchestra.run.trial198.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-23T10:18:55.551 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-23T10:18:55.551 INFO:teuthology.orchestra.run.trial198.stdout: python3-pytest-6.2.2-7.el9.noarch 2026-02-23T10:18:55.551 INFO:teuthology.orchestra.run.trial198.stdout: python3-rados-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.551 INFO:teuthology.orchestra.run.trial198.stdout: python3-rbd-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.551 INFO:teuthology.orchestra.run.trial198.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-23T10:18:55.551 INFO:teuthology.orchestra.run.trial198.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-23T10:18:55.551 INFO:teuthology.orchestra.run.trial198.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-23T10:18:55.551 INFO:teuthology.orchestra.run.trial198.stdout: python3-rgw-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.551 INFO:teuthology.orchestra.run.trial198.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-23T10:18:55.551 INFO:teuthology.orchestra.run.trial198.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-23T10:18:55.552 INFO:teuthology.orchestra.run.trial198.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-23T10:18:55.552 INFO:teuthology.orchestra.run.trial198.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-23T10:18:55.552 INFO:teuthology.orchestra.run.trial198.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-23T10:18:55.552 INFO:teuthology.orchestra.run.trial198.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-23T10:18:55.552 INFO:teuthology.orchestra.run.trial198.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-23T10:18:55.552 INFO:teuthology.orchestra.run.trial198.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-23T10:18:55.552 INFO:teuthology.orchestra.run.trial198.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-23T10:18:55.552 INFO:teuthology.orchestra.run.trial198.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-23T10:18:55.552 INFO:teuthology.orchestra.run.trial198.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-23T10:18:55.552 INFO:teuthology.orchestra.run.trial198.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-23T10:18:55.552 INFO:teuthology.orchestra.run.trial198.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-23T10:18:55.552 INFO:teuthology.orchestra.run.trial198.stdout: rbd-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.552 INFO:teuthology.orchestra.run.trial198.stdout: rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.553 INFO:teuthology.orchestra.run.trial198.stdout: rbd-nbd-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:18:55.553 INFO:teuthology.orchestra.run.trial198.stdout: re2-1:20211101-20.el9.x86_64 2026-02-23T10:18:55.553 INFO:teuthology.orchestra.run.trial198.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-23T10:18:55.553 INFO:teuthology.orchestra.run.trial198.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-23T10:18:55.553 INFO:teuthology.orchestra.run.trial198.stdout: unzip-6.0-59.el9.x86_64 2026-02-23T10:18:55.553 INFO:teuthology.orchestra.run.trial198.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-23T10:18:55.553 INFO:teuthology.orchestra.run.trial198.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-23T10:18:55.553 INFO:teuthology.orchestra.run.trial198.stdout: zip-3.0-35.el9.x86_64 2026-02-23T10:18:55.553 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:18:55.553 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-23T10:18:55.688 DEBUG:teuthology.parallel:result is None 2026-02-23T10:19:32.383 INFO:teuthology.orchestra.run.trial044.stdout:(146/146): ceph-osd-crimson-debuginfo-20.3.0-54 1.7 MB/s | 429 MB 04:19 2026-02-23T10:19:32.386 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-23T10:19:32.386 INFO:teuthology.orchestra.run.trial044.stdout:Total 3.2 MB/s | 848 MB 04:23 2026-02-23T10:19:32.901 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-23T10:19:32.948 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-23T10:19:32.949 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-23T10:19:35.613 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-23T10:19:35.613 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-23T10:19:38.354 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-23T10:19:38.357 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/148 2026-02-23T10:19:38.366 INFO:teuthology.orchestra.run.trial044.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/148 2026-02-23T10:19:38.378 INFO:teuthology.orchestra.run.trial044.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/148 2026-02-23T10:19:38.524 INFO:teuthology.orchestra.run.trial044.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/148 2026-02-23T10:19:38.525 INFO:teuthology.orchestra.run.trial044.stdout: Upgrading : librados2-2:20.3.0-5439.ge371433f.el9.x86_64 5/148 2026-02-23T10:19:38.552 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: librados2-2:20.3.0-5439.ge371433f.el9.x86_64 5/148 2026-02-23T10:19:38.560 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-rados-2:20.3.0-5439.ge371433f.el9.x86_64 6/148 2026-02-23T10:19:38.562 INFO:teuthology.orchestra.run.trial044.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/148 2026-02-23T10:19:38.565 INFO:teuthology.orchestra.run.trial044.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/148 2026-02-23T10:19:38.567 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/148 2026-02-23T10:19:38.572 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 10/148 2026-02-23T10:19:38.687 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 11/148 2026-02-23T10:19:38.688 INFO:teuthology.orchestra.run.trial044.stdout: Upgrading : librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 12/148 2026-02-23T10:19:38.704 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 12/148 2026-02-23T10:19:38.705 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libcephsqlite-2:20.3.0-5439.ge371433f.el9.x86_64 13/148 2026-02-23T10:19:38.727 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5439.ge371433f.el9.x86_64 13/148 2026-02-23T10:19:38.728 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libradosstriper1-2:20.3.0-5439.ge371433f.el9.x86 14/148 2026-02-23T10:19:38.740 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5439.ge371433f.el9.x86 14/148 2026-02-23T10:19:38.743 INFO:teuthology.orchestra.run.trial044.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 15/148 2026-02-23T10:19:38.773 INFO:teuthology.orchestra.run.trial044.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/148 2026-02-23T10:19:38.779 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 17/148 2026-02-23T10:19:38.783 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 18/148 2026-02-23T10:19:38.804 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 19/148 2026-02-23T10:19:38.810 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/148 2026-02-23T10:19:38.812 INFO:teuthology.orchestra.run.trial044.stdout: Installing : lua-5.4.4-4.el9.x86_64 21/148 2026-02-23T10:19:38.817 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 22/148 2026-02-23T10:19:38.818 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 23/148 2026-02-23T10:19:38.830 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 23/148 2026-02-23T10:19:38.835 INFO:teuthology.orchestra.run.trial044.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 24/148 2026-02-23T10:19:38.860 INFO:teuthology.orchestra.run.trial044.stdout: Installing : unzip-6.0-59.el9.x86_64 25/148 2026-02-23T10:19:38.873 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 26/148 2026-02-23T10:19:38.879 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 27/148 2026-02-23T10:19:38.883 INFO:teuthology.orchestra.run.trial044.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 28/148 2026-02-23T10:19:38.888 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 29/148 2026-02-23T10:19:38.890 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 30/148 2026-02-23T10:19:38.892 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 31/148 2026-02-23T10:19:38.902 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 32/148 2026-02-23T10:19:38.936 INFO:teuthology.orchestra.run.trial044.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 33/148 2026-02-23T10:19:38.940 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-ceph-common-2:20.3.0-5439.ge371433f.el9. 34/148 2026-02-23T10:19:38.942 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-ceph-argparse-2:20.3.0-5439.ge371433f.el 35/148 2026-02-23T10:19:38.943 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libcephfs-proxy2-2:20.3.0-5439.ge371433f.el9.x86 36/148 2026-02-23T10:19:38.989 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5439.ge371433f.el9.x86 36/148 2026-02-23T10:19:38.989 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 37/148 2026-02-23T10:19:39.010 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 37/148 2026-02-23T10:19:39.021 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-cephfs-2:20.3.0-5439.ge371433f.el9.x86_6 38/148 2026-02-23T10:19:39.028 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 39/148 2026-02-23T10:19:39.052 INFO:teuthology.orchestra.run.trial044.stdout: Installing : zip-3.0-35.el9.x86_64 40/148 2026-02-23T10:19:39.055 INFO:teuthology.orchestra.run.trial044.stdout: Installing : luarocks-3.9.2-5.el9.noarch 41/148 2026-02-23T10:19:39.105 INFO:teuthology.orchestra.run.trial044.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/148 2026-02-23T10:19:39.118 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 43/148 2026-02-23T10:19:39.125 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-rsa-4.9-2.el9.noarch 44/148 2026-02-23T10:19:39.128 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 45/148 2026-02-23T10:19:39.145 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 46/148 2026-02-23T10:19:39.150 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-rbd-2:20.3.0-5439.ge371433f.el9.x86_64 47/148 2026-02-23T10:19:39.157 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/148 2026-02-23T10:19:39.166 INFO:teuthology.orchestra.run.trial044.stdout: Installing : librados-devel-2:20.3.0-5439.ge371433f.el9.x86_6 49/148 2026-02-23T10:19:39.178 INFO:teuthology.orchestra.run.trial044.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 50/148 2026-02-23T10:19:39.183 INFO:teuthology.orchestra.run.trial044.stdout: Installing : thrift-0.15.0-4.el9.x86_64 51/148 2026-02-23T10:19:39.186 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/148 2026-02-23T10:19:39.200 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 53/148 2026-02-23T10:19:39.204 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/148 2026-02-23T10:19:39.209 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 55/148 2026-02-23T10:19:39.221 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 56/148 2026-02-23T10:19:39.230 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 57/148 2026-02-23T10:19:39.234 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/148 2026-02-23T10:19:39.242 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 59/148 2026-02-23T10:19:39.282 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/148 2026-02-23T10:19:39.605 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 61/148 2026-02-23T10:19:39.615 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 62/148 2026-02-23T10:19:39.619 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 63/148 2026-02-23T10:19:39.624 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 64/148 2026-02-23T10:19:39.630 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 65/148 2026-02-23T10:19:39.634 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 66/148 2026-02-23T10:19:39.637 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 67/148 2026-02-23T10:19:39.644 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 68/148 2026-02-23T10:19:39.647 INFO:teuthology.orchestra.run.trial044.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 69/148 2026-02-23T10:19:39.648 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 70/148 2026-02-23T10:19:39.678 INFO:teuthology.orchestra.run.trial044.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 71/148 2026-02-23T10:19:39.721 INFO:teuthology.orchestra.run.trial044.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 72/148 2026-02-23T10:19:39.730 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 73/148 2026-02-23T10:19:39.776 INFO:teuthology.orchestra.run.trial044.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 74/148 2026-02-23T10:19:39.805 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-py-1.10.0-6.el9.noarch 75/148 2026-02-23T10:19:39.817 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 76/148 2026-02-23T10:19:39.824 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 77/148 2026-02-23T10:19:39.831 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-pluggy-0.13.1-7.el9.noarch 78/148 2026-02-23T10:19:39.838 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 79/148 2026-02-23T10:19:39.842 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 80/148 2026-02-23T10:19:39.877 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-iniconfig-1.1.1-7.el9.noarch 81/148 2026-02-23T10:19:40.100 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 82/148 2026-02-23T10:19:40.124 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 83/148 2026-02-23T10:19:40.128 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 84/148 2026-02-23T10:19:40.187 INFO:teuthology.orchestra.run.trial044.stdout: Installing : openblas-0.3.29-1.el9.x86_64 85/148 2026-02-23T10:19:40.189 INFO:teuthology.orchestra.run.trial044.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 86/148 2026-02-23T10:19:40.210 INFO:teuthology.orchestra.run.trial044.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 87/148 2026-02-23T10:19:40.535 INFO:teuthology.orchestra.run.trial044.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 88/148 2026-02-23T10:19:40.607 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 89/148 2026-02-23T10:19:41.277 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 90/148 2026-02-23T10:19:41.294 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 91/148 2026-02-23T10:19:41.298 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 92/148 2026-02-23T10:19:41.300 INFO:teuthology.orchestra.run.trial044.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 93/148 2026-02-23T10:19:41.306 INFO:teuthology.orchestra.run.trial044.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 94/148 2026-02-23T10:19:41.555 INFO:teuthology.orchestra.run.trial044.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 95/148 2026-02-23T10:19:41.557 INFO:teuthology.orchestra.run.trial044.stdout: Installing : librgw2-2:20.3.0-5439.ge371433f.el9.x86_64 96/148 2026-02-23T10:19:41.575 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: librgw2-2:20.3.0-5439.ge371433f.el9.x86_64 96/148 2026-02-23T10:19:41.576 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-rgw-2:20.3.0-5439.ge371433f.el9.x86_64 97/148 2026-02-23T10:19:42.511 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 98/148 2026-02-23T10:19:42.514 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 98/148 2026-02-23T10:19:42.530 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 98/148 2026-02-23T10:19:42.540 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 99/148 2026-02-23T10:19:42.546 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-packaging-20.9-5.el9.noarch 100/148 2026-02-23T10:19:42.560 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-ply-3.11-14.el9.noarch 101/148 2026-02-23T10:19:42.575 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 102/148 2026-02-23T10:19:42.650 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 103/148 2026-02-23T10:19:42.659 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 104/148 2026-02-23T10:19:42.682 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 105/148 2026-02-23T10:19:42.712 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 106/148 2026-02-23T10:19:42.762 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 107/148 2026-02-23T10:19:42.768 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 108/148 2026-02-23T10:19:42.772 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 109/148 2026-02-23T10:19:42.776 INFO:teuthology.orchestra.run.trial044.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 110/148 2026-02-23T10:19:42.778 INFO:teuthology.orchestra.run.trial044.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 111/148 2026-02-23T10:19:42.779 INFO:teuthology.orchestra.run.trial044.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 112/148 2026-02-23T10:19:42.796 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 112/148 2026-02-23T10:19:43.043 INFO:teuthology.orchestra.run.trial044.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 113/148 2026-02-23T10:19:43.047 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 114/148 2026-02-23T10:19:43.086 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 114/148 2026-02-23T10:19:43.086 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-23T10:19:43.086 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-23T10:19:43.087 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:19:43.090 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-selinux-2:20.3.0-5439.ge371433f.el9.x86_64 115/148 2026-02-23T10:19:47.699 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5439.ge371433f.el9.x86_64 115/148 2026-02-23T10:19:47.700 INFO:teuthology.orchestra.run.trial044.stdout:skipping the directory /sys 2026-02-23T10:19:47.700 INFO:teuthology.orchestra.run.trial044.stdout:skipping the directory /proc 2026-02-23T10:19:47.700 INFO:teuthology.orchestra.run.trial044.stdout:skipping the directory /mnt 2026-02-23T10:19:47.700 INFO:teuthology.orchestra.run.trial044.stdout:skipping the directory /var/tmp 2026-02-23T10:19:47.700 INFO:teuthology.orchestra.run.trial044.stdout:skipping the directory /home 2026-02-23T10:19:47.700 INFO:teuthology.orchestra.run.trial044.stdout:skipping the directory /root 2026-02-23T10:19:47.700 INFO:teuthology.orchestra.run.trial044.stdout:skipping the directory /tmp 2026-02-23T10:19:47.700 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:19:47.789 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mds-2:20.3.0-5439.ge371433f.el9.x86_64 116/148 2026-02-23T10:19:47.811 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-mds-2:20.3.0-5439.ge371433f.el9.x86_64 116/148 2026-02-23T10:19:47.811 INFO:teuthology.orchestra.run.trial044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T10:19:47.812 INFO:teuthology.orchestra.run.trial044.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-23T10:19:47.812 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-23T10:19:47.812 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-23T10:19:47.812 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:19:48.015 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mon-2:20.3.0-5439.ge371433f.el9.x86_64 117/148 2026-02-23T10:19:48.035 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-mon-2:20.3.0-5439.ge371433f.el9.x86_64 117/148 2026-02-23T10:19:48.036 INFO:teuthology.orchestra.run.trial044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T10:19:48.036 INFO:teuthology.orchestra.run.trial044.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-23T10:19:48.036 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-23T10:19:48.036 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-23T10:19:48.036 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:19:48.041 INFO:teuthology.orchestra.run.trial044.stdout: Installing : mailcap-2.1.49-5.el9.noarch 118/148 2026-02-23T10:19:48.043 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 119/148 2026-02-23T10:19:48.060 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 120/148 2026-02-23T10:19:48.060 INFO:teuthology.orchestra.run.trial044.stdout:Creating group 'qat' with GID 992. 2026-02-23T10:19:48.060 INFO:teuthology.orchestra.run.trial044.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-23T10:19:48.060 INFO:teuthology.orchestra.run.trial044.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-23T10:19:48.060 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:19:48.068 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 120/148 2026-02-23T10:19:48.090 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 120/148 2026-02-23T10:19:48.090 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-23T10:19:48.091 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:19:48.124 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 121/148 2026-02-23T10:19:48.709 INFO:teuthology.orchestra.run.trial044.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 122/148 2026-02-23T10:19:54.052 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86 123/148 2026-02-23T10:19:54.115 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86 124/148 2026-02-23T10:19:54.117 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch 125/148 2026-02-23T10:19:54.131 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch 125/148 2026-02-23T10:19:54.131 INFO:teuthology.orchestra.run.trial044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T10:19:54.131 INFO:teuthology.orchestra.run.trial044.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-23T10:19:54.131 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:19:54.141 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 126/148 2026-02-23T10:19:54.162 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 126/148 2026-02-23T10:19:54.162 INFO:teuthology.orchestra.run.trial044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T10:19:54.162 INFO:teuthology.orchestra.run.trial044.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-23T10:19:54.162 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-23T10:19:54.163 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-23T10:19:54.163 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:19:54.217 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: cephadm-2:20.3.0-5439.ge371433f.el9.noarch 127/148 2026-02-23T10:19:54.219 INFO:teuthology.orchestra.run.trial044.stdout: Installing : cephadm-2:20.3.0-5439.ge371433f.el9.noarch 127/148 2026-02-23T10:19:54.228 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5439.ge371433f.e 128/148 2026-02-23T10:19:54.252 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5439.ge371433f. 129/148 2026-02-23T10:19:54.253 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noa 130/148 2026-02-23T10:19:57.143 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noa 130/148 2026-02-23T10:19:57.150 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.n 131/148 2026-02-23T10:19:57.603 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.n 131/148 2026-02-23T10:19:57.604 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5439.ge37 132/148 2026-02-23T10:19:57.664 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5439.ge37 132/148 2026-02-23T10:19:57.703 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5439.ge371433f.el 133/148 2026-02-23T10:19:57.705 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 134/148 2026-02-23T10:19:57.725 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 134/148 2026-02-23T10:19:57.726 INFO:teuthology.orchestra.run.trial044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T10:19:57.726 INFO:teuthology.orchestra.run.trial044.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-23T10:19:57.726 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-23T10:19:57.726 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-23T10:19:57.726 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:19:57.738 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch 135/148 2026-02-23T10:19:57.747 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch 135/148 2026-02-23T10:19:58.231 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-2:20.3.0-5439.ge371433f.el9.x86_64 136/148 2026-02-23T10:19:58.233 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 137/148 2026-02-23T10:19:58.253 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 137/148 2026-02-23T10:19:58.253 INFO:teuthology.orchestra.run.trial044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T10:19:58.253 INFO:teuthology.orchestra.run.trial044.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-23T10:19:58.253 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-23T10:19:58.254 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-23T10:19:58.254 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:19:58.262 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5439.ge3714 138/148 2026-02-23T10:19:58.280 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5439.ge3714 138/148 2026-02-23T10:19:58.280 INFO:teuthology.orchestra.run.trial044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T10:19:58.280 INFO:teuthology.orchestra.run.trial044.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-23T10:19:58.280 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:19:58.392 INFO:teuthology.orchestra.run.trial044.stdout: Installing : rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 139/148 2026-02-23T10:19:58.411 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 139/148 2026-02-23T10:19:58.411 INFO:teuthology.orchestra.run.trial044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T10:19:58.411 INFO:teuthology.orchestra.run.trial044.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-23T10:19:58.412 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-23T10:19:58.412 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-23T10:19:58.412 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:20:05.347 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-pytest-6.2.2-7.el9.noarch 140/148 2026-02-23T10:20:05.354 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-test-2:20.3.0-5439.ge371433f.el9.x86_64 141/148 2026-02-23T10:20:05.359 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libcephfs-devel-2:20.3.0-5439.ge371433f.el9.x86_ 142/148 2026-02-23T10:20:05.368 INFO:teuthology.orchestra.run.trial044.stdout: Installing : rbd-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 143/148 2026-02-23T10:20:05.408 INFO:teuthology.orchestra.run.trial044.stdout: Installing : rbd-nbd-2:20.3.0-5439.ge371433f.el9.x86_64 144/148 2026-02-23T10:20:27.529 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 145/148 2026-02-23T10:20:27.532 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5439.ge37143 146/148 2026-02-23T10:20:27.532 INFO:teuthology.orchestra.run.trial044.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 147/148 2026-02-23T10:20:27.544 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 147/148 2026-02-23T10:20:27.544 INFO:teuthology.orchestra.run.trial044.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 148/148 2026-02-23T10:20:27.556 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 148/148 2026-02-23T10:20:27.562 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86 148/148 2026-02-23T10:20:27.586 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86 148/148 2026-02-23T10:20:31.168 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 148/148 2026-02-23T10:20:31.168 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-2:20.3.0-5439.ge371433f.el9.x86_64 1/148 2026-02-23T10:20:31.168 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 2/148 2026-02-23T10:20:31.168 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 3/148 2026-02-23T10:20:31.169 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 4/148 2026-02-23T10:20:31.169 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5439.ge3714 5/148 2026-02-23T10:20:31.169 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mds-2:20.3.0-5439.ge371433f.el9.x86_64 6/148 2026-02-23T10:20:31.169 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 7/148 2026-02-23T10:20:31.169 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mon-2:20.3.0-5439.ge371433f.el9.x86_64 8/148 2026-02-23T10:20:31.169 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 9/148 2026-02-23T10:20:31.169 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86 10/148 2026-02-23T10:20:31.169 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86 11/148 2026-02-23T10:20:31.169 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5439.ge37143 12/148 2026-02-23T10:20:31.169 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 13/148 2026-02-23T10:20:31.169 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-selinux-2:20.3.0-5439.ge371433f.el9.x86_64 14/148 2026-02-23T10:20:31.169 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-test-2:20.3.0-5439.ge371433f.el9.x86_64 15/148 2026-02-23T10:20:31.170 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libcephfs-devel-2:20.3.0-5439.ge371433f.el9.x86_ 16/148 2026-02-23T10:20:31.170 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5439.ge371433f.el9.x86 17/148 2026-02-23T10:20:31.170 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 18/148 2026-02-23T10:20:31.170 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libcephsqlite-2:20.3.0-5439.ge371433f.el9.x86_64 19/148 2026-02-23T10:20:31.170 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librados-devel-2:20.3.0-5439.ge371433f.el9.x86_6 20/148 2026-02-23T10:20:31.170 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libradosstriper1-2:20.3.0-5439.ge371433f.el9.x86 21/148 2026-02-23T10:20:31.170 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librgw2-2:20.3.0-5439.ge371433f.el9.x86_64 22/148 2026-02-23T10:20:31.170 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5439.ge371433f.el 23/148 2026-02-23T10:20:31.170 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-ceph-common-2:20.3.0-5439.ge371433f.el9. 24/148 2026-02-23T10:20:31.170 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-cephfs-2:20.3.0-5439.ge371433f.el9.x86_6 25/148 2026-02-23T10:20:31.170 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-rados-2:20.3.0-5439.ge371433f.el9.x86_64 26/148 2026-02-23T10:20:31.170 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-rbd-2:20.3.0-5439.ge371433f.el9.x86_64 27/148 2026-02-23T10:20:31.171 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-rgw-2:20.3.0-5439.ge371433f.el9.x86_64 28/148 2026-02-23T10:20:31.171 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : rbd-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 29/148 2026-02-23T10:20:31.171 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 30/148 2026-02-23T10:20:31.171 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : rbd-nbd-2:20.3.0-5439.ge371433f.el9.x86_64 31/148 2026-02-23T10:20:31.171 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5439.ge371433f. 32/148 2026-02-23T10:20:31.171 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noa 33/148 2026-02-23T10:20:31.171 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.n 34/148 2026-02-23T10:20:31.171 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5439.ge37 35/148 2026-02-23T10:20:31.171 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5439.ge371433f.el 36/148 2026-02-23T10:20:31.171 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch 37/148 2026-02-23T10:20:31.171 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5439.ge371433f.e 38/148 2026-02-23T10:20:31.171 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch 39/148 2026-02-23T10:20:31.171 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : cephadm-2:20.3.0-5439.ge371433f.el9.noarch 40/148 2026-02-23T10:20:31.172 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 41/148 2026-02-23T10:20:31.172 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 42/148 2026-02-23T10:20:31.172 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 43/148 2026-02-23T10:20:31.172 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 44/148 2026-02-23T10:20:31.172 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 45/148 2026-02-23T10:20:31.172 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 46/148 2026-02-23T10:20:31.172 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 47/148 2026-02-23T10:20:31.172 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 48/148 2026-02-23T10:20:31.172 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 49/148 2026-02-23T10:20:31.172 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 50/148 2026-02-23T10:20:31.172 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 51/148 2026-02-23T10:20:31.172 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 52/148 2026-02-23T10:20:31.173 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-ply-3.11-14.el9.noarch 53/148 2026-02-23T10:20:31.173 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 54/148 2026-02-23T10:20:31.173 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 55/148 2026-02-23T10:20:31.173 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 56/148 2026-02-23T10:20:31.173 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 57/148 2026-02-23T10:20:31.173 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : unzip-6.0-59.el9.x86_64 58/148 2026-02-23T10:20:31.173 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : zip-3.0-35.el9.x86_64 59/148 2026-02-23T10:20:31.173 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 60/148 2026-02-23T10:20:31.173 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 61/148 2026-02-23T10:20:31.173 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 62/148 2026-02-23T10:20:31.173 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 63/148 2026-02-23T10:20:31.173 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 64/148 2026-02-23T10:20:31.173 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 65/148 2026-02-23T10:20:31.174 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 66/148 2026-02-23T10:20:31.174 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 67/148 2026-02-23T10:20:31.174 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 68/148 2026-02-23T10:20:31.174 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 69/148 2026-02-23T10:20:31.174 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 70/148 2026-02-23T10:20:31.174 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 71/148 2026-02-23T10:20:31.174 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 72/148 2026-02-23T10:20:31.174 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : lua-5.4.4-4.el9.x86_64 73/148 2026-02-23T10:20:31.174 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 74/148 2026-02-23T10:20:31.174 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 75/148 2026-02-23T10:20:31.174 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 76/148 2026-02-23T10:20:31.174 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/148 2026-02-23T10:20:31.174 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 78/148 2026-02-23T10:20:31.175 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-iniconfig-1.1.1-7.el9.noarch 79/148 2026-02-23T10:20:31.175 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 80/148 2026-02-23T10:20:31.175 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 81/148 2026-02-23T10:20:31.175 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 82/148 2026-02-23T10:20:31.175 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/148 2026-02-23T10:20:31.175 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 84/148 2026-02-23T10:20:31.175 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 85/148 2026-02-23T10:20:31.175 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/148 2026-02-23T10:20:31.175 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-pluggy-0.13.1-7.el9.noarch 87/148 2026-02-23T10:20:31.175 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 88/148 2026-02-23T10:20:31.175 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-py-1.10.0-6.el9.noarch 89/148 2026-02-23T10:20:31.175 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/148 2026-02-23T10:20:31.175 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/148 2026-02-23T10:20:31.176 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-pytest-6.2.2-7.el9.noarch 92/148 2026-02-23T10:20:31.176 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/148 2026-02-23T10:20:31.176 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 94/148 2026-02-23T10:20:31.176 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/148 2026-02-23T10:20:31.176 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 96/148 2026-02-23T10:20:31.176 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 97/148 2026-02-23T10:20:31.176 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 98/148 2026-02-23T10:20:31.176 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 99/148 2026-02-23T10:20:31.176 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 100/148 2026-02-23T10:20:31.176 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 101/148 2026-02-23T10:20:31.176 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 102/148 2026-02-23T10:20:31.176 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 103/148 2026-02-23T10:20:31.177 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 104/148 2026-02-23T10:20:31.177 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 105/148 2026-02-23T10:20:31.177 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 106/148 2026-02-23T10:20:31.177 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 107/148 2026-02-23T10:20:31.177 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 108/148 2026-02-23T10:20:31.177 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 109/148 2026-02-23T10:20:31.177 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 110/148 2026-02-23T10:20:31.177 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 111/148 2026-02-23T10:20:31.177 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 112/148 2026-02-23T10:20:31.177 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 113/148 2026-02-23T10:20:31.177 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 114/148 2026-02-23T10:20:31.177 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/148 2026-02-23T10:20:31.177 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/148 2026-02-23T10:20:31.178 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 117/148 2026-02-23T10:20:31.178 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 118/148 2026-02-23T10:20:31.178 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/148 2026-02-23T10:20:31.178 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 120/148 2026-02-23T10:20:31.178 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 121/148 2026-02-23T10:20:31.178 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 122/148 2026-02-23T10:20:31.178 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 123/148 2026-02-23T10:20:31.178 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 124/148 2026-02-23T10:20:31.178 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 125/148 2026-02-23T10:20:31.179 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 126/148 2026-02-23T10:20:31.179 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 127/148 2026-02-23T10:20:31.179 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 128/148 2026-02-23T10:20:31.179 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 129/148 2026-02-23T10:20:31.179 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 130/148 2026-02-23T10:20:31.179 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 131/148 2026-02-23T10:20:31.179 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 132/148 2026-02-23T10:20:31.179 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 133/148 2026-02-23T10:20:31.179 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 134/148 2026-02-23T10:20:31.179 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 135/148 2026-02-23T10:20:31.179 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 136/148 2026-02-23T10:20:31.179 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 137/148 2026-02-23T10:20:31.179 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 138/148 2026-02-23T10:20:31.180 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 139/148 2026-02-23T10:20:31.180 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 140/148 2026-02-23T10:20:31.180 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 141/148 2026-02-23T10:20:31.180 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : re2-1:20211101-20.el9.x86_64 142/148 2026-02-23T10:20:31.180 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 143/148 2026-02-23T10:20:31.180 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 144/148 2026-02-23T10:20:31.180 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librados2-2:20.3.0-5439.ge371433f.el9.x86_64 145/148 2026-02-23T10:20:31.180 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 146/148 2026-02-23T10:20:31.180 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 147/148 2026-02-23T10:20:31.234 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 148/148 2026-02-23T10:20:31.235 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:20:31.235 INFO:teuthology.orchestra.run.trial044.stdout:Upgraded: 2026-02-23T10:20:31.235 INFO:teuthology.orchestra.run.trial044.stdout: librados2-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.235 INFO:teuthology.orchestra.run.trial044.stdout: librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.235 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-23T10:20:31.235 INFO:teuthology.orchestra.run.trial044.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-23T10:20:31.235 INFO:teuthology.orchestra.run.trial044.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-23T10:20:31.235 INFO:teuthology.orchestra.run.trial044.stdout: ceph-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.235 INFO:teuthology.orchestra.run.trial044.stdout: ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.235 INFO:teuthology.orchestra.run.trial044.stdout: ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.236 INFO:teuthology.orchestra.run.trial044.stdout: ceph-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.236 INFO:teuthology.orchestra.run.trial044.stdout: ceph-grafana-dashboards-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:20:31.236 INFO:teuthology.orchestra.run.trial044.stdout: ceph-immutable-object-cache-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.236 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mds-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.236 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.236 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:20:31.236 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:20:31.236 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:20:31.236 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-modules-core-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:20:31.236 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:20:31.236 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mon-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.236 INFO:teuthology.orchestra.run.trial044.stdout: ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.236 INFO:teuthology.orchestra.run.trial044.stdout: ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.237 INFO:teuthology.orchestra.run.trial044.stdout: ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.237 INFO:teuthology.orchestra.run.trial044.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.237 INFO:teuthology.orchestra.run.trial044.stdout: ceph-prometheus-alerts-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:20:31.237 INFO:teuthology.orchestra.run.trial044.stdout: ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.237 INFO:teuthology.orchestra.run.trial044.stdout: ceph-selinux-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.237 INFO:teuthology.orchestra.run.trial044.stdout: ceph-test-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.237 INFO:teuthology.orchestra.run.trial044.stdout: ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:20:31.237 INFO:teuthology.orchestra.run.trial044.stdout: cephadm-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T10:20:31.237 INFO:teuthology.orchestra.run.trial044.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-23T10:20:31.237 INFO:teuthology.orchestra.run.trial044.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-23T10:20:31.237 INFO:teuthology.orchestra.run.trial044.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-23T10:20:31.237 INFO:teuthology.orchestra.run.trial044.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-23T10:20:31.238 INFO:teuthology.orchestra.run.trial044.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-23T10:20:31.238 INFO:teuthology.orchestra.run.trial044.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-23T10:20:31.238 INFO:teuthology.orchestra.run.trial044.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-23T10:20:31.238 INFO:teuthology.orchestra.run.trial044.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-23T10:20:31.238 INFO:teuthology.orchestra.run.trial044.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-23T10:20:31.238 INFO:teuthology.orchestra.run.trial044.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-23T10:20:31.238 INFO:teuthology.orchestra.run.trial044.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-23T10:20:31.238 INFO:teuthology.orchestra.run.trial044.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-23T10:20:31.238 INFO:teuthology.orchestra.run.trial044.stdout: libcephfs-devel-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.238 INFO:teuthology.orchestra.run.trial044.stdout: libcephfs-proxy2-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.238 INFO:teuthology.orchestra.run.trial044.stdout: libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.238 INFO:teuthology.orchestra.run.trial044.stdout: libcephsqlite-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.239 INFO:teuthology.orchestra.run.trial044.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-23T10:20:31.239 INFO:teuthology.orchestra.run.trial044.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-23T10:20:31.239 INFO:teuthology.orchestra.run.trial044.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-23T10:20:31.239 INFO:teuthology.orchestra.run.trial044.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-23T10:20:31.239 INFO:teuthology.orchestra.run.trial044.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-23T10:20:31.239 INFO:teuthology.orchestra.run.trial044.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-23T10:20:31.239 INFO:teuthology.orchestra.run.trial044.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-23T10:20:31.239 INFO:teuthology.orchestra.run.trial044.stdout: librados-devel-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.239 INFO:teuthology.orchestra.run.trial044.stdout: libradosstriper1-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.239 INFO:teuthology.orchestra.run.trial044.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-23T10:20:31.239 INFO:teuthology.orchestra.run.trial044.stdout: librgw2-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.239 INFO:teuthology.orchestra.run.trial044.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-23T10:20:31.240 INFO:teuthology.orchestra.run.trial044.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-23T10:20:31.240 INFO:teuthology.orchestra.run.trial044.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-23T10:20:31.240 INFO:teuthology.orchestra.run.trial044.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-23T10:20:31.240 INFO:teuthology.orchestra.run.trial044.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-23T10:20:31.240 INFO:teuthology.orchestra.run.trial044.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-23T10:20:31.240 INFO:teuthology.orchestra.run.trial044.stdout: lua-5.4.4-4.el9.x86_64 2026-02-23T10:20:31.240 INFO:teuthology.orchestra.run.trial044.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-23T10:20:31.240 INFO:teuthology.orchestra.run.trial044.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-23T10:20:31.240 INFO:teuthology.orchestra.run.trial044.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-23T10:20:31.240 INFO:teuthology.orchestra.run.trial044.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-23T10:20:31.240 INFO:teuthology.orchestra.run.trial044.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-23T10:20:31.240 INFO:teuthology.orchestra.run.trial044.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-23T10:20:31.240 INFO:teuthology.orchestra.run.trial044.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-23T10:20:31.241 INFO:teuthology.orchestra.run.trial044.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-23T10:20:31.241 INFO:teuthology.orchestra.run.trial044.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-23T10:20:31.241 INFO:teuthology.orchestra.run.trial044.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-23T10:20:31.241 INFO:teuthology.orchestra.run.trial044.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-23T10:20:31.241 INFO:teuthology.orchestra.run.trial044.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-23T10:20:31.241 INFO:teuthology.orchestra.run.trial044.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-23T10:20:31.241 INFO:teuthology.orchestra.run.trial044.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-23T10:20:31.241 INFO:teuthology.orchestra.run.trial044.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-23T10:20:31.241 INFO:teuthology.orchestra.run.trial044.stdout: python3-ceph-argparse-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.241 INFO:teuthology.orchestra.run.trial044.stdout: python3-ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.241 INFO:teuthology.orchestra.run.trial044.stdout: python3-cephfs-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.241 INFO:teuthology.orchestra.run.trial044.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-23T10:20:31.241 INFO:teuthology.orchestra.run.trial044.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-23T10:20:31.242 INFO:teuthology.orchestra.run.trial044.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-23T10:20:31.242 INFO:teuthology.orchestra.run.trial044.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-23T10:20:31.242 INFO:teuthology.orchestra.run.trial044.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-23T10:20:31.242 INFO:teuthology.orchestra.run.trial044.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-23T10:20:31.242 INFO:teuthology.orchestra.run.trial044.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-23T10:20:31.242 INFO:teuthology.orchestra.run.trial044.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-23T10:20:31.242 INFO:teuthology.orchestra.run.trial044.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-23T10:20:31.242 INFO:teuthology.orchestra.run.trial044.stdout: python3-iniconfig-1.1.1-7.el9.noarch 2026-02-23T10:20:31.243 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-23T10:20:31.243 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-23T10:20:31.243 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-23T10:20:31.243 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-23T10:20:31.243 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-23T10:20:31.243 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-23T10:20:31.243 INFO:teuthology.orchestra.run.trial044.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-23T10:20:31.243 INFO:teuthology.orchestra.run.trial044.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-23T10:20:31.243 INFO:teuthology.orchestra.run.trial044.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-23T10:20:31.243 INFO:teuthology.orchestra.run.trial044.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-23T10:20:31.243 INFO:teuthology.orchestra.run.trial044.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-23T10:20:31.243 INFO:teuthology.orchestra.run.trial044.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-23T10:20:31.244 INFO:teuthology.orchestra.run.trial044.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-23T10:20:31.244 INFO:teuthology.orchestra.run.trial044.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-23T10:20:31.244 INFO:teuthology.orchestra.run.trial044.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-23T10:20:31.244 INFO:teuthology.orchestra.run.trial044.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-23T10:20:31.244 INFO:teuthology.orchestra.run.trial044.stdout: python3-pluggy-0.13.1-7.el9.noarch 2026-02-23T10:20:31.244 INFO:teuthology.orchestra.run.trial044.stdout: python3-ply-3.11-14.el9.noarch 2026-02-23T10:20:31.244 INFO:teuthology.orchestra.run.trial044.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-23T10:20:31.244 INFO:teuthology.orchestra.run.trial044.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-23T10:20:31.244 INFO:teuthology.orchestra.run.trial044.stdout: python3-py-1.10.0-6.el9.noarch 2026-02-23T10:20:31.245 INFO:teuthology.orchestra.run.trial044.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-23T10:20:31.245 INFO:teuthology.orchestra.run.trial044.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-23T10:20:31.245 INFO:teuthology.orchestra.run.trial044.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-23T10:20:31.245 INFO:teuthology.orchestra.run.trial044.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-23T10:20:31.245 INFO:teuthology.orchestra.run.trial044.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-23T10:20:31.245 INFO:teuthology.orchestra.run.trial044.stdout: python3-pytest-6.2.2-7.el9.noarch 2026-02-23T10:20:31.245 INFO:teuthology.orchestra.run.trial044.stdout: python3-rados-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.245 INFO:teuthology.orchestra.run.trial044.stdout: python3-rbd-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.245 INFO:teuthology.orchestra.run.trial044.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-23T10:20:31.245 INFO:teuthology.orchestra.run.trial044.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-23T10:20:31.245 INFO:teuthology.orchestra.run.trial044.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-23T10:20:31.245 INFO:teuthology.orchestra.run.trial044.stdout: python3-rgw-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.245 INFO:teuthology.orchestra.run.trial044.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-23T10:20:31.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-23T10:20:31.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-23T10:20:31.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-23T10:20:31.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-23T10:20:31.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-23T10:20:31.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-23T10:20:31.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-23T10:20:31.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-23T10:20:31.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-23T10:20:31.246 INFO:teuthology.orchestra.run.trial044.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-23T10:20:31.246 INFO:teuthology.orchestra.run.trial044.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-23T10:20:31.246 INFO:teuthology.orchestra.run.trial044.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-23T10:20:31.247 INFO:teuthology.orchestra.run.trial044.stdout: rbd-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.247 INFO:teuthology.orchestra.run.trial044.stdout: rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.247 INFO:teuthology.orchestra.run.trial044.stdout: rbd-nbd-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T10:20:31.247 INFO:teuthology.orchestra.run.trial044.stdout: re2-1:20211101-20.el9.x86_64 2026-02-23T10:20:31.247 INFO:teuthology.orchestra.run.trial044.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-23T10:20:31.247 INFO:teuthology.orchestra.run.trial044.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-23T10:20:31.247 INFO:teuthology.orchestra.run.trial044.stdout: unzip-6.0-59.el9.x86_64 2026-02-23T10:20:31.247 INFO:teuthology.orchestra.run.trial044.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-23T10:20:31.247 INFO:teuthology.orchestra.run.trial044.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-23T10:20:31.247 INFO:teuthology.orchestra.run.trial044.stdout: zip-3.0-35.el9.x86_64 2026-02-23T10:20:31.247 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:20:31.247 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-23T10:20:31.381 DEBUG:teuthology.parallel:result is None 2026-02-23T10:20:31.381 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T10:20:31.546 DEBUG:teuthology.orchestra.run.trial044:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-23T10:20:31.567 INFO:teuthology.orchestra.run.trial044.stdout:20.3.0-5439.ge371433f.el9 2026-02-23T10:20:31.567 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5439.ge371433f.el9 2026-02-23T10:20:31.568 INFO:teuthology.task.install:The correct ceph version 20.3.0-5439.ge371433f is installed. 2026-02-23T10:20:31.569 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T10:20:31.709 DEBUG:teuthology.orchestra.run.trial198:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-23T10:20:31.745 INFO:teuthology.orchestra.run.trial198.stdout:20.3.0-5439.ge371433f.el9 2026-02-23T10:20:31.745 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5439.ge371433f.el9 2026-02-23T10:20:31.745 INFO:teuthology.task.install:The correct ceph version 20.3.0-5439.ge371433f is installed. 2026-02-23T10:20:31.748 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-23T10:20:31.748 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:20:31.748 DEBUG:teuthology.orchestra.run.trial044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-23T10:20:31.776 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-23T10:20:31.776 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-23T10:20:31.811 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-23T10:20:31.811 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:20:31.811 DEBUG:teuthology.orchestra.run.trial044:> sudo dd of=/usr/bin/daemon-helper 2026-02-23T10:20:31.839 DEBUG:teuthology.orchestra.run.trial044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-23T10:20:31.905 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-23T10:20:31.905 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/usr/bin/daemon-helper 2026-02-23T10:20:31.932 DEBUG:teuthology.orchestra.run.trial198:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-23T10:20:31.997 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-23T10:20:31.998 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:20:31.998 DEBUG:teuthology.orchestra.run.trial044:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-23T10:20:32.022 DEBUG:teuthology.orchestra.run.trial044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-23T10:20:32.086 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-23T10:20:32.086 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-23T10:20:32.111 DEBUG:teuthology.orchestra.run.trial198:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-23T10:20:32.176 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-23T10:20:32.176 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:20:32.176 DEBUG:teuthology.orchestra.run.trial044:> sudo dd of=/usr/bin/stdin-killer 2026-02-23T10:20:32.202 DEBUG:teuthology.orchestra.run.trial044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-23T10:20:32.268 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-23T10:20:32.268 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/usr/bin/stdin-killer 2026-02-23T10:20:32.294 DEBUG:teuthology.orchestra.run.trial198:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-23T10:20:32.359 INFO:teuthology.run_tasks:Running task pexec... 2026-02-23T10:20:32.372 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-23T10:20:32.372 DEBUG:teuthology.orchestra.run.trial044:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-23T10:20:32.373 DEBUG:teuthology.orchestra.run.trial198:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-23T10:20:32.374 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial044.front.sepia.ceph.com 2026-02-23T10:20:32.374 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-23T10:20:32.402 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial198.front.sepia.ceph.com 2026-02-23T10:20:32.402 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-23T10:20:32.426 DEBUG:teuthology.parallel:result is None 2026-02-23T10:20:32.452 DEBUG:teuthology.parallel:result is None 2026-02-23T10:20:32.453 INFO:teuthology.run_tasks:Running task install... 2026-02-23T10:20:32.466 DEBUG:teuthology.task.install:project ceph 2026-02-23T10:20:32.467 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d'}} 2026-02-23T10:20:32.467 DEBUG:teuthology.task.install:config {'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d'} 2026-02-23T10:20:32.467 INFO:teuthology.task.install:Using flavor: debug 2026-02-23T10:20:32.475 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-23T10:20:32.475 INFO:teuthology.task.install:extra packages: [] 2026-02-23T10:20:32.476 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d', 'tag': None, 'wait_for_package': False} 2026-02-23T10:20:32.476 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T10:20:32.478 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d', 'tag': None, 'wait_for_package': False} 2026-02-23T10:20:32.478 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T10:20:32.666 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/ 2026-02-23T10:20:32.666 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5439.ge371433f 2026-02-23T10:20:32.676 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/ 2026-02-23T10:20:32.677 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5439.ge371433f 2026-02-23T10:20:33.041 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-23T10:20:33.041 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:20:33.041 DEBUG:teuthology.orchestra.run.trial044:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-23T10:20:33.066 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-pytest on remote rpm x86_64 2026-02-23T10:20:33.067 DEBUG:teuthology.orchestra.run.trial044:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-23T10:20:33.093 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-23T10:20:33.094 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-23T10:20:33.094 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-23T10:20:33.120 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-pytest on remote rpm x86_64 2026-02-23T10:20:33.120 DEBUG:teuthology.orchestra.run.trial198:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-23T10:20:33.131 DEBUG:teuthology.orchestra.run.trial044:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-23T10:20:33.185 DEBUG:teuthology.orchestra.run.trial198:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-23T10:20:33.194 DEBUG:teuthology.orchestra.run.trial044:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-23T10:20:33.250 DEBUG:teuthology.orchestra.run.trial198:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-23T10:20:33.251 INFO:teuthology.orchestra.run.trial044.stdout:check_obsoletes = 1 2026-02-23T10:20:33.259 DEBUG:teuthology.orchestra.run.trial044:> sudo yum clean all 2026-02-23T10:20:33.306 INFO:teuthology.orchestra.run.trial198.stdout:check_obsoletes = 1 2026-02-23T10:20:33.315 DEBUG:teuthology.orchestra.run.trial198:> sudo yum clean all 2026-02-23T10:20:33.416 INFO:teuthology.orchestra.run.trial044.stdout:56 files removed 2026-02-23T10:20:33.430 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-pytest 2026-02-23T10:20:33.477 INFO:teuthology.orchestra.run.trial198.stdout:56 files removed 2026-02-23T10:20:33.491 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-pytest 2026-02-23T10:20:34.248 INFO:teuthology.orchestra.run.trial044.stdout:ceph packages for x86_64 137 kB/s | 92 kB 00:00 2026-02-23T10:20:34.313 INFO:teuthology.orchestra.run.trial198.stdout:ceph packages for x86_64 137 kB/s | 92 kB 00:00 2026-02-23T10:20:34.868 INFO:teuthology.orchestra.run.trial044.stdout:ceph noarch packages 40 kB/s | 24 kB 00:00 2026-02-23T10:20:34.930 INFO:teuthology.orchestra.run.trial198.stdout:ceph noarch packages 40 kB/s | 24 kB 00:00 2026-02-23T10:20:35.425 INFO:teuthology.orchestra.run.trial044.stdout:ceph source packages 3.9 kB/s | 2.1 kB 00:00 2026-02-23T10:20:35.483 INFO:teuthology.orchestra.run.trial198.stdout:ceph source packages 3.9 kB/s | 2.1 kB 00:00 2026-02-23T10:20:36.541 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - BaseOS 8.6 MB/s | 8.9 MB 00:01 2026-02-23T10:20:36.868 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.9 MB 00:01 2026-02-23T10:20:39.726 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-23T10:20:43.851 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 7.8 MB 00:01 2026-02-23T10:20:44.973 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 20 kB 00:00 2026-02-23T10:20:45.928 INFO:teuthology.orchestra.run.trial198.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2026-02-23T10:20:48.714 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - AppStream 2.4 MB/s | 27 MB 00:11 2026-02-23T10:20:49.131 INFO:teuthology.orchestra.run.trial198.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-23T10:20:50.321 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.322 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-test-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.322 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.323 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.323 INFO:teuthology.orchestra.run.trial198.stdout:Package cephadm-2:20.3.0-5439.ge371433f.el9.noarch is already installed. 2026-02-23T10:20:50.324 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-immutable-object-cache-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.324 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.324 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.noarch is already installed. 2026-02-23T10:20:50.325 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5439.ge371433f.el9.noarch is already installed. 2026-02-23T10:20:50.325 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch is already installed. 2026-02-23T10:20:50.326 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noarch is already installed. 2026-02-23T10:20:50.326 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.327 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.327 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.327 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch is already installed. 2026-02-23T10:20:50.328 INFO:teuthology.orchestra.run.trial198.stdout:Package librados-devel-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.328 INFO:teuthology.orchestra.run.trial198.stdout:Package libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.329 INFO:teuthology.orchestra.run.trial198.stdout:Package libcephfs-devel-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.329 INFO:teuthology.orchestra.run.trial198.stdout:Package librados2-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.330 INFO:teuthology.orchestra.run.trial198.stdout:Package librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.330 INFO:teuthology.orchestra.run.trial198.stdout:Package python3-rados-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.331 INFO:teuthology.orchestra.run.trial198.stdout:Package python3-rgw-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.331 INFO:teuthology.orchestra.run.trial198.stdout:Package python3-cephfs-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.331 INFO:teuthology.orchestra.run.trial198.stdout:Package python3-rbd-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.332 INFO:teuthology.orchestra.run.trial198.stdout:Package rbd-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.332 INFO:teuthology.orchestra.run.trial198.stdout:Package rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.333 INFO:teuthology.orchestra.run.trial198.stdout:Package rbd-nbd-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:50.333 INFO:teuthology.orchestra.run.trial198.stdout:Package python3-pytest-6.2.2-7.el9.noarch is already installed. 2026-02-23T10:20:50.352 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-23T10:20:50.353 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-23T10:20:50.353 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-23T10:20:50.380 DEBUG:teuthology.parallel:result is None 2026-02-23T10:20:51.984 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - CRB 8.6 MB/s | 7.8 MB 00:00 2026-02-23T10:20:53.721 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-23T10:20:54.984 INFO:teuthology.orchestra.run.trial044.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2026-02-23T10:20:58.161 INFO:teuthology.orchestra.run.trial044.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-23T10:20:59.340 INFO:teuthology.orchestra.run.trial044.stdout:Package ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.340 INFO:teuthology.orchestra.run.trial044.stdout:Package ceph-test-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.340 INFO:teuthology.orchestra.run.trial044.stdout:Package ceph-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.341 INFO:teuthology.orchestra.run.trial044.stdout:Package ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.341 INFO:teuthology.orchestra.run.trial044.stdout:Package cephadm-2:20.3.0-5439.ge371433f.el9.noarch is already installed. 2026-02-23T10:20:59.342 INFO:teuthology.orchestra.run.trial044.stdout:Package ceph-immutable-object-cache-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.342 INFO:teuthology.orchestra.run.trial044.stdout:Package ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.343 INFO:teuthology.orchestra.run.trial044.stdout:Package ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.noarch is already installed. 2026-02-23T10:20:59.343 INFO:teuthology.orchestra.run.trial044.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5439.ge371433f.el9.noarch is already installed. 2026-02-23T10:20:59.344 INFO:teuthology.orchestra.run.trial044.stdout:Package ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch is already installed. 2026-02-23T10:20:59.344 INFO:teuthology.orchestra.run.trial044.stdout:Package ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noarch is already installed. 2026-02-23T10:20:59.344 INFO:teuthology.orchestra.run.trial044.stdout:Package ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.345 INFO:teuthology.orchestra.run.trial044.stdout:Package ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.345 INFO:teuthology.orchestra.run.trial044.stdout:Package ceph-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.346 INFO:teuthology.orchestra.run.trial044.stdout:Package ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch is already installed. 2026-02-23T10:20:59.346 INFO:teuthology.orchestra.run.trial044.stdout:Package librados-devel-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.346 INFO:teuthology.orchestra.run.trial044.stdout:Package libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.347 INFO:teuthology.orchestra.run.trial044.stdout:Package libcephfs-devel-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.347 INFO:teuthology.orchestra.run.trial044.stdout:Package librados2-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.348 INFO:teuthology.orchestra.run.trial044.stdout:Package librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.348 INFO:teuthology.orchestra.run.trial044.stdout:Package python3-rados-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.349 INFO:teuthology.orchestra.run.trial044.stdout:Package python3-rgw-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.349 INFO:teuthology.orchestra.run.trial044.stdout:Package python3-cephfs-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.349 INFO:teuthology.orchestra.run.trial044.stdout:Package python3-rbd-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.350 INFO:teuthology.orchestra.run.trial044.stdout:Package rbd-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.350 INFO:teuthology.orchestra.run.trial044.stdout:Package rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.351 INFO:teuthology.orchestra.run.trial044.stdout:Package rbd-nbd-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T10:20:59.351 INFO:teuthology.orchestra.run.trial044.stdout:Package python3-pytest-6.2.2-7.el9.noarch is already installed. 2026-02-23T10:20:59.370 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-23T10:20:59.370 INFO:teuthology.orchestra.run.trial044.stdout:Nothing to do. 2026-02-23T10:20:59.371 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-23T10:20:59.397 DEBUG:teuthology.parallel:result is None 2026-02-23T10:20:59.397 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T10:20:59.554 DEBUG:teuthology.orchestra.run.trial044:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-23T10:20:59.576 INFO:teuthology.orchestra.run.trial044.stdout:20.3.0-5439.ge371433f.el9 2026-02-23T10:20:59.576 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5439.ge371433f.el9 2026-02-23T10:20:59.576 INFO:teuthology.task.install:The correct ceph version 20.3.0-5439.ge371433f is installed. 2026-02-23T10:20:59.578 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T10:20:59.718 DEBUG:teuthology.orchestra.run.trial198:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-23T10:20:59.740 INFO:teuthology.orchestra.run.trial198.stdout:20.3.0-5439.ge371433f.el9 2026-02-23T10:20:59.740 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5439.ge371433f.el9 2026-02-23T10:20:59.740 INFO:teuthology.task.install:The correct ceph version 20.3.0-5439.ge371433f is installed. 2026-02-23T10:20:59.742 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-23T10:20:59.742 INFO:teuthology.run_tasks:Running task ceph... 2026-02-23T10:20:59.830 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-23T10:20:59.830 DEBUG:teuthology.orchestra.run.trial044:> sudo chmod 777 /var/log/ceph 2026-02-23T10:20:59.832 DEBUG:teuthology.orchestra.run.trial198:> sudo chmod 777 /var/log/ceph 2026-02-23T10:20:59.857 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-23T10:20:59.857 DEBUG:teuthology.orchestra.run.trial044:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-23T10:20:59.898 DEBUG:teuthology.orchestra.run.trial198:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-23T10:20:59.922 INFO:tasks.ceph:Creating extra log directories... 2026-02-23T10:20:59.922 DEBUG:teuthology.orchestra.run.trial044:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-23T10:20:59.960 DEBUG:teuthology.orchestra.run.trial198:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-23T10:21:00.001 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-23T10:21:00.001 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-23T10:21:00.002 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66051', 'branch': 'main', 'description': 'crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} tasks/rados_python}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '66051', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)'], 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d'}}, 'workunit': {'branch': 'wip-shraddhaag-enable-cephadm-tests', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d'}}, 'owner': 'scheduled_shraddhaag@soko04.front.sepia.ceph.com', 'priority': 49, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 66, 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'wip-shraddhaag-enable-cephadm-tests', 'suite_path': '/home/teuthworker/src/github.com_shraddhaag_ceph_e371433fcd1390a0b82cfb18effc422c1f5d8c1d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/shraddhaag/ceph.git', 'suite_sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d', 'targets': {'trial044.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJMCgeLkn31yx43MnVuva4j6Xks7ITN4h1eQj61X5UT/Hj+TJC8gFNm+w+icF2VTaADP70JJZ8VzKlfslt3cqgM=', 'trial198.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOHwvpTfCvG2EPGOeKJWsBwRo+BIGGaKtxPQ7QNTeCuTACuYKTPzBAlohb+iynR4VXtu6zHJSMvY/w/lxPXs5kc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)'], 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ["rados/test_python.sh -m 'not (wait or tier or ec)'"]}, 'timeout': '1h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-23_09:58:48', 'tube': 'trial', 'user': 'shraddhaag', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653'} 2026-02-23T10:21:00.002 DEBUG:teuthology.orchestra.run.trial044:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-23T10:21:00.025 DEBUG:teuthology.orchestra.run.trial198:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-23T10:21:00.045 DEBUG:teuthology.orchestra.run.trial044:> sudo install -d -m0777 -- /var/run/ceph 2026-02-23T10:21:00.081 DEBUG:teuthology.orchestra.run.trial198:> sudo install -d -m0777 -- /var/run/ceph 2026-02-23T10:21:00.111 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:21:00.111 DEBUG:teuthology.orchestra.run.trial044:> dd if=/scratch_devs of=/dev/stdout 2026-02-23T10:21:00.161 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-23T10:21:00.162 DEBUG:teuthology.orchestra.run.trial044:> stat /dev/vg_nvme/lv_1 2026-02-23T10:21:00.217 INFO:teuthology.orchestra.run.trial044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-23T10:21:00.217 INFO:teuthology.orchestra.run.trial044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T10:21:00.218 INFO:teuthology.orchestra.run.trial044.stdout:Device: 6h/6d Inode: 916 Links: 1 2026-02-23T10:21:00.218 INFO:teuthology.orchestra.run.trial044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T10:21:00.218 INFO:teuthology.orchestra.run.trial044.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T10:21:00.218 INFO:teuthology.orchestra.run.trial044.stdout:Access: 2026-02-23 10:20:27.788173981 +0000 2026-02-23T10:21:00.218 INFO:teuthology.orchestra.run.trial044.stdout:Modify: 2026-02-23 10:14:33.805557731 +0000 2026-02-23T10:21:00.218 INFO:teuthology.orchestra.run.trial044.stdout:Change: 2026-02-23 10:14:33.805557731 +0000 2026-02-23T10:21:00.218 INFO:teuthology.orchestra.run.trial044.stdout: Birth: 2026-02-23 10:14:33.805557731 +0000 2026-02-23T10:21:00.219 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-23T10:21:00.279 INFO:teuthology.orchestra.run.trial044.stderr:1+0 records in 2026-02-23T10:21:00.279 INFO:teuthology.orchestra.run.trial044.stderr:1+0 records out 2026-02-23T10:21:00.279 INFO:teuthology.orchestra.run.trial044.stderr:512 bytes copied, 0.000166418 s, 3.1 MB/s 2026-02-23T10:21:00.280 DEBUG:teuthology.orchestra.run.trial044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-23T10:21:00.337 DEBUG:teuthology.orchestra.run.trial044:> stat /dev/vg_nvme/lv_2 2026-02-23T10:21:00.395 INFO:teuthology.orchestra.run.trial044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-23T10:21:00.395 INFO:teuthology.orchestra.run.trial044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T10:21:00.395 INFO:teuthology.orchestra.run.trial044.stdout:Device: 6h/6d Inode: 942 Links: 1 2026-02-23T10:21:00.395 INFO:teuthology.orchestra.run.trial044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T10:21:00.396 INFO:teuthology.orchestra.run.trial044.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T10:21:00.396 INFO:teuthology.orchestra.run.trial044.stdout:Access: 2026-02-23 10:20:27.789173961 +0000 2026-02-23T10:21:00.396 INFO:teuthology.orchestra.run.trial044.stdout:Modify: 2026-02-23 10:14:34.036553081 +0000 2026-02-23T10:21:00.396 INFO:teuthology.orchestra.run.trial044.stdout:Change: 2026-02-23 10:14:34.036553081 +0000 2026-02-23T10:21:00.396 INFO:teuthology.orchestra.run.trial044.stdout: Birth: 2026-02-23 10:14:34.036553081 +0000 2026-02-23T10:21:00.396 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-23T10:21:00.457 INFO:teuthology.orchestra.run.trial044.stderr:1+0 records in 2026-02-23T10:21:00.457 INFO:teuthology.orchestra.run.trial044.stderr:1+0 records out 2026-02-23T10:21:00.458 INFO:teuthology.orchestra.run.trial044.stderr:512 bytes copied, 0.000143696 s, 3.6 MB/s 2026-02-23T10:21:00.459 DEBUG:teuthology.orchestra.run.trial044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-23T10:21:00.517 DEBUG:teuthology.orchestra.run.trial044:> stat /dev/vg_nvme/lv_3 2026-02-23T10:21:00.573 INFO:teuthology.orchestra.run.trial044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-23T10:21:00.573 INFO:teuthology.orchestra.run.trial044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T10:21:00.573 INFO:teuthology.orchestra.run.trial044.stdout:Device: 6h/6d Inode: 974 Links: 1 2026-02-23T10:21:00.573 INFO:teuthology.orchestra.run.trial044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T10:21:00.573 INFO:teuthology.orchestra.run.trial044.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T10:21:00.573 INFO:teuthology.orchestra.run.trial044.stdout:Access: 2026-02-23 10:20:27.789173961 +0000 2026-02-23T10:21:00.573 INFO:teuthology.orchestra.run.trial044.stdout:Modify: 2026-02-23 10:14:34.296547849 +0000 2026-02-23T10:21:00.573 INFO:teuthology.orchestra.run.trial044.stdout:Change: 2026-02-23 10:14:34.296547849 +0000 2026-02-23T10:21:00.573 INFO:teuthology.orchestra.run.trial044.stdout: Birth: 2026-02-23 10:14:34.296547849 +0000 2026-02-23T10:21:00.573 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-23T10:21:00.635 INFO:teuthology.orchestra.run.trial044.stderr:1+0 records in 2026-02-23T10:21:00.635 INFO:teuthology.orchestra.run.trial044.stderr:1+0 records out 2026-02-23T10:21:00.635 INFO:teuthology.orchestra.run.trial044.stderr:512 bytes copied, 0.000201033 s, 2.5 MB/s 2026-02-23T10:21:00.636 DEBUG:teuthology.orchestra.run.trial044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-23T10:21:00.692 DEBUG:teuthology.orchestra.run.trial044:> stat /dev/vg_nvme/lv_4 2026-02-23T10:21:00.748 INFO:teuthology.orchestra.run.trial044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-23T10:21:00.748 INFO:teuthology.orchestra.run.trial044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T10:21:00.748 INFO:teuthology.orchestra.run.trial044.stdout:Device: 6h/6d Inode: 998 Links: 1 2026-02-23T10:21:00.748 INFO:teuthology.orchestra.run.trial044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T10:21:00.748 INFO:teuthology.orchestra.run.trial044.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T10:21:00.748 INFO:teuthology.orchestra.run.trial044.stdout:Access: 2026-02-23 10:20:27.789173961 +0000 2026-02-23T10:21:00.748 INFO:teuthology.orchestra.run.trial044.stdout:Modify: 2026-02-23 10:14:34.537542998 +0000 2026-02-23T10:21:00.749 INFO:teuthology.orchestra.run.trial044.stdout:Change: 2026-02-23 10:14:34.537542998 +0000 2026-02-23T10:21:00.749 INFO:teuthology.orchestra.run.trial044.stdout: Birth: 2026-02-23 10:14:34.537542998 +0000 2026-02-23T10:21:00.749 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-23T10:21:00.812 INFO:teuthology.orchestra.run.trial044.stderr:1+0 records in 2026-02-23T10:21:00.812 INFO:teuthology.orchestra.run.trial044.stderr:1+0 records out 2026-02-23T10:21:00.812 INFO:teuthology.orchestra.run.trial044.stderr:512 bytes copied, 0.000155167 s, 3.3 MB/s 2026-02-23T10:21:00.814 DEBUG:teuthology.orchestra.run.trial044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-23T10:21:00.871 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-23T10:21:00.871 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-23T10:21:00.871 DEBUG:teuthology.orchestra.run.trial198:> dd if=/scratch_devs of=/dev/stdout 2026-02-23T10:21:00.890 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-23T10:21:00.890 DEBUG:teuthology.orchestra.run.trial198:> stat /dev/vg_nvme/lv_1 2026-02-23T10:21:00.947 INFO:teuthology.orchestra.run.trial198.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-23T10:21:00.947 INFO:teuthology.orchestra.run.trial198.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T10:21:00.947 INFO:teuthology.orchestra.run.trial198.stdout:Device: 6h/6d Inode: 905 Links: 1 2026-02-23T10:21:00.947 INFO:teuthology.orchestra.run.trial198.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T10:21:00.947 INFO:teuthology.orchestra.run.trial198.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T10:21:00.947 INFO:teuthology.orchestra.run.trial198.stdout:Access: 2026-02-23 10:18:52.044266534 +0000 2026-02-23T10:21:00.947 INFO:teuthology.orchestra.run.trial198.stdout:Modify: 2026-02-23 10:14:31.526033169 +0000 2026-02-23T10:21:00.947 INFO:teuthology.orchestra.run.trial198.stdout:Change: 2026-02-23 10:14:31.526033169 +0000 2026-02-23T10:21:00.947 INFO:teuthology.orchestra.run.trial198.stdout: Birth: 2026-02-23 10:14:31.526033169 +0000 2026-02-23T10:21:00.948 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-23T10:21:01.009 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records in 2026-02-23T10:21:01.009 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records out 2026-02-23T10:21:01.009 INFO:teuthology.orchestra.run.trial198.stderr:512 bytes copied, 0.00016212 s, 3.2 MB/s 2026-02-23T10:21:01.011 DEBUG:teuthology.orchestra.run.trial198:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-23T10:21:01.068 DEBUG:teuthology.orchestra.run.trial198:> stat /dev/vg_nvme/lv_2 2026-02-23T10:21:01.124 INFO:teuthology.orchestra.run.trial198.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-23T10:21:01.125 INFO:teuthology.orchestra.run.trial198.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T10:21:01.125 INFO:teuthology.orchestra.run.trial198.stdout:Device: 6h/6d Inode: 938 Links: 1 2026-02-23T10:21:01.125 INFO:teuthology.orchestra.run.trial198.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T10:21:01.125 INFO:teuthology.orchestra.run.trial198.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T10:21:01.125 INFO:teuthology.orchestra.run.trial198.stdout:Access: 2026-02-23 10:18:52.044266534 +0000 2026-02-23T10:21:01.125 INFO:teuthology.orchestra.run.trial198.stdout:Modify: 2026-02-23 10:14:31.754029455 +0000 2026-02-23T10:21:01.125 INFO:teuthology.orchestra.run.trial198.stdout:Change: 2026-02-23 10:14:31.754029455 +0000 2026-02-23T10:21:01.125 INFO:teuthology.orchestra.run.trial198.stdout: Birth: 2026-02-23 10:14:31.754029455 +0000 2026-02-23T10:21:01.126 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-23T10:21:01.188 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records in 2026-02-23T10:21:01.188 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records out 2026-02-23T10:21:01.188 INFO:teuthology.orchestra.run.trial198.stderr:512 bytes copied, 0.000139769 s, 3.7 MB/s 2026-02-23T10:21:01.189 DEBUG:teuthology.orchestra.run.trial198:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-23T10:21:01.246 DEBUG:teuthology.orchestra.run.trial198:> stat /dev/vg_nvme/lv_3 2026-02-23T10:21:01.305 INFO:teuthology.orchestra.run.trial198.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-23T10:21:01.305 INFO:teuthology.orchestra.run.trial198.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T10:21:01.305 INFO:teuthology.orchestra.run.trial198.stdout:Device: 6h/6d Inode: 964 Links: 1 2026-02-23T10:21:01.305 INFO:teuthology.orchestra.run.trial198.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T10:21:01.305 INFO:teuthology.orchestra.run.trial198.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T10:21:01.305 INFO:teuthology.orchestra.run.trial198.stdout:Access: 2026-02-23 10:18:52.045266520 +0000 2026-02-23T10:21:01.305 INFO:teuthology.orchestra.run.trial198.stdout:Modify: 2026-02-23 10:14:31.976025838 +0000 2026-02-23T10:21:01.306 INFO:teuthology.orchestra.run.trial198.stdout:Change: 2026-02-23 10:14:31.976025838 +0000 2026-02-23T10:21:01.306 INFO:teuthology.orchestra.run.trial198.stdout: Birth: 2026-02-23 10:14:31.976025838 +0000 2026-02-23T10:21:01.306 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-23T10:21:01.367 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records in 2026-02-23T10:21:01.367 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records out 2026-02-23T10:21:01.367 INFO:teuthology.orchestra.run.trial198.stderr:512 bytes copied, 0.000156791 s, 3.3 MB/s 2026-02-23T10:21:01.368 DEBUG:teuthology.orchestra.run.trial198:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-23T10:21:01.426 DEBUG:teuthology.orchestra.run.trial198:> stat /dev/vg_nvme/lv_4 2026-02-23T10:21:01.482 INFO:teuthology.orchestra.run.trial198.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-23T10:21:01.482 INFO:teuthology.orchestra.run.trial198.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T10:21:01.482 INFO:teuthology.orchestra.run.trial198.stdout:Device: 6h/6d Inode: 995 Links: 1 2026-02-23T10:21:01.482 INFO:teuthology.orchestra.run.trial198.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T10:21:01.482 INFO:teuthology.orchestra.run.trial198.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T10:21:01.482 INFO:teuthology.orchestra.run.trial198.stdout:Access: 2026-02-23 10:18:52.045266520 +0000 2026-02-23T10:21:01.482 INFO:teuthology.orchestra.run.trial198.stdout:Modify: 2026-02-23 10:14:32.240021537 +0000 2026-02-23T10:21:01.482 INFO:teuthology.orchestra.run.trial198.stdout:Change: 2026-02-23 10:14:32.240021537 +0000 2026-02-23T10:21:01.482 INFO:teuthology.orchestra.run.trial198.stdout: Birth: 2026-02-23 10:14:32.240021537 +0000 2026-02-23T10:21:01.482 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-23T10:21:01.546 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records in 2026-02-23T10:21:01.546 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records out 2026-02-23T10:21:01.546 INFO:teuthology.orchestra.run.trial198.stderr:512 bytes copied, 0.000147243 s, 3.5 MB/s 2026-02-23T10:21:01.547 DEBUG:teuthology.orchestra.run.trial198:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-23T10:21:01.606 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-23T10:21:01.606 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial198.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-23T10:21:01.606 INFO:tasks.ceph:Generating config... 2026-02-23T10:21:01.609 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-23T10:21:01.609 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-23T10:21:01.609 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-23T10:21:01.609 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-23T10:21:01.609 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-23T10:21:01.609 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-23T10:21:01.609 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-23T10:21:01.609 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-23T10:21:01.610 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-23T10:21:01.610 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-23T10:21:01.610 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-23T10:21:01.610 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-23T10:21:01.610 INFO:tasks.ceph:[osd] debug ms = 20 2026-02-23T10:21:01.610 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-23T10:21:01.610 INFO:tasks.ceph:[osd] debug seastore = 20 2026-02-23T10:21:01.610 INFO:tasks.ceph:[osd] debug seastore backref = 20 2026-02-23T10:21:01.610 INFO:tasks.ceph:[osd] debug seastore cache = 20 2026-02-23T10:21:01.610 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2026-02-23T10:21:01.610 INFO:tasks.ceph:[osd] debug seastore device = 20 2026-02-23T10:21:01.610 INFO:tasks.ceph:[osd] debug seastore epm = 20 2026-02-23T10:21:01.611 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2026-02-23T10:21:01.611 INFO:tasks.ceph:[osd] debug seastore journal = 20 2026-02-23T10:21:01.611 INFO:tasks.ceph:[osd] debug seastore lba = 20 2026-02-23T10:21:01.611 INFO:tasks.ceph:[osd] debug seastore odata = 20 2026-02-23T10:21:01.611 INFO:tasks.ceph:[osd] debug seastore omap = 20 2026-02-23T10:21:01.611 INFO:tasks.ceph:[osd] debug seastore onode = 20 2026-02-23T10:21:01.611 INFO:tasks.ceph:[osd] debug seastore t = 20 2026-02-23T10:21:01.611 INFO:tasks.ceph:[osd] debug seastore tm = 20 2026-02-23T10:21:01.611 INFO:tasks.ceph:[osd] osd objectstore = seastore 2026-02-23T10:21:01.611 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-23T10:21:01.611 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-23T10:21:01.611 INFO:tasks.ceph:[osd] seastore cachepin type = 2Q 2026-02-23T10:21:01.612 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-23T10:21:01.612 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-23T10:21:01.612 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-23T10:21:01.612 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-23T10:21:01.612 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-23T10:21:01.612 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-23T10:21:01.612 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-23T10:21:01.612 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-23T10:21:01.612 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-23T10:21:01.612 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-23T10:21:01.612 INFO:tasks.ceph:Setting up mon.a... 2026-02-23T10:21:01.613 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-23T10:21:01.655 INFO:teuthology.orchestra.run.trial044.stdout:creating /etc/ceph/ceph.keyring 2026-02-23T10:21:01.658 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-23T10:21:01.742 DEBUG:teuthology.orchestra.run.trial044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-23T10:21:01.807 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.44')] 2026-02-23T10:21:01.808 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.44', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-23T10:21:01.810 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:21:01.810 DEBUG:teuthology.orchestra.run.trial044:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-23T10:21:01.865 DEBUG:teuthology.orchestra.run.trial044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.44 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-23T10:21:01.944 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:01.942+0000 7f68bb03df40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:01.945 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:01.942+0000 7f68bb03df40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:01.945 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:01.942+0000 7f68bb03df40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:01.946 INFO:teuthology.orchestra.run.trial044.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-23T10:21:01.946 INFO:teuthology.orchestra.run.trial044.stdout:monmaptool: generated fsid 746afa72-9d07-49c4-8eb1-34745ca9165e 2026-02-23T10:21:01.946 INFO:teuthology.orchestra.run.trial044.stdout:setting min_mon_release = tentacle 2026-02-23T10:21:01.946 INFO:teuthology.orchestra.run.trial044.stdout:epoch 0 2026-02-23T10:21:01.946 INFO:teuthology.orchestra.run.trial044.stdout:fsid 746afa72-9d07-49c4-8eb1-34745ca9165e 2026-02-23T10:21:01.946 INFO:teuthology.orchestra.run.trial044.stdout:last_changed 2026-02-23T10:21:01.943845+0000 2026-02-23T10:21:01.947 INFO:teuthology.orchestra.run.trial044.stdout:created 2026-02-23T10:21:01.943845+0000 2026-02-23T10:21:01.947 INFO:teuthology.orchestra.run.trial044.stdout:min_mon_release 20 (tentacle) 2026-02-23T10:21:01.947 INFO:teuthology.orchestra.run.trial044.stdout:election_strategy: 1 2026-02-23T10:21:01.947 INFO:teuthology.orchestra.run.trial044.stdout:0: [v2:10.20.193.44:3300/0,v1:10.20.193.44:6789/0] mon.a 2026-02-23T10:21:01.947 INFO:teuthology.orchestra.run.trial044.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-23T10:21:01.948 DEBUG:teuthology.orchestra.run.trial044:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-23T10:21:02.003 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 746afa72-9d07-49c4-8eb1-34745ca9165e... 2026-02-23T10:21:02.004 DEBUG:teuthology.orchestra.run.trial044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-23T10:21:02.046 DEBUG:teuthology.orchestra.run.trial198:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-23T10:21:02.086 INFO:teuthology.orchestra.run.trial044.stdout:[global] 2026-02-23T10:21:02.086 INFO:teuthology.orchestra.run.trial044.stdout: chdir = "" 2026-02-23T10:21:02.086 INFO:teuthology.orchestra.run.trial044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-23T10:21:02.086 INFO:teuthology.orchestra.run.trial044.stdout: auth supported = cephx 2026-02-23T10:21:02.086 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.087 INFO:teuthology.orchestra.run.trial044.stdout: filestore xattr use omap = true 2026-02-23T10:21:02.087 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.087 INFO:teuthology.orchestra.run.trial044.stdout: mon clock drift allowed = 1.000 2026-02-23T10:21:02.087 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.087 INFO:teuthology.orchestra.run.trial044.stdout: osd crush chooseleaf type = 0 2026-02-23T10:21:02.087 INFO:teuthology.orchestra.run.trial044.stdout: auth debug = true 2026-02-23T10:21:02.087 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.087 INFO:teuthology.orchestra.run.trial044.stdout: ms die on old message = true 2026-02-23T10:21:02.087 INFO:teuthology.orchestra.run.trial044.stdout: ms die on bug = true 2026-02-23T10:21:02.087 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.087 INFO:teuthology.orchestra.run.trial044.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-23T10:21:02.087 INFO:teuthology.orchestra.run.trial044.stdout: mon pg warn max object skew = 0 2026-02-23T10:21:02.088 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.088 INFO:teuthology.orchestra.run.trial044.stdout: # disable pg_autoscaler by default for new pools 2026-02-23T10:21:02.088 INFO:teuthology.orchestra.run.trial044.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-23T10:21:02.088 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.088 INFO:teuthology.orchestra.run.trial044.stdout: osd pool default size = 2 2026-02-23T10:21:02.088 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.088 INFO:teuthology.orchestra.run.trial044.stdout: mon osd allow primary affinity = true 2026-02-23T10:21:02.088 INFO:teuthology.orchestra.run.trial044.stdout: mon osd allow pg remap = true 2026-02-23T10:21:02.088 INFO:teuthology.orchestra.run.trial044.stdout: mon warn on legacy crush tunables = false 2026-02-23T10:21:02.088 INFO:teuthology.orchestra.run.trial044.stdout: mon warn on crush straw calc version zero = false 2026-02-23T10:21:02.088 INFO:teuthology.orchestra.run.trial044.stdout: mon warn on no sortbitwise = false 2026-02-23T10:21:02.088 INFO:teuthology.orchestra.run.trial044.stdout: mon warn on osd down out interval zero = false 2026-02-23T10:21:02.088 INFO:teuthology.orchestra.run.trial044.stdout: mon warn on too few osds = false 2026-02-23T10:21:02.089 INFO:teuthology.orchestra.run.trial044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-23T10:21:02.089 INFO:teuthology.orchestra.run.trial044.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-23T10:21:02.089 INFO:teuthology.orchestra.run.trial044.stdout: mon_allow_pool_size_one = true 2026-02-23T10:21:02.089 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.089 INFO:teuthology.orchestra.run.trial044.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-23T10:21:02.089 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.089 INFO:teuthology.orchestra.run.trial044.stdout: osd default data pool replay window = 5 2026-02-23T10:21:02.089 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.089 INFO:teuthology.orchestra.run.trial044.stdout: mon allow pool delete = true 2026-02-23T10:21:02.089 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.089 INFO:teuthology.orchestra.run.trial044.stdout: mon cluster log file level = debug 2026-02-23T10:21:02.089 INFO:teuthology.orchestra.run.trial044.stdout: debug asserts on shutdown = true 2026-02-23T10:21:02.090 INFO:teuthology.orchestra.run.trial044.stdout: mon health detail to clog = false 2026-02-23T10:21:02.090 INFO:teuthology.orchestra.run.trial044.stdout: mon host = 10.20.193.44 2026-02-23T10:21:02.090 INFO:teuthology.orchestra.run.trial044.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-23T10:21:02.090 INFO:teuthology.orchestra.run.trial044.stdout: ms client mode = crc 2026-02-23T10:21:02.090 INFO:teuthology.orchestra.run.trial044.stdout: ms cluster mode = crc 2026-02-23T10:21:02.090 INFO:teuthology.orchestra.run.trial044.stdout: ms mon client mode = crc 2026-02-23T10:21:02.090 INFO:teuthology.orchestra.run.trial044.stdout: ms mon cluster mode = crc 2026-02-23T10:21:02.090 INFO:teuthology.orchestra.run.trial044.stdout: ms mon service mode = crc 2026-02-23T10:21:02.090 INFO:teuthology.orchestra.run.trial044.stdout: ms service mode = crc 2026-02-23T10:21:02.090 INFO:teuthology.orchestra.run.trial044.stdout: fsid = 746afa72-9d07-49c4-8eb1-34745ca9165e 2026-02-23T10:21:02.090 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.090 INFO:teuthology.orchestra.run.trial044.stdout:[osd] 2026-02-23T10:21:02.090 INFO:teuthology.orchestra.run.trial044.stdout: osd journal size = 100 2026-02-23T10:21:02.091 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.091 INFO:teuthology.orchestra.run.trial044.stdout: osd scrub load threshold = 5.0 2026-02-23T10:21:02.091 INFO:teuthology.orchestra.run.trial044.stdout: osd scrub max interval = 600 2026-02-23T10:21:02.091 INFO:teuthology.orchestra.run.trial044.stdout: osd mclock profile = high_recovery_ops 2026-02-23T10:21:02.091 INFO:teuthology.orchestra.run.trial044.stdout: osd mclock skip benchmark = true 2026-02-23T10:21:02.091 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.091 INFO:teuthology.orchestra.run.trial044.stdout: osd recover clone overlap = true 2026-02-23T10:21:02.091 INFO:teuthology.orchestra.run.trial044.stdout: osd recovery max chunk = 1048576 2026-02-23T10:21:02.091 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.091 INFO:teuthology.orchestra.run.trial044.stdout: osd debug shutdown = true 2026-02-23T10:21:02.091 INFO:teuthology.orchestra.run.trial044.stdout: osd debug op order = true 2026-02-23T10:21:02.091 INFO:teuthology.orchestra.run.trial044.stdout: osd debug verify stray on activate = true 2026-02-23T10:21:02.091 INFO:teuthology.orchestra.run.trial044.stdout: osd debug trim objects = true 2026-02-23T10:21:02.091 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.092 INFO:teuthology.orchestra.run.trial044.stdout: osd open classes on start = true 2026-02-23T10:21:02.092 INFO:teuthology.orchestra.run.trial044.stdout: osd debug pg log writeout = true 2026-02-23T10:21:02.092 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.092 INFO:teuthology.orchestra.run.trial044.stdout: osd deep scrub update digest min age = 30 2026-02-23T10:21:02.092 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.092 INFO:teuthology.orchestra.run.trial044.stdout: osd map max advance = 10 2026-02-23T10:21:02.092 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.092 INFO:teuthology.orchestra.run.trial044.stdout: journal zero on create = true 2026-02-23T10:21:02.092 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.092 INFO:teuthology.orchestra.run.trial044.stdout: filestore ondisk finisher threads = 3 2026-02-23T10:21:02.092 INFO:teuthology.orchestra.run.trial044.stdout: filestore apply finisher threads = 3 2026-02-23T10:21:02.092 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.093 INFO:teuthology.orchestra.run.trial044.stdout: bdev debug aio = true 2026-02-23T10:21:02.093 INFO:teuthology.orchestra.run.trial044.stdout: osd debug misdirected ops = true 2026-02-23T10:21:02.093 INFO:teuthology.orchestra.run.trial044.stdout: debug monc = 20 2026-02-23T10:21:02.093 INFO:teuthology.orchestra.run.trial044.stdout: crimson cpu num = 4 2026-02-23T10:21:02.093 INFO:teuthology.orchestra.run.trial044.stdout: crimson osd obc lru size = 10 2026-02-23T10:21:02.093 INFO:teuthology.orchestra.run.trial044.stdout: debug ms = 20 2026-02-23T10:21:02.093 INFO:teuthology.orchestra.run.trial044.stdout: debug osd = 20 2026-02-23T10:21:02.093 INFO:teuthology.orchestra.run.trial044.stdout: debug seastore = 20 2026-02-23T10:21:02.093 INFO:teuthology.orchestra.run.trial044.stdout: debug seastore backref = 20 2026-02-23T10:21:02.093 INFO:teuthology.orchestra.run.trial044.stdout: debug seastore cache = 20 2026-02-23T10:21:02.093 INFO:teuthology.orchestra.run.trial044.stdout: debug seastore cleaner = 20 2026-02-23T10:21:02.093 INFO:teuthology.orchestra.run.trial044.stdout: debug seastore device = 20 2026-02-23T10:21:02.093 INFO:teuthology.orchestra.run.trial044.stdout: debug seastore epm = 20 2026-02-23T10:21:02.093 INFO:teuthology.orchestra.run.trial044.stdout: debug seastore fixedkv tree = 20 2026-02-23T10:21:02.094 INFO:teuthology.orchestra.run.trial044.stdout: debug seastore journal = 20 2026-02-23T10:21:02.094 INFO:teuthology.orchestra.run.trial044.stdout: debug seastore lba = 20 2026-02-23T10:21:02.094 INFO:teuthology.orchestra.run.trial044.stdout: debug seastore odata = 20 2026-02-23T10:21:02.094 INFO:teuthology.orchestra.run.trial044.stdout: debug seastore omap = 20 2026-02-23T10:21:02.094 INFO:teuthology.orchestra.run.trial044.stdout: debug seastore onode = 20 2026-02-23T10:21:02.094 INFO:teuthology.orchestra.run.trial044.stdout: debug seastore t = 20 2026-02-23T10:21:02.094 INFO:teuthology.orchestra.run.trial044.stdout: debug seastore tm = 20 2026-02-23T10:21:02.094 INFO:teuthology.orchestra.run.trial044.stdout: osd objectstore = seastore 2026-02-23T10:21:02.094 INFO:teuthology.orchestra.run.trial044.stdout: osd shutdown pgref assert = True 2026-02-23T10:21:02.094 INFO:teuthology.orchestra.run.trial044.stdout: seastore cachepin size pershard = 64M 2026-02-23T10:21:02.094 INFO:teuthology.orchestra.run.trial044.stdout: seastore cachepin type = 2Q 2026-02-23T10:21:02.094 INFO:teuthology.orchestra.run.trial044.stdout: seastore max concurrent transactions = 8 2026-02-23T10:21:02.094 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.095 INFO:teuthology.orchestra.run.trial044.stdout:[mgr] 2026-02-23T10:21:02.095 INFO:teuthology.orchestra.run.trial044.stdout: debug ms = 1 2026-02-23T10:21:02.095 INFO:teuthology.orchestra.run.trial044.stdout: debug mgr = 20 2026-02-23T10:21:02.095 INFO:teuthology.orchestra.run.trial044.stdout: debug mon = 20 2026-02-23T10:21:02.095 INFO:teuthology.orchestra.run.trial044.stdout: debug auth = 20 2026-02-23T10:21:02.095 INFO:teuthology.orchestra.run.trial044.stdout: mon reweight min pgs per osd = 4 2026-02-23T10:21:02.095 INFO:teuthology.orchestra.run.trial044.stdout: mon reweight min bytes per osd = 10 2026-02-23T10:21:02.095 INFO:teuthology.orchestra.run.trial044.stdout: mgr/telemetry/nag = false 2026-02-23T10:21:02.095 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.095 INFO:teuthology.orchestra.run.trial044.stdout:[mon] 2026-02-23T10:21:02.095 INFO:teuthology.orchestra.run.trial044.stdout: debug ms = 1 2026-02-23T10:21:02.095 INFO:teuthology.orchestra.run.trial044.stdout: debug mon = 20 2026-02-23T10:21:02.095 INFO:teuthology.orchestra.run.trial044.stdout: debug paxos = 20 2026-02-23T10:21:02.096 INFO:teuthology.orchestra.run.trial044.stdout: debug auth = 20 2026-02-23T10:21:02.096 INFO:teuthology.orchestra.run.trial044.stdout: mon data avail warn = 5 2026-02-23T10:21:02.096 INFO:teuthology.orchestra.run.trial044.stdout: mon mgr mkfs grace = 240 2026-02-23T10:21:02.096 INFO:teuthology.orchestra.run.trial044.stdout: mon reweight min pgs per osd = 4 2026-02-23T10:21:02.096 INFO:teuthology.orchestra.run.trial044.stdout: mon osd reporter subtree level = osd 2026-02-23T10:21:02.096 INFO:teuthology.orchestra.run.trial044.stdout: mon osd prime pg temp = true 2026-02-23T10:21:02.096 INFO:teuthology.orchestra.run.trial044.stdout: mon reweight min bytes per osd = 10 2026-02-23T10:21:02.096 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.096 INFO:teuthology.orchestra.run.trial044.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-23T10:21:02.096 INFO:teuthology.orchestra.run.trial044.stdout: auth mon ticket ttl = 660 # 11m 2026-02-23T10:21:02.096 INFO:teuthology.orchestra.run.trial044.stdout: auth service ticket ttl = 240 # 4m 2026-02-23T10:21:02.096 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.097 INFO:teuthology.orchestra.run.trial044.stdout: # don't complain about insecure global_id in the test suite 2026-02-23T10:21:02.097 INFO:teuthology.orchestra.run.trial044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-23T10:21:02.097 INFO:teuthology.orchestra.run.trial044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-23T10:21:02.097 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.097 INFO:teuthology.orchestra.run.trial044.stdout: # 1m isn't quite enough 2026-02-23T10:21:02.097 INFO:teuthology.orchestra.run.trial044.stdout: mon_down_mkfs_grace = 2m 2026-02-23T10:21:02.097 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.097 INFO:teuthology.orchestra.run.trial044.stdout: mon_warn_on_filestore_osds = false 2026-02-23T10:21:02.097 INFO:teuthology.orchestra.run.trial044.stdout: mon min osdmap epochs = 50 2026-02-23T10:21:02.097 INFO:teuthology.orchestra.run.trial044.stdout: mon osdmap full prune interval = 2 2026-02-23T10:21:02.097 INFO:teuthology.orchestra.run.trial044.stdout: mon osdmap full prune min = 15 2026-02-23T10:21:02.097 INFO:teuthology.orchestra.run.trial044.stdout: mon osdmap full prune txsize = 2 2026-02-23T10:21:02.097 INFO:teuthology.orchestra.run.trial044.stdout: paxos service trim min = 10 2026-02-23T10:21:02.097 INFO:teuthology.orchestra.run.trial044.stdout: osd pool default crimson = True 2026-02-23T10:21:02.098 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:02.098 INFO:teuthology.orchestra.run.trial044.stdout:[client] 2026-02-23T10:21:02.098 INFO:teuthology.orchestra.run.trial044.stdout: rgw cache enabled = true 2026-02-23T10:21:02.098 INFO:teuthology.orchestra.run.trial044.stdout: rgw enable ops log = true 2026-02-23T10:21:02.098 INFO:teuthology.orchestra.run.trial044.stdout: rgw enable usage log = true 2026-02-23T10:21:02.098 INFO:teuthology.orchestra.run.trial044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-23T10:21:02.098 INFO:teuthology.orchestra.run.trial044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-23T10:21:02.098 INFO:teuthology.orchestra.run.trial044.stdout:[mon.a] 2026-02-23T10:21:02.100 INFO:teuthology.orchestra.run.trial198.stdout:[global] 2026-02-23T10:21:02.100 INFO:teuthology.orchestra.run.trial198.stdout: chdir = "" 2026-02-23T10:21:02.100 INFO:teuthology.orchestra.run.trial198.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-23T10:21:02.100 INFO:teuthology.orchestra.run.trial198.stdout: auth supported = cephx 2026-02-23T10:21:02.100 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.101 INFO:teuthology.orchestra.run.trial198.stdout: filestore xattr use omap = true 2026-02-23T10:21:02.101 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.101 INFO:teuthology.orchestra.run.trial198.stdout: mon clock drift allowed = 1.000 2026-02-23T10:21:02.101 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.101 INFO:teuthology.orchestra.run.trial198.stdout: osd crush chooseleaf type = 0 2026-02-23T10:21:02.101 INFO:teuthology.orchestra.run.trial198.stdout: auth debug = true 2026-02-23T10:21:02.101 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.101 INFO:teuthology.orchestra.run.trial198.stdout: ms die on old message = true 2026-02-23T10:21:02.101 INFO:teuthology.orchestra.run.trial198.stdout: ms die on bug = true 2026-02-23T10:21:02.101 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.101 INFO:teuthology.orchestra.run.trial198.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-23T10:21:02.101 INFO:teuthology.orchestra.run.trial198.stdout: mon pg warn max object skew = 0 2026-02-23T10:21:02.102 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.102 INFO:teuthology.orchestra.run.trial198.stdout: # disable pg_autoscaler by default for new pools 2026-02-23T10:21:02.102 INFO:teuthology.orchestra.run.trial198.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-23T10:21:02.102 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.102 INFO:teuthology.orchestra.run.trial198.stdout: osd pool default size = 2 2026-02-23T10:21:02.102 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.102 INFO:teuthology.orchestra.run.trial198.stdout: mon osd allow primary affinity = true 2026-02-23T10:21:02.102 INFO:teuthology.orchestra.run.trial198.stdout: mon osd allow pg remap = true 2026-02-23T10:21:02.102 INFO:teuthology.orchestra.run.trial198.stdout: mon warn on legacy crush tunables = false 2026-02-23T10:21:02.102 INFO:teuthology.orchestra.run.trial198.stdout: mon warn on crush straw calc version zero = false 2026-02-23T10:21:02.102 INFO:teuthology.orchestra.run.trial198.stdout: mon warn on no sortbitwise = false 2026-02-23T10:21:02.102 INFO:teuthology.orchestra.run.trial198.stdout: mon warn on osd down out interval zero = false 2026-02-23T10:21:02.102 INFO:teuthology.orchestra.run.trial198.stdout: mon warn on too few osds = false 2026-02-23T10:21:02.103 INFO:teuthology.orchestra.run.trial198.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-23T10:21:02.103 INFO:teuthology.orchestra.run.trial198.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-23T10:21:02.103 INFO:teuthology.orchestra.run.trial198.stdout: mon_allow_pool_size_one = true 2026-02-23T10:21:02.103 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.103 INFO:teuthology.orchestra.run.trial198.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-23T10:21:02.103 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.103 INFO:teuthology.orchestra.run.trial198.stdout: osd default data pool replay window = 5 2026-02-23T10:21:02.103 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.103 INFO:teuthology.orchestra.run.trial198.stdout: mon allow pool delete = true 2026-02-23T10:21:02.103 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.103 INFO:teuthology.orchestra.run.trial198.stdout: mon cluster log file level = debug 2026-02-23T10:21:02.103 INFO:teuthology.orchestra.run.trial198.stdout: debug asserts on shutdown = true 2026-02-23T10:21:02.104 INFO:teuthology.orchestra.run.trial198.stdout: mon health detail to clog = false 2026-02-23T10:21:02.104 INFO:teuthology.orchestra.run.trial198.stdout: mon host = 10.20.193.44 2026-02-23T10:21:02.104 INFO:teuthology.orchestra.run.trial198.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-23T10:21:02.104 INFO:teuthology.orchestra.run.trial198.stdout: ms client mode = crc 2026-02-23T10:21:02.104 INFO:teuthology.orchestra.run.trial198.stdout: ms cluster mode = crc 2026-02-23T10:21:02.104 INFO:teuthology.orchestra.run.trial198.stdout: ms mon client mode = crc 2026-02-23T10:21:02.104 INFO:teuthology.orchestra.run.trial198.stdout: ms mon cluster mode = crc 2026-02-23T10:21:02.104 INFO:teuthology.orchestra.run.trial198.stdout: ms mon service mode = crc 2026-02-23T10:21:02.104 INFO:teuthology.orchestra.run.trial198.stdout: ms service mode = crc 2026-02-23T10:21:02.104 INFO:teuthology.orchestra.run.trial198.stdout: fsid = 746afa72-9d07-49c4-8eb1-34745ca9165e 2026-02-23T10:21:02.104 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.105 INFO:teuthology.orchestra.run.trial198.stdout:[osd] 2026-02-23T10:21:02.105 INFO:teuthology.orchestra.run.trial198.stdout: osd journal size = 100 2026-02-23T10:21:02.105 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.105 INFO:teuthology.orchestra.run.trial198.stdout: osd scrub load threshold = 5.0 2026-02-23T10:21:02.105 INFO:teuthology.orchestra.run.trial198.stdout: osd scrub max interval = 600 2026-02-23T10:21:02.105 INFO:teuthology.orchestra.run.trial198.stdout: osd mclock profile = high_recovery_ops 2026-02-23T10:21:02.105 INFO:teuthology.orchestra.run.trial198.stdout: osd mclock skip benchmark = true 2026-02-23T10:21:02.105 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.105 INFO:teuthology.orchestra.run.trial198.stdout: osd recover clone overlap = true 2026-02-23T10:21:02.105 INFO:teuthology.orchestra.run.trial198.stdout: osd recovery max chunk = 1048576 2026-02-23T10:21:02.105 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.105 INFO:teuthology.orchestra.run.trial198.stdout: osd debug shutdown = true 2026-02-23T10:21:02.106 INFO:teuthology.orchestra.run.trial198.stdout: osd debug op order = true 2026-02-23T10:21:02.106 INFO:teuthology.orchestra.run.trial198.stdout: osd debug verify stray on activate = true 2026-02-23T10:21:02.106 INFO:teuthology.orchestra.run.trial198.stdout: osd debug trim objects = true 2026-02-23T10:21:02.106 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.106 INFO:teuthology.orchestra.run.trial198.stdout: osd open classes on start = true 2026-02-23T10:21:02.106 INFO:teuthology.orchestra.run.trial198.stdout: osd debug pg log writeout = true 2026-02-23T10:21:02.106 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.106 INFO:teuthology.orchestra.run.trial198.stdout: osd deep scrub update digest min age = 30 2026-02-23T10:21:02.106 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.106 INFO:teuthology.orchestra.run.trial198.stdout: osd map max advance = 10 2026-02-23T10:21:02.106 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.106 INFO:teuthology.orchestra.run.trial198.stdout: journal zero on create = true 2026-02-23T10:21:02.106 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.107 INFO:teuthology.orchestra.run.trial198.stdout: filestore ondisk finisher threads = 3 2026-02-23T10:21:02.107 INFO:teuthology.orchestra.run.trial198.stdout: filestore apply finisher threads = 3 2026-02-23T10:21:02.107 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.107 INFO:teuthology.orchestra.run.trial198.stdout: bdev debug aio = true 2026-02-23T10:21:02.107 INFO:teuthology.orchestra.run.trial198.stdout: osd debug misdirected ops = true 2026-02-23T10:21:02.107 INFO:teuthology.orchestra.run.trial198.stdout: debug monc = 20 2026-02-23T10:21:02.107 INFO:teuthology.orchestra.run.trial198.stdout: crimson cpu num = 4 2026-02-23T10:21:02.107 INFO:teuthology.orchestra.run.trial198.stdout: crimson osd obc lru size = 10 2026-02-23T10:21:02.107 INFO:teuthology.orchestra.run.trial198.stdout: debug ms = 20 2026-02-23T10:21:02.107 INFO:teuthology.orchestra.run.trial198.stdout: debug osd = 20 2026-02-23T10:21:02.107 INFO:teuthology.orchestra.run.trial198.stdout: debug seastore = 20 2026-02-23T10:21:02.107 INFO:teuthology.orchestra.run.trial198.stdout: debug seastore backref = 20 2026-02-23T10:21:02.107 INFO:teuthology.orchestra.run.trial198.stdout: debug seastore cache = 20 2026-02-23T10:21:02.108 INFO:teuthology.orchestra.run.trial198.stdout: debug seastore cleaner = 20 2026-02-23T10:21:02.108 INFO:teuthology.orchestra.run.trial198.stdout: debug seastore device = 20 2026-02-23T10:21:02.108 INFO:teuthology.orchestra.run.trial198.stdout: debug seastore epm = 20 2026-02-23T10:21:02.108 INFO:teuthology.orchestra.run.trial198.stdout: debug seastore fixedkv tree = 20 2026-02-23T10:21:02.108 INFO:teuthology.orchestra.run.trial198.stdout: debug seastore journal = 20 2026-02-23T10:21:02.108 INFO:teuthology.orchestra.run.trial198.stdout: debug seastore lba = 20 2026-02-23T10:21:02.108 INFO:teuthology.orchestra.run.trial198.stdout: debug seastore odata = 20 2026-02-23T10:21:02.108 INFO:teuthology.orchestra.run.trial198.stdout: debug seastore omap = 20 2026-02-23T10:21:02.108 INFO:teuthology.orchestra.run.trial198.stdout: debug seastore onode = 20 2026-02-23T10:21:02.108 INFO:teuthology.orchestra.run.trial198.stdout: debug seastore t = 20 2026-02-23T10:21:02.108 INFO:teuthology.orchestra.run.trial198.stdout: debug seastore tm = 20 2026-02-23T10:21:02.108 INFO:teuthology.orchestra.run.trial198.stdout: osd objectstore = seastore 2026-02-23T10:21:02.108 INFO:teuthology.orchestra.run.trial198.stdout: osd shutdown pgref assert = True 2026-02-23T10:21:02.109 INFO:teuthology.orchestra.run.trial198.stdout: seastore cachepin size pershard = 64M 2026-02-23T10:21:02.109 INFO:teuthology.orchestra.run.trial198.stdout: seastore cachepin type = 2Q 2026-02-23T10:21:02.109 INFO:teuthology.orchestra.run.trial198.stdout: seastore max concurrent transactions = 8 2026-02-23T10:21:02.109 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.109 INFO:teuthology.orchestra.run.trial198.stdout:[mgr] 2026-02-23T10:21:02.109 INFO:teuthology.orchestra.run.trial198.stdout: debug ms = 1 2026-02-23T10:21:02.109 INFO:teuthology.orchestra.run.trial198.stdout: debug mgr = 20 2026-02-23T10:21:02.109 INFO:teuthology.orchestra.run.trial198.stdout: debug mon = 20 2026-02-23T10:21:02.109 INFO:teuthology.orchestra.run.trial198.stdout: debug auth = 20 2026-02-23T10:21:02.109 INFO:teuthology.orchestra.run.trial198.stdout: mon reweight min pgs per osd = 4 2026-02-23T10:21:02.109 INFO:teuthology.orchestra.run.trial198.stdout: mon reweight min bytes per osd = 10 2026-02-23T10:21:02.109 INFO:teuthology.orchestra.run.trial198.stdout: mgr/telemetry/nag = false 2026-02-23T10:21:02.109 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.110 INFO:teuthology.orchestra.run.trial198.stdout:[mon] 2026-02-23T10:21:02.110 INFO:teuthology.orchestra.run.trial198.stdout: debug ms = 1 2026-02-23T10:21:02.110 INFO:teuthology.orchestra.run.trial198.stdout: debug mon = 20 2026-02-23T10:21:02.110 INFO:teuthology.orchestra.run.trial198.stdout: debug paxos = 20 2026-02-23T10:21:02.110 INFO:teuthology.orchestra.run.trial198.stdout: debug auth = 20 2026-02-23T10:21:02.110 INFO:teuthology.orchestra.run.trial198.stdout: mon data avail warn = 5 2026-02-23T10:21:02.110 INFO:teuthology.orchestra.run.trial198.stdout: mon mgr mkfs grace = 240 2026-02-23T10:21:02.110 INFO:teuthology.orchestra.run.trial198.stdout: mon reweight min pgs per osd = 4 2026-02-23T10:21:02.110 INFO:teuthology.orchestra.run.trial198.stdout: mon osd reporter subtree level = osd 2026-02-23T10:21:02.110 INFO:teuthology.orchestra.run.trial198.stdout: mon osd prime pg temp = true 2026-02-23T10:21:02.110 INFO:teuthology.orchestra.run.trial198.stdout: mon reweight min bytes per osd = 10 2026-02-23T10:21:02.110 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.110 INFO:teuthology.orchestra.run.trial198.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-23T10:21:02.111 INFO:teuthology.orchestra.run.trial198.stdout: auth mon ticket ttl = 660 # 11m 2026-02-23T10:21:02.111 INFO:teuthology.orchestra.run.trial198.stdout: auth service ticket ttl = 240 # 4m 2026-02-23T10:21:02.111 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.111 INFO:teuthology.orchestra.run.trial198.stdout: # don't complain about insecure global_id in the test suite 2026-02-23T10:21:02.111 INFO:teuthology.orchestra.run.trial198.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-23T10:21:02.111 INFO:teuthology.orchestra.run.trial198.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-23T10:21:02.111 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.111 INFO:teuthology.orchestra.run.trial198.stdout: # 1m isn't quite enough 2026-02-23T10:21:02.111 INFO:teuthology.orchestra.run.trial198.stdout: mon_down_mkfs_grace = 2m 2026-02-23T10:21:02.111 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.111 INFO:teuthology.orchestra.run.trial198.stdout: mon_warn_on_filestore_osds = false 2026-02-23T10:21:02.111 INFO:teuthology.orchestra.run.trial198.stdout: mon min osdmap epochs = 50 2026-02-23T10:21:02.112 INFO:teuthology.orchestra.run.trial198.stdout: mon osdmap full prune interval = 2 2026-02-23T10:21:02.112 INFO:teuthology.orchestra.run.trial198.stdout: mon osdmap full prune min = 15 2026-02-23T10:21:02.112 INFO:teuthology.orchestra.run.trial198.stdout: mon osdmap full prune txsize = 2 2026-02-23T10:21:02.112 INFO:teuthology.orchestra.run.trial198.stdout: paxos service trim min = 10 2026-02-23T10:21:02.112 INFO:teuthology.orchestra.run.trial198.stdout: osd pool default crimson = True 2026-02-23T10:21:02.112 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-23T10:21:02.112 INFO:teuthology.orchestra.run.trial198.stdout:[client] 2026-02-23T10:21:02.112 INFO:teuthology.orchestra.run.trial198.stdout: rgw cache enabled = true 2026-02-23T10:21:02.112 INFO:teuthology.orchestra.run.trial198.stdout: rgw enable ops log = true 2026-02-23T10:21:02.112 INFO:teuthology.orchestra.run.trial198.stdout: rgw enable usage log = true 2026-02-23T10:21:02.112 INFO:teuthology.orchestra.run.trial198.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-23T10:21:02.112 INFO:teuthology.orchestra.run.trial198.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-23T10:21:02.112 INFO:teuthology.orchestra.run.trial198.stdout:[mon.a] 2026-02-23T10:21:02.113 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-23T10:21:02.113 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-23T10:21:02.193 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-23T10:21:02.193 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:21:02.193 DEBUG:teuthology.orchestra.run.trial044:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-23T10:21:02.210 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:21:02.210 DEBUG:teuthology.orchestra.run.trial044:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-23T10:21:02.266 INFO:tasks.ceph:Sending monmap to node ubuntu@trial044.front.sepia.ceph.com 2026-02-23T10:21:02.267 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:21:02.267 DEBUG:teuthology.orchestra.run.trial044:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-23T10:21:02.267 DEBUG:teuthology.orchestra.run.trial044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-23T10:21:02.339 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:21:02.339 DEBUG:teuthology.orchestra.run.trial044:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-23T10:21:02.397 INFO:tasks.ceph:Sending monmap to node ubuntu@trial198.front.sepia.ceph.com 2026-02-23T10:21:02.397 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-23T10:21:02.397 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-23T10:21:02.397 DEBUG:teuthology.orchestra.run.trial198:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-23T10:21:02.432 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-23T10:21:02.432 DEBUG:teuthology.orchestra.run.trial198:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-23T10:21:02.488 INFO:tasks.ceph:Setting up mon nodes... 2026-02-23T10:21:02.488 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-23T10:21:02.489 DEBUG:teuthology.orchestra.run.trial198:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-23T10:21:02.578 INFO:teuthology.orchestra.run.trial198.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-23T10:21:02.581 INFO:tasks.ceph:Setting up mds nodes... 2026-02-23T10:21:02.581 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-23T10:21:02.581 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-23T10:21:02.624 INFO:teuthology.orchestra.run.trial044.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-23T10:21:02.636 DEBUG:teuthology.orchestra.run.trial198:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-23T10:21:02.679 INFO:teuthology.orchestra.run.trial198.stdout:creating /etc/ceph/ceph.client.1.keyring 2026-02-23T10:21:02.692 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-23T10:21:02.692 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial198.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-23T10:21:02.692 DEBUG:teuthology.orchestra.run.trial044:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-23T10:21:02.718 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-23T10:21:02.718 INFO:tasks.ceph:role: osd.0 2026-02-23T10:21:02.718 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial044.front.sepia.ceph.com 2026-02-23T10:21:02.718 DEBUG:teuthology.orchestra.run.trial044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-23T10:21:02.785 INFO:teuthology.orchestra.run.trial044.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-23T10:21:02.785 INFO:teuthology.orchestra.run.trial044.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-23T10:21:02.785 INFO:teuthology.orchestra.run.trial044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-23T10:21:02.786 INFO:teuthology.orchestra.run.trial044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-23T10:21:02.786 INFO:teuthology.orchestra.run.trial044.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-23T10:21:02.786 INFO:teuthology.orchestra.run.trial044.stdout: = sunit=0 swidth=0 blks 2026-02-23T10:21:02.786 INFO:teuthology.orchestra.run.trial044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-23T10:21:02.786 INFO:teuthology.orchestra.run.trial044.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-23T10:21:02.786 INFO:teuthology.orchestra.run.trial044.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-23T10:21:02.786 INFO:teuthology.orchestra.run.trial044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-23T10:21:03.354 INFO:teuthology.orchestra.run.trial044.stdout:Discarding blocks...Done. 2026-02-23T10:21:03.356 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial044.front.sepia.ceph.com -o noatime 2026-02-23T10:21:03.356 DEBUG:teuthology.orchestra.run.trial044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-23T10:21:03.425 DEBUG:teuthology.orchestra.run.trial044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-23T10:21:03.492 DEBUG:teuthology.orchestra.run.trial044:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-23T10:21:03.558 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-23T10:21:03.558 INFO:tasks.ceph:role: osd.1 2026-02-23T10:21:03.558 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial044.front.sepia.ceph.com 2026-02-23T10:21:03.558 DEBUG:teuthology.orchestra.run.trial044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-23T10:21:03.624 INFO:teuthology.orchestra.run.trial044.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-23T10:21:03.625 INFO:teuthology.orchestra.run.trial044.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-23T10:21:03.625 INFO:teuthology.orchestra.run.trial044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-23T10:21:03.625 INFO:teuthology.orchestra.run.trial044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-23T10:21:03.625 INFO:teuthology.orchestra.run.trial044.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-23T10:21:03.625 INFO:teuthology.orchestra.run.trial044.stdout: = sunit=0 swidth=0 blks 2026-02-23T10:21:03.625 INFO:teuthology.orchestra.run.trial044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-23T10:21:03.625 INFO:teuthology.orchestra.run.trial044.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-23T10:21:03.625 INFO:teuthology.orchestra.run.trial044.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-23T10:21:03.625 INFO:teuthology.orchestra.run.trial044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-23T10:21:04.185 INFO:teuthology.orchestra.run.trial044.stdout:Discarding blocks...Done. 2026-02-23T10:21:04.187 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial044.front.sepia.ceph.com -o noatime 2026-02-23T10:21:04.187 DEBUG:teuthology.orchestra.run.trial044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-23T10:21:04.255 DEBUG:teuthology.orchestra.run.trial044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-23T10:21:04.322 DEBUG:teuthology.orchestra.run.trial044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-23T10:21:04.473 INFO:teuthology.orchestra.run.trial044.stderr:INFO  osd - OSD::main: parsing early config 2026-02-23T10:21:04.531 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:04,530 seastar - Reactor backend: linux-aio 2026-02-23T10:21:04.541 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:04,540 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-23T10:21:04.541 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:04,540 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-23T10:21:04.543 INFO:teuthology.orchestra.run.trial044.stderr:==35422==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-23T10:21:04.598 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:04,596 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-23T10:21:04.598 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:04,596 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-23T10:21:04.598 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:04,596 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-23T10:21:04.598 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:04,596 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-23T10:21:04.598 INFO:teuthology.orchestra.run.trial044.stderr:DEBUG 2026-02-23 10:21:04,597 [shard 0:main] seastar - reactor::drain 2026-02-23T10:21:06.655 INFO:teuthology.orchestra.run.trial044.stderr:----------------------------------------------------- 2026-02-23T10:21:06.655 INFO:teuthology.orchestra.run.trial044.stderr:Suppressions used: 2026-02-23T10:21:06.655 INFO:teuthology.orchestra.run.trial044.stderr: count bytes template 2026-02-23T10:21:06.655 INFO:teuthology.orchestra.run.trial044.stderr: 1 8 MallocExtension::Register 2026-02-23T10:21:06.655 INFO:teuthology.orchestra.run.trial044.stderr:----------------------------------------------------- 2026-02-23T10:21:06.655 INFO:teuthology.orchestra.run.trial044.stderr: 2026-02-23T10:21:06.673 INFO:teuthology.orchestra.run.trial044.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-23T10:21:06.674 INFO:teuthology.orchestra.run.trial044.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-23T10:21:06.718 INFO:teuthology.orchestra.run.trial044.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-23T10:21:06.719 INFO:teuthology.orchestra.run.trial044.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-23T10:21:06.725 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:06,724 seastar - Reactor backend: linux-aio 2026-02-23T10:21:06.736 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:06,735 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-23T10:21:06.736 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:06,735 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-23T10:21:06.739 INFO:teuthology.orchestra.run.trial044.stderr:==35420==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-23T10:21:06.740 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:06,739 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-23T10:21:06.797 INFO:teuthology.orchestra.run.trial044.stderr:DEBUG 2026-02-23 10:21:06,796 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-23T10:21:06.877 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x316b59b 0x9b7e073 0x9b7e348 0x9b7e5fe 0x9b7f0ad 0x9b7f5ab 0x9b7fbdb 0x9b7fd45 0x9c8fd63 0x9ca2b6a 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f9f19a 0x6fa2f9b 0x6fa8b45 0x7482004 0x72a89fa 0x72a8afc 0x72a8bf4 0x735cb16 0x735cbcf 0x735cd82 0x735ceba 0x735cf35 0x735cfba 0x735d115 0x7425e13 0x748208d 0x728f241 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:06.877 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xb1426 0xb69729 0x10912a0 0xf2e3ce 0x9b7dc0b 0x9b7e0d5 0x9b7e348 0x9b7e5fe 0x9b7f0ad 0x9b7f5ab 0x9b7fbdb 0x9b7fd45 0x9c8fd63 0x9ca2b6a 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f9f19a 0x6fa2f9b 0x6fa8b45 0x7482004 0x72a89fa 0x72a8afc 0x72a8bf4 0x735cb16 0x735cbcf 0x735cd82 0x735ceba 0x735cf35 0x735cfba 0x735d115 0x7425e13 0x748208d 0x728f241 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:06.877 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15876 0x1091317 0xf2e3ce 0x9b8256f 0x9c9fa83 0x9ca45f1 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f9f19a 0x6fa2f9b 0x6fa8b45 0x7482004 0x72a89fa 0x72a8afc 0x72a8bf4 0x735cb16 0x735cbcf 0x735cd82 0x735ceba 0x735cf35 0x735cfba 0x735d115 0x7425e13 0x748208d 0x728f241 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:06.909 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x9b03926 0x9ca27bf 0x9c052e1 0x9c042e1 0x7e58655 0x7e5b450 0x8f80d69 0x8f836d7 0x787a27f 0x78aad7c 0x6fa0365 0x75590f6 0x755924a 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9e29e18 0x9c44517 0x9c44d52 0xecf43f /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f54 2026-02-23T10:21:06.975 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6583 /lib64/libasan.so.8+0x15197 0x2a5304b 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9e29e18 0x9c44517 0x9c44d52 0xecf43f /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f54 2026-02-23T10:21:07.014 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1521a 0x2a5304b 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:07.015 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x10069f /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x2a5304b 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:07.015 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x2a51fd7 0x7d7e22e 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:07.145 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x9b80783 0x9c9578b 0x9c95ee6 0x9ca0178 0x9ca45f1 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f3ec5e 0x6f40fc6 0x747ed38 0x72a6837 0x72a6939 0x72a6a31 0x735bce2 0x735bd9b 0x735bf4e 0x735c086 0x735c101 0x735c186 0x735c2e1 0x7425af5 0x747edc1 0x728e178 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:07.145 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xfdf27 /lib64/libasan.so.8+0xc6d7 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x9a48dbb 0x9c7db9c 0x9c7dcca 0x9c9b8a5 0x9c9c048 0x9ca693e 0x77f3d8d 0x7be876e 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f3ec5e 0x6f40fc6 0x747ed38 0x72a6837 0x72a6939 0x72a6a31 0x735bce2 0x735bd9b 0x735bf4e 0x735c086 0x735c101 0x735c186 0x735c2e1 0x7425af5 0x747edc1 0x728e178 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:07.146 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xe93d /lib64/libasan.so.8+0xef905 0x316fa84 0x316fc5e 0x316ff15 0x316feda 0x317000a 0x6f6ef3a 0x9c89d1c 0x9c89f34 0x9c8a206 0x7be8875 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f3ec5e 0x6f40fc6 0x747ed38 0x72a6837 0x72a6939 0x72a6a31 0x735bce2 0x735bd9b 0x735bf4e 0x735c086 0x735c101 0x735c186 0x735c2e1 0x7425af5 0x747edc1 0x728e178 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:07.146 INFO:teuthology.orchestra.run.trial044.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff9445e022 0xffffffff943e9001 0xffffffff943cb93d 0xffffffff943d3aeb 0xffffffff943d3f4b 0xffffffff940910d2 0xffffffff94d4d451 0xffffffff94e00ba2 2026-02-23T10:21:07.228 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x2a52e81 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9e29e18 0x9c44517 0x9c44d52 0xecf43f /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f54 2026-02-23T10:21:07.242 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65c2 /lib64/libasan.so.8+0x15197 0x2a5304b 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:07.242 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297e0 /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x2a5304b 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:07.242 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x2a529b0 0x7d7e250 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:09.409 INFO:teuthology.orchestra.run.trial044.stderr:----------------------------------------------------- 2026-02-23T10:21:09.409 INFO:teuthology.orchestra.run.trial044.stderr:Suppressions used: 2026-02-23T10:21:09.409 INFO:teuthology.orchestra.run.trial044.stderr: count bytes template 2026-02-23T10:21:09.409 INFO:teuthology.orchestra.run.trial044.stderr: 1 8 MallocExtension::Register 2026-02-23T10:21:09.409 INFO:teuthology.orchestra.run.trial044.stderr:----------------------------------------------------- 2026-02-23T10:21:09.409 INFO:teuthology.orchestra.run.trial044.stderr: 2026-02-23T10:21:09.445 DEBUG:teuthology.orchestra.run.trial044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-23T10:21:09.470 DEBUG:teuthology.orchestra.run.trial044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-23T10:21:09.622 INFO:teuthology.orchestra.run.trial044.stderr:INFO  osd - OSD::main: parsing early config 2026-02-23T10:21:09.675 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:09,675 seastar - Reactor backend: linux-aio 2026-02-23T10:21:09.687 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:09,687 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-23T10:21:09.688 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:09,687 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-23T10:21:09.690 INFO:teuthology.orchestra.run.trial044.stderr:==35488==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-23T10:21:09.745 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:09,743 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-23T10:21:09.745 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:09,743 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-23T10:21:09.745 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:09,743 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-23T10:21:09.745 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:09,743 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-23T10:21:09.745 INFO:teuthology.orchestra.run.trial044.stderr:DEBUG 2026-02-23 10:21:09,744 [shard 0:main] seastar - reactor::drain 2026-02-23T10:21:11.783 INFO:teuthology.orchestra.run.trial044.stderr:----------------------------------------------------- 2026-02-23T10:21:11.784 INFO:teuthology.orchestra.run.trial044.stderr:Suppressions used: 2026-02-23T10:21:11.784 INFO:teuthology.orchestra.run.trial044.stderr: count bytes template 2026-02-23T10:21:11.784 INFO:teuthology.orchestra.run.trial044.stderr: 1 8 MallocExtension::Register 2026-02-23T10:21:11.784 INFO:teuthology.orchestra.run.trial044.stderr:----------------------------------------------------- 2026-02-23T10:21:11.784 INFO:teuthology.orchestra.run.trial044.stderr: 2026-02-23T10:21:11.803 INFO:teuthology.orchestra.run.trial044.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-23T10:21:11.803 INFO:teuthology.orchestra.run.trial044.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-23T10:21:11.846 INFO:teuthology.orchestra.run.trial044.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-23T10:21:11.846 INFO:teuthology.orchestra.run.trial044.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-23T10:21:11.853 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:11,852 seastar - Reactor backend: linux-aio 2026-02-23T10:21:11.867 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:11,867 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-23T10:21:11.868 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:11,867 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-23T10:21:11.871 INFO:teuthology.orchestra.run.trial044.stderr:==35486==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-23T10:21:11.871 INFO:teuthology.orchestra.run.trial044.stderr:INFO 2026-02-23 10:21:11,871 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-23T10:21:11.930 INFO:teuthology.orchestra.run.trial044.stderr:DEBUG 2026-02-23 10:21:11,929 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-23T10:21:12.009 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x316ca28 0x9b7e336 0x9b7e5fe 0x9b7f0ad 0x9b7f5ab 0x9b7fbdb 0x9b7fd45 0x9c8fd63 0x9ca2b6a 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f9f19a 0x6fa2f9b 0x6fa8b45 0x7482004 0x72a89fa 0x72a8afc 0x72a8bf4 0x735cb16 0x735cbcf 0x735cd82 0x735ceba 0x735cf35 0x735cfba 0x735d115 0x7425e13 0x748208d 0x728f241 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:12.010 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x9a48dbb 0x9b02622 0x9b02738 0x9b02814 0x9b02a90 0x9b02b49 0x9b03037 0x9b0343b 0x9b036f8 0x9b041b6 0x9c864c2 0x9c865bb 0x7be87ab 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f9f19a 0x6fa2f9b 0x6fa8b45 0x7482004 0x72a89fa 0x72a8afc 0x72a8bf4 0x735cb16 0x735cbcf 0x735cd82 0x735ceba 0x735cf35 0x735cfba 0x735d115 0x7425e13 0x748208d 0x728f241 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:12.010 INFO:teuthology.orchestra.run.trial044.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff9421f6b4 0xffffffff9421fb20 0xffffffff9409525e 0xffffffff943e61a9 0xffffffff943c9715 0xffffffff943d3aeb 0xffffffff943d3f4b 0xffffffff940910d2 0xffffffff94d4d451 0xffffffff94e00ba2 2026-02-23T10:21:12.010 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x10912b2 0xf2e3ce 0x9b7dc0b 0x9b7e0d5 0x9b7e348 0x9b8006f 0x9b805bc 0x9b807bb 0x9c9578b 0x9c95ee6 0x9ca0178 0x9ca45f1 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f9f19a 0x6fa2f9b 0x6fa8b45 0x7482004 0x72a89fa 0x72a8afc 0x72a8bf4 0x735cb16 0x735cbcf 0x735cd82 0x735ceba 0x735cf35 0x735cfba 0x735d115 0x7425e13 0x748208d 0x728f241 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:12.074 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 32 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x29fe1f6 0x2a52fec 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9e29e18 0x9c44517 0x9c44d52 0xecf43f /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f54 2026-02-23T10:21:12.083 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1006a8 /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15e37 0x33882b9 0x338883d 0x33e08cd 0x33e1764 0x22ed5e1 0x22ed894 0x714848b 0x9abbbbe 0x9492e3d 0x9492f9e 0x7a90e4c 0x711ff75 0x6f9ff86 0x75590f6 0x755924a 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:12.146 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x2a52fd4 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:12.146 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x2a52f60 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:12.149 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x2a529b0 0x7d7e250 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:12.274 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x157c7 0x73d62f9 0x73d647f 0x73d67d2 0x77f3cf1 0x7be876e 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f3ec5e 0x6f40fc6 0x747ed38 0x72a6837 0x72a6939 0x72a6a31 0x735bce2 0x735bd9b 0x735bf4e 0x735c086 0x735c101 0x735c186 0x735c2e1 0x7425af5 0x747edc1 0x728e178 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:12.274 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x9b7e489 0x9b7f348 0x9b84049 0x9b843c5 0x9c9ff46 0x9ca45f1 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f3ec5e 0x6f40fc6 0x747ed38 0x72a6837 0x72a6939 0x72a6a31 0x735bce2 0x735bd9b 0x735bf4e 0x735c086 0x735c101 0x735c186 0x735c2e1 0x7425af5 0x747edc1 0x728e178 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:12.274 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x1125df4 0xf2e3c3 0x9b7dc0b 0x9b7e0d5 0x9b7e348 0x9b8006f 0x9b805bc 0x9b807bb 0x9c9578b 0x9c95ee6 0x9ca0178 0x9ca45f1 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f3ec5e 0x6f40fc6 0x747ed38 0x72a6837 0x72a6939 0x72a6a31 0x735bce2 0x735bd9b 0x735bf4e 0x735c086 0x735c101 0x735c186 0x735c2e1 0x7425af5 0x747edc1 0x728e178 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:12.339 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1518b 0x2a5304b 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:12.357 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1521e 0x2a5304b 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9e29e18 0x9c44517 0x9c44d52 0xecf43f /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f54 2026-02-23T10:21:12.371 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x2a51f00 0x7d7e22e 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:12.371 INFO:teuthology.orchestra.run.trial044.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x129747 /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x2a5304b 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:14.546 INFO:teuthology.orchestra.run.trial044.stderr:----------------------------------------------------- 2026-02-23T10:21:14.546 INFO:teuthology.orchestra.run.trial044.stderr:Suppressions used: 2026-02-23T10:21:14.546 INFO:teuthology.orchestra.run.trial044.stderr: count bytes template 2026-02-23T10:21:14.546 INFO:teuthology.orchestra.run.trial044.stderr: 1 8 MallocExtension::Register 2026-02-23T10:21:14.546 INFO:teuthology.orchestra.run.trial044.stderr:----------------------------------------------------- 2026-02-23T10:21:14.546 INFO:teuthology.orchestra.run.trial044.stderr: 2026-02-23T10:21:14.582 DEBUG:teuthology.orchestra.run.trial044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-23T10:21:14.608 DEBUG:teuthology.orchestra.run.trial198:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-23T10:21:14.634 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-23T10:21:14.635 INFO:tasks.ceph:role: osd.2 2026-02-23T10:21:14.635 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial198.front.sepia.ceph.com 2026-02-23T10:21:14.635 DEBUG:teuthology.orchestra.run.trial198:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-23T10:21:14.699 INFO:teuthology.orchestra.run.trial198.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-23T10:21:14.700 INFO:teuthology.orchestra.run.trial198.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-23T10:21:14.700 INFO:teuthology.orchestra.run.trial198.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-23T10:21:14.700 INFO:teuthology.orchestra.run.trial198.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-23T10:21:14.700 INFO:teuthology.orchestra.run.trial198.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-23T10:21:14.700 INFO:teuthology.orchestra.run.trial198.stdout: = sunit=0 swidth=0 blks 2026-02-23T10:21:14.700 INFO:teuthology.orchestra.run.trial198.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-23T10:21:14.700 INFO:teuthology.orchestra.run.trial198.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-23T10:21:14.700 INFO:teuthology.orchestra.run.trial198.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-23T10:21:14.700 INFO:teuthology.orchestra.run.trial198.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-23T10:21:15.287 INFO:teuthology.orchestra.run.trial198.stdout:Discarding blocks...Done. 2026-02-23T10:21:15.289 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial198.front.sepia.ceph.com -o noatime 2026-02-23T10:21:15.289 DEBUG:teuthology.orchestra.run.trial198:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-23T10:21:15.356 DEBUG:teuthology.orchestra.run.trial198:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-23T10:21:15.423 DEBUG:teuthology.orchestra.run.trial198:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-23T10:21:15.488 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-23T10:21:15.489 INFO:tasks.ceph:role: osd.3 2026-02-23T10:21:15.489 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial198.front.sepia.ceph.com 2026-02-23T10:21:15.489 DEBUG:teuthology.orchestra.run.trial198:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-23T10:21:15.554 INFO:teuthology.orchestra.run.trial198.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-23T10:21:15.554 INFO:teuthology.orchestra.run.trial198.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-23T10:21:15.554 INFO:teuthology.orchestra.run.trial198.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-23T10:21:15.554 INFO:teuthology.orchestra.run.trial198.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-23T10:21:15.554 INFO:teuthology.orchestra.run.trial198.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-23T10:21:15.554 INFO:teuthology.orchestra.run.trial198.stdout: = sunit=0 swidth=0 blks 2026-02-23T10:21:15.555 INFO:teuthology.orchestra.run.trial198.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-23T10:21:15.555 INFO:teuthology.orchestra.run.trial198.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-23T10:21:15.555 INFO:teuthology.orchestra.run.trial198.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-23T10:21:15.555 INFO:teuthology.orchestra.run.trial198.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-23T10:21:16.115 INFO:teuthology.orchestra.run.trial198.stdout:Discarding blocks...Done. 2026-02-23T10:21:16.118 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial198.front.sepia.ceph.com -o noatime 2026-02-23T10:21:16.118 DEBUG:teuthology.orchestra.run.trial198:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2026-02-23T10:21:16.185 DEBUG:teuthology.orchestra.run.trial198:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-23T10:21:16.253 DEBUG:teuthology.orchestra.run.trial198:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-23T10:21:16.403 INFO:teuthology.orchestra.run.trial198.stderr:INFO  osd - OSD::main: parsing early config 2026-02-23T10:21:16.462 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:16,461 seastar - Reactor backend: linux-aio 2026-02-23T10:21:16.469 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:16,468 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-23T10:21:16.470 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:16,468 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-23T10:21:16.472 INFO:teuthology.orchestra.run.trial198.stderr:==34955==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-23T10:21:16.527 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:16,525 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-23T10:21:16.527 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:16,525 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-23T10:21:16.527 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:16,525 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-23T10:21:16.527 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:16,525 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-23T10:21:16.527 INFO:teuthology.orchestra.run.trial198.stderr:DEBUG 2026-02-23 10:21:16,526 [shard 0:main] seastar - reactor::drain 2026-02-23T10:21:18.586 INFO:teuthology.orchestra.run.trial198.stderr:----------------------------------------------------- 2026-02-23T10:21:18.587 INFO:teuthology.orchestra.run.trial198.stderr:Suppressions used: 2026-02-23T10:21:18.587 INFO:teuthology.orchestra.run.trial198.stderr: count bytes template 2026-02-23T10:21:18.587 INFO:teuthology.orchestra.run.trial198.stderr: 1 8 MallocExtension::Register 2026-02-23T10:21:18.587 INFO:teuthology.orchestra.run.trial198.stderr:----------------------------------------------------- 2026-02-23T10:21:18.587 INFO:teuthology.orchestra.run.trial198.stderr: 2026-02-23T10:21:18.606 INFO:teuthology.orchestra.run.trial198.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-23T10:21:18.606 INFO:teuthology.orchestra.run.trial198.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-23T10:21:18.651 INFO:teuthology.orchestra.run.trial198.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-23T10:21:18.651 INFO:teuthology.orchestra.run.trial198.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-23T10:21:18.658 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:18,657 seastar - Reactor backend: linux-aio 2026-02-23T10:21:18.667 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:18,667 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-23T10:21:18.667 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:18,667 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-23T10:21:18.671 INFO:teuthology.orchestra.run.trial198.stderr:==34953==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-23T10:21:18.671 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:18,671 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-23T10:21:18.728 INFO:teuthology.orchestra.run.trial198.stderr:DEBUG 2026-02-23 10:21:18,728 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-23T10:21:18.808 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xed720 0xcb0505 0x9c87dfc 0x9c88176 0x9c9f909 0x9ca45f1 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f9f19a 0x6fa2f9b 0x6fa8b45 0x7482004 0x72a89fa 0x72a8afc 0x72a8bf4 0x735cb16 0x735cbcf 0x735cd82 0x735ceba 0x735cf35 0x735cfba 0x735d115 0x7425e13 0x748208d 0x728f241 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:18.808 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0xe06a27 0x1125de5 0xf2e3c3 0x9b7ddd8 0x9b7e0d5 0x9b7e348 0x9b8006f 0x9b8a1e5 0x9b8a5f7 0x9c8f718 0x9c8fb4c 0x9c8fedf 0x9ca2b6a 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f9f19a 0x6fa2f9b 0x6fa8b45 0x7482004 0x72a89fa 0x72a8afc 0x72a8bf4 0x735cb16 0x735cbcf 0x735cd82 0x735ceba 0x735cf35 0x735cfba 0x735d115 0x7425e13 0x748208d 0x728f241 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:18.808 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x9b02185 0x9b02304 0x9b023e9 0x9b02645 0x9b02738 0x9b02814 0x9b02ed0 0x9b02b49 0x9b03037 0x9b0343b 0x9b036f8 0x9ca27bf 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f9f19a 0x6fa2f9b 0x6fa8b45 0x7482004 0x72a89fa 0x72a8afc 0x72a8bf4 0x735cb16 0x735cbcf 0x735cd82 0x735ceba 0x735cf35 0x735cfba 0x735d115 0x7425e13 0x748208d 0x728f241 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:18.904 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x7d7e219 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9e29e18 0x9c44517 0x9c44d52 0xecf43f /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f54 2026-02-23T10:21:18.944 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x2a52f18 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:18.944 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cc0c /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x2a5304b 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:18.945 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x2a5303a 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:19.073 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6583 /lib64/libasan.so.8+0x15e37 0x9b7df96 0x9b7e348 0x9b7e5fe 0x9b7ebc0 0x9b83ce5 0x9b843c5 0x9c9ff46 0x9ca45f1 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f3ec5e 0x6f40fc6 0x747ed38 0x72a6837 0x72a6939 0x72a6a31 0x735bce2 0x735bd9b 0x735bf4e 0x735c086 0x735c101 0x735c186 0x735c2e1 0x7425af5 0x747edc1 0x728e178 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:19.073 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15835 0x1091317 0xf2e3ce 0x9b7dc0b 0x9b7e0d5 0x9b7e348 0x9b7e5fe 0x9b7f0ad 0x9b7f5ab 0x9b7fbdb 0x9b7fd45 0x9c8fd63 0x9ca2b6a 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f3ec5e 0x6f40fc6 0x747ed38 0x72a6837 0x72a6939 0x72a6a31 0x735bce2 0x735bd9b 0x735bf4e 0x735c086 0x735c101 0x735c186 0x735c2e1 0x7425af5 0x747edc1 0x728e178 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:19.073 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x9b7eb74 0x9b83ce5 0x9b843c5 0x9c9ff46 0x9ca45f1 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f3ec5e 0x6f40fc6 0x747ed38 0x72a6837 0x72a6939 0x72a6a31 0x735bce2 0x735bd9b 0x735bf4e 0x735c086 0x735c101 0x735c186 0x735c2e1 0x7425af5 0x747edc1 0x728e178 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:19.155 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x2a51f1d 0x7d7e22e 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9e29e18 0x9c44517 0x9c44d52 0xecf43f /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f54 2026-02-23T10:21:19.169 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x29fe1a8 0x2a52fec 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:19.169 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x2a5241b 0x7d7e243 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:19.170 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297ad /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x2a5304b 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:21.305 INFO:teuthology.orchestra.run.trial198.stderr:----------------------------------------------------- 2026-02-23T10:21:21.305 INFO:teuthology.orchestra.run.trial198.stderr:Suppressions used: 2026-02-23T10:21:21.305 INFO:teuthology.orchestra.run.trial198.stderr: count bytes template 2026-02-23T10:21:21.305 INFO:teuthology.orchestra.run.trial198.stderr: 1 8 MallocExtension::Register 2026-02-23T10:21:21.306 INFO:teuthology.orchestra.run.trial198.stderr:----------------------------------------------------- 2026-02-23T10:21:21.306 INFO:teuthology.orchestra.run.trial198.stderr: 2026-02-23T10:21:21.338 DEBUG:teuthology.orchestra.run.trial198:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-23T10:21:21.364 DEBUG:teuthology.orchestra.run.trial198:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-23T10:21:21.515 INFO:teuthology.orchestra.run.trial198.stderr:INFO  osd - OSD::main: parsing early config 2026-02-23T10:21:21.572 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:21,571 seastar - Reactor backend: linux-aio 2026-02-23T10:21:21.582 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:21,581 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-23T10:21:21.582 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:21,581 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-23T10:21:21.584 INFO:teuthology.orchestra.run.trial198.stderr:==35021==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-23T10:21:21.639 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:21,638 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-23T10:21:21.640 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:21,638 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-23T10:21:21.640 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:21,638 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-23T10:21:21.640 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:21,638 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-23T10:21:21.640 INFO:teuthology.orchestra.run.trial198.stderr:DEBUG 2026-02-23 10:21:21,638 [shard 0:main] seastar - reactor::drain 2026-02-23T10:21:23.708 INFO:teuthology.orchestra.run.trial198.stderr:----------------------------------------------------- 2026-02-23T10:21:23.709 INFO:teuthology.orchestra.run.trial198.stderr:Suppressions used: 2026-02-23T10:21:23.709 INFO:teuthology.orchestra.run.trial198.stderr: count bytes template 2026-02-23T10:21:23.709 INFO:teuthology.orchestra.run.trial198.stderr: 1 8 MallocExtension::Register 2026-02-23T10:21:23.709 INFO:teuthology.orchestra.run.trial198.stderr:----------------------------------------------------- 2026-02-23T10:21:23.709 INFO:teuthology.orchestra.run.trial198.stderr: 2026-02-23T10:21:23.728 INFO:teuthology.orchestra.run.trial198.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-23T10:21:23.728 INFO:teuthology.orchestra.run.trial198.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-23T10:21:23.769 INFO:teuthology.orchestra.run.trial198.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-23T10:21:23.770 INFO:teuthology.orchestra.run.trial198.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-23T10:21:23.776 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:23,776 seastar - Reactor backend: linux-aio 2026-02-23T10:21:23.787 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:23,786 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-23T10:21:23.787 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:23,786 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-23T10:21:23.791 INFO:teuthology.orchestra.run.trial198.stderr:==35019==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-23T10:21:23.791 INFO:teuthology.orchestra.run.trial198.stderr:INFO 2026-02-23 10:21:23,790 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-23T10:21:23.849 INFO:teuthology.orchestra.run.trial198.stderr:DEBUG 2026-02-23 10:21:23,848 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-23T10:21:23.928 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x3606acc 0x9b8b6b3 0x9b8b796 0x9c872e7 0x9c8747c 0x9c8780e 0x9c87a19 0x9c87d55 0x9c88176 0x9c9f909 0x9ca45f1 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f9f19a 0x6fa2f9b 0x6fa8b45 0x7482004 0x72a89fa 0x72a8afc 0x72a8bf4 0x735cb16 0x735cbcf 0x735cd82 0x735ceba 0x735cf35 0x735cfba 0x735d115 0x7425e13 0x748208d 0x728f241 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:23.929 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65c2 /lib64/libasan.so.8+0x157c7 0x3607f33 0x9c877d3 0x9c87a19 0x9c87d55 0x9c88176 0x9c9f909 0x9ca45f1 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f9f19a 0x6fa2f9b 0x6fa8b45 0x7482004 0x72a89fa 0x72a8afc 0x72a8bf4 0x735cb16 0x735cbcf 0x735cd82 0x735ceba 0x735cf35 0x735cfba 0x735d115 0x7425e13 0x748208d 0x728f241 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:23.929 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc59b /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x9a48dbb 0x9b02622 0x9b02738 0x9b02814 0x9b02ed0 0x9b03037 0x9b0343b 0x9b036f8 0x9ca27bf 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f9f19a 0x6fa2f9b 0x6fa8b45 0x7482004 0x72a89fa 0x72a8afc 0x72a8bf4 0x735cb16 0x735cbcf 0x735cd82 0x735ceba 0x735cf35 0x735cfba 0x735d115 0x7425e13 0x748208d 0x728f241 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:23.963 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 68 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x7e9b8d8 0x7e9bb9c 0xb6e4fb 0x6f6f021 0x9c89d1c 0x9c89f34 0x9c8a206 0x7e21b72 0x7e2f1db 0x79f7939 0x7a8f19f 0x711ff75 0x6f9ff86 0x75590f6 0x755924a 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9e29e18 0x9c44517 0x9c44d52 0xecf43f /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f54 2026-02-23T10:21:23.998 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 32 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1006a8 /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x2a5304b 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9e29e18 0x9c44517 0x9c44d52 0xecf43f /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f54 2026-02-23T10:21:24.065 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xf4e8f /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x2a5304b 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:24.067 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x2a52343 0x7d7e243 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:24.067 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x2a529eb 0x7d7e250 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:24.190 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x151f5 0x1125e3c 0xf2e3c3 0x9c906c3 0x9c90cb0 0x9c91033 0x9ca118e 0x9ca45f1 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f3ec5e 0x6f40fc6 0x747ed38 0x72a6837 0x72a6939 0x72a6a31 0x735bce2 0x735bd9b 0x735bf4e 0x735c086 0x735c101 0x735c186 0x735c2e1 0x7425af5 0x747edc1 0x728e178 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:24.190 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x8eea /lib64/libasan.so.8+0xedc45 0xe1d5af 0x9ca5d35 0x77f3d8d 0x7be8169 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f3ec5e 0x6f40fc6 0x747ed38 0x72a6837 0x72a6939 0x72a6a31 0x735bce2 0x735bd9b 0x735bf4e 0x735c086 0x735c101 0x735c186 0x735c2e1 0x7425af5 0x747edc1 0x728e178 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:24.190 INFO:teuthology.orchestra.run.trial198.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff9d15fe1b 0xffffffff9c7f8a88 0xffffffff9c7f92f3 0xffffffff9c7f9774 0xffffffff9c7fb709 0xffffffff9c7fcc31 0xffffffff9c824893 0xffffffff9c824a55 0xffffffff9c7c97c8 0xffffffff9c7d3aeb 0xffffffff9c7d3f4b 0xffffffff9c4910d2 0xffffffff9d14d451 0xffffffff9d200ba2 2026-02-23T10:21:24.191 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libstdc++.so.6+0xc6247 0x316b607 0x9b7e045 0x9b7e348 0x9b7e5fe 0x9b7f0ad 0x9b7f5ab 0x9b7fbdb 0x9b7fd45 0x9c8fd63 0x9ca2b6a 0x9c052e1 0x9c042e1 0x7be8837 0x7bf23a6 0x7a51d33 0x7a8d6c5 0x711ff75 0x6f3ec5e 0x6f40fc6 0x747ed38 0x72a6837 0x72a6939 0x72a6a31 0x735bce2 0x735bd9b 0x735bf4e 0x735c086 0x735c101 0x735c186 0x735c2e1 0x7425af5 0x747edc1 0x728e178 0x72a6bae 0x73b5274 0x7432e6c 0x7432ee7 0x7432f62 0x74eccd2 0x75e6286 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:24.273 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1006a8 /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x2a5304b 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9e29e18 0x9c44517 0x9c44d52 0xecf43f /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f54 2026-02-23T10:21:24.286 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1006a8 /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x2a5304b 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:24.287 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1fb10 /lib64/libasan.so.8+0x15197 0x2a5304b 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:24.287 INFO:teuthology.orchestra.run.trial198.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9f10dfc 0x9d045c3 0x9d40a13 0x9d43fc6 0x9d44234 0x9d4437c 0x9d4483b /lib64/libc.so.6+0x3fc2f 0x29fe1ef 0x2a52fec 0x7d7e215 0x7d9da0c 0x7e39ed3 0x7dbe035 0x78750f3 0x7875de8 0x79b38b2 0x7833a0a 0x78a9398 0x78f345f 0x78f36d8 0x79a02cc 0x79a042b 0x79b3a15 0x7864b7c 0x799073e 0x79907ce 0x7990872 0x73eb37a 0x7409299 0x740c6cb 0x75440fc 0x9e08ac1 0x9d0cb62 0x9dc6e39 0x9e285fb 0x9f988cc 0x9f98f48 0x26ed527 0xa5ce02e /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-23T10:21:26.470 INFO:teuthology.orchestra.run.trial198.stderr:----------------------------------------------------- 2026-02-23T10:21:26.470 INFO:teuthology.orchestra.run.trial198.stderr:Suppressions used: 2026-02-23T10:21:26.470 INFO:teuthology.orchestra.run.trial198.stderr: count bytes template 2026-02-23T10:21:26.470 INFO:teuthology.orchestra.run.trial198.stderr: 1 8 MallocExtension::Register 2026-02-23T10:21:26.470 INFO:teuthology.orchestra.run.trial198.stderr:----------------------------------------------------- 2026-02-23T10:21:26.470 INFO:teuthology.orchestra.run.trial198.stderr: 2026-02-23T10:21:26.504 DEBUG:teuthology.orchestra.run.trial198:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-23T10:21:26.530 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-23T10:21:26.530 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:21:26.531 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-23T10:21:26.557 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:21:26.557 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-23T10:21:26.620 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-23T10:21:26.621 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-23T10:21:26.647 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-23T10:21:26.647 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-23T10:21:26.712 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-23T10:21:26.713 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-23T10:21:26.776 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:21:26.776 DEBUG:teuthology.orchestra.run.trial044:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-23T10:21:26.795 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-23T10:21:26.795 DEBUG:teuthology.orchestra.run.trial198:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2026-02-23T10:21:26.832 INFO:tasks.ceph:Adding keys to all mons... 2026-02-23T10:21:26.833 DEBUG:teuthology.orchestra.run.trial044:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-23T10:21:26.857 INFO:teuthology.orchestra.run.trial044.stdout:[osd.0] 2026-02-23T10:21:26.858 INFO:teuthology.orchestra.run.trial044.stdout: key = AQASKpxplrWuLxAAfARVDdaG8XcWxYhGGj2Yzg== 2026-02-23T10:21:26.858 INFO:teuthology.orchestra.run.trial044.stdout:[osd.1] 2026-02-23T10:21:26.858 INFO:teuthology.orchestra.run.trial044.stdout: key = AQAXKpxp7ouaNxAA03j04KtEF4FgrGTb6789Iw== 2026-02-23T10:21:26.858 INFO:teuthology.orchestra.run.trial044.stdout:[mgr.x] 2026-02-23T10:21:26.858 INFO:teuthology.orchestra.run.trial044.stdout: key = AQAOKpxpMuFqIhAAyM7sJCMvCZIO8oETlmnCHg== 2026-02-23T10:21:26.858 INFO:teuthology.orchestra.run.trial044.stdout:[osd.2] 2026-02-23T10:21:26.858 INFO:teuthology.orchestra.run.trial044.stdout: key = AQAeKpxpnFCgKxAAc2nrDP1ng7rgILnXwcDU+Q== 2026-02-23T10:21:26.858 INFO:teuthology.orchestra.run.trial044.stdout:[osd.3] 2026-02-23T10:21:26.858 INFO:teuthology.orchestra.run.trial044.stdout: key = AQAjKpxpb+DDMhAAUKSK7WMHWnuNBxhTdbuCLA== 2026-02-23T10:21:26.858 INFO:teuthology.orchestra.run.trial044.stdout:[client.0] 2026-02-23T10:21:26.859 INFO:teuthology.orchestra.run.trial044.stdout: key = AQAOKpxpuI8mJRAAmSM4fXYrhIX8YCVbnrA2XA== 2026-02-23T10:21:26.859 INFO:teuthology.orchestra.run.trial044.stdout:[client.1] 2026-02-23T10:21:26.859 INFO:teuthology.orchestra.run.trial044.stdout: key = AQAOKpxp3sp2KBAAevfLeTx9ms7UHsmkIJRRHw== 2026-02-23T10:21:26.860 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T10:21:26.947 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T10:21:26.996 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-23T10:21:27.043 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T10:21:27.092 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T10:21:27.142 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-23T10:21:27.194 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-23T10:21:27.244 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-23T10:21:27.244 DEBUG:teuthology.orchestra.run.trial044:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-23T10:21:27.269 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-23T10:21:27.355 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:27.353+0000 7fe224c89c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:27.355 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:27.353+0000 7fe224c89c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:27.367 DEBUG:teuthology.orchestra.run.trial044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-23T10:21:27.392 DEBUG:teuthology.orchestra.run.trial044:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-23T10:21:27.449 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-23T10:21:27.449 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-23T10:21:27.449 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-23T10:21:27.492 INFO:tasks.ceph.mon.a:Started 2026-02-23T10:21:27.492 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-23T10:21:27.492 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-23T10:21:27.493 DEBUG:teuthology.orchestra.run.trial198:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-23T10:21:27.495 INFO:tasks.ceph.mgr.x:Started 2026-02-23T10:21:27.495 DEBUG:tasks.ceph:set 0 configs 2026-02-23T10:21:27.496 DEBUG:teuthology.orchestra.run.trial044:> sudo ceph --cluster ceph config dump 2026-02-23T10:21:27.553 INFO:tasks.ceph.mon.a.trial044.stderr:2026-02-23T10:21:27.551+0000 7f968b087c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:27.553 INFO:tasks.ceph.mon.a.trial044.stderr:2026-02-23T10:21:27.551+0000 7f968b087c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:27.553 INFO:tasks.ceph.mon.a.trial044.stderr:2026-02-23T10:21:27.551+0000 7f968b087c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:27.555 INFO:tasks.ceph.mgr.x.trial198.stderr:2026-02-23T10:21:27.553+0000 7faca5bc7fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:27.568 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:27.564+0000 7fe59e2c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:27.571 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:27.569+0000 7fe59e2c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:27.577 INFO:tasks.ceph.mgr.x.trial198.stderr:2026-02-23T10:21:27.574+0000 7faca5bc7fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:27.577 INFO:tasks.ceph.mgr.x.trial198.stderr:2026-02-23T10:21:27.575+0000 7faca5bc7fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:27.605 INFO:teuthology.orchestra.run.trial044.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-23T10:21:27.612 INFO:tasks.ceph:Setting crush tunables to default 2026-02-23T10:21:27.612 DEBUG:teuthology.orchestra.run.trial044:> sudo ceph --cluster ceph osd crush tunables default 2026-02-23T10:21:27.686 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:27.681+0000 7f86530c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:27.688 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:27.686+0000 7f86530c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:27.724 INFO:teuthology.orchestra.run.trial044.stderr:adjusted tunables profile to default 2026-02-23T10:21:27.732 INFO:tasks.ceph:check_enable_crimson: True 2026-02-23T10:21:27.732 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-23T10:21:27.732 DEBUG:teuthology.orchestra.run.trial044:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-23T10:21:27.805 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:27.800+0000 7f8a2056f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:27.807 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:27.805+0000 7f8a2056f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:27.847 INFO:tasks.ceph.mon.a.trial044.stderr:2026-02-23T10:21:27.844+0000 7f96833f1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-23T10:21:27.847 INFO:tasks.ceph.mon.a.trial044.stderr:Please be aware that this feature is experimental, untested, 2026-02-23T10:21:27.847 INFO:tasks.ceph.mon.a.trial044.stderr:unsupported, and may result in data corruption, data loss, 2026-02-23T10:21:27.847 INFO:tasks.ceph.mon.a.trial044.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-23T10:21:27.847 INFO:tasks.ceph.mon.a.trial044.stderr:feature with important data. 2026-02-23T10:21:27.847 INFO:tasks.ceph.mon.a.trial044.stderr: 2026-02-23T10:21:28.407 INFO:tasks.ceph.mgr.x.trial198.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-23T10:21:28.407 INFO:tasks.ceph.mgr.x.trial198.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-23T10:21:28.407 INFO:tasks.ceph.mgr.x.trial198.stderr: from numpy import show_config as show_numpy_config 2026-02-23T10:21:28.735 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-23T10:21:28.735 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:21:28.735 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-23T10:21:28.760 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:21:28.760 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-23T10:21:28.824 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-23T10:21:28.825 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-23T10:21:28.850 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-23T10:21:28.850 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-23T10:21:28.914 DEBUG:teuthology.orchestra.run.trial198:> sudo ceph --cluster ceph osd new 3c43e764-bab2-4a61-963d-7ed9fc9e29f1 0 2026-02-23T10:21:29.029 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-23T10:21:29.024+0000 7f43836cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:29.031 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-23T10:21:29.029+0000 7f43836cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:29.068 INFO:teuthology.orchestra.run.trial198.stdout:0 2026-02-23T10:21:29.075 DEBUG:teuthology.orchestra.run.trial198:> sudo ceph --cluster ceph osd new b21113b1-290a-414f-888b-5caaefed55d4 1 2026-02-23T10:21:29.147 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-23T10:21:29.142+0000 7f7ff5ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:29.150 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-23T10:21:29.148+0000 7f7ff5ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:29.187 INFO:teuthology.orchestra.run.trial198.stdout:1 2026-02-23T10:21:29.195 DEBUG:teuthology.orchestra.run.trial198:> sudo ceph --cluster ceph osd new 927dd7f0-f27c-44d4-a817-d26fbeddac60 2 2026-02-23T10:21:29.267 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-23T10:21:29.263+0000 7fe1a3c11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:29.271 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-23T10:21:29.269+0000 7fe1a3c11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:29.309 INFO:teuthology.orchestra.run.trial198.stdout:2 2026-02-23T10:21:29.316 DEBUG:teuthology.orchestra.run.trial198:> sudo ceph --cluster ceph osd new fe73bff8-c92a-48ba-aa55-a165b0fd0770 3 2026-02-23T10:21:29.389 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-23T10:21:29.384+0000 7f58b15d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:29.391 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-23T10:21:29.389+0000 7f58b15d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:29.429 INFO:teuthology.orchestra.run.trial198.stdout:3 2026-02-23T10:21:29.437 DEBUG:teuthology.orchestra.run.trial044:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-23T10:21:29.465 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-23T10:21:29.465 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-23T10:21:29.507 INFO:tasks.ceph.osd.0:Started 2026-02-23T10:21:29.507 DEBUG:teuthology.orchestra.run.trial044:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-23T10:21:29.534 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-23T10:21:29.534 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-23T10:21:29.576 INFO:tasks.ceph.osd.1:Started 2026-02-23T10:21:29.576 DEBUG:teuthology.orchestra.run.trial198:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-23T10:21:29.602 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-23T10:21:29.602 DEBUG:teuthology.orchestra.run.trial198:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-23T10:21:29.643 INFO:tasks.ceph.osd.2:Started 2026-02-23T10:21:29.643 DEBUG:teuthology.orchestra.run.trial198:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2026-02-23T10:21:29.669 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-23T10:21:29.670 DEBUG:teuthology.orchestra.run.trial198:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2026-02-23T10:21:29.711 INFO:tasks.ceph.osd.3:Started 2026-02-23T10:21:29.712 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-23T10:21:29.786 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:29.781+0000 7f346610b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:29.788 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:29.786+0000 7f346610b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:29.821 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:29.822 INFO:teuthology.orchestra.run.trial044.stdout:{"epoch":7,"fsid":"746afa72-9d07-49c4-8eb1-34745ca9165e","created":"2026-02-23T10:21:27.563675+0000","modified":"2026-02-23T10:21:29.428766+0000","last_up_change":"0.000000","last_in_change":"2026-02-23T10:21:29.428766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"3c43e764-bab2-4a61-963d-7ed9fc9e29f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b21113b1-290a-414f-888b-5caaefed55d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"927dd7f0-f27c-44d4-a817-d26fbeddac60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fe73bff8-c92a-48ba-aa55-a165b0fd0770","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T10:21:29.829 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-23T10:21:29.829 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-23T10:21:30.231 DEBUG:teuthology.orchestra.run.trial044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-23T10:21:30.298 INFO:teuthology.misc.health.trial044.stderr:2026-02-23T10:21:30.293+0000 7f590dbb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:30.300 INFO:teuthology.misc.health.trial044.stderr:2026-02-23T10:21:30.298+0000 7f590dbb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:30.333 INFO:teuthology.misc.health.trial044.stdout: 2026-02-23T10:21:30.333 INFO:teuthology.misc.health.trial044.stdout:{"epoch":7,"fsid":"746afa72-9d07-49c4-8eb1-34745ca9165e","created":"2026-02-23T10:21:27.563675+0000","modified":"2026-02-23T10:21:29.428766+0000","last_up_change":"0.000000","last_in_change":"2026-02-23T10:21:29.428766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"3c43e764-bab2-4a61-963d-7ed9fc9e29f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b21113b1-290a-414f-888b-5caaefed55d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"927dd7f0-f27c-44d4-a817-d26fbeddac60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fe73bff8-c92a-48ba-aa55-a165b0fd0770","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T10:21:30.338 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-23T10:21:30.604 INFO:tasks.ceph.mgr.x.trial198.stderr:2026-02-23T10:21:30.602+0000 7fabc2a81640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-23T10:21:36.742 DEBUG:teuthology.orchestra.run.trial044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-23T10:21:36.808 INFO:teuthology.misc.health.trial044.stderr:2026-02-23T10:21:36.804+0000 7f0aac85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:36.811 INFO:teuthology.misc.health.trial044.stderr:2026-02-23T10:21:36.809+0000 7f0aac85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:36.921 INFO:teuthology.misc.health.trial044.stdout: 2026-02-23T10:21:36.921 INFO:teuthology.misc.health.trial044.stdout:{"epoch":11,"fsid":"746afa72-9d07-49c4-8eb1-34745ca9165e","created":"2026-02-23T10:21:27.563675+0000","modified":"2026-02-23T10:21:36.735919+0000","last_up_change":"2026-02-23T10:21:36.735919+0000","last_in_change":"2026-02-23T10:21:29.428766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"3c43e764-bab2-4a61-963d-7ed9fc9e29f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6818","nonce":3853675516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6817","nonce":3853675516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6801","nonce":3853675516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6803","nonce":3853675516}]},"public_addr":"10.20.193.44:6818/3853675516","cluster_addr":"10.20.193.44:6817/3853675516","heartbeat_back_addr":"10.20.193.44:6801/3853675516","heartbeat_front_addr":"10.20.193.44:6803/3853675516","state":["exists","up"]},{"osd":1,"uuid":"b21113b1-290a-414f-888b-5caaefed55d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6804","nonce":378639318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6805","nonce":378639318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6807","nonce":378639318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6806","nonce":378639318}]},"public_addr":"10.20.193.44:6804/378639318","cluster_addr":"10.20.193.44:6805/378639318","heartbeat_back_addr":"10.20.193.44:6807/378639318","heartbeat_front_addr":"10.20.193.44:6806/378639318","state":["exists","up"]},{"osd":2,"uuid":"927dd7f0-f27c-44d4-a817-d26fbeddac60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6803","nonce":3235942581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6802","nonce":3235942581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6810","nonce":3235942581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6811","nonce":3235942581}]},"public_addr":"10.20.193.198:6803/3235942581","cluster_addr":"10.20.193.198:6802/3235942581","heartbeat_back_addr":"10.20.193.198:6810/3235942581","heartbeat_front_addr":"10.20.193.198:6811/3235942581","state":["exists","up"]},{"osd":3,"uuid":"fe73bff8-c92a-48ba-aa55-a165b0fd0770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6805","nonce":794892580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6806","nonce":794892580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6807","nonce":794892580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6804","nonce":794892580}]},"public_addr":"10.20.193.198:6805/794892580","cluster_addr":"10.20.193.198:6806/794892580","heartbeat_back_addr":"10.20.193.198:6807/794892580","heartbeat_front_addr":"10.20.193.198:6804/794892580","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T10:21:36.928 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-23T10:21:36.928 INFO:tasks.ceph:Creating RBD pool 2026-02-23T10:21:36.928 DEBUG:teuthology.orchestra.run.trial044:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-23T10:21:37.002 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:36.996+0000 7fc40635b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:37.004 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:37.002+0000 7fc40635b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:37.740 INFO:teuthology.orchestra.run.trial044.stderr:pool 'rbd' created 2026-02-23T10:21:37.754 DEBUG:teuthology.orchestra.run.trial044:> rbd --cluster ceph pool init rbd 2026-02-23T10:21:37.795 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:37.793+0000 7fcebd709240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:37.795 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:37.793+0000 7fcebd709240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:37.798 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:37.796+0000 7fcebd709240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:40.783 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-23T10:21:40.784 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-23T10:21:40.785 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-23T10:21:40.900 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:40.895+0000 7f126930b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:40.903 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:40.901+0000 7f126930b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.016 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:41.026 INFO:teuthology.orchestra.run.trial044.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-23T10:21:41.027 INFO:tasks.ceph_manager:config epoch is 1 2026-02-23T10:21:41.027 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-23T10:21:41.027 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-23T10:21:41.027 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-23T10:21:41.102 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.098+0000 7fb9921dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.105 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.103+0000 7fb9921dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.247 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:41.256 INFO:teuthology.orchestra.run.trial044.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6800","nonce":1303224577},{"type":"v1","addr":"10.20.193.198:6801","nonce":1303224577}]},"active_addr":"10.20.193.198:6801/1303224577","active_change":"2026-02-23T10:21:29.596498+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.198:0","nonce":3718067844}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.198:0","nonce":1969803268}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.198:0","nonce":1361802367}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.198:0","nonce":1675185644}]}]} 2026-02-23T10:21:41.260 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-23T10:21:41.260 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-23T10:21:41.261 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-23T10:21:41.337 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.332+0000 7f1ab499c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.340 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.338+0000 7f1ab499c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.453 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:41.453 INFO:teuthology.orchestra.run.trial044.stdout:{"epoch":15,"fsid":"746afa72-9d07-49c4-8eb1-34745ca9165e","created":"2026-02-23T10:21:27.563675+0000","modified":"2026-02-23T10:21:40.751553+0000","last_up_change":"2026-02-23T10:21:36.735919+0000","last_in_change":"2026-02-23T10:21:29.428766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-23T10:21:37.119461+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-23T10:21:37.617843+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3c43e764-bab2-4a61-963d-7ed9fc9e29f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6818","nonce":3853675516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6817","nonce":3853675516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6801","nonce":3853675516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6803","nonce":3853675516}]},"public_addr":"10.20.193.44:6818/3853675516","cluster_addr":"10.20.193.44:6817/3853675516","heartbeat_back_addr":"10.20.193.44:6801/3853675516","heartbeat_front_addr":"10.20.193.44:6803/3853675516","state":["exists","up"]},{"osd":1,"uuid":"b21113b1-290a-414f-888b-5caaefed55d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6804","nonce":378639318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6805","nonce":378639318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6807","nonce":378639318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6806","nonce":378639318}]},"public_addr":"10.20.193.44:6804/378639318","cluster_addr":"10.20.193.44:6805/378639318","heartbeat_back_addr":"10.20.193.44:6807/378639318","heartbeat_front_addr":"10.20.193.44:6806/378639318","state":["exists","up"]},{"osd":2,"uuid":"927dd7f0-f27c-44d4-a817-d26fbeddac60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6803","nonce":3235942581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6802","nonce":3235942581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6810","nonce":3235942581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6811","nonce":3235942581}]},"public_addr":"10.20.193.198:6803/3235942581","cluster_addr":"10.20.193.198:6802/3235942581","heartbeat_back_addr":"10.20.193.198:6810/3235942581","heartbeat_front_addr":"10.20.193.198:6811/3235942581","state":["exists","up"]},{"osd":3,"uuid":"fe73bff8-c92a-48ba-aa55-a165b0fd0770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6805","nonce":794892580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6806","nonce":794892580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6807","nonce":794892580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6804","nonce":794892580}]},"public_addr":"10.20.193.198:6805/794892580","cluster_addr":"10.20.193.198:6806/794892580","heartbeat_back_addr":"10.20.193.198:6807/794892580","heartbeat_front_addr":"10.20.193.198:6804/794892580","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T10:21:41.463 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-23T10:21:41.464 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-23T10:21:41.540 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.535+0000 7f5f06d9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.542 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.540+0000 7f5f06d9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.654 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:41.655 INFO:teuthology.orchestra.run.trial044.stdout:{"epoch":15,"fsid":"746afa72-9d07-49c4-8eb1-34745ca9165e","created":"2026-02-23T10:21:27.563675+0000","modified":"2026-02-23T10:21:40.751553+0000","last_up_change":"2026-02-23T10:21:36.735919+0000","last_in_change":"2026-02-23T10:21:29.428766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-23T10:21:37.119461+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-23T10:21:37.617843+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3c43e764-bab2-4a61-963d-7ed9fc9e29f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6818","nonce":3853675516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6817","nonce":3853675516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6801","nonce":3853675516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6803","nonce":3853675516}]},"public_addr":"10.20.193.44:6818/3853675516","cluster_addr":"10.20.193.44:6817/3853675516","heartbeat_back_addr":"10.20.193.44:6801/3853675516","heartbeat_front_addr":"10.20.193.44:6803/3853675516","state":["exists","up"]},{"osd":1,"uuid":"b21113b1-290a-414f-888b-5caaefed55d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6804","nonce":378639318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6805","nonce":378639318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6807","nonce":378639318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6806","nonce":378639318}]},"public_addr":"10.20.193.44:6804/378639318","cluster_addr":"10.20.193.44:6805/378639318","heartbeat_back_addr":"10.20.193.44:6807/378639318","heartbeat_front_addr":"10.20.193.44:6806/378639318","state":["exists","up"]},{"osd":2,"uuid":"927dd7f0-f27c-44d4-a817-d26fbeddac60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6803","nonce":3235942581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6802","nonce":3235942581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6810","nonce":3235942581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6811","nonce":3235942581}]},"public_addr":"10.20.193.198:6803/3235942581","cluster_addr":"10.20.193.198:6802/3235942581","heartbeat_back_addr":"10.20.193.198:6810/3235942581","heartbeat_front_addr":"10.20.193.198:6811/3235942581","state":["exists","up"]},{"osd":3,"uuid":"fe73bff8-c92a-48ba-aa55-a165b0fd0770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6805","nonce":794892580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6806","nonce":794892580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6807","nonce":794892580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6804","nonce":794892580}]},"public_addr":"10.20.193.198:6805/794892580","cluster_addr":"10.20.193.198:6806/794892580","heartbeat_back_addr":"10.20.193.198:6807/794892580","heartbeat_front_addr":"10.20.193.198:6804/794892580","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T10:21:41.665 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-23T10:21:41.666 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-23T10:21:41.666 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-23T10:21:41.667 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-23T10:21:41.750 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.745+0000 7f9f159e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.750 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.744+0000 7f007ba5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.751 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.746+0000 7f7d9b10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.751 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.745+0000 7fd0f4a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.752 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.750+0000 7f9f159e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.753 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.751+0000 7fd0f4a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.753 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.751+0000 7f007ba5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.754 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.751+0000 7f7d9b10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.769 INFO:teuthology.orchestra.run.trial044.stdout:47244640261 2026-02-23T10:21:41.770 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-23T10:21:41.773 INFO:teuthology.orchestra.run.trial044.stdout:47244640261 2026-02-23T10:21:41.774 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-23T10:21:41.775 INFO:teuthology.orchestra.run.trial044.stdout:42949672966 2026-02-23T10:21:41.775 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-23T10:21:41.776 INFO:teuthology.orchestra.run.trial044.stdout:47244640261 2026-02-23T10:21:41.776 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-23T10:21:41.895 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.890+0000 7f2f1a81a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.895 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.890+0000 7fdef6ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.896 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.890+0000 7f364d25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.896 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.891+0000 7f981bd83640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.897 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.895+0000 7fdef6ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.898 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.896+0000 7f2f1a81a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.898 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.896+0000 7f364d25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:41.899 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:41.897+0000 7f981bd83640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:42.011 INFO:teuthology.orchestra.run.trial044.stdout:47244640261 2026-02-23T10:21:42.018 INFO:teuthology.orchestra.run.trial044.stdout:42949672966 2026-02-23T10:21:42.018 INFO:teuthology.orchestra.run.trial044.stdout:47244640261 2026-02-23T10:21:42.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.0 2026-02-23T10:21:42.022 DEBUG:teuthology.parallel:result is None 2026-02-23T10:21:42.022 INFO:teuthology.orchestra.run.trial044.stdout:47244640261 2026-02-23T10:21:42.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.3 2026-02-23T10:21:42.030 DEBUG:teuthology.parallel:result is None 2026-02-23T10:21:42.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.1 2026-02-23T10:21:42.031 DEBUG:teuthology.parallel:result is None 2026-02-23T10:21:42.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.2 2026-02-23T10:21:42.033 DEBUG:teuthology.parallel:result is None 2026-02-23T10:21:42.033 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-23T10:21:42.034 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T10:21:42.148 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:42.144+0000 7f2e1865a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:42.150 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:42.148+0000 7f2e1865a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:42.261 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:42.262 INFO:teuthology.orchestra.run.trial044.stderr:dumped all 2026-02-23T10:21:42.269 INFO:teuthology.orchestra.run.trial044.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-23T10:21:41.765805+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":2720,"kb_used_data":2720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208663904,"statfs":{"total":213674622976,"available":213671837696,"internally_reserved":0,"allocated":2785280,"data_stored":2785280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.762257+0000","last_change":"2026-02-23T10:21:40.767883+0000","last_active":"2026-02-23T10:21:40.762257+0000","last_peered":"2026-02-23T10:21:40.762257+0000","last_clean":"2026-02-23T10:21:40.762257+0000","last_became_active":"2026-02-23T10:21:38.784164+0000","last_became_peered":"2026-02-23T10:21:38.784164+0000","last_unstale":"2026-02-23T10:21:40.762257+0000","last_undegraded":"2026-02-23T10:21:40.762257+0000","last_fullsized":"2026-02-23T10:21:40.762257+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.764352+0000","last_change":"2026-02-23T10:21:40.766366+0000","last_active":"2026-02-23T10:21:40.764352+0000","last_peered":"2026-02-23T10:21:40.764352+0000","last_clean":"2026-02-23T10:21:40.764352+0000","last_became_active":"2026-02-23T10:21:38.784159+0000","last_became_peered":"2026-02-23T10:21:38.784159+0000","last_unstale":"2026-02-23T10:21:40.764352+0000","last_undegraded":"2026-02-23T10:21:40.764352+0000","last_fullsized":"2026-02-23T10:21:40.764352+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.764051+0000","last_change":"2026-02-23T10:21:40.766130+0000","last_active":"2026-02-23T10:21:40.764051+0000","last_peered":"2026-02-23T10:21:40.764051+0000","last_clean":"2026-02-23T10:21:40.764051+0000","last_became_active":"2026-02-23T10:21:38.783892+0000","last_became_peered":"2026-02-23T10:21:38.783892+0000","last_unstale":"2026-02-23T10:21:40.764051+0000","last_undegraded":"2026-02-23T10:21:40.764051+0000","last_fullsized":"2026-02-23T10:21:40.764051+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.762863+0000","last_change":"2026-02-23T10:21:40.765639+0000","last_active":"2026-02-23T10:21:40.762863+0000","last_peered":"2026-02-23T10:21:40.762863+0000","last_clean":"2026-02-23T10:21:40.762863+0000","last_became_active":"2026-02-23T10:21:38.783242+0000","last_became_peered":"2026-02-23T10:21:38.783242+0000","last_unstale":"2026-02-23T10:21:40.762863+0000","last_undegraded":"2026-02-23T10:21:40.762863+0000","last_fullsized":"2026-02-23T10:21:40.762863+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":81,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.763717+0000","last_change":"2026-02-23T10:21:38.800194+0000","last_active":"2026-02-23T10:21:40.763717+0000","last_peered":"2026-02-23T10:21:40.763717+0000","last_clean":"2026-02-23T10:21:40.763717+0000","last_became_active":"2026-02-23T10:21:38.790380+0000","last_became_peered":"2026-02-23T10:21:38.790380+0000","last_unstale":"2026-02-23T10:21:40.763717+0000","last_undegraded":"2026-02-23T10:21:40.763717+0000","last_fullsized":"2026-02-23T10:21:40.763717+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.761201+0000","last_change":"2026-02-23T10:21:40.764662+0000","last_active":"2026-02-23T10:21:40.761201+0000","last_peered":"2026-02-23T10:21:40.761201+0000","last_clean":"2026-02-23T10:21:40.761201+0000","last_became_active":"2026-02-23T10:21:38.783420+0000","last_became_peered":"2026-02-23T10:21:38.783420+0000","last_unstale":"2026-02-23T10:21:40.761201+0000","last_undegraded":"2026-02-23T10:21:40.761201+0000","last_fullsized":"2026-02-23T10:21:40.761201+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.768389+0000","last_change":"2026-02-23T10:21:40.769460+0000","last_active":"2026-02-23T10:21:40.768389+0000","last_peered":"2026-02-23T10:21:40.768389+0000","last_clean":"2026-02-23T10:21:40.768389+0000","last_became_active":"2026-02-23T10:21:38.792756+0000","last_became_peered":"2026-02-23T10:21:38.792756+0000","last_unstale":"2026-02-23T10:21:40.768389+0000","last_undegraded":"2026-02-23T10:21:40.768389+0000","last_fullsized":"2026-02-23T10:21:40.768389+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.762149+0000","last_change":"2026-02-23T10:21:40.765588+0000","last_active":"2026-02-23T10:21:40.762149+0000","last_peered":"2026-02-23T10:21:40.762149+0000","last_clean":"2026-02-23T10:21:40.762149+0000","last_became_active":"2026-02-23T10:21:38.783531+0000","last_became_peered":"2026-02-23T10:21:38.783531+0000","last_unstale":"2026-02-23T10:21:40.762149+0000","last_undegraded":"2026-02-23T10:21:40.762149+0000","last_fullsized":"2026-02-23T10:21:40.762149+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.762475+0000","last_change":"2026-02-23T10:21:40.768009+0000","last_active":"2026-02-23T10:21:40.762475+0000","last_peered":"2026-02-23T10:21:40.762475+0000","last_clean":"2026-02-23T10:21:40.762475+0000","last_became_active":"2026-02-23T10:21:38.771052+0000","last_became_peered":"2026-02-23T10:21:38.771052+0000","last_unstale":"2026-02-23T10:21:40.762475+0000","last_undegraded":"2026-02-23T10:21:40.762475+0000","last_fullsized":"2026-02-23T10:21:40.762475+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53417570304,"internally_reserved":0,"allocated":1085440,"data_stored":1085440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160253456384,"internally_reserved":0,"allocated":2510848,"data_stored":2510848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1060,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165596,"statfs":{"total":53418655744,"available":53417570304,"internally_reserved":0,"allocated":1085440,"data_stored":1085440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":268,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166388,"statfs":{"total":53418655744,"available":53418381312,"internally_reserved":0,"allocated":274432,"data_stored":274432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":332,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166324,"statfs":{"total":53418655744,"available":53418315776,"internally_reserved":0,"allocated":339968,"data_stored":339968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1060,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165596,"statfs":{"total":53418655744,"available":53417570304,"internally_reserved":0,"allocated":1085440,"data_stored":1085440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53418655744,"available":53417570304,"internally_reserved":0,"allocated":1085440,"data_stored":1085440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53418655744,"available":53418315776,"internally_reserved":0,"allocated":339968,"data_stored":339968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53417570304,"internally_reserved":0,"allocated":1085440,"data_stored":1085440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53418655744,"available":53417570304,"internally_reserved":0,"allocated":1085440,"data_stored":1085440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T10:21:42.271 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T10:21:42.346 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:42.342+0000 7fa70381a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:42.348 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:42.346+0000 7fa70381a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:42.459 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:42.459 INFO:teuthology.orchestra.run.trial044.stderr:dumped all 2026-02-23T10:21:42.468 INFO:teuthology.orchestra.run.trial044.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-23T10:21:41.765805+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":2720,"kb_used_data":2720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208663904,"statfs":{"total":213674622976,"available":213671837696,"internally_reserved":0,"allocated":2785280,"data_stored":2785280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.762257+0000","last_change":"2026-02-23T10:21:40.767883+0000","last_active":"2026-02-23T10:21:40.762257+0000","last_peered":"2026-02-23T10:21:40.762257+0000","last_clean":"2026-02-23T10:21:40.762257+0000","last_became_active":"2026-02-23T10:21:38.784164+0000","last_became_peered":"2026-02-23T10:21:38.784164+0000","last_unstale":"2026-02-23T10:21:40.762257+0000","last_undegraded":"2026-02-23T10:21:40.762257+0000","last_fullsized":"2026-02-23T10:21:40.762257+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.764352+0000","last_change":"2026-02-23T10:21:40.766366+0000","last_active":"2026-02-23T10:21:40.764352+0000","last_peered":"2026-02-23T10:21:40.764352+0000","last_clean":"2026-02-23T10:21:40.764352+0000","last_became_active":"2026-02-23T10:21:38.784159+0000","last_became_peered":"2026-02-23T10:21:38.784159+0000","last_unstale":"2026-02-23T10:21:40.764352+0000","last_undegraded":"2026-02-23T10:21:40.764352+0000","last_fullsized":"2026-02-23T10:21:40.764352+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.764051+0000","last_change":"2026-02-23T10:21:40.766130+0000","last_active":"2026-02-23T10:21:40.764051+0000","last_peered":"2026-02-23T10:21:40.764051+0000","last_clean":"2026-02-23T10:21:40.764051+0000","last_became_active":"2026-02-23T10:21:38.783892+0000","last_became_peered":"2026-02-23T10:21:38.783892+0000","last_unstale":"2026-02-23T10:21:40.764051+0000","last_undegraded":"2026-02-23T10:21:40.764051+0000","last_fullsized":"2026-02-23T10:21:40.764051+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.762863+0000","last_change":"2026-02-23T10:21:40.765639+0000","last_active":"2026-02-23T10:21:40.762863+0000","last_peered":"2026-02-23T10:21:40.762863+0000","last_clean":"2026-02-23T10:21:40.762863+0000","last_became_active":"2026-02-23T10:21:38.783242+0000","last_became_peered":"2026-02-23T10:21:38.783242+0000","last_unstale":"2026-02-23T10:21:40.762863+0000","last_undegraded":"2026-02-23T10:21:40.762863+0000","last_fullsized":"2026-02-23T10:21:40.762863+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":81,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.763717+0000","last_change":"2026-02-23T10:21:38.800194+0000","last_active":"2026-02-23T10:21:40.763717+0000","last_peered":"2026-02-23T10:21:40.763717+0000","last_clean":"2026-02-23T10:21:40.763717+0000","last_became_active":"2026-02-23T10:21:38.790380+0000","last_became_peered":"2026-02-23T10:21:38.790380+0000","last_unstale":"2026-02-23T10:21:40.763717+0000","last_undegraded":"2026-02-23T10:21:40.763717+0000","last_fullsized":"2026-02-23T10:21:40.763717+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.761201+0000","last_change":"2026-02-23T10:21:40.764662+0000","last_active":"2026-02-23T10:21:40.761201+0000","last_peered":"2026-02-23T10:21:40.761201+0000","last_clean":"2026-02-23T10:21:40.761201+0000","last_became_active":"2026-02-23T10:21:38.783420+0000","last_became_peered":"2026-02-23T10:21:38.783420+0000","last_unstale":"2026-02-23T10:21:40.761201+0000","last_undegraded":"2026-02-23T10:21:40.761201+0000","last_fullsized":"2026-02-23T10:21:40.761201+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.768389+0000","last_change":"2026-02-23T10:21:40.769460+0000","last_active":"2026-02-23T10:21:40.768389+0000","last_peered":"2026-02-23T10:21:40.768389+0000","last_clean":"2026-02-23T10:21:40.768389+0000","last_became_active":"2026-02-23T10:21:38.792756+0000","last_became_peered":"2026-02-23T10:21:38.792756+0000","last_unstale":"2026-02-23T10:21:40.768389+0000","last_undegraded":"2026-02-23T10:21:40.768389+0000","last_fullsized":"2026-02-23T10:21:40.768389+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.762149+0000","last_change":"2026-02-23T10:21:40.765588+0000","last_active":"2026-02-23T10:21:40.762149+0000","last_peered":"2026-02-23T10:21:40.762149+0000","last_clean":"2026-02-23T10:21:40.762149+0000","last_became_active":"2026-02-23T10:21:38.783531+0000","last_became_peered":"2026-02-23T10:21:38.783531+0000","last_unstale":"2026-02-23T10:21:40.762149+0000","last_undegraded":"2026-02-23T10:21:40.762149+0000","last_fullsized":"2026-02-23T10:21:40.762149+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-23T10:21:40.762475+0000","last_change":"2026-02-23T10:21:40.768009+0000","last_active":"2026-02-23T10:21:40.762475+0000","last_peered":"2026-02-23T10:21:40.762475+0000","last_clean":"2026-02-23T10:21:40.762475+0000","last_became_active":"2026-02-23T10:21:38.771052+0000","last_became_peered":"2026-02-23T10:21:38.771052+0000","last_unstale":"2026-02-23T10:21:40.762475+0000","last_undegraded":"2026-02-23T10:21:40.762475+0000","last_fullsized":"2026-02-23T10:21:40.762475+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53417570304,"internally_reserved":0,"allocated":1085440,"data_stored":1085440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160253456384,"internally_reserved":0,"allocated":2510848,"data_stored":2510848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1060,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165596,"statfs":{"total":53418655744,"available":53417570304,"internally_reserved":0,"allocated":1085440,"data_stored":1085440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":268,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166388,"statfs":{"total":53418655744,"available":53418381312,"internally_reserved":0,"allocated":274432,"data_stored":274432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":332,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166324,"statfs":{"total":53418655744,"available":53418315776,"internally_reserved":0,"allocated":339968,"data_stored":339968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1060,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165596,"statfs":{"total":53418655744,"available":53417570304,"internally_reserved":0,"allocated":1085440,"data_stored":1085440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53418655744,"available":53417570304,"internally_reserved":0,"allocated":1085440,"data_stored":1085440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53418655744,"available":53418315776,"internally_reserved":0,"allocated":339968,"data_stored":339968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53417570304,"internally_reserved":0,"allocated":1085440,"data_stored":1085440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53418655744,"available":53417570304,"internally_reserved":0,"allocated":1085440,"data_stored":1085440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T10:21:42.470 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-23T10:21:42.470 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-23T10:21:42.470 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-23T10:21:42.470 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-23T10:21:42.546 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:42.542+0000 7fe232583640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:42.548 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:21:42.546+0000 7fe232583640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:21:42.692 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:21:42.692 INFO:teuthology.orchestra.run.trial044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-23T10:21:42.701 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-23T10:21:42.702 INFO:teuthology.run_tasks:Running task workunit... 2026-02-23T10:21:42.727 INFO:tasks.workunit:Pulling workunits from ref e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T10:21:42.727 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-23T10:21:42.728 DEBUG:teuthology.orchestra.run.trial044:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-23T10:21:42.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T10:21:42.744 INFO:teuthology.orchestra.run.trial044.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-23T10:21:42.745 DEBUG:teuthology.orchestra.run.trial044:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-23T10:21:42.801 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-23T10:21:42.801 DEBUG:teuthology.orchestra.run.trial044:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-23T10:21:42.857 INFO:tasks.workunit:timeout=1h 2026-02-23T10:21:42.857 INFO:tasks.workunit:cleanup=True 2026-02-23T10:21:42.858 DEBUG:teuthology.orchestra.run.trial044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/shraddhaag/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T10:21:42.920 INFO:tasks.workunit.client.0.trial044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-23T10:22:04.264 INFO:tasks.workunit.client.0.trial044.stderr:Note: switching to 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d'. 2026-02-23T10:22:04.264 INFO:tasks.workunit.client.0.trial044.stderr: 2026-02-23T10:22:04.264 INFO:tasks.workunit.client.0.trial044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-23T10:22:04.264 INFO:tasks.workunit.client.0.trial044.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-23T10:22:04.264 INFO:tasks.workunit.client.0.trial044.stderr:state without impacting any branches by switching back to a branch. 2026-02-23T10:22:04.264 INFO:tasks.workunit.client.0.trial044.stderr: 2026-02-23T10:22:04.265 INFO:tasks.workunit.client.0.trial044.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-23T10:22:04.265 INFO:tasks.workunit.client.0.trial044.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-23T10:22:04.265 INFO:tasks.workunit.client.0.trial044.stderr: 2026-02-23T10:22:04.265 INFO:tasks.workunit.client.0.trial044.stderr: git switch -c 2026-02-23T10:22:04.265 INFO:tasks.workunit.client.0.trial044.stderr: 2026-02-23T10:22:04.265 INFO:tasks.workunit.client.0.trial044.stderr:Or undo this operation with: 2026-02-23T10:22:04.265 INFO:tasks.workunit.client.0.trial044.stderr: 2026-02-23T10:22:04.265 INFO:tasks.workunit.client.0.trial044.stderr: git switch - 2026-02-23T10:22:04.265 INFO:tasks.workunit.client.0.trial044.stderr: 2026-02-23T10:22:04.265 INFO:tasks.workunit.client.0.trial044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-23T10:22:04.265 INFO:tasks.workunit.client.0.trial044.stderr: 2026-02-23T10:22:04.266 INFO:tasks.workunit.client.0.trial044.stderr:HEAD is now at e371433fcd1 qa/suites/crimson-rados: enable cephadm tests 2026-02-23T10:22:04.267 DEBUG:teuthology.orchestra.run.trial044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-23T10:22:04.326 INFO:tasks.workunit.client.0.trial044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-23T10:22:04.328 INFO:tasks.workunit.client.0.trial044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-23T10:22:04.329 INFO:tasks.workunit.client.0.trial044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-23T10:22:04.424 INFO:tasks.workunit.client.0.trial044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-23T10:22:04.455 INFO:tasks.workunit.client.0.trial044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-23T10:22:04.482 INFO:tasks.workunit.client.0.trial044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-23T10:22:04.483 INFO:tasks.workunit.client.0.trial044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-23T10:22:04.483 INFO:tasks.workunit.client.0.trial044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-23T10:22:04.508 INFO:tasks.workunit.client.0.trial044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-23T10:22:04.512 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-23T10:22:04.512 DEBUG:teuthology.orchestra.run.trial044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-23T10:22:04.568 INFO:tasks.workunit:Running workunits matching rados/test_python.sh on client.0... 2026-02-23T10:22:04.570 INFO:tasks.workunit:Running workunit rados/test_python.sh... 2026-02-23T10:22:04.570 DEBUG:teuthology.orchestra.run.trial044:workunit test rados/test_python.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e371433fcd1390a0b82cfb18effc422c1f5d8c1d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh -m 'not (wait or tier or ec)' 2026-02-23T10:22:04.628 INFO:tasks.workunit.client.0.trial044.stderr:+ ceph osd pool create rbd 2026-02-23T10:22:04.681 INFO:tasks.workunit.client.0.trial044.stderr:2026-02-23T10:22:04.677+0000 7f926a8cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:22:04.684 INFO:tasks.workunit.client.0.trial044.stderr:2026-02-23T10:22:04.683+0000 7f926a8cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:22:04.852 INFO:tasks.workunit.client.0.trial044.stderr:pool 'rbd' already exists 2026-02-23T10:22:04.860 INFO:tasks.workunit.client.0.trial044.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh 2026-02-23T10:22:04.861 INFO:tasks.workunit.client.0.trial044.stderr:+ python3 -m pytest -v /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/../../../src/test/pybind/test_rados.py -m 'not (wait or tier or ec)' 2026-02-23T10:22:04.934 INFO:tasks.workunit.client.0.trial044.stdout:============================= test session starts ============================== 2026-02-23T10:22:04.934 INFO:tasks.workunit.client.0.trial044.stdout:platform linux -- Python 3.9.25, pytest-6.2.2, py-1.10.0, pluggy-0.13.1 -- /usr/bin/python3 2026-02-23T10:22:04.935 INFO:tasks.workunit.client.0.trial044.stdout:cachedir: .pytest_cache 2026-02-23T10:22:04.935 INFO:tasks.workunit.client.0.trial044.stdout:rootdir: /home/ubuntu/cephtest/clone.client.0/src/test/pybind, configfile: pytest.ini 2026-02-23T10:22:05.073 INFO:tasks.workunit.client.0.trial044.stdout:collecting ... collected 91 items / 5 deselected / 86 selected 2026-02-23T10:22:05.073 INFO:tasks.workunit.client.0.trial044.stdout: 2026-02-23T10:22:05.079 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::test_rados_init_error PASSED [ 1%] 2026-02-23T10:22:05.127 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::test_rados_init PASSED [ 2%] 2026-02-23T10:22:05.139 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::test_ioctx_context_manager PASSED [ 3%] 2026-02-23T10:22:05.146 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::test_parse_argv PASSED [ 4%] 2026-02-23T10:22:05.150 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::test_parse_argv_empty_str PASSED [ 5%] 2026-02-23T10:22:05.157 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRadosStateError::test_configuring PASSED [ 6%] 2026-02-23T10:22:05.169 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRadosStateError::test_connected PASSED [ 8%] 2026-02-23T10:22:05.182 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRadosStateError::test_shutdown PASSED [ 9%] 2026-02-23T10:22:05.198 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_ping_monitor PASSED [ 10%] 2026-02-23T10:22:05.212 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_annotations PASSED [ 11%] 2026-02-23T10:22:06.788 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_create PASSED [ 12%] 2026-02-23T10:22:08.797 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_create_utf8 PASSED [ 13%] 2026-02-23T10:22:10.803 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_pool_lookup_utf8 PASSED [ 15%] 2026-02-23T10:22:12.811 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_eexist PASSED [ 16%] 2026-02-23T10:22:20.844 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_list_pools PASSED [ 17%] 2026-02-23T10:22:20.862 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_get_fsid PASSED [ 18%] 2026-02-23T10:22:21.846 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_blocklist_add PASSED [ 19%] 2026-02-23T10:22:21.863 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_get_cluster_stats PASSED [ 20%] 2026-02-23T10:22:21.877 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_monitor_log PASSED [ 22%] 2026-02-23T10:22:24.576 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_last_version PASSED [ 23%] 2026-02-23T10:22:27.585 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_stats PASSED [ 24%] 2026-02-23T10:22:31.603 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_write PASSED [ 25%] 2026-02-23T10:22:35.618 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_write_full PASSED [ 26%] 2026-02-23T10:22:39.629 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_writesame PASSED [ 27%] 2026-02-23T10:22:43.643 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_append PASSED [ 29%] 2026-02-23T10:22:47.659 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_write_zeros PASSED [ 30%] 2026-02-23T10:22:51.669 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_trunc PASSED [ 31%] 2026-02-23T10:22:55.684 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_cmpext PASSED [ 32%] 2026-02-23T10:22:59.590 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_list_objects_empty PASSED [ 33%] 2026-02-23T10:23:03.601 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_read_crc PASSED [ 34%] 2026-02-23T10:23:07.579 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_list_objects PASSED [ 36%] 2026-02-23T10:23:11.591 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_list_ns_objects PASSED [ 37%] 2026-02-23T10:23:15.607 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_xattrs PASSED [ 38%] 2026-02-23T10:23:19.618 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_obj_xattrs PASSED [ 39%] 2026-02-23T10:23:22.626 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_pool_id PASSED [ 40%] 2026-02-23T10:23:25.639 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_pool_name PASSED [ 41%] 2026-02-23T10:23:30.588 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_create_snap PASSED [ 43%] 2026-02-23T10:23:33.606 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_list_snaps_empty PASSED [ 44%] 2026-02-23T10:23:39.593 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_list_snaps PASSED [ 45%] 2026-02-23T10:23:43.606 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_lookup_snap PASSED [ 46%] 2026-02-23T10:23:47.589 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_snap_timestamp PASSED [ 47%] 2026-02-23T10:23:52.601 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_remove_snap PASSED [ 48%] 2026-02-23T10:23:58.592 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_snap_rollback PASSED [ 50%] 2026-02-23T10:24:04.612 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_snap_rollback_removed PASSED [ 51%] 2026-02-23T10:24:10.631 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_snap_read PASSED [ 52%] 2026-02-23T10:24:14.647 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_set_omap PASSED [ 53%] 2026-02-23T10:24:18.595 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_set_omap_aio PASSED [ 54%] 2026-02-23T10:24:22.607 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_write_ops PASSED [ 55%] 2026-02-23T10:24:26.629 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_execute_op PASSED [ 56%] 2026-02-23T10:24:30.633 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_writesame_op PASSED [ 58%] 2026-02-23T10:24:34.645 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_omap_vals_by_keys PASSED [ 59%] 2026-02-23T10:24:38.599 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_omap_keys PASSED [ 60%] 2026-02-23T10:24:42.619 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_clear_omap PASSED [ 61%] 2026-02-23T10:24:46.635 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_remove_omap_range2 PASSED [ 62%] 2026-02-23T10:24:50.608 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_omap_cmp PASSED [ 63%] 2026-02-23T10:24:54.626 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_cmpext_op PASSED [ 65%] 2026-02-23T10:24:58.604 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_xattrs_op PASSED [ 66%] 2026-02-23T10:25:01.614 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_locator PASSED [ 67%] 2026-02-23T10:25:05.628 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_operate_aio_write_op PASSED [ 68%] 2026-02-23T10:25:09.639 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_write PASSED [ 69%] 2026-02-23T10:25:13.653 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_cmpext PASSED [ 70%] 2026-02-23T10:25:17.608 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_rmxattr PASSED [ 72%] 2026-02-23T10:25:21.620 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_write_no_comp_ref PASSED [ 73%] 2026-02-23T10:25:25.634 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_append PASSED [ 74%] 2026-02-23T10:25:29.647 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_write_full PASSED [ 75%] 2026-02-23T10:25:33.660 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_writesame PASSED [ 76%] 2026-02-23T10:25:37.613 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_stat PASSED [ 77%] 2026-02-23T10:25:41.625 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_remove PASSED [ 79%] 2026-02-23T10:25:45.642 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_lock PASSED [ 80%] 2026-02-23T10:25:49.653 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_execute PASSED [ 81%] 2026-02-23T10:25:53.670 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_execute PASSED [ 82%] 2026-02-23T10:25:57.616 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_setxattr PASSED [ 83%] 2026-02-23T10:26:06.645 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_applications PASSED [ 84%] 2026-02-23T10:26:09.624 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_service_daemon PASSED [ 86%] 2026-02-23T10:26:12.632 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_alignment PASSED [ 87%] 2026-02-23T10:26:15.647 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx2::test_get_last_version PASSED [ 88%] 2026-02-23T10:26:18.624 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx2::test_get_stats PASSED [ 89%] 2026-02-23T10:26:21.630 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestObject::test_read PASSED [ 90%] 2026-02-23T10:26:24.641 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestObject::test_seek PASSED [ 91%] 2026-02-23T10:26:27.623 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestObject::test_write PASSED [ 93%] 2026-02-23T10:26:35.646 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoCtxSelfManagedSnaps::test PASSED [ 94%] 2026-02-23T10:26:35.668 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestCommand::test_monmap_dump PASSED [ 95%] 2026-02-23T10:26:35.748 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestCommand::test_osd_bench PASSED [ 96%] 2026-02-23T10:26:36.648 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestCommand::test_ceph_osd_pool_create_utf8 PASSED [ 97%] 2026-02-23T10:26:42.659 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestWatchNotify::test PASSED [ 98%] 2026-02-23T10:26:48.677 INFO:tasks.workunit.client.0.trial044.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestWatchNotify::test_aio_notify PASSED [100%] 2026-02-23T10:26:48.677 INFO:tasks.workunit.client.0.trial044.stdout: 2026-02-23T10:26:48.678 INFO:tasks.workunit.client.0.trial044.stdout:================= 86 passed, 5 deselected in 283.74s (0:04:43) ================= 2026-02-23T10:26:48.696 INFO:tasks.workunit.client.0.trial044.stderr:+ exit 0 2026-02-23T10:26:48.697 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-23T10:26:48.697 DEBUG:teuthology.orchestra.run.trial044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-23T10:26:48.765 INFO:tasks.workunit:Stopping ["rados/test_python.sh -m 'not (wait or tier or ec)'"] on client.0... 2026-02-23T10:26:48.765 DEBUG:teuthology.orchestra.run.trial044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-23T10:26:49.149 DEBUG:teuthology.parallel:result is None 2026-02-23T10:26:49.150 DEBUG:teuthology.orchestra.run.trial044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-23T10:26:49.174 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-23T10:26:49.174 DEBUG:teuthology.orchestra.run.trial044:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-23T10:26:49.230 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-23T10:26:49.231 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-23T10:26:49.246 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-23T10:26:49.246 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T10:26:49.345 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:49.342+0000 7f5988f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:49.348 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:49.346+0000 7f5988f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:49.461 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:26:49.462 INFO:teuthology.orchestra.run.trial044.stderr:dumped all 2026-02-23T10:26:49.470 INFO:teuthology.orchestra.run.trial044.stdout:{"pg_ready":true,"pg_map":{"version":444,"stamp":"2026-02-23T10:26:48.670282+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":15976,"kb_used_data":15976,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208650648,"statfs":{"total":213674622976,"available":213658263552,"internally_reserved":0,"allocated":16359424,"data_stored":16359424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.017890"},"pg_stats":[{"pgid":"73.f","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.690344+0000","last_change":"2026-02-23T10:26:37.703878+0000","last_active":"2026-02-23T10:26:45.690344+0000","last_peered":"2026-02-23T10:26:45.690344+0000","last_clean":"2026-02-23T10:26:45.690344+0000","last_became_active":"2026-02-23T10:26:37.694547+0000","last_became_peered":"2026-02-23T10:26:37.694547+0000","last_unstale":"2026-02-23T10:26:45.690344+0000","last_undegraded":"2026-02-23T10:26:45.690344+0000","last_fullsized":"2026-02-23T10:26:45.690344+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.e","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.679689+0000","last_change":"2026-02-23T10:26:37.691147+0000","last_active":"2026-02-23T10:26:45.679689+0000","last_peered":"2026-02-23T10:26:45.679689+0000","last_clean":"2026-02-23T10:26:45.679689+0000","last_became_active":"2026-02-23T10:26:37.684243+0000","last_became_peered":"2026-02-23T10:26:37.684243+0000","last_unstale":"2026-02-23T10:26:45.679689+0000","last_undegraded":"2026-02-23T10:26:45.679689+0000","last_fullsized":"2026-02-23T10:26:45.679689+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.d","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.686471+0000","last_change":"2026-02-23T10:26:37.678835+0000","last_active":"2026-02-23T10:26:45.686471+0000","last_peered":"2026-02-23T10:26:45.686471+0000","last_clean":"2026-02-23T10:26:45.686471+0000","last_became_active":"2026-02-23T10:26:37.665101+0000","last_became_peered":"2026-02-23T10:26:37.665101+0000","last_unstale":"2026-02-23T10:26:45.686471+0000","last_undegraded":"2026-02-23T10:26:45.686471+0000","last_fullsized":"2026-02-23T10:26:45.686471+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.c","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688164+0000","last_change":"2026-02-23T10:26:37.669210+0000","last_active":"2026-02-23T10:26:45.688164+0000","last_peered":"2026-02-23T10:26:45.688164+0000","last_clean":"2026-02-23T10:26:45.688164+0000","last_became_active":"2026-02-23T10:26:37.664422+0000","last_became_peered":"2026-02-23T10:26:37.664422+0000","last_unstale":"2026-02-23T10:26:45.688164+0000","last_undegraded":"2026-02-23T10:26:45.688164+0000","last_fullsized":"2026-02-23T10:26:45.688164+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.b","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.685260+0000","last_change":"2026-02-23T10:26:37.688542+0000","last_active":"2026-02-23T10:26:45.685260+0000","last_peered":"2026-02-23T10:26:45.685260+0000","last_clean":"2026-02-23T10:26:45.685260+0000","last_became_active":"2026-02-23T10:26:37.675496+0000","last_became_peered":"2026-02-23T10:26:37.675496+0000","last_unstale":"2026-02-23T10:26:45.685260+0000","last_undegraded":"2026-02-23T10:26:45.685260+0000","last_fullsized":"2026-02-23T10:26:45.685260+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.a","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.687536+0000","last_change":"2026-02-23T10:26:37.676391+0000","last_active":"2026-02-23T10:26:45.687536+0000","last_peered":"2026-02-23T10:26:45.687536+0000","last_clean":"2026-02-23T10:26:45.687536+0000","last_became_active":"2026-02-23T10:26:37.665175+0000","last_became_peered":"2026-02-23T10:26:37.665175+0000","last_unstale":"2026-02-23T10:26:45.687536+0000","last_undegraded":"2026-02-23T10:26:45.687536+0000","last_fullsized":"2026-02-23T10:26:45.687536+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.9","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.683423+0000","last_change":"2026-02-23T10:26:37.676209+0000","last_active":"2026-02-23T10:26:45.683423+0000","last_peered":"2026-02-23T10:26:45.683423+0000","last_clean":"2026-02-23T10:26:45.683423+0000","last_became_active":"2026-02-23T10:26:37.664820+0000","last_became_peered":"2026-02-23T10:26:37.664820+0000","last_unstale":"2026-02-23T10:26:45.683423+0000","last_undegraded":"2026-02-23T10:26:45.683423+0000","last_fullsized":"2026-02-23T10:26:45.683423+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.8","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688284+0000","last_change":"2026-02-23T10:26:37.680935+0000","last_active":"2026-02-23T10:26:45.688284+0000","last_peered":"2026-02-23T10:26:45.688284+0000","last_clean":"2026-02-23T10:26:45.688284+0000","last_became_active":"2026-02-23T10:26:37.674071+0000","last_became_peered":"2026-02-23T10:26:37.674071+0000","last_unstale":"2026-02-23T10:26:45.688284+0000","last_undegraded":"2026-02-23T10:26:45.688284+0000","last_fullsized":"2026-02-23T10:26:45.688284+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.7","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688582+0000","last_change":"2026-02-23T10:26:37.691787+0000","last_active":"2026-02-23T10:26:45.688582+0000","last_peered":"2026-02-23T10:26:45.688582+0000","last_clean":"2026-02-23T10:26:45.688582+0000","last_became_active":"2026-02-23T10:26:37.679686+0000","last_became_peered":"2026-02-23T10:26:37.679686+0000","last_unstale":"2026-02-23T10:26:45.688582+0000","last_undegraded":"2026-02-23T10:26:45.688582+0000","last_fullsized":"2026-02-23T10:26:45.688582+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.6","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.690122+0000","last_change":"2026-02-23T10:26:37.719175+0000","last_active":"2026-02-23T10:26:45.690122+0000","last_peered":"2026-02-23T10:26:45.690122+0000","last_clean":"2026-02-23T10:26:45.690122+0000","last_became_active":"2026-02-23T10:26:37.713858+0000","last_became_peered":"2026-02-23T10:26:37.713858+0000","last_unstale":"2026-02-23T10:26:45.690122+0000","last_undegraded":"2026-02-23T10:26:45.690122+0000","last_fullsized":"2026-02-23T10:26:45.690122+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.5","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.689531+0000","last_change":"2026-02-23T10:26:37.688309+0000","last_active":"2026-02-23T10:26:45.689531+0000","last_peered":"2026-02-23T10:26:45.689531+0000","last_clean":"2026-02-23T10:26:45.689531+0000","last_became_active":"2026-02-23T10:26:37.676353+0000","last_became_peered":"2026-02-23T10:26:37.676353+0000","last_unstale":"2026-02-23T10:26:45.689531+0000","last_undegraded":"2026-02-23T10:26:45.689531+0000","last_fullsized":"2026-02-23T10:26:45.689531+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.4","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.680034+0000","last_change":"2026-02-23T10:26:37.721670+0000","last_active":"2026-02-23T10:26:45.680034+0000","last_peered":"2026-02-23T10:26:45.680034+0000","last_clean":"2026-02-23T10:26:45.680034+0000","last_became_active":"2026-02-23T10:26:37.717264+0000","last_became_peered":"2026-02-23T10:26:37.717264+0000","last_unstale":"2026-02-23T10:26:45.680034+0000","last_undegraded":"2026-02-23T10:26:45.680034+0000","last_fullsized":"2026-02-23T10:26:45.680034+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.3","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.684416+0000","last_change":"2026-02-23T10:26:37.697670+0000","last_active":"2026-02-23T10:26:45.684416+0000","last_peered":"2026-02-23T10:26:45.684416+0000","last_clean":"2026-02-23T10:26:45.684416+0000","last_became_active":"2026-02-23T10:26:37.686822+0000","last_became_peered":"2026-02-23T10:26:37.686822+0000","last_unstale":"2026-02-23T10:26:45.684416+0000","last_undegraded":"2026-02-23T10:26:45.684416+0000","last_fullsized":"2026-02-23T10:26:45.684416+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.2","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.683941+0000","last_change":"2026-02-23T10:26:37.720556+0000","last_active":"2026-02-23T10:26:45.683941+0000","last_peered":"2026-02-23T10:26:45.683941+0000","last_clean":"2026-02-23T10:26:45.683941+0000","last_became_active":"2026-02-23T10:26:37.705139+0000","last_became_peered":"2026-02-23T10:26:37.705139+0000","last_unstale":"2026-02-23T10:26:45.683941+0000","last_undegraded":"2026-02-23T10:26:45.683941+0000","last_fullsized":"2026-02-23T10:26:45.683941+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.1","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688995+0000","last_change":"2026-02-23T10:26:37.706474+0000","last_active":"2026-02-23T10:26:45.688995+0000","last_peered":"2026-02-23T10:26:45.688995+0000","last_clean":"2026-02-23T10:26:45.688995+0000","last_became_active":"2026-02-23T10:26:37.691182+0000","last_became_peered":"2026-02-23T10:26:37.691182+0000","last_unstale":"2026-02-23T10:26:45.688995+0000","last_undegraded":"2026-02-23T10:26:45.688995+0000","last_fullsized":"2026-02-23T10:26:45.688995+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.0","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.681286+0000","last_change":"2026-02-23T10:26:37.706665+0000","last_active":"2026-02-23T10:26:45.681286+0000","last_peered":"2026-02-23T10:26:45.681286+0000","last_clean":"2026-02-23T10:26:45.681286+0000","last_became_active":"2026-02-23T10:26:37.695864+0000","last_became_peered":"2026-02-23T10:26:37.695864+0000","last_unstale":"2026-02-23T10:26:45.681286+0000","last_undegraded":"2026-02-23T10:26:45.681286+0000","last_fullsized":"2026-02-23T10:26:45.681286+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.687752+0000","last_change":"2026-02-23T10:21:40.768009+0000","last_active":"2026-02-23T10:26:45.687752+0000","last_peered":"2026-02-23T10:26:45.687752+0000","last_clean":"2026-02-23T10:26:45.687752+0000","last_became_active":"2026-02-23T10:21:38.771052+0000","last_became_peered":"2026-02-23T10:21:38.771052+0000","last_unstale":"2026-02-23T10:26:45.687752+0000","last_undegraded":"2026-02-23T10:26:45.687752+0000","last_fullsized":"2026-02-23T10:26:45.687752+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.685731+0000","last_change":"2026-02-23T10:21:40.765588+0000","last_active":"2026-02-23T10:26:45.685731+0000","last_peered":"2026-02-23T10:26:45.685731+0000","last_clean":"2026-02-23T10:26:45.685731+0000","last_became_active":"2026-02-23T10:21:38.783531+0000","last_became_peered":"2026-02-23T10:21:38.783531+0000","last_unstale":"2026-02-23T10:26:45.685731+0000","last_undegraded":"2026-02-23T10:26:45.685731+0000","last_fullsized":"2026-02-23T10:26:45.685731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":854,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688643+0000","last_change":"2026-02-23T10:21:40.769460+0000","last_active":"2026-02-23T10:26:45.688643+0000","last_peered":"2026-02-23T10:26:45.688643+0000","last_clean":"2026-02-23T10:26:45.688643+0000","last_became_active":"2026-02-23T10:21:38.792756+0000","last_became_peered":"2026-02-23T10:21:38.792756+0000","last_unstale":"2026-02-23T10:26:45.688643+0000","last_undegraded":"2026-02-23T10:26:45.688643+0000","last_fullsized":"2026-02-23T10:26:45.688643+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":853,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.681859+0000","last_change":"2026-02-23T10:21:40.764662+0000","last_active":"2026-02-23T10:26:45.681859+0000","last_peered":"2026-02-23T10:26:45.681859+0000","last_clean":"2026-02-23T10:26:45.681859+0000","last_became_active":"2026-02-23T10:21:38.783420+0000","last_became_peered":"2026-02-23T10:21:38.783420+0000","last_unstale":"2026-02-23T10:26:45.681859+0000","last_undegraded":"2026-02-23T10:26:45.681859+0000","last_fullsized":"2026-02-23T10:26:45.681859+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":918,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.687946+0000","last_change":"2026-02-23T10:21:38.800194+0000","last_active":"2026-02-23T10:26:45.687946+0000","last_peered":"2026-02-23T10:26:45.687946+0000","last_clean":"2026-02-23T10:26:45.687946+0000","last_became_active":"2026-02-23T10:21:38.790380+0000","last_became_peered":"2026-02-23T10:21:38.790380+0000","last_unstale":"2026-02-23T10:26:45.687946+0000","last_undegraded":"2026-02-23T10:26:45.687946+0000","last_fullsized":"2026-02-23T10:26:45.687946+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.682889+0000","last_change":"2026-02-23T10:21:40.765639+0000","last_active":"2026-02-23T10:26:45.682889+0000","last_peered":"2026-02-23T10:26:45.682889+0000","last_clean":"2026-02-23T10:26:45.682889+0000","last_became_active":"2026-02-23T10:21:38.783242+0000","last_became_peered":"2026-02-23T10:21:38.783242+0000","last_unstale":"2026-02-23T10:26:45.682889+0000","last_undegraded":"2026-02-23T10:26:45.682889+0000","last_fullsized":"2026-02-23T10:26:45.682889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688488+0000","last_change":"2026-02-23T10:21:40.766130+0000","last_active":"2026-02-23T10:26:45.688488+0000","last_peered":"2026-02-23T10:26:45.688488+0000","last_clean":"2026-02-23T10:26:45.688488+0000","last_became_active":"2026-02-23T10:21:38.783892+0000","last_became_peered":"2026-02-23T10:21:38.783892+0000","last_unstale":"2026-02-23T10:26:45.688488+0000","last_undegraded":"2026-02-23T10:26:45.688488+0000","last_fullsized":"2026-02-23T10:26:45.688488+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688394+0000","last_change":"2026-02-23T10:21:40.766366+0000","last_active":"2026-02-23T10:26:45.688394+0000","last_peered":"2026-02-23T10:26:45.688394+0000","last_clean":"2026-02-23T10:26:45.688394+0000","last_became_active":"2026-02-23T10:21:38.784159+0000","last_became_peered":"2026-02-23T10:21:38.784159+0000","last_unstale":"2026-02-23T10:26:45.688394+0000","last_undegraded":"2026-02-23T10:26:45.688394+0000","last_fullsized":"2026-02-23T10:26:45.688394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688452+0000","last_change":"2026-02-23T10:21:40.767883+0000","last_active":"2026-02-23T10:26:45.688452+0000","last_peered":"2026-02-23T10:26:45.688452+0000","last_clean":"2026-02-23T10:26:45.688452+0000","last_became_active":"2026-02-23T10:21:38.784164+0000","last_became_peered":"2026-02-23T10:21:38.784164+0000","last_unstale":"2026-02-23T10:26:45.688452+0000","last_undegraded":"2026-02-23T10:26:45.688452+0000","last_fullsized":"2026-02-23T10:26:45.688452+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":73,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213658255360,"internally_reserved":0,"allocated":16367616,"data_stored":16367616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160243089408,"internally_reserved":0,"allocated":12877824,"data_stored":12877824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673269,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4448,"kb_used_data":4448,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162208,"statfs":{"total":53418655744,"available":53414100992,"internally_reserved":0,"allocated":4554752,"data_stored":4554752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3408,"kb_used_data":3408,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52163248,"statfs":{"total":53418655744,"available":53415165952,"internally_reserved":0,"allocated":3489792,"data_stored":3489792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3664,"kb_used_data":3664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162992,"statfs":{"total":53418655744,"available":53414903808,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4456,"kb_used_data":4456,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162200,"statfs":{"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53418655744,"available":53414903808,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":0,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":1,"total":53418655744,"available":53414903808,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":2,"total":53418655744,"available":53415165952,"internally_reserved":0,"allocated":3489792,"data_stored":3489792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":3,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T10:26:49.473 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T10:26:49.548 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:49.545+0000 7f5f8c211640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:49.551 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:49.550+0000 7f5f8c211640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:49.663 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:26:49.664 INFO:teuthology.orchestra.run.trial044.stderr:dumped all 2026-02-23T10:26:49.672 INFO:teuthology.orchestra.run.trial044.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2026-02-23T10:26:49.653346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":15976,"kb_used_data":15976,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208650648,"statfs":{"total":213674622976,"available":213658263552,"internally_reserved":0,"allocated":16359424,"data_stored":16359424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.992046"},"pg_stats":[{"pgid":"73.f","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.690344+0000","last_change":"2026-02-23T10:26:37.703878+0000","last_active":"2026-02-23T10:26:45.690344+0000","last_peered":"2026-02-23T10:26:45.690344+0000","last_clean":"2026-02-23T10:26:45.690344+0000","last_became_active":"2026-02-23T10:26:37.694547+0000","last_became_peered":"2026-02-23T10:26:37.694547+0000","last_unstale":"2026-02-23T10:26:45.690344+0000","last_undegraded":"2026-02-23T10:26:45.690344+0000","last_fullsized":"2026-02-23T10:26:45.690344+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.e","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.679689+0000","last_change":"2026-02-23T10:26:37.691147+0000","last_active":"2026-02-23T10:26:45.679689+0000","last_peered":"2026-02-23T10:26:45.679689+0000","last_clean":"2026-02-23T10:26:45.679689+0000","last_became_active":"2026-02-23T10:26:37.684243+0000","last_became_peered":"2026-02-23T10:26:37.684243+0000","last_unstale":"2026-02-23T10:26:45.679689+0000","last_undegraded":"2026-02-23T10:26:45.679689+0000","last_fullsized":"2026-02-23T10:26:45.679689+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.d","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.686471+0000","last_change":"2026-02-23T10:26:37.678835+0000","last_active":"2026-02-23T10:26:45.686471+0000","last_peered":"2026-02-23T10:26:45.686471+0000","last_clean":"2026-02-23T10:26:45.686471+0000","last_became_active":"2026-02-23T10:26:37.665101+0000","last_became_peered":"2026-02-23T10:26:37.665101+0000","last_unstale":"2026-02-23T10:26:45.686471+0000","last_undegraded":"2026-02-23T10:26:45.686471+0000","last_fullsized":"2026-02-23T10:26:45.686471+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.c","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688164+0000","last_change":"2026-02-23T10:26:37.669210+0000","last_active":"2026-02-23T10:26:45.688164+0000","last_peered":"2026-02-23T10:26:45.688164+0000","last_clean":"2026-02-23T10:26:45.688164+0000","last_became_active":"2026-02-23T10:26:37.664422+0000","last_became_peered":"2026-02-23T10:26:37.664422+0000","last_unstale":"2026-02-23T10:26:45.688164+0000","last_undegraded":"2026-02-23T10:26:45.688164+0000","last_fullsized":"2026-02-23T10:26:45.688164+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.b","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.685260+0000","last_change":"2026-02-23T10:26:37.688542+0000","last_active":"2026-02-23T10:26:45.685260+0000","last_peered":"2026-02-23T10:26:45.685260+0000","last_clean":"2026-02-23T10:26:45.685260+0000","last_became_active":"2026-02-23T10:26:37.675496+0000","last_became_peered":"2026-02-23T10:26:37.675496+0000","last_unstale":"2026-02-23T10:26:45.685260+0000","last_undegraded":"2026-02-23T10:26:45.685260+0000","last_fullsized":"2026-02-23T10:26:45.685260+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.a","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.687536+0000","last_change":"2026-02-23T10:26:37.676391+0000","last_active":"2026-02-23T10:26:45.687536+0000","last_peered":"2026-02-23T10:26:45.687536+0000","last_clean":"2026-02-23T10:26:45.687536+0000","last_became_active":"2026-02-23T10:26:37.665175+0000","last_became_peered":"2026-02-23T10:26:37.665175+0000","last_unstale":"2026-02-23T10:26:45.687536+0000","last_undegraded":"2026-02-23T10:26:45.687536+0000","last_fullsized":"2026-02-23T10:26:45.687536+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.9","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.683423+0000","last_change":"2026-02-23T10:26:37.676209+0000","last_active":"2026-02-23T10:26:45.683423+0000","last_peered":"2026-02-23T10:26:45.683423+0000","last_clean":"2026-02-23T10:26:45.683423+0000","last_became_active":"2026-02-23T10:26:37.664820+0000","last_became_peered":"2026-02-23T10:26:37.664820+0000","last_unstale":"2026-02-23T10:26:45.683423+0000","last_undegraded":"2026-02-23T10:26:45.683423+0000","last_fullsized":"2026-02-23T10:26:45.683423+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.8","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688284+0000","last_change":"2026-02-23T10:26:37.680935+0000","last_active":"2026-02-23T10:26:45.688284+0000","last_peered":"2026-02-23T10:26:45.688284+0000","last_clean":"2026-02-23T10:26:45.688284+0000","last_became_active":"2026-02-23T10:26:37.674071+0000","last_became_peered":"2026-02-23T10:26:37.674071+0000","last_unstale":"2026-02-23T10:26:45.688284+0000","last_undegraded":"2026-02-23T10:26:45.688284+0000","last_fullsized":"2026-02-23T10:26:45.688284+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.7","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688582+0000","last_change":"2026-02-23T10:26:37.691787+0000","last_active":"2026-02-23T10:26:45.688582+0000","last_peered":"2026-02-23T10:26:45.688582+0000","last_clean":"2026-02-23T10:26:45.688582+0000","last_became_active":"2026-02-23T10:26:37.679686+0000","last_became_peered":"2026-02-23T10:26:37.679686+0000","last_unstale":"2026-02-23T10:26:45.688582+0000","last_undegraded":"2026-02-23T10:26:45.688582+0000","last_fullsized":"2026-02-23T10:26:45.688582+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.6","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.690122+0000","last_change":"2026-02-23T10:26:37.719175+0000","last_active":"2026-02-23T10:26:45.690122+0000","last_peered":"2026-02-23T10:26:45.690122+0000","last_clean":"2026-02-23T10:26:45.690122+0000","last_became_active":"2026-02-23T10:26:37.713858+0000","last_became_peered":"2026-02-23T10:26:37.713858+0000","last_unstale":"2026-02-23T10:26:45.690122+0000","last_undegraded":"2026-02-23T10:26:45.690122+0000","last_fullsized":"2026-02-23T10:26:45.690122+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.5","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.689531+0000","last_change":"2026-02-23T10:26:37.688309+0000","last_active":"2026-02-23T10:26:45.689531+0000","last_peered":"2026-02-23T10:26:45.689531+0000","last_clean":"2026-02-23T10:26:45.689531+0000","last_became_active":"2026-02-23T10:26:37.676353+0000","last_became_peered":"2026-02-23T10:26:37.676353+0000","last_unstale":"2026-02-23T10:26:45.689531+0000","last_undegraded":"2026-02-23T10:26:45.689531+0000","last_fullsized":"2026-02-23T10:26:45.689531+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.4","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.680034+0000","last_change":"2026-02-23T10:26:37.721670+0000","last_active":"2026-02-23T10:26:45.680034+0000","last_peered":"2026-02-23T10:26:45.680034+0000","last_clean":"2026-02-23T10:26:45.680034+0000","last_became_active":"2026-02-23T10:26:37.717264+0000","last_became_peered":"2026-02-23T10:26:37.717264+0000","last_unstale":"2026-02-23T10:26:45.680034+0000","last_undegraded":"2026-02-23T10:26:45.680034+0000","last_fullsized":"2026-02-23T10:26:45.680034+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.3","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.684416+0000","last_change":"2026-02-23T10:26:37.697670+0000","last_active":"2026-02-23T10:26:45.684416+0000","last_peered":"2026-02-23T10:26:45.684416+0000","last_clean":"2026-02-23T10:26:45.684416+0000","last_became_active":"2026-02-23T10:26:37.686822+0000","last_became_peered":"2026-02-23T10:26:37.686822+0000","last_unstale":"2026-02-23T10:26:45.684416+0000","last_undegraded":"2026-02-23T10:26:45.684416+0000","last_fullsized":"2026-02-23T10:26:45.684416+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.2","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.683941+0000","last_change":"2026-02-23T10:26:37.720556+0000","last_active":"2026-02-23T10:26:45.683941+0000","last_peered":"2026-02-23T10:26:45.683941+0000","last_clean":"2026-02-23T10:26:45.683941+0000","last_became_active":"2026-02-23T10:26:37.705139+0000","last_became_peered":"2026-02-23T10:26:37.705139+0000","last_unstale":"2026-02-23T10:26:45.683941+0000","last_undegraded":"2026-02-23T10:26:45.683941+0000","last_fullsized":"2026-02-23T10:26:45.683941+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.1","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688995+0000","last_change":"2026-02-23T10:26:37.706474+0000","last_active":"2026-02-23T10:26:45.688995+0000","last_peered":"2026-02-23T10:26:45.688995+0000","last_clean":"2026-02-23T10:26:45.688995+0000","last_became_active":"2026-02-23T10:26:37.691182+0000","last_became_peered":"2026-02-23T10:26:37.691182+0000","last_unstale":"2026-02-23T10:26:45.688995+0000","last_undegraded":"2026-02-23T10:26:45.688995+0000","last_fullsized":"2026-02-23T10:26:45.688995+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.0","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.681286+0000","last_change":"2026-02-23T10:26:37.706665+0000","last_active":"2026-02-23T10:26:45.681286+0000","last_peered":"2026-02-23T10:26:45.681286+0000","last_clean":"2026-02-23T10:26:45.681286+0000","last_became_active":"2026-02-23T10:26:37.695864+0000","last_became_peered":"2026-02-23T10:26:37.695864+0000","last_unstale":"2026-02-23T10:26:45.681286+0000","last_undegraded":"2026-02-23T10:26:45.681286+0000","last_fullsized":"2026-02-23T10:26:45.681286+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.687752+0000","last_change":"2026-02-23T10:21:40.768009+0000","last_active":"2026-02-23T10:26:45.687752+0000","last_peered":"2026-02-23T10:26:45.687752+0000","last_clean":"2026-02-23T10:26:45.687752+0000","last_became_active":"2026-02-23T10:21:38.771052+0000","last_became_peered":"2026-02-23T10:21:38.771052+0000","last_unstale":"2026-02-23T10:26:45.687752+0000","last_undegraded":"2026-02-23T10:26:45.687752+0000","last_fullsized":"2026-02-23T10:26:45.687752+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.685731+0000","last_change":"2026-02-23T10:21:40.765588+0000","last_active":"2026-02-23T10:26:45.685731+0000","last_peered":"2026-02-23T10:26:45.685731+0000","last_clean":"2026-02-23T10:26:45.685731+0000","last_became_active":"2026-02-23T10:21:38.783531+0000","last_became_peered":"2026-02-23T10:21:38.783531+0000","last_unstale":"2026-02-23T10:26:45.685731+0000","last_undegraded":"2026-02-23T10:26:45.685731+0000","last_fullsized":"2026-02-23T10:26:45.685731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":854,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688643+0000","last_change":"2026-02-23T10:21:40.769460+0000","last_active":"2026-02-23T10:26:45.688643+0000","last_peered":"2026-02-23T10:26:45.688643+0000","last_clean":"2026-02-23T10:26:45.688643+0000","last_became_active":"2026-02-23T10:21:38.792756+0000","last_became_peered":"2026-02-23T10:21:38.792756+0000","last_unstale":"2026-02-23T10:26:45.688643+0000","last_undegraded":"2026-02-23T10:26:45.688643+0000","last_fullsized":"2026-02-23T10:26:45.688643+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":853,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.681859+0000","last_change":"2026-02-23T10:21:40.764662+0000","last_active":"2026-02-23T10:26:45.681859+0000","last_peered":"2026-02-23T10:26:45.681859+0000","last_clean":"2026-02-23T10:26:45.681859+0000","last_became_active":"2026-02-23T10:21:38.783420+0000","last_became_peered":"2026-02-23T10:21:38.783420+0000","last_unstale":"2026-02-23T10:26:45.681859+0000","last_undegraded":"2026-02-23T10:26:45.681859+0000","last_fullsized":"2026-02-23T10:26:45.681859+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":918,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.687946+0000","last_change":"2026-02-23T10:21:38.800194+0000","last_active":"2026-02-23T10:26:45.687946+0000","last_peered":"2026-02-23T10:26:45.687946+0000","last_clean":"2026-02-23T10:26:45.687946+0000","last_became_active":"2026-02-23T10:21:38.790380+0000","last_became_peered":"2026-02-23T10:21:38.790380+0000","last_unstale":"2026-02-23T10:26:45.687946+0000","last_undegraded":"2026-02-23T10:26:45.687946+0000","last_fullsized":"2026-02-23T10:26:45.687946+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.682889+0000","last_change":"2026-02-23T10:21:40.765639+0000","last_active":"2026-02-23T10:26:45.682889+0000","last_peered":"2026-02-23T10:26:45.682889+0000","last_clean":"2026-02-23T10:26:45.682889+0000","last_became_active":"2026-02-23T10:21:38.783242+0000","last_became_peered":"2026-02-23T10:21:38.783242+0000","last_unstale":"2026-02-23T10:26:45.682889+0000","last_undegraded":"2026-02-23T10:26:45.682889+0000","last_fullsized":"2026-02-23T10:26:45.682889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688488+0000","last_change":"2026-02-23T10:21:40.766130+0000","last_active":"2026-02-23T10:26:45.688488+0000","last_peered":"2026-02-23T10:26:45.688488+0000","last_clean":"2026-02-23T10:26:45.688488+0000","last_became_active":"2026-02-23T10:21:38.783892+0000","last_became_peered":"2026-02-23T10:21:38.783892+0000","last_unstale":"2026-02-23T10:26:45.688488+0000","last_undegraded":"2026-02-23T10:26:45.688488+0000","last_fullsized":"2026-02-23T10:26:45.688488+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688394+0000","last_change":"2026-02-23T10:21:40.766366+0000","last_active":"2026-02-23T10:26:45.688394+0000","last_peered":"2026-02-23T10:26:45.688394+0000","last_clean":"2026-02-23T10:26:45.688394+0000","last_became_active":"2026-02-23T10:21:38.784159+0000","last_became_peered":"2026-02-23T10:21:38.784159+0000","last_unstale":"2026-02-23T10:26:45.688394+0000","last_undegraded":"2026-02-23T10:26:45.688394+0000","last_fullsized":"2026-02-23T10:26:45.688394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688452+0000","last_change":"2026-02-23T10:21:40.767883+0000","last_active":"2026-02-23T10:26:45.688452+0000","last_peered":"2026-02-23T10:26:45.688452+0000","last_clean":"2026-02-23T10:26:45.688452+0000","last_became_active":"2026-02-23T10:21:38.784164+0000","last_became_peered":"2026-02-23T10:21:38.784164+0000","last_unstale":"2026-02-23T10:26:45.688452+0000","last_undegraded":"2026-02-23T10:26:45.688452+0000","last_fullsized":"2026-02-23T10:26:45.688452+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":73,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213658255360,"internally_reserved":0,"allocated":16367616,"data_stored":16367616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160243089408,"internally_reserved":0,"allocated":12877824,"data_stored":12877824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673269,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4448,"kb_used_data":4448,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162208,"statfs":{"total":53418655744,"available":53414100992,"internally_reserved":0,"allocated":4554752,"data_stored":4554752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3408,"kb_used_data":3408,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52163248,"statfs":{"total":53418655744,"available":53415165952,"internally_reserved":0,"allocated":3489792,"data_stored":3489792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3664,"kb_used_data":3664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162992,"statfs":{"total":53418655744,"available":53414903808,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4456,"kb_used_data":4456,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162200,"statfs":{"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53418655744,"available":53414903808,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":0,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":1,"total":53418655744,"available":53414903808,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":2,"total":53418655744,"available":53415165952,"internally_reserved":0,"allocated":3489792,"data_stored":3489792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":3,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T10:26:49.674 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-23T10:26:49.675 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T10:26:49.751 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:49.747+0000 7fcaaedb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:49.753 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:49.752+0000 7fcaaedb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:49.867 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:26:49.868 INFO:teuthology.orchestra.run.trial044.stderr:dumped all 2026-02-23T10:26:49.877 INFO:teuthology.orchestra.run.trial044.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2026-02-23T10:26:49.653346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":15976,"kb_used_data":15976,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208650648,"statfs":{"total":213674622976,"available":213658263552,"internally_reserved":0,"allocated":16359424,"data_stored":16359424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.992046"},"pg_stats":[{"pgid":"73.f","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.690344+0000","last_change":"2026-02-23T10:26:37.703878+0000","last_active":"2026-02-23T10:26:45.690344+0000","last_peered":"2026-02-23T10:26:45.690344+0000","last_clean":"2026-02-23T10:26:45.690344+0000","last_became_active":"2026-02-23T10:26:37.694547+0000","last_became_peered":"2026-02-23T10:26:37.694547+0000","last_unstale":"2026-02-23T10:26:45.690344+0000","last_undegraded":"2026-02-23T10:26:45.690344+0000","last_fullsized":"2026-02-23T10:26:45.690344+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.e","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.679689+0000","last_change":"2026-02-23T10:26:37.691147+0000","last_active":"2026-02-23T10:26:45.679689+0000","last_peered":"2026-02-23T10:26:45.679689+0000","last_clean":"2026-02-23T10:26:45.679689+0000","last_became_active":"2026-02-23T10:26:37.684243+0000","last_became_peered":"2026-02-23T10:26:37.684243+0000","last_unstale":"2026-02-23T10:26:45.679689+0000","last_undegraded":"2026-02-23T10:26:45.679689+0000","last_fullsized":"2026-02-23T10:26:45.679689+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.d","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.686471+0000","last_change":"2026-02-23T10:26:37.678835+0000","last_active":"2026-02-23T10:26:45.686471+0000","last_peered":"2026-02-23T10:26:45.686471+0000","last_clean":"2026-02-23T10:26:45.686471+0000","last_became_active":"2026-02-23T10:26:37.665101+0000","last_became_peered":"2026-02-23T10:26:37.665101+0000","last_unstale":"2026-02-23T10:26:45.686471+0000","last_undegraded":"2026-02-23T10:26:45.686471+0000","last_fullsized":"2026-02-23T10:26:45.686471+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.c","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688164+0000","last_change":"2026-02-23T10:26:37.669210+0000","last_active":"2026-02-23T10:26:45.688164+0000","last_peered":"2026-02-23T10:26:45.688164+0000","last_clean":"2026-02-23T10:26:45.688164+0000","last_became_active":"2026-02-23T10:26:37.664422+0000","last_became_peered":"2026-02-23T10:26:37.664422+0000","last_unstale":"2026-02-23T10:26:45.688164+0000","last_undegraded":"2026-02-23T10:26:45.688164+0000","last_fullsized":"2026-02-23T10:26:45.688164+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.b","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.685260+0000","last_change":"2026-02-23T10:26:37.688542+0000","last_active":"2026-02-23T10:26:45.685260+0000","last_peered":"2026-02-23T10:26:45.685260+0000","last_clean":"2026-02-23T10:26:45.685260+0000","last_became_active":"2026-02-23T10:26:37.675496+0000","last_became_peered":"2026-02-23T10:26:37.675496+0000","last_unstale":"2026-02-23T10:26:45.685260+0000","last_undegraded":"2026-02-23T10:26:45.685260+0000","last_fullsized":"2026-02-23T10:26:45.685260+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.a","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.687536+0000","last_change":"2026-02-23T10:26:37.676391+0000","last_active":"2026-02-23T10:26:45.687536+0000","last_peered":"2026-02-23T10:26:45.687536+0000","last_clean":"2026-02-23T10:26:45.687536+0000","last_became_active":"2026-02-23T10:26:37.665175+0000","last_became_peered":"2026-02-23T10:26:37.665175+0000","last_unstale":"2026-02-23T10:26:45.687536+0000","last_undegraded":"2026-02-23T10:26:45.687536+0000","last_fullsized":"2026-02-23T10:26:45.687536+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.9","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.683423+0000","last_change":"2026-02-23T10:26:37.676209+0000","last_active":"2026-02-23T10:26:45.683423+0000","last_peered":"2026-02-23T10:26:45.683423+0000","last_clean":"2026-02-23T10:26:45.683423+0000","last_became_active":"2026-02-23T10:26:37.664820+0000","last_became_peered":"2026-02-23T10:26:37.664820+0000","last_unstale":"2026-02-23T10:26:45.683423+0000","last_undegraded":"2026-02-23T10:26:45.683423+0000","last_fullsized":"2026-02-23T10:26:45.683423+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.8","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688284+0000","last_change":"2026-02-23T10:26:37.680935+0000","last_active":"2026-02-23T10:26:45.688284+0000","last_peered":"2026-02-23T10:26:45.688284+0000","last_clean":"2026-02-23T10:26:45.688284+0000","last_became_active":"2026-02-23T10:26:37.674071+0000","last_became_peered":"2026-02-23T10:26:37.674071+0000","last_unstale":"2026-02-23T10:26:45.688284+0000","last_undegraded":"2026-02-23T10:26:45.688284+0000","last_fullsized":"2026-02-23T10:26:45.688284+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.7","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688582+0000","last_change":"2026-02-23T10:26:37.691787+0000","last_active":"2026-02-23T10:26:45.688582+0000","last_peered":"2026-02-23T10:26:45.688582+0000","last_clean":"2026-02-23T10:26:45.688582+0000","last_became_active":"2026-02-23T10:26:37.679686+0000","last_became_peered":"2026-02-23T10:26:37.679686+0000","last_unstale":"2026-02-23T10:26:45.688582+0000","last_undegraded":"2026-02-23T10:26:45.688582+0000","last_fullsized":"2026-02-23T10:26:45.688582+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.6","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.690122+0000","last_change":"2026-02-23T10:26:37.719175+0000","last_active":"2026-02-23T10:26:45.690122+0000","last_peered":"2026-02-23T10:26:45.690122+0000","last_clean":"2026-02-23T10:26:45.690122+0000","last_became_active":"2026-02-23T10:26:37.713858+0000","last_became_peered":"2026-02-23T10:26:37.713858+0000","last_unstale":"2026-02-23T10:26:45.690122+0000","last_undegraded":"2026-02-23T10:26:45.690122+0000","last_fullsized":"2026-02-23T10:26:45.690122+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.5","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.689531+0000","last_change":"2026-02-23T10:26:37.688309+0000","last_active":"2026-02-23T10:26:45.689531+0000","last_peered":"2026-02-23T10:26:45.689531+0000","last_clean":"2026-02-23T10:26:45.689531+0000","last_became_active":"2026-02-23T10:26:37.676353+0000","last_became_peered":"2026-02-23T10:26:37.676353+0000","last_unstale":"2026-02-23T10:26:45.689531+0000","last_undegraded":"2026-02-23T10:26:45.689531+0000","last_fullsized":"2026-02-23T10:26:45.689531+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.4","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.680034+0000","last_change":"2026-02-23T10:26:37.721670+0000","last_active":"2026-02-23T10:26:45.680034+0000","last_peered":"2026-02-23T10:26:45.680034+0000","last_clean":"2026-02-23T10:26:45.680034+0000","last_became_active":"2026-02-23T10:26:37.717264+0000","last_became_peered":"2026-02-23T10:26:37.717264+0000","last_unstale":"2026-02-23T10:26:45.680034+0000","last_undegraded":"2026-02-23T10:26:45.680034+0000","last_fullsized":"2026-02-23T10:26:45.680034+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.3","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.684416+0000","last_change":"2026-02-23T10:26:37.697670+0000","last_active":"2026-02-23T10:26:45.684416+0000","last_peered":"2026-02-23T10:26:45.684416+0000","last_clean":"2026-02-23T10:26:45.684416+0000","last_became_active":"2026-02-23T10:26:37.686822+0000","last_became_peered":"2026-02-23T10:26:37.686822+0000","last_unstale":"2026-02-23T10:26:45.684416+0000","last_undegraded":"2026-02-23T10:26:45.684416+0000","last_fullsized":"2026-02-23T10:26:45.684416+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.2","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.683941+0000","last_change":"2026-02-23T10:26:37.720556+0000","last_active":"2026-02-23T10:26:45.683941+0000","last_peered":"2026-02-23T10:26:45.683941+0000","last_clean":"2026-02-23T10:26:45.683941+0000","last_became_active":"2026-02-23T10:26:37.705139+0000","last_became_peered":"2026-02-23T10:26:37.705139+0000","last_unstale":"2026-02-23T10:26:45.683941+0000","last_undegraded":"2026-02-23T10:26:45.683941+0000","last_fullsized":"2026-02-23T10:26:45.683941+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.1","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688995+0000","last_change":"2026-02-23T10:26:37.706474+0000","last_active":"2026-02-23T10:26:45.688995+0000","last_peered":"2026-02-23T10:26:45.688995+0000","last_clean":"2026-02-23T10:26:45.688995+0000","last_became_active":"2026-02-23T10:26:37.691182+0000","last_became_peered":"2026-02-23T10:26:37.691182+0000","last_unstale":"2026-02-23T10:26:45.688995+0000","last_undegraded":"2026-02-23T10:26:45.688995+0000","last_fullsized":"2026-02-23T10:26:45.688995+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.0","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.681286+0000","last_change":"2026-02-23T10:26:37.706665+0000","last_active":"2026-02-23T10:26:45.681286+0000","last_peered":"2026-02-23T10:26:45.681286+0000","last_clean":"2026-02-23T10:26:45.681286+0000","last_became_active":"2026-02-23T10:26:37.695864+0000","last_became_peered":"2026-02-23T10:26:37.695864+0000","last_unstale":"2026-02-23T10:26:45.681286+0000","last_undegraded":"2026-02-23T10:26:45.681286+0000","last_fullsized":"2026-02-23T10:26:45.681286+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.687752+0000","last_change":"2026-02-23T10:21:40.768009+0000","last_active":"2026-02-23T10:26:45.687752+0000","last_peered":"2026-02-23T10:26:45.687752+0000","last_clean":"2026-02-23T10:26:45.687752+0000","last_became_active":"2026-02-23T10:21:38.771052+0000","last_became_peered":"2026-02-23T10:21:38.771052+0000","last_unstale":"2026-02-23T10:26:45.687752+0000","last_undegraded":"2026-02-23T10:26:45.687752+0000","last_fullsized":"2026-02-23T10:26:45.687752+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.685731+0000","last_change":"2026-02-23T10:21:40.765588+0000","last_active":"2026-02-23T10:26:45.685731+0000","last_peered":"2026-02-23T10:26:45.685731+0000","last_clean":"2026-02-23T10:26:45.685731+0000","last_became_active":"2026-02-23T10:21:38.783531+0000","last_became_peered":"2026-02-23T10:21:38.783531+0000","last_unstale":"2026-02-23T10:26:45.685731+0000","last_undegraded":"2026-02-23T10:26:45.685731+0000","last_fullsized":"2026-02-23T10:26:45.685731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":854,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688643+0000","last_change":"2026-02-23T10:21:40.769460+0000","last_active":"2026-02-23T10:26:45.688643+0000","last_peered":"2026-02-23T10:26:45.688643+0000","last_clean":"2026-02-23T10:26:45.688643+0000","last_became_active":"2026-02-23T10:21:38.792756+0000","last_became_peered":"2026-02-23T10:21:38.792756+0000","last_unstale":"2026-02-23T10:26:45.688643+0000","last_undegraded":"2026-02-23T10:26:45.688643+0000","last_fullsized":"2026-02-23T10:26:45.688643+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":853,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.681859+0000","last_change":"2026-02-23T10:21:40.764662+0000","last_active":"2026-02-23T10:26:45.681859+0000","last_peered":"2026-02-23T10:26:45.681859+0000","last_clean":"2026-02-23T10:26:45.681859+0000","last_became_active":"2026-02-23T10:21:38.783420+0000","last_became_peered":"2026-02-23T10:21:38.783420+0000","last_unstale":"2026-02-23T10:26:45.681859+0000","last_undegraded":"2026-02-23T10:26:45.681859+0000","last_fullsized":"2026-02-23T10:26:45.681859+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":918,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.687946+0000","last_change":"2026-02-23T10:21:38.800194+0000","last_active":"2026-02-23T10:26:45.687946+0000","last_peered":"2026-02-23T10:26:45.687946+0000","last_clean":"2026-02-23T10:26:45.687946+0000","last_became_active":"2026-02-23T10:21:38.790380+0000","last_became_peered":"2026-02-23T10:21:38.790380+0000","last_unstale":"2026-02-23T10:26:45.687946+0000","last_undegraded":"2026-02-23T10:26:45.687946+0000","last_fullsized":"2026-02-23T10:26:45.687946+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.682889+0000","last_change":"2026-02-23T10:21:40.765639+0000","last_active":"2026-02-23T10:26:45.682889+0000","last_peered":"2026-02-23T10:26:45.682889+0000","last_clean":"2026-02-23T10:26:45.682889+0000","last_became_active":"2026-02-23T10:21:38.783242+0000","last_became_peered":"2026-02-23T10:21:38.783242+0000","last_unstale":"2026-02-23T10:26:45.682889+0000","last_undegraded":"2026-02-23T10:26:45.682889+0000","last_fullsized":"2026-02-23T10:26:45.682889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688488+0000","last_change":"2026-02-23T10:21:40.766130+0000","last_active":"2026-02-23T10:26:45.688488+0000","last_peered":"2026-02-23T10:26:45.688488+0000","last_clean":"2026-02-23T10:26:45.688488+0000","last_became_active":"2026-02-23T10:21:38.783892+0000","last_became_peered":"2026-02-23T10:21:38.783892+0000","last_unstale":"2026-02-23T10:26:45.688488+0000","last_undegraded":"2026-02-23T10:26:45.688488+0000","last_fullsized":"2026-02-23T10:26:45.688488+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688394+0000","last_change":"2026-02-23T10:21:40.766366+0000","last_active":"2026-02-23T10:26:45.688394+0000","last_peered":"2026-02-23T10:26:45.688394+0000","last_clean":"2026-02-23T10:26:45.688394+0000","last_became_active":"2026-02-23T10:21:38.784159+0000","last_became_peered":"2026-02-23T10:21:38.784159+0000","last_unstale":"2026-02-23T10:26:45.688394+0000","last_undegraded":"2026-02-23T10:26:45.688394+0000","last_fullsized":"2026-02-23T10:26:45.688394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688452+0000","last_change":"2026-02-23T10:21:40.767883+0000","last_active":"2026-02-23T10:26:45.688452+0000","last_peered":"2026-02-23T10:26:45.688452+0000","last_clean":"2026-02-23T10:26:45.688452+0000","last_became_active":"2026-02-23T10:21:38.784164+0000","last_became_peered":"2026-02-23T10:21:38.784164+0000","last_unstale":"2026-02-23T10:26:45.688452+0000","last_undegraded":"2026-02-23T10:26:45.688452+0000","last_fullsized":"2026-02-23T10:26:45.688452+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":73,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213658255360,"internally_reserved":0,"allocated":16367616,"data_stored":16367616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160243089408,"internally_reserved":0,"allocated":12877824,"data_stored":12877824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673269,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4448,"kb_used_data":4448,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162208,"statfs":{"total":53418655744,"available":53414100992,"internally_reserved":0,"allocated":4554752,"data_stored":4554752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3408,"kb_used_data":3408,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52163248,"statfs":{"total":53418655744,"available":53415165952,"internally_reserved":0,"allocated":3489792,"data_stored":3489792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3664,"kb_used_data":3664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162992,"statfs":{"total":53418655744,"available":53414903808,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4456,"kb_used_data":4456,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162200,"statfs":{"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53418655744,"available":53414903808,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":0,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":1,"total":53418655744,"available":53414903808,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":2,"total":53418655744,"available":53415165952,"internally_reserved":0,"allocated":3489792,"data_stored":3489792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":3,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T10:26:49.879 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-23T10:26:49.955 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:49.951+0000 7fc48ba3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:49.957 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:49.956+0000 7fc48ba3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:50.070 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:26:50.070 INFO:teuthology.orchestra.run.trial044.stdout:{"epoch":295,"fsid":"746afa72-9d07-49c4-8eb1-34745ca9165e","created":"2026-02-23T10:21:27.563675+0000","modified":"2026-02-23T10:26:48.669183+0000","last_up_change":"2026-02-23T10:21:36.735919+0000","last_in_change":"2026-02-23T10:21:29.428766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":75,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-23T10:21:37.119461+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-23T10:21:37.617843+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":73,"pool_name":"黅","create_time":"2026-02-23T10:26:35.763088+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"289","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3c43e764-bab2-4a61-963d-7ed9fc9e29f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":292,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6818","nonce":3853675516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6817","nonce":3853675516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6801","nonce":3853675516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6803","nonce":3853675516}]},"public_addr":"10.20.193.44:6818/3853675516","cluster_addr":"10.20.193.44:6817/3853675516","heartbeat_back_addr":"10.20.193.44:6801/3853675516","heartbeat_front_addr":"10.20.193.44:6803/3853675516","state":["exists","up"]},{"osd":1,"uuid":"b21113b1-290a-414f-888b-5caaefed55d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":292,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6804","nonce":378639318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6805","nonce":378639318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6807","nonce":378639318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.44:6806","nonce":378639318}]},"public_addr":"10.20.193.44:6804/378639318","cluster_addr":"10.20.193.44:6805/378639318","heartbeat_back_addr":"10.20.193.44:6807/378639318","heartbeat_front_addr":"10.20.193.44:6806/378639318","state":["exists","up"]},{"osd":2,"uuid":"927dd7f0-f27c-44d4-a817-d26fbeddac60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":288,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6803","nonce":3235942581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6802","nonce":3235942581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6810","nonce":3235942581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6811","nonce":3235942581}]},"public_addr":"10.20.193.198:6803/3235942581","cluster_addr":"10.20.193.198:6802/3235942581","heartbeat_back_addr":"10.20.193.198:6810/3235942581","heartbeat_front_addr":"10.20.193.198:6811/3235942581","state":["exists","up"]},{"osd":3,"uuid":"fe73bff8-c92a-48ba-aa55-a165b0fd0770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":292,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6805","nonce":794892580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6806","nonce":794892580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6807","nonce":794892580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6804","nonce":794892580}]},"public_addr":"10.20.193.198:6805/794892580","cluster_addr":"10.20.193.198:6806/794892580","heartbeat_back_addr":"10.20.193.198:6807/794892580","heartbeat_front_addr":"10.20.193.198:6804/794892580","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]},{"pool":28,"snaps":[{"begin":1,"length":1}]},{"pool":33,"snaps":[{"begin":1,"length":1}]},{"pool":34,"snaps":[{"begin":1,"length":1}]},{"pool":35,"snaps":[{"begin":1,"length":1}]},{"pool":36,"snaps":[{"begin":1,"length":1}]},{"pool":72,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T10:26:51.081 INFO:tasks.ceph:Scrubbing osd.0 2026-02-23T10:26:51.081 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-23T10:26:51.162 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:51.156+0000 7f9f02b74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:51.164 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:51.163+0000 7f9f02b74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:51.174 INFO:teuthology.orchestra.run.trial044.stdout:{ 2026-02-23T10:26:51.174 INFO:teuthology.orchestra.run.trial044.stdout: "success": "" 2026-02-23T10:26:51.174 INFO:teuthology.orchestra.run.trial044.stdout:} 2026-02-23T10:26:51.181 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-23T10:26:51.258 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:51.254+0000 7f6a7f65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:51.260 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:51.259+0000 7f6a7f65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:51.378 INFO:teuthology.orchestra.run.trial044.stderr:instructed osd(s) 0 to deep-scrub 2026-02-23T10:26:51.388 INFO:tasks.ceph:Scrubbing osd.1 2026-02-23T10:26:51.389 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-23T10:26:51.465 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:51.460+0000 7f803b61a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:51.467 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:51.466+0000 7f803b61a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:51.477 INFO:teuthology.orchestra.run.trial044.stdout:{ 2026-02-23T10:26:51.477 INFO:teuthology.orchestra.run.trial044.stdout: "success": "" 2026-02-23T10:26:51.477 INFO:teuthology.orchestra.run.trial044.stdout:} 2026-02-23T10:26:51.484 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-23T10:26:51.561 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:51.557+0000 7f7bc29dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:51.564 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:51.563+0000 7f7bc29dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:51.677 INFO:teuthology.orchestra.run.trial044.stderr:instructed osd(s) 1 to deep-scrub 2026-02-23T10:26:51.688 INFO:tasks.ceph:Scrubbing osd.2 2026-02-23T10:26:51.688 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-23T10:26:51.766 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:51.760+0000 7f61cf90b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:51.768 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:51.767+0000 7f61cf90b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:51.778 INFO:teuthology.orchestra.run.trial044.stdout:{ 2026-02-23T10:26:51.778 INFO:teuthology.orchestra.run.trial044.stdout: "success": "" 2026-02-23T10:26:51.778 INFO:teuthology.orchestra.run.trial044.stdout:} 2026-02-23T10:26:51.787 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-23T10:26:51.864 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:51.860+0000 7fd3f9acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:51.866 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:51.865+0000 7fd3f9acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:51.979 INFO:teuthology.orchestra.run.trial044.stderr:instructed osd(s) 2 to deep-scrub 2026-02-23T10:26:51.990 INFO:tasks.ceph:Scrubbing osd.3 2026-02-23T10:26:51.990 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-23T10:26:52.068 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:52.062+0000 7fbaa270b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:52.070 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:52.069+0000 7fbaa270b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:52.080 INFO:teuthology.orchestra.run.trial044.stdout:{ 2026-02-23T10:26:52.081 INFO:teuthology.orchestra.run.trial044.stdout: "success": "" 2026-02-23T10:26:52.081 INFO:teuthology.orchestra.run.trial044.stdout:} 2026-02-23T10:26:52.087 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-23T10:26:52.163 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:52.159+0000 7f9dfe251640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:52.166 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:52.165+0000 7f9dfe251640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:52.279 INFO:teuthology.orchestra.run.trial044.stderr:instructed osd(s) 3 to deep-scrub 2026-02-23T10:26:52.289 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T10:26:52.365 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:52.361+0000 7f459979c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:52.367 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:26:52.366+0000 7f459979c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:26:52.478 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:26:52.479 INFO:teuthology.orchestra.run.trial044.stderr:dumped all 2026-02-23T10:26:52.487 INFO:teuthology.orchestra.run.trial044.stdout:{"pg_ready":true,"pg_map":{"version":446,"stamp":"2026-02-23T10:26:51.653578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":15676,"kb_used_data":15676,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208650948,"statfs":{"total":213674622976,"available":213658570752,"internally_reserved":0,"allocated":16052224,"data_stored":16052224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.989619"},"pg_stats":[{"pgid":"73.f","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.690344+0000","last_change":"2026-02-23T10:26:37.703878+0000","last_active":"2026-02-23T10:26:45.690344+0000","last_peered":"2026-02-23T10:26:45.690344+0000","last_clean":"2026-02-23T10:26:45.690344+0000","last_became_active":"2026-02-23T10:26:37.694547+0000","last_became_peered":"2026-02-23T10:26:37.694547+0000","last_unstale":"2026-02-23T10:26:45.690344+0000","last_undegraded":"2026-02-23T10:26:45.690344+0000","last_fullsized":"2026-02-23T10:26:45.690344+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.e","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.679689+0000","last_change":"2026-02-23T10:26:37.691147+0000","last_active":"2026-02-23T10:26:45.679689+0000","last_peered":"2026-02-23T10:26:45.679689+0000","last_clean":"2026-02-23T10:26:45.679689+0000","last_became_active":"2026-02-23T10:26:37.684243+0000","last_became_peered":"2026-02-23T10:26:37.684243+0000","last_unstale":"2026-02-23T10:26:45.679689+0000","last_undegraded":"2026-02-23T10:26:45.679689+0000","last_fullsized":"2026-02-23T10:26:45.679689+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.d","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.686471+0000","last_change":"2026-02-23T10:26:37.678835+0000","last_active":"2026-02-23T10:26:45.686471+0000","last_peered":"2026-02-23T10:26:45.686471+0000","last_clean":"2026-02-23T10:26:45.686471+0000","last_became_active":"2026-02-23T10:26:37.665101+0000","last_became_peered":"2026-02-23T10:26:37.665101+0000","last_unstale":"2026-02-23T10:26:45.686471+0000","last_undegraded":"2026-02-23T10:26:45.686471+0000","last_fullsized":"2026-02-23T10:26:45.686471+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.c","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688164+0000","last_change":"2026-02-23T10:26:37.669210+0000","last_active":"2026-02-23T10:26:45.688164+0000","last_peered":"2026-02-23T10:26:45.688164+0000","last_clean":"2026-02-23T10:26:45.688164+0000","last_became_active":"2026-02-23T10:26:37.664422+0000","last_became_peered":"2026-02-23T10:26:37.664422+0000","last_unstale":"2026-02-23T10:26:45.688164+0000","last_undegraded":"2026-02-23T10:26:45.688164+0000","last_fullsized":"2026-02-23T10:26:45.688164+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.b","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.685260+0000","last_change":"2026-02-23T10:26:37.688542+0000","last_active":"2026-02-23T10:26:45.685260+0000","last_peered":"2026-02-23T10:26:45.685260+0000","last_clean":"2026-02-23T10:26:45.685260+0000","last_became_active":"2026-02-23T10:26:37.675496+0000","last_became_peered":"2026-02-23T10:26:37.675496+0000","last_unstale":"2026-02-23T10:26:45.685260+0000","last_undegraded":"2026-02-23T10:26:45.685260+0000","last_fullsized":"2026-02-23T10:26:45.685260+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.a","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.687536+0000","last_change":"2026-02-23T10:26:37.676391+0000","last_active":"2026-02-23T10:26:45.687536+0000","last_peered":"2026-02-23T10:26:45.687536+0000","last_clean":"2026-02-23T10:26:45.687536+0000","last_became_active":"2026-02-23T10:26:37.665175+0000","last_became_peered":"2026-02-23T10:26:37.665175+0000","last_unstale":"2026-02-23T10:26:45.687536+0000","last_undegraded":"2026-02-23T10:26:45.687536+0000","last_fullsized":"2026-02-23T10:26:45.687536+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.9","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-23T10:26:48.684288+0000","last_change":"2026-02-23T10:26:37.676209+0000","last_active":"2026-02-23T10:26:48.684288+0000","last_peered":"2026-02-23T10:26:48.684288+0000","last_clean":"2026-02-23T10:26:48.684288+0000","last_became_active":"2026-02-23T10:26:37.664820+0000","last_became_peered":"2026-02-23T10:26:37.664820+0000","last_unstale":"2026-02-23T10:26:48.684288+0000","last_undegraded":"2026-02-23T10:26:48.684288+0000","last_fullsized":"2026-02-23T10:26:48.684288+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.8","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688284+0000","last_change":"2026-02-23T10:26:37.680935+0000","last_active":"2026-02-23T10:26:45.688284+0000","last_peered":"2026-02-23T10:26:45.688284+0000","last_clean":"2026-02-23T10:26:45.688284+0000","last_became_active":"2026-02-23T10:26:37.674071+0000","last_became_peered":"2026-02-23T10:26:37.674071+0000","last_unstale":"2026-02-23T10:26:45.688284+0000","last_undegraded":"2026-02-23T10:26:45.688284+0000","last_fullsized":"2026-02-23T10:26:45.688284+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.7","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688582+0000","last_change":"2026-02-23T10:26:37.691787+0000","last_active":"2026-02-23T10:26:45.688582+0000","last_peered":"2026-02-23T10:26:45.688582+0000","last_clean":"2026-02-23T10:26:45.688582+0000","last_became_active":"2026-02-23T10:26:37.679686+0000","last_became_peered":"2026-02-23T10:26:37.679686+0000","last_unstale":"2026-02-23T10:26:45.688582+0000","last_undegraded":"2026-02-23T10:26:45.688582+0000","last_fullsized":"2026-02-23T10:26:45.688582+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.6","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.690122+0000","last_change":"2026-02-23T10:26:37.719175+0000","last_active":"2026-02-23T10:26:45.690122+0000","last_peered":"2026-02-23T10:26:45.690122+0000","last_clean":"2026-02-23T10:26:45.690122+0000","last_became_active":"2026-02-23T10:26:37.713858+0000","last_became_peered":"2026-02-23T10:26:37.713858+0000","last_unstale":"2026-02-23T10:26:45.690122+0000","last_undegraded":"2026-02-23T10:26:45.690122+0000","last_fullsized":"2026-02-23T10:26:45.690122+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.5","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.689531+0000","last_change":"2026-02-23T10:26:37.688309+0000","last_active":"2026-02-23T10:26:45.689531+0000","last_peered":"2026-02-23T10:26:45.689531+0000","last_clean":"2026-02-23T10:26:45.689531+0000","last_became_active":"2026-02-23T10:26:37.676353+0000","last_became_peered":"2026-02-23T10:26:37.676353+0000","last_unstale":"2026-02-23T10:26:45.689531+0000","last_undegraded":"2026-02-23T10:26:45.689531+0000","last_fullsized":"2026-02-23T10:26:45.689531+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.4","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.680034+0000","last_change":"2026-02-23T10:26:37.721670+0000","last_active":"2026-02-23T10:26:45.680034+0000","last_peered":"2026-02-23T10:26:45.680034+0000","last_clean":"2026-02-23T10:26:45.680034+0000","last_became_active":"2026-02-23T10:26:37.717264+0000","last_became_peered":"2026-02-23T10:26:37.717264+0000","last_unstale":"2026-02-23T10:26:45.680034+0000","last_undegraded":"2026-02-23T10:26:45.680034+0000","last_fullsized":"2026-02-23T10:26:45.680034+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.3","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-23T10:26:48.695948+0000","last_change":"2026-02-23T10:26:37.697670+0000","last_active":"2026-02-23T10:26:48.695948+0000","last_peered":"2026-02-23T10:26:48.695948+0000","last_clean":"2026-02-23T10:26:48.695948+0000","last_became_active":"2026-02-23T10:26:37.686822+0000","last_became_peered":"2026-02-23T10:26:37.686822+0000","last_unstale":"2026-02-23T10:26:48.695948+0000","last_undegraded":"2026-02-23T10:26:48.695948+0000","last_fullsized":"2026-02-23T10:26:48.695948+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.2","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-23T10:26:48.694081+0000","last_change":"2026-02-23T10:26:37.720556+0000","last_active":"2026-02-23T10:26:48.694081+0000","last_peered":"2026-02-23T10:26:48.694081+0000","last_clean":"2026-02-23T10:26:48.694081+0000","last_became_active":"2026-02-23T10:26:37.705139+0000","last_became_peered":"2026-02-23T10:26:37.705139+0000","last_unstale":"2026-02-23T10:26:48.694081+0000","last_undegraded":"2026-02-23T10:26:48.694081+0000","last_fullsized":"2026-02-23T10:26:48.694081+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.1","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688995+0000","last_change":"2026-02-23T10:26:37.706474+0000","last_active":"2026-02-23T10:26:45.688995+0000","last_peered":"2026-02-23T10:26:45.688995+0000","last_clean":"2026-02-23T10:26:45.688995+0000","last_became_active":"2026-02-23T10:26:37.691182+0000","last_became_peered":"2026-02-23T10:26:37.691182+0000","last_unstale":"2026-02-23T10:26:45.688995+0000","last_undegraded":"2026-02-23T10:26:45.688995+0000","last_fullsized":"2026-02-23T10:26:45.688995+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.0","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.681286+0000","last_change":"2026-02-23T10:26:37.706665+0000","last_active":"2026-02-23T10:26:45.681286+0000","last_peered":"2026-02-23T10:26:45.681286+0000","last_clean":"2026-02-23T10:26:45.681286+0000","last_became_active":"2026-02-23T10:26:37.695864+0000","last_became_peered":"2026-02-23T10:26:37.695864+0000","last_unstale":"2026-02-23T10:26:45.681286+0000","last_undegraded":"2026-02-23T10:26:45.681286+0000","last_fullsized":"2026-02-23T10:26:45.681286+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:36.642848+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.687752+0000","last_change":"2026-02-23T10:21:40.768009+0000","last_active":"2026-02-23T10:26:45.687752+0000","last_peered":"2026-02-23T10:26:45.687752+0000","last_clean":"2026-02-23T10:26:45.687752+0000","last_became_active":"2026-02-23T10:21:38.771052+0000","last_became_peered":"2026-02-23T10:21:38.771052+0000","last_unstale":"2026-02-23T10:26:45.687752+0000","last_undegraded":"2026-02-23T10:26:45.687752+0000","last_fullsized":"2026-02-23T10:26:45.687752+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.685731+0000","last_change":"2026-02-23T10:21:40.765588+0000","last_active":"2026-02-23T10:26:45.685731+0000","last_peered":"2026-02-23T10:26:45.685731+0000","last_clean":"2026-02-23T10:26:45.685731+0000","last_became_active":"2026-02-23T10:21:38.783531+0000","last_became_peered":"2026-02-23T10:21:38.783531+0000","last_unstale":"2026-02-23T10:26:45.685731+0000","last_undegraded":"2026-02-23T10:26:45.685731+0000","last_fullsized":"2026-02-23T10:26:45.685731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":854,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688643+0000","last_change":"2026-02-23T10:21:40.769460+0000","last_active":"2026-02-23T10:26:45.688643+0000","last_peered":"2026-02-23T10:26:45.688643+0000","last_clean":"2026-02-23T10:26:45.688643+0000","last_became_active":"2026-02-23T10:21:38.792756+0000","last_became_peered":"2026-02-23T10:21:38.792756+0000","last_unstale":"2026-02-23T10:26:45.688643+0000","last_undegraded":"2026-02-23T10:26:45.688643+0000","last_fullsized":"2026-02-23T10:26:45.688643+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":856,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-23T10:26:48.687590+0000","last_change":"2026-02-23T10:21:40.764662+0000","last_active":"2026-02-23T10:26:48.687590+0000","last_peered":"2026-02-23T10:26:48.687590+0000","last_clean":"2026-02-23T10:26:48.687590+0000","last_became_active":"2026-02-23T10:21:38.783420+0000","last_became_peered":"2026-02-23T10:21:38.783420+0000","last_unstale":"2026-02-23T10:26:48.687590+0000","last_undegraded":"2026-02-23T10:26:48.687590+0000","last_fullsized":"2026-02-23T10:26:48.687590+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":918,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.687946+0000","last_change":"2026-02-23T10:21:38.800194+0000","last_active":"2026-02-23T10:26:45.687946+0000","last_peered":"2026-02-23T10:26:45.687946+0000","last_clean":"2026-02-23T10:26:45.687946+0000","last_became_active":"2026-02-23T10:21:38.790380+0000","last_became_peered":"2026-02-23T10:21:38.790380+0000","last_unstale":"2026-02-23T10:26:45.687946+0000","last_undegraded":"2026-02-23T10:26:45.687946+0000","last_fullsized":"2026-02-23T10:26:45.687946+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":855,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-23T10:26:48.689776+0000","last_change":"2026-02-23T10:21:40.765639+0000","last_active":"2026-02-23T10:26:48.689776+0000","last_peered":"2026-02-23T10:26:48.689776+0000","last_clean":"2026-02-23T10:26:48.689776+0000","last_became_active":"2026-02-23T10:21:38.783242+0000","last_became_peered":"2026-02-23T10:21:38.783242+0000","last_unstale":"2026-02-23T10:26:48.689776+0000","last_undegraded":"2026-02-23T10:26:48.689776+0000","last_fullsized":"2026-02-23T10:26:48.689776+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688488+0000","last_change":"2026-02-23T10:21:40.766130+0000","last_active":"2026-02-23T10:26:45.688488+0000","last_peered":"2026-02-23T10:26:45.688488+0000","last_clean":"2026-02-23T10:26:45.688488+0000","last_became_active":"2026-02-23T10:21:38.783892+0000","last_became_peered":"2026-02-23T10:21:38.783892+0000","last_unstale":"2026-02-23T10:26:45.688488+0000","last_undegraded":"2026-02-23T10:26:45.688488+0000","last_fullsized":"2026-02-23T10:26:45.688488+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688394+0000","last_change":"2026-02-23T10:21:40.766366+0000","last_active":"2026-02-23T10:26:45.688394+0000","last_peered":"2026-02-23T10:26:45.688394+0000","last_clean":"2026-02-23T10:26:45.688394+0000","last_became_active":"2026-02-23T10:21:38.784159+0000","last_became_peered":"2026-02-23T10:21:38.784159+0000","last_unstale":"2026-02-23T10:26:45.688394+0000","last_undegraded":"2026-02-23T10:26:45.688394+0000","last_fullsized":"2026-02-23T10:26:45.688394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-23T10:26:45.688452+0000","last_change":"2026-02-23T10:21:40.767883+0000","last_active":"2026-02-23T10:26:45.688452+0000","last_peered":"2026-02-23T10:26:45.688452+0000","last_clean":"2026-02-23T10:26:45.688452+0000","last_became_active":"2026-02-23T10:21:38.784164+0000","last_became_peered":"2026-02-23T10:21:38.784164+0000","last_unstale":"2026-02-23T10:26:45.688452+0000","last_undegraded":"2026-02-23T10:26:45.688452+0000","last_fullsized":"2026-02-23T10:26:45.688452+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:21:37.738611+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":73,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213658570752,"internally_reserved":0,"allocated":16052224,"data_stored":16052224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160243404800,"internally_reserved":0,"allocated":12562432,"data_stored":12562432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673274,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4148,"kb_used_data":4148,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162508,"statfs":{"total":53418655744,"available":53414408192,"internally_reserved":0,"allocated":4247552,"data_stored":4247552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3408,"kb_used_data":3408,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52163248,"statfs":{"total":53418655744,"available":53415165952,"internally_reserved":0,"allocated":3489792,"data_stored":3489792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3664,"kb_used_data":3664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162992,"statfs":{"total":53418655744,"available":53414903808,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4456,"kb_used_data":4456,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162200,"statfs":{"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53418655744,"available":53414903808,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53414408192,"internally_reserved":0,"allocated":4247552,"data_stored":4247552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":0,"total":53418655744,"available":53414092800,"internally_reserved":0,"allocated":4562944,"data_stored":4562944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":1,"total":53418655744,"available":53414903808,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":2,"total":53418655744,"available":53415165952,"internally_reserved":0,"allocated":3489792,"data_stored":3489792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":3,"total":53418655744,"available":53414408192,"internally_reserved":0,"allocated":4247552,"data_stored":4247552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T10:26:52.493 INFO:tasks.ceph:pgid 73.f last_scrub_stamp 2026-02-23T10:26:36.642848+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=36, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.493 INFO:tasks.ceph:pgid 73.e last_scrub_stamp 2026-02-23T10:26:36.642848+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=36, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.493 INFO:tasks.ceph:pgid 73.d last_scrub_stamp 2026-02-23T10:26:36.642848+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=36, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.494 INFO:tasks.ceph:pgid 73.c last_scrub_stamp 2026-02-23T10:26:36.642848+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=36, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.494 INFO:tasks.ceph:pgid 73.b last_scrub_stamp 2026-02-23T10:26:36.642848+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=36, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.494 INFO:tasks.ceph:pgid 73.a last_scrub_stamp 2026-02-23T10:26:36.642848+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=36, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.494 INFO:tasks.ceph:pgid 73.9 last_scrub_stamp 2026-02-23T10:26:36.642848+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=36, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.494 INFO:tasks.ceph:pgid 73.8 last_scrub_stamp 2026-02-23T10:26:36.642848+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=36, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.494 INFO:tasks.ceph:pgid 73.7 last_scrub_stamp 2026-02-23T10:26:36.642848+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=36, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.495 INFO:tasks.ceph:pgid 73.6 last_scrub_stamp 2026-02-23T10:26:36.642848+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=36, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.495 INFO:tasks.ceph:pgid 73.5 last_scrub_stamp 2026-02-23T10:26:36.642848+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=36, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.495 INFO:tasks.ceph:pgid 73.4 last_scrub_stamp 2026-02-23T10:26:36.642848+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=36, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.495 INFO:tasks.ceph:pgid 73.3 last_scrub_stamp 2026-02-23T10:26:36.642848+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=36, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.495 INFO:tasks.ceph:pgid 73.2 last_scrub_stamp 2026-02-23T10:26:36.642848+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=36, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.495 INFO:tasks.ceph:pgid 73.1 last_scrub_stamp 2026-02-23T10:26:36.642848+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=36, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.495 INFO:tasks.ceph:pgid 73.0 last_scrub_stamp 2026-02-23T10:26:36.642848+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=36, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.496 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-23T10:21:37.738611+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=21, tm_sec=37, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.496 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-23T10:21:37.738611+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=21, tm_sec=37, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.496 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-23T10:21:37.738611+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=21, tm_sec=37, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.496 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-23T10:21:37.738611+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=21, tm_sec=37, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.496 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-23T10:21:37.738611+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=21, tm_sec=37, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.496 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-23T10:21:37.738611+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=21, tm_sec=37, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.496 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-23T10:21:37.738611+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=21, tm_sec=37, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.497 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-23T10:21:37.738611+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=21, tm_sec=37, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.497 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-23T10:21:37.738611+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=21, tm_sec=37, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=10, tm_min=26, tm_sec=50, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T10:26:52.497 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-23T10:27:12.497 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T10:27:12.576 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:27:12.572+0000 7fe591d62640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:27:12.579 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:27:12.577+0000 7fe591d62640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:27:12.692 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-23T10:27:12.692 INFO:teuthology.orchestra.run.trial044.stderr:dumped all 2026-02-23T10:27:12.701 INFO:teuthology.orchestra.run.trial044.stdout:{"pg_ready":true,"pg_map":{"version":457,"stamp":"2026-02-23T10:27:11.656895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":15044,"kb_used_data":15044,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208651580,"statfs":{"total":213674622976,"available":213659217920,"internally_reserved":0,"allocated":15405056,"data_stored":15405056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002284"},"pg_stats":[{"pgid":"73.f","version":"0'0","reported_seq":34,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.633447+0000","last_change":"2026-02-23T10:26:51.696646+0000","last_active":"2026-02-23T10:26:52.633447+0000","last_peered":"2026-02-23T10:26:52.633447+0000","last_clean":"2026-02-23T10:26:52.633447+0000","last_became_active":"2026-02-23T10:26:37.694547+0000","last_became_peered":"2026-02-23T10:26:37.694547+0000","last_unstale":"2026-02-23T10:26:52.633447+0000","last_undegraded":"2026-02-23T10:26:52.633447+0000","last_fullsized":"2026-02-23T10:26:52.633447+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.696586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.696586+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.e","version":"0'0","reported_seq":34,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.632888+0000","last_change":"2026-02-23T10:26:51.990225+0000","last_active":"2026-02-23T10:26:52.632888+0000","last_peered":"2026-02-23T10:26:52.632888+0000","last_clean":"2026-02-23T10:26:52.632888+0000","last_became_active":"2026-02-23T10:26:37.684243+0000","last_became_peered":"2026-02-23T10:26:37.684243+0000","last_unstale":"2026-02-23T10:26:52.632888+0000","last_undegraded":"2026-02-23T10:26:52.632888+0000","last_fullsized":"2026-02-23T10:26:52.632888+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.990171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.990171+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.d","version":"0'0","reported_seq":34,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.631239+0000","last_change":"2026-02-23T10:26:51.398932+0000","last_active":"2026-02-23T10:26:52.631239+0000","last_peered":"2026-02-23T10:26:52.631239+0000","last_clean":"2026-02-23T10:26:52.631239+0000","last_became_active":"2026-02-23T10:26:37.665101+0000","last_became_peered":"2026-02-23T10:26:37.665101+0000","last_unstale":"2026-02-23T10:26:52.631239+0000","last_undegraded":"2026-02-23T10:26:52.631239+0000","last_fullsized":"2026-02-23T10:26:52.631239+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.398883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.398883+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.c","version":"0'0","reported_seq":34,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.632373+0000","last_change":"2026-02-23T10:26:51.394482+0000","last_active":"2026-02-23T10:26:52.632373+0000","last_peered":"2026-02-23T10:26:52.632373+0000","last_clean":"2026-02-23T10:26:52.632373+0000","last_became_active":"2026-02-23T10:26:37.664422+0000","last_became_peered":"2026-02-23T10:26:37.664422+0000","last_unstale":"2026-02-23T10:26:52.632373+0000","last_undegraded":"2026-02-23T10:26:52.632373+0000","last_fullsized":"2026-02-23T10:26:52.632373+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.394409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.394409+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.b","version":"0'0","reported_seq":34,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.631750+0000","last_change":"2026-02-23T10:26:51.399329+0000","last_active":"2026-02-23T10:26:52.631750+0000","last_peered":"2026-02-23T10:26:52.631750+0000","last_clean":"2026-02-23T10:26:52.631750+0000","last_became_active":"2026-02-23T10:26:37.675496+0000","last_became_peered":"2026-02-23T10:26:37.675496+0000","last_unstale":"2026-02-23T10:26:52.631750+0000","last_undegraded":"2026-02-23T10:26:52.631750+0000","last_fullsized":"2026-02-23T10:26:52.631750+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.399277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.399277+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.a","version":"0'0","reported_seq":34,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.632293+0000","last_change":"2026-02-23T10:26:51.699925+0000","last_active":"2026-02-23T10:26:52.632293+0000","last_peered":"2026-02-23T10:26:52.632293+0000","last_clean":"2026-02-23T10:26:52.632293+0000","last_became_active":"2026-02-23T10:26:37.665175+0000","last_became_peered":"2026-02-23T10:26:37.665175+0000","last_unstale":"2026-02-23T10:26:52.632293+0000","last_undegraded":"2026-02-23T10:26:52.632293+0000","last_fullsized":"2026-02-23T10:26:52.632293+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.699874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.699874+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.9","version":"0'0","reported_seq":34,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.638850+0000","last_change":"2026-02-23T10:26:52.292266+0000","last_active":"2026-02-23T10:26:52.638850+0000","last_peered":"2026-02-23T10:26:52.638850+0000","last_clean":"2026-02-23T10:26:52.638850+0000","last_became_active":"2026-02-23T10:26:37.664820+0000","last_became_peered":"2026-02-23T10:26:37.664820+0000","last_unstale":"2026-02-23T10:26:52.638850+0000","last_undegraded":"2026-02-23T10:26:52.638850+0000","last_fullsized":"2026-02-23T10:26:52.638850+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:52.292220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:52.292220+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.8","version":"0'0","reported_seq":34,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.632985+0000","last_change":"2026-02-23T10:26:51.393225+0000","last_active":"2026-02-23T10:26:52.632985+0000","last_peered":"2026-02-23T10:26:52.632985+0000","last_clean":"2026-02-23T10:26:52.632985+0000","last_became_active":"2026-02-23T10:26:37.674071+0000","last_became_peered":"2026-02-23T10:26:37.674071+0000","last_unstale":"2026-02-23T10:26:52.632985+0000","last_undegraded":"2026-02-23T10:26:52.632985+0000","last_fullsized":"2026-02-23T10:26:52.632985+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.393145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.393145+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.7","version":"0'0","reported_seq":34,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.633665+0000","last_change":"2026-02-23T10:26:51.693886+0000","last_active":"2026-02-23T10:26:52.633665+0000","last_peered":"2026-02-23T10:26:52.633665+0000","last_clean":"2026-02-23T10:26:52.633665+0000","last_became_active":"2026-02-23T10:26:37.679686+0000","last_became_peered":"2026-02-23T10:26:37.679686+0000","last_unstale":"2026-02-23T10:26:52.633665+0000","last_undegraded":"2026-02-23T10:26:52.633665+0000","last_fullsized":"2026-02-23T10:26:52.633665+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.693822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.693822+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.6","version":"0'0","reported_seq":34,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.632663+0000","last_change":"2026-02-23T10:26:51.396509+0000","last_active":"2026-02-23T10:26:52.632663+0000","last_peered":"2026-02-23T10:26:52.632663+0000","last_clean":"2026-02-23T10:26:52.632663+0000","last_became_active":"2026-02-23T10:26:37.713858+0000","last_became_peered":"2026-02-23T10:26:37.713858+0000","last_unstale":"2026-02-23T10:26:52.632663+0000","last_undegraded":"2026-02-23T10:26:52.632663+0000","last_fullsized":"2026-02-23T10:26:52.632663+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.396455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.396455+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.5","version":"0'0","reported_seq":34,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.633444+0000","last_change":"2026-02-23T10:26:51.692721+0000","last_active":"2026-02-23T10:26:52.633444+0000","last_peered":"2026-02-23T10:26:52.633444+0000","last_clean":"2026-02-23T10:26:52.633444+0000","last_became_active":"2026-02-23T10:26:37.676353+0000","last_became_peered":"2026-02-23T10:26:37.676353+0000","last_unstale":"2026-02-23T10:26:52.633444+0000","last_undegraded":"2026-02-23T10:26:52.633444+0000","last_fullsized":"2026-02-23T10:26:52.633444+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.692645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.692645+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.4","version":"0'0","reported_seq":34,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.632990+0000","last_change":"2026-02-23T10:26:51.989978+0000","last_active":"2026-02-23T10:26:52.632990+0000","last_peered":"2026-02-23T10:26:52.632990+0000","last_clean":"2026-02-23T10:26:52.632990+0000","last_became_active":"2026-02-23T10:26:37.717264+0000","last_became_peered":"2026-02-23T10:26:37.717264+0000","last_unstale":"2026-02-23T10:26:52.632990+0000","last_undegraded":"2026-02-23T10:26:52.632990+0000","last_fullsized":"2026-02-23T10:26:52.632990+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.989925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.989925+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.3","version":"0'0","reported_seq":34,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.639332+0000","last_change":"2026-02-23T10:26:52.291187+0000","last_active":"2026-02-23T10:26:52.639332+0000","last_peered":"2026-02-23T10:26:52.639332+0000","last_clean":"2026-02-23T10:26:52.639332+0000","last_became_active":"2026-02-23T10:26:37.686822+0000","last_became_peered":"2026-02-23T10:26:37.686822+0000","last_unstale":"2026-02-23T10:26:52.639332+0000","last_undegraded":"2026-02-23T10:26:52.639332+0000","last_fullsized":"2026-02-23T10:26:52.639332+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:52.291094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:52.291094+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.2","version":"0'0","reported_seq":34,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.639616+0000","last_change":"2026-02-23T10:26:52.293234+0000","last_active":"2026-02-23T10:26:52.639616+0000","last_peered":"2026-02-23T10:26:52.639616+0000","last_clean":"2026-02-23T10:26:52.639616+0000","last_became_active":"2026-02-23T10:26:37.705139+0000","last_became_peered":"2026-02-23T10:26:37.705139+0000","last_unstale":"2026-02-23T10:26:52.639616+0000","last_undegraded":"2026-02-23T10:26:52.639616+0000","last_fullsized":"2026-02-23T10:26:52.639616+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:52.293183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:52.293183+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.1","version":"0'0","reported_seq":34,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.633997+0000","last_change":"2026-02-23T10:26:51.696133+0000","last_active":"2026-02-23T10:26:52.633997+0000","last_peered":"2026-02-23T10:26:52.633997+0000","last_clean":"2026-02-23T10:26:52.633997+0000","last_became_active":"2026-02-23T10:26:37.691182+0000","last_became_peered":"2026-02-23T10:26:37.691182+0000","last_unstale":"2026-02-23T10:26:52.633997+0000","last_undegraded":"2026-02-23T10:26:52.633997+0000","last_fullsized":"2026-02-23T10:26:52.633997+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.696056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.696056+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.0","version":"0'0","reported_seq":34,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.633636+0000","last_change":"2026-02-23T10:26:51.989313+0000","last_active":"2026-02-23T10:26:52.633636+0000","last_peered":"2026-02-23T10:26:52.633636+0000","last_clean":"2026-02-23T10:26:52.633636+0000","last_became_active":"2026-02-23T10:26:37.695864+0000","last_became_peered":"2026-02-23T10:26:37.695864+0000","last_unstale":"2026-02-23T10:26:52.633636+0000","last_undegraded":"2026-02-23T10:26:52.633636+0000","last_fullsized":"2026-02-23T10:26:52.633636+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.989227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.989227+0000","last_clean_scrub_stamp":"2026-02-23T10:26:36.642848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":860,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.632679+0000","last_change":"2026-02-23T10:26:51.699480+0000","last_active":"2026-02-23T10:26:52.632679+0000","last_peered":"2026-02-23T10:26:52.632679+0000","last_clean":"2026-02-23T10:26:52.632679+0000","last_became_active":"2026-02-23T10:21:38.771052+0000","last_became_peered":"2026-02-23T10:21:38.771052+0000","last_unstale":"2026-02-23T10:26:52.632679+0000","last_undegraded":"2026-02-23T10:26:52.632679+0000","last_fullsized":"2026-02-23T10:26:52.632679+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.699431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.699431+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":860,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.631586+0000","last_change":"2026-02-23T10:26:51.397818+0000","last_active":"2026-02-23T10:26:52.631586+0000","last_peered":"2026-02-23T10:26:52.631586+0000","last_clean":"2026-02-23T10:26:52.631586+0000","last_became_active":"2026-02-23T10:21:38.783531+0000","last_became_peered":"2026-02-23T10:21:38.783531+0000","last_unstale":"2026-02-23T10:26:52.631586+0000","last_undegraded":"2026-02-23T10:26:52.631586+0000","last_fullsized":"2026-02-23T10:26:52.631586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.397767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.397767+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":862,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.632728+0000","last_change":"2026-02-23T10:26:51.396213+0000","last_active":"2026-02-23T10:26:52.632728+0000","last_peered":"2026-02-23T10:26:52.632728+0000","last_clean":"2026-02-23T10:26:52.632728+0000","last_became_active":"2026-02-23T10:21:38.792756+0000","last_became_peered":"2026-02-23T10:21:38.792756+0000","last_unstale":"2026-02-23T10:26:52.632728+0000","last_undegraded":"2026-02-23T10:26:52.632728+0000","last_fullsized":"2026-02-23T10:26:52.632728+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2026-02-23T10:26:51.396155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.396155+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":861,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.638492+0000","last_change":"2026-02-23T10:26:52.295640+0000","last_active":"2026-02-23T10:26:52.638492+0000","last_peered":"2026-02-23T10:26:52.638492+0000","last_clean":"2026-02-23T10:26:52.638492+0000","last_became_active":"2026-02-23T10:21:38.783420+0000","last_became_peered":"2026-02-23T10:21:38.783420+0000","last_unstale":"2026-02-23T10:26:52.638492+0000","last_undegraded":"2026-02-23T10:26:52.638492+0000","last_fullsized":"2026-02-23T10:26:52.638492+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2026-02-23T10:26:52.295587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:52.295587+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":926,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.632331+0000","last_change":"2026-02-23T10:26:51.400118+0000","last_active":"2026-02-23T10:26:52.632331+0000","last_peered":"2026-02-23T10:26:52.632331+0000","last_clean":"2026-02-23T10:26:52.632331+0000","last_became_active":"2026-02-23T10:21:38.790380+0000","last_became_peered":"2026-02-23T10:21:38.790380+0000","last_unstale":"2026-02-23T10:26:52.632331+0000","last_undegraded":"2026-02-23T10:26:52.632331+0000","last_fullsized":"2026-02-23T10:26:52.632331+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'52","last_scrub_stamp":"2026-02-23T10:26:51.400040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.400040+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":860,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.639786+0000","last_change":"2026-02-23T10:26:52.291459+0000","last_active":"2026-02-23T10:26:52.639786+0000","last_peered":"2026-02-23T10:26:52.639786+0000","last_clean":"2026-02-23T10:26:52.639786+0000","last_became_active":"2026-02-23T10:21:38.783242+0000","last_became_peered":"2026-02-23T10:21:38.783242+0000","last_unstale":"2026-02-23T10:26:52.639786+0000","last_undegraded":"2026-02-23T10:26:52.639786+0000","last_fullsized":"2026-02-23T10:26:52.639786+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:52.291388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:52.291388+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":860,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.632620+0000","last_change":"2026-02-23T10:26:51.688494+0000","last_active":"2026-02-23T10:26:52.632620+0000","last_peered":"2026-02-23T10:26:52.632620+0000","last_clean":"2026-02-23T10:26:52.632620+0000","last_became_active":"2026-02-23T10:21:38.783892+0000","last_became_peered":"2026-02-23T10:21:38.783892+0000","last_unstale":"2026-02-23T10:26:52.632620+0000","last_undegraded":"2026-02-23T10:26:52.632620+0000","last_fullsized":"2026-02-23T10:26:52.632620+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.688425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.688425+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":860,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.633711+0000","last_change":"2026-02-23T10:26:51.692425+0000","last_active":"2026-02-23T10:26:52.633711+0000","last_peered":"2026-02-23T10:26:52.633711+0000","last_clean":"2026-02-23T10:26:52.633711+0000","last_became_active":"2026-02-23T10:21:38.784159+0000","last_became_peered":"2026-02-23T10:21:38.784159+0000","last_unstale":"2026-02-23T10:26:52.633711+0000","last_undegraded":"2026-02-23T10:26:52.633711+0000","last_fullsized":"2026-02-23T10:26:52.633711+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.692369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.692369+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":860,"reported_epoch":296,"state":"active+clean","last_fresh":"2026-02-23T10:26:52.631805+0000","last_change":"2026-02-23T10:26:51.699210+0000","last_active":"2026-02-23T10:26:52.631805+0000","last_peered":"2026-02-23T10:26:52.631805+0000","last_clean":"2026-02-23T10:26:52.631805+0000","last_became_active":"2026-02-23T10:21:38.784164+0000","last_became_peered":"2026-02-23T10:21:38.784164+0000","last_unstale":"2026-02-23T10:26:52.631805+0000","last_undegraded":"2026-02-23T10:26:52.631805+0000","last_fullsized":"2026-02-23T10:26:52.631805+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T10:26:51.699150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T10:26:51.699150+0000","last_clean_scrub_stamp":"2026-02-23T10:21:37.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":73,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213659217920,"internally_reserved":0,"allocated":15405056,"data_stored":15405056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53414395904,"internally_reserved":0,"allocated":4259840,"data_stored":4259840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160243941376,"internally_reserved":0,"allocated":12025856,"data_stored":12025856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4156,"kb_used_data":4156,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162500,"statfs":{"total":53418655744,"available":53414400000,"internally_reserved":0,"allocated":4255744,"data_stored":4255744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640585,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3300,"kb_used_data":3300,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52163356,"statfs":{"total":53418655744,"available":53415276544,"internally_reserved":0,"allocated":3379200,"data_stored":3379200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640585,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3428,"kb_used_data":3428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52163228,"statfs":{"total":53418655744,"available":53415145472,"internally_reserved":0,"allocated":3510272,"data_stored":3510272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640585,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4160,"kb_used_data":4160,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162496,"statfs":{"total":53418655744,"available":53414395904,"internally_reserved":0,"allocated":4259840,"data_stored":4259840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53418655744,"available":53414395904,"internally_reserved":0,"allocated":4259840,"data_stored":4259840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53418655744,"available":53415145472,"internally_reserved":0,"allocated":3510272,"data_stored":3510272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53414400000,"internally_reserved":0,"allocated":4255744,"data_stored":4255744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53418655744,"available":53414395904,"internally_reserved":0,"allocated":4259840,"data_stored":4259840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":0,"total":53418655744,"available":53414395904,"internally_reserved":0,"allocated":4259840,"data_stored":4259840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":1,"total":53418655744,"available":53415145472,"internally_reserved":0,"allocated":3510272,"data_stored":3510272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":2,"total":53418655744,"available":53415276544,"internally_reserved":0,"allocated":3379200,"data_stored":3379200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":3,"total":53418655744,"available":53414400000,"internally_reserved":0,"allocated":4255744,"data_stored":4255744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T10:27:12.704 DEBUG:teuthology.orchestra.run.trial044:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-23T10:27:12.779 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:27:12.773+0000 7fb8c11f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:27:12.781 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-23T10:27:12.779+0000 7fb8c11f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T10:27:12.907 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-23T10:27:12.907 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-23T10:27:12.907 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-23T10:27:12.907 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T10:27:12.968 INFO:tasks.ceph.osd.0:Stopped 2026-02-23T10:27:12.968 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-23T10:27:12.968 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T10:27:13.032 INFO:tasks.ceph.osd.1:Stopped 2026-02-23T10:27:13.032 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-23T10:27:13.032 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T10:27:13.102 INFO:tasks.ceph.osd.2:Stopped 2026-02-23T10:27:13.103 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-23T10:27:13.103 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T10:27:13.166 INFO:tasks.ceph.osd.3:Stopped 2026-02-23T10:27:13.167 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-23T10:27:13.167 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-23T10:27:13.167 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T10:27:13.201 INFO:tasks.ceph.mgr.x:Stopped 2026-02-23T10:27:13.201 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-23T10:27:13.202 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-23T10:27:13.202 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T10:27:13.215 INFO:tasks.ceph.mon.a:Stopped 2026-02-23T10:27:13.215 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-23T10:27:13.215 DEBUG:teuthology.orchestra.run.trial044:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v 'but it is still running' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(PG_' | grep -E -v '\(OSD_' | grep -E -v '\(OBJECT_' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | head -n 1 2026-02-23T10:27:13.281 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial044.front.sepia.ceph.com 2026-02-23T10:27:13.281 DEBUG:teuthology.orchestra.run.trial044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-23T10:27:13.349 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial044.front.sepia.ceph.com 2026-02-23T10:27:13.349 DEBUG:teuthology.orchestra.run.trial044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-23T10:27:13.422 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial198.front.sepia.ceph.com 2026-02-23T10:27:13.422 DEBUG:teuthology.orchestra.run.trial198:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-23T10:27:13.504 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial198.front.sepia.ceph.com 2026-02-23T10:27:13.505 DEBUG:teuthology.orchestra.run.trial198:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-23T10:27:13.549 INFO:tasks.ceph:Archiving mon data... 2026-02-23T10:27:13.550 DEBUG:teuthology.misc:Transferring archived files from trial044:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66051/data/mon.a.tgz 2026-02-23T10:27:13.550 DEBUG:teuthology.orchestra.run.trial044:> mktemp 2026-02-23T10:27:13.567 INFO:teuthology.orchestra.run.trial044.stdout:/tmp/tmp.gmNGIDqkIc 2026-02-23T10:27:13.567 DEBUG:teuthology.orchestra.run.trial044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.gmNGIDqkIc 2026-02-23T10:27:13.681 DEBUG:teuthology.orchestra.run.trial044:> sudo chmod 0666 /tmp/tmp.gmNGIDqkIc 2026-02-23T10:27:13.764 DEBUG:teuthology.orchestra.remote:trial044:/tmp/tmp.gmNGIDqkIc is 403KB 2026-02-23T10:27:13.858 DEBUG:teuthology.orchestra.run.trial044:> rm -fr /tmp/tmp.gmNGIDqkIc 2026-02-23T10:27:13.875 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-23T10:27:13.875 DEBUG:teuthology.orchestra.run.trial044:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-23T10:27:13.917 DEBUG:teuthology.orchestra.run.trial198:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-23T10:27:13.996 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-23T10:27:14.012 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-23T10:27:14.012 INFO:tasks.ceph:Archiving crash dumps... 2026-02-23T10:27:14.014 DEBUG:teuthology.misc:Transferring archived files from trial044:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66051/remote/trial044/crash 2026-02-23T10:27:14.016 DEBUG:teuthology.orchestra.run.trial044:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-23T10:27:14.062 DEBUG:teuthology.misc:Transferring archived files from trial198:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66051/remote/trial198/crash 2026-02-23T10:27:14.063 DEBUG:teuthology.orchestra.run.trial198:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-23T10:27:14.088 INFO:tasks.ceph:Compressing logs... 2026-02-23T10:27:14.089 DEBUG:teuthology.orchestra.run.trial044:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-23T10:27:14.107 DEBUG:teuthology.orchestra.run.trial198:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-23T10:27:14.128 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-23T10:27:14.141 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36746.log 2026-02-23T10:27:14.141 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-23T10:27:14.142 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.36746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39727.log 2026-02-23T10:27:14.142 INFO:teuthology.orchestra.run.trial044.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36746.log.gz 2026-02-23T10:27:14.142 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39286.log 2026-02-23T10:27:14.142 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.39727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36429.log 2026-02-23T10:27:14.142 INFO:teuthology.orchestra.run.trial044.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39727.log.gz 2026-02-23T10:27:14.142 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.39286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37069.log 2026-02-23T10:27:14.142 INFO:teuthology.orchestra.run.trial044.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39286.log.gz 2026-02-23T10:27:14.142 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.36429.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36429.log.gz 2026-02-23T10:27:14.142 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39433.log 2026-02-23T10:27:14.142 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.37069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36599.log 2026-02-23T10:27:14.142 INFO:teuthology.orchestra.run.trial044.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37069.log.gz 2026-02-23T10:27:14.142 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.39433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36873.log 2026-02-23T10:27:14.143 INFO:teuthology.orchestra.run.trial044.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39433.log.gz 2026-02-23T10:27:14.143 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.36599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37559.log 2026-02-23T10:27:14.143 INFO:teuthology.orchestra.run.trial044.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36599.log.gz 2026-02-23T10:27:14.143 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.36873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39482.log 2026-02-23T10:27:14.143 INFO:teuthology.orchestra.run.trial044.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36873.log.gz 2026-02-23T10:27:14.143 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.37559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39825.log 2026-02-23T10:27:14.143 INFO:teuthology.orchestra.run.trial044.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37559.log.gz 2026-02-23T10:27:14.143 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.39482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37072.log 2026-02-23T10:27:14.143 INFO:teuthology.orchestra.run.trial044.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39482.log.gz 2026-02-23T10:27:14.143 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.39825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36697.log 2026-02-23T10:27:14.143 INFO:teuthology.orchestra.run.trial044.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39825.log.gz 2026-02-23T10:27:14.143 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.37072.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37072.log.gz 2026-02-23T10:27:14.144 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35990.log 2026-02-23T10:27:14.144 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.36697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39580.log 2026-02-23T10:27:14.144 INFO:teuthology.orchestra.run.trial044.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36697.log.gz 2026-02-23T10:27:14.144 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.35990.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.35990.log.gz 2026-02-23T10:27:14.144 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39678.log 2026-02-23T10:27:14.144 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.39580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39874.log 2026-02-23T10:27:14.144 INFO:teuthology.orchestra.run.trial044.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39580.log.gz 2026-02-23T10:27:14.144 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.39678.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39678.log.gz 2026-02-23T10:27:14.144 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39237.log 2026-02-23T10:27:14.144 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.39874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37584.log 2026-02-23T10:27:14.144 INFO:teuthology.orchestra.run.trial044.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39874.log.gz 2026-02-23T10:27:14.144 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.39237.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39237.log.gz 2026-02-23T10:27:14.144 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-23T10:27:14.145 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.34930.log 2026-02-23T10:27:14.145 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.37584.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39384.log 2026-02-23T10:27:14.145 INFO:teuthology.orchestra.run.trial044.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.37584.log.gz 2026-02-23T10:27:14.145 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph.tmp-client.admin.34930.log: 88.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-23T10:27:14.145 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36331.log 2026-02-23T10:27:14.145 INFO:teuthology.orchestra.run.trial044.stderr: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.34930.log.gz 2026-02-23T10:27:14.145 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.39384.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-23T10:27:14.145 INFO:teuthology.orchestra.run.trial044.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39384.log.gz 2026-02-23T10:27:14.145 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.36331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37070.log 2026-02-23T10:27:14.145 INFO:teuthology.orchestra.run.trial044.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36331.log.gz 2026-02-23T10:27:14.145 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37071.log 2026-02-23T10:27:14.145 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.37070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36648.log 2026-02-23T10:27:14.145 INFO:teuthology.orchestra.run.trial044.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37070.log.gz 2026-02-23T10:27:14.146 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.37071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39531.log 2026-02-23T10:27:14.146 INFO:teuthology.orchestra.run.trial044.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.37071.log.gz 2026-02-23T10:27:14.146 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.36648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36526.log 2026-02-23T10:27:14.146 INFO:teuthology.orchestra.run.trial044.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36648.log.gz 2026-02-23T10:27:14.146 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.39531.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.39531.log.gz -5 2026-02-23T10:27:14.146 INFO:teuthology.orchestra.run.trial044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36357.log 2026-02-23T10:27:14.146 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.36526.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.36526.log.gz 2026-02-23T10:27:14.146 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39335.log 2026-02-23T10:27:14.146 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.36357.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36357.log.gz 2026-02-23T10:27:14.146 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36876.log 2026-02-23T10:27:14.146 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.39335.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39335.log.gz 2026-02-23T10:27:14.146 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36875.log 2026-02-23T10:27:14.146 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.36876.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36876.log.gz 2026-02-23T10:27:14.147 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36874.log 2026-02-23T10:27:14.147 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.36875.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36875.log.gz 2026-02-23T10:27:14.147 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39776.log 2026-02-23T10:27:14.147 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.36874.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36874.log.gz 2026-02-23T10:27:14.147 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39629.log 2026-02-23T10:27:14.147 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.39776.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39776.log.gz 2026-02-23T10:27:14.147 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39921.log 2026-02-23T10:27:14.147 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.39629.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39629.log.gz 2026-02-23T10:27:14.147 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-23T10:27:14.147 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.39921.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39921.log.gz 2026-02-23T10:27:14.147 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37236.log 2026-02-23T10:27:14.147 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37187.log 2026-02-23T10:27:14.147 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.37236.log: gzip -5 50.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.37236.log.gz 2026-02-23T10:27:14.148 INFO:teuthology.orchestra.run.trial044.stderr: /var/log/ceph/ceph-client.admin.36123.log 2026-02-23T10:27:14.148 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.37187.log: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-23T10:27:14.148 INFO:teuthology.orchestra.run.trial044.stderr: 50.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.37187.log.gz 2026-02-23T10:27:14.148 INFO:teuthology.orchestra.run.trial044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36499.log 2026-02-23T10:27:14.148 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.36123.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.36123.log.gz 2026-02-23T10:27:14.148 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37285.log 2026-02-23T10:27:14.148 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.36499.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.36499.log.gz 2026-02-23T10:27:14.148 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36076.log 2026-02-23T10:27:14.148 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.37285.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.37285.log.gz 2026-02-23T10:27:14.148 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-client.admin.36076.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36076.log.gz 2026-02-23T10:27:14.160 INFO:teuthology.orchestra.run.trial198.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-23T10:27:14.160 INFO:teuthology.orchestra.run.trial198.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35280.log 2026-02-23T10:27:14.160 INFO:teuthology.orchestra.run.trial198.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-23T10:27:14.162 INFO:teuthology.orchestra.run.trial198.stderr:/var/log/ceph/ceph-client.admin.35280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35379.log 2026-02-23T10:27:14.162 INFO:teuthology.orchestra.run.trial198.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35280.log.gz 2026-02-23T10:27:14.162 INFO:teuthology.orchestra.run.trial198.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35432.log 2026-02-23T10:27:14.162 INFO:teuthology.orchestra.run.trial198.stderr:/var/log/ceph/ceph-client.admin.35379.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-23T10:27:14.162 INFO:teuthology.orchestra.run.trial198.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.35379.log.gz 2026-02-23T10:27:14.162 INFO:teuthology.orchestra.run.trial198.stderr:/var/log/ceph/ceph-client.admin.35432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35327.log 2026-02-23T10:27:14.162 INFO:teuthology.orchestra.run.trial198.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35432.log.gz 2026-02-23T10:27:14.162 INFO:teuthology.orchestra.run.trial198.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.35327.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35327.log.gz 2026-02-23T10:27:14.185 INFO:teuthology.orchestra.run.trial198.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-23T10:27:14.305 INFO:teuthology.orchestra.run.trial044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-23T10:27:16.811 INFO:teuthology.orchestra.run.trial198.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-23T10:27:16.824 INFO:teuthology.orchestra.run.trial044.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-23T10:27:16.972 INFO:teuthology.orchestra.run.trial198.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-23T10:27:16.974 INFO:teuthology.orchestra.run.trial198.stderr: 2026-02-23T10:27:16.974 INFO:teuthology.orchestra.run.trial198.stderr:real 0m2.823s 2026-02-23T10:27:16.975 INFO:teuthology.orchestra.run.trial198.stderr:user 0m5.223s 2026-02-23T10:27:16.975 INFO:teuthology.orchestra.run.trial198.stderr:sys 0m0.274s 2026-02-23T10:27:17.031 INFO:teuthology.orchestra.run.trial044.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-23T10:27:17.032 INFO:teuthology.orchestra.run.trial044.stderr: 2026-02-23T10:27:17.033 INFO:teuthology.orchestra.run.trial044.stderr:real 0m2.913s 2026-02-23T10:27:17.033 INFO:teuthology.orchestra.run.trial044.stderr:user 0m5.481s 2026-02-23T10:27:17.033 INFO:teuthology.orchestra.run.trial044.stderr:sys 0m0.321s 2026-02-23T10:27:17.033 INFO:tasks.ceph:Archiving logs... 2026-02-23T10:27:17.034 DEBUG:teuthology.misc:Transferring archived files from trial044:/var/log/ceph to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66051/remote/trial044/log 2026-02-23T10:27:17.035 DEBUG:teuthology.orchestra.run.trial044:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-23T10:27:17.662 DEBUG:teuthology.misc:Transferring archived files from trial198:/var/log/ceph to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66051/remote/trial198/log 2026-02-23T10:27:17.662 DEBUG:teuthology.orchestra.run.trial198:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-23T10:27:18.163 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-23T10:27:18.287 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-23T10:27:18.298 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-23T10:27:18.298 DEBUG:teuthology.orchestra.run.trial044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-23T10:27:18.300 DEBUG:teuthology.orchestra.run.trial198:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-23T10:27:18.327 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-23T10:27:18.338 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-23T10:27:18.338 DEBUG:teuthology.orchestra.run.trial044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-23T10:27:18.365 DEBUG:teuthology.orchestra.run.trial198:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-23T10:27:18.379 INFO:teuthology.orchestra.run.trial044.stderr:bash: line 1: ntpq: command not found 2026-02-23T10:27:18.383 INFO:teuthology.orchestra.run.trial198.stderr:bash: line 1: ntpq: command not found 2026-02-23T10:27:18.396 INFO:teuthology.orchestra.run.trial198.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-23T10:27:18.396 INFO:teuthology.orchestra.run.trial198.stdout:=============================================================================== 2026-02-23T10:27:18.396 INFO:teuthology.orchestra.run.trial198.stdout:^- connected.by.freedominte> 2 6 377 36 -68us[ -68us] +/- 41ms 2026-02-23T10:27:18.396 INFO:teuthology.orchestra.run.trial198.stdout:^- 172-233-155-39.ip.linode> 4 6 377 35 -1569us[-1569us] +/- 67ms 2026-02-23T10:27:18.396 INFO:teuthology.orchestra.run.trial198.stdout:^* ntp.nyc.icanbwell.com 2 6 377 37 +3260ns[ +15us] +/- 2829us 2026-02-23T10:27:18.396 INFO:teuthology.orchestra.run.trial198.stdout:^- 172-234-44-141.ip.linode> 2 6 377 36 +12ms[ +12ms] +/- 91ms 2026-02-23T10:27:18.397 INFO:teuthology.orchestra.run.trial044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-23T10:27:18.397 INFO:teuthology.orchestra.run.trial044.stdout:=============================================================================== 2026-02-23T10:27:18.397 INFO:teuthology.orchestra.run.trial044.stdout:^- connected.by.freedominte> 2 6 377 36 -435us[ -433us] +/- 41ms 2026-02-23T10:27:18.398 INFO:teuthology.orchestra.run.trial044.stdout:^- 172-233-155-39.ip.linode> 4 6 377 166 -2387us[-2381us] +/- 65ms 2026-02-23T10:27:18.398 INFO:teuthology.orchestra.run.trial044.stdout:^* ntp.nyc.icanbwell.com 2 6 377 35 +4045ns[+5744ns] +/- 2813us 2026-02-23T10:27:18.398 INFO:teuthology.orchestra.run.trial044.stdout:^- 172-234-44-141.ip.linode> 2 6 377 35 +12ms[ +12ms] +/- 92ms 2026-02-23T10:27:18.398 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-23T10:27:18.410 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-23T10:27:18.411 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-23T10:27:18.426 DEBUG:teuthology.orchestra.run.trial044:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-23T10:27:18.488 DEBUG:teuthology.orchestra.run.trial198:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-23T10:27:18.542 DEBUG:teuthology.orchestra.run.trial044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-23T10:27:18.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T10:27:18.571 DEBUG:teuthology.orchestra.run.trial198:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-23T10:27:18.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T10:27:18.597 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-23T10:27:18.613 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-23T10:27:18.628 INFO:teuthology.task.internal:Duration was 919.032938 seconds 2026-02-23T10:27:18.629 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-23T10:27:18.644 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-23T10:27:18.645 DEBUG:teuthology.orchestra.run.trial044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-23T10:27:18.647 DEBUG:teuthology.orchestra.run.trial198:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-23T10:27:18.682 INFO:teuthology.orchestra.run.trial044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-23T10:27:18.684 INFO:teuthology.orchestra.run.trial198.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-23T10:27:19.076 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-23T10:27:19.076 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial044.front.sepia.ceph.com 2026-02-23T10:27:19.077 DEBUG:teuthology.orchestra.run.trial044:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-23T10:27:19.135 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial198.front.sepia.ceph.com 2026-02-23T10:27:19.135 DEBUG:teuthology.orchestra.run.trial198:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-23T10:27:19.155 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-23T10:27:19.156 DEBUG:teuthology.orchestra.run.trial044:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-23T10:27:19.177 DEBUG:teuthology.orchestra.run.trial198:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-23T10:27:19.254 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-23T10:27:19.254 DEBUG:teuthology.orchestra.run.trial044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-23T10:27:19.256 DEBUG:teuthology.orchestra.run.trial198:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-23T10:27:19.278 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T10:27:19.279 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T10:27:19.279 INFO:teuthology.orchestra.run.trial044.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-23T10:27:19.279 INFO:teuthology.orchestra.run.trial044.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-23T10:27:19.279 INFO:teuthology.orchestra.run.trial044.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-23T10:27:19.280 INFO:teuthology.orchestra.run.trial198.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T10:27:19.281 INFO:teuthology.orchestra.run.trial198.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T10:27:19.281 INFO:teuthology.orchestra.run.trial198.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-23T10:27:19.281 INFO:teuthology.orchestra.run.trial198.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-23T10:27:19.281 INFO:teuthology.orchestra.run.trial198.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-23T10:27:19.288 INFO:teuthology.orchestra.run.trial044.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-23T10:27:19.291 INFO:teuthology.orchestra.run.trial198.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-23T10:27:19.293 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-23T10:27:19.310 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-23T10:27:19.310 DEBUG:teuthology.orchestra.run.trial044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-23T10:27:19.354 DEBUG:teuthology.orchestra.run.trial198:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-23T10:27:19.379 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-23T10:27:19.396 DEBUG:teuthology.orchestra.run.trial044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-23T10:27:19.399 DEBUG:teuthology.orchestra.run.trial198:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-23T10:27:19.419 INFO:teuthology.orchestra.run.trial044.stdout:kernel.core_pattern = core 2026-02-23T10:27:19.442 INFO:teuthology.orchestra.run.trial198.stdout:kernel.core_pattern = core 2026-02-23T10:27:19.455 DEBUG:teuthology.orchestra.run.trial044:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-23T10:27:19.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T10:27:19.487 DEBUG:teuthology.orchestra.run.trial198:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-23T10:27:19.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T10:27:19.511 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-23T10:27:19.528 INFO:teuthology.task.internal:Transferring archived files... 2026-02-23T10:27:19.529 DEBUG:teuthology.misc:Transferring archived files from trial044:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66051/remote/trial044 2026-02-23T10:27:19.529 DEBUG:teuthology.orchestra.run.trial044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-23T10:27:19.564 DEBUG:teuthology.misc:Transferring archived files from trial198:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66051/remote/trial198 2026-02-23T10:27:19.564 DEBUG:teuthology.orchestra.run.trial198:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-23T10:27:19.600 INFO:teuthology.task.internal:Removing archive directory... 2026-02-23T10:27:19.600 DEBUG:teuthology.orchestra.run.trial044:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-23T10:27:19.602 DEBUG:teuthology.orchestra.run.trial198:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-23T10:27:19.651 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-23T10:27:19.669 INFO:teuthology.task.internal:Not uploading archives. 2026-02-23T10:27:19.669 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-23T10:27:19.694 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-23T10:27:19.694 DEBUG:teuthology.orchestra.run.trial044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-23T10:27:19.697 DEBUG:teuthology.orchestra.run.trial198:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-23T10:27:19.712 INFO:teuthology.orchestra.run.trial044.stdout: 917572 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 23 10:27 /home/ubuntu/cephtest 2026-02-23T10:27:19.715 INFO:teuthology.orchestra.run.trial198.stdout: 917521 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 23 10:27 /home/ubuntu/cephtest 2026-02-23T10:27:19.716 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-23T10:27:19.734 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-23T10:27:19.773 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} tasks/rados_python} duration: 919.0329377651215 flavor: debug owner: scheduled_shraddhaag@soko04.front.sepia.ceph.com success: true 2026-02-23T10:27:19.773 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T10:27:19.891 INFO:teuthology.run:pass