2026-02-25T08:03:02.092 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-25T08:03:02.105 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T08:03:02.180 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/matan-2026-02-25_07:55:35-crimson-rados-wip-logstoremanager-distro-debug-trial/69099 branch: wip-logstoremanager description: crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/rados_python} email: null first_in_suite: false flavor: debug job_id: '69099' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: matan-2026-02-25_07:55:35-crimson-rados-wip-logstoremanager-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-logstoremanager ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd pool default crimson: true osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug ms: 20 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd objectstore: seastore osd shutdown pgref assert: true seastore cachepin size pershard: 64M seastore main device type: RANDOM_BLOCK_SSD seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(PG_ - \(OSD_ - \(OBJECT_ - \(POOL_APP_NOT_ENABLED\) sha1: 6aeb6975bc9a4790a399c9cc70dba9635d2a7819 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: extra_system_packages: - python3-pytest flavor: debug sha1: 6aeb6975bc9a4790a399c9cc70dba9635d2a7819 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: c32469671c6b0222f786dd36c34eb702f780a11d owner: scheduled_matan@soko04.front.sepia.ceph.com priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 869 sha1: 6aeb6975bc9a4790a399c9cc70dba9635d2a7819 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_c32469671c6b0222f786dd36c34eb702f780a11d/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: c32469671c6b0222f786dd36c34eb702f780a11d targets: trial009.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDiUDklaRD/6Oz7AkjGSM5Hg+P73hZIlbLL0EuS+qnU1RsSC5WZlE4I0o4PLpIB7olkqCwW57VdwlkMlPBRMS9I= trial059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAyIXwbEb0ytPwSRyh/mkeLj4NC6kyGR1yX0BtN+2E0BbOY/o8zl1XtmRZOrUS9A5LxwGpMDe4oYk3+4xpxh1D0= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 - workunit: clients: client.0: - rados/test_python.sh -m 'not (wait or tier or ec)' timeout: 1h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-25_07:55:35 tube: trial user: matan verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-25T08:03:02.181 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_c32469671c6b0222f786dd36c34eb702f780a11d/qa; will attempt to use it 2026-02-25T08:03:02.181 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_c32469671c6b0222f786dd36c34eb702f780a11d/qa/tasks 2026-02-25T08:03:02.181 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-25T08:03:02.182 INFO:teuthology.task.internal:Checking packages... 2026-02-25T08:03:02.183 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash '6aeb6975bc9a4790a399c9cc70dba9635d2a7819' 2026-02-25T08:03:02.183 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-25T08:03:02.183 INFO:teuthology.packaging:ref: None 2026-02-25T08:03:02.183 INFO:teuthology.packaging:tag: None 2026-02-25T08:03:02.183 INFO:teuthology.packaging:branch: wip-logstoremanager 2026-02-25T08:03:02.183 INFO:teuthology.packaging:sha1: 6aeb6975bc9a4790a399c9cc70dba9635d2a7819 2026-02-25T08:03:02.183 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=wip-logstoremanager 2026-02-25T08:03:02.307 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5338.g6aeb6975 2026-02-25T08:03:02.309 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-25T08:03:02.321 INFO:teuthology.task.internal:no buildpackages task found 2026-02-25T08:03:02.321 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-25T08:03:02.334 INFO:teuthology.task.internal:Saving configuration 2026-02-25T08:03:02.347 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-25T08:03:02.359 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-25T08:03:02.439 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial009.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/matan-2026-02-25_07:55:35-crimson-rados-wip-logstoremanager-distro-debug-trial/69099', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-25 07:57:58.069218', 'locked_by': 'scheduled_matan@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDiUDklaRD/6Oz7AkjGSM5Hg+P73hZIlbLL0EuS+qnU1RsSC5WZlE4I0o4PLpIB7olkqCwW57VdwlkMlPBRMS9I='} 2026-02-25T08:03:02.496 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial059.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/matan-2026-02-25_07:55:35-crimson-rados-wip-logstoremanager-distro-debug-trial/69099', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-25 07:57:58.069798', 'locked_by': 'scheduled_matan@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAyIXwbEb0ytPwSRyh/mkeLj4NC6kyGR1yX0BtN+2E0BbOY/o8zl1XtmRZOrUS9A5LxwGpMDe4oYk3+4xpxh1D0='} 2026-02-25T08:03:02.497 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-25T08:03:02.507 INFO:teuthology.task.internal:roles: ubuntu@trial009.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2026-02-25T08:03:02.507 INFO:teuthology.task.internal:roles: ubuntu@trial059.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2026-02-25T08:03:02.507 INFO:teuthology.run_tasks:Running task console_log... 2026-02-25T08:03:02.646 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7b80b4027ec0>, signals=[15]) 2026-02-25T08:03:02.646 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-25T08:03:02.656 INFO:teuthology.task.internal:Opening connections... 2026-02-25T08:03:02.656 DEBUG:teuthology.task.internal:connecting to ubuntu@trial009.front.sepia.ceph.com 2026-02-25T08:03:02.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T08:03:02.722 DEBUG:teuthology.task.internal:connecting to ubuntu@trial059.front.sepia.ceph.com 2026-02-25T08:03:02.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T08:03:02.793 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-25T08:03:02.816 DEBUG:teuthology.orchestra.run.trial009:> uname -m 2026-02-25T08:03:02.833 INFO:teuthology.orchestra.run.trial009.stdout:x86_64 2026-02-25T08:03:02.833 DEBUG:teuthology.orchestra.run.trial009:> cat /etc/os-release 2026-02-25T08:03:02.890 INFO:teuthology.orchestra.run.trial009.stdout:NAME="CentOS Stream" 2026-02-25T08:03:02.891 INFO:teuthology.orchestra.run.trial009.stdout:VERSION="9" 2026-02-25T08:03:02.891 INFO:teuthology.orchestra.run.trial009.stdout:ID="centos" 2026-02-25T08:03:02.891 INFO:teuthology.orchestra.run.trial009.stdout:ID_LIKE="rhel fedora" 2026-02-25T08:03:02.891 INFO:teuthology.orchestra.run.trial009.stdout:VERSION_ID="9" 2026-02-25T08:03:02.891 INFO:teuthology.orchestra.run.trial009.stdout:PLATFORM_ID="platform:el9" 2026-02-25T08:03:02.891 INFO:teuthology.orchestra.run.trial009.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T08:03:02.891 INFO:teuthology.orchestra.run.trial009.stdout:ANSI_COLOR="0;31" 2026-02-25T08:03:02.891 INFO:teuthology.orchestra.run.trial009.stdout:LOGO="fedora-logo-icon" 2026-02-25T08:03:02.891 INFO:teuthology.orchestra.run.trial009.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T08:03:02.891 INFO:teuthology.orchestra.run.trial009.stdout:HOME_URL="https://centos.org/" 2026-02-25T08:03:02.891 INFO:teuthology.orchestra.run.trial009.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T08:03:02.891 INFO:teuthology.orchestra.run.trial009.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T08:03:02.891 INFO:teuthology.orchestra.run.trial009.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T08:03:02.891 INFO:teuthology.lock.ops:Updating trial009.front.sepia.ceph.com on lock server 2026-02-25T08:03:02.958 DEBUG:teuthology.orchestra.run.trial059:> uname -m 2026-02-25T08:03:02.973 INFO:teuthology.orchestra.run.trial059.stdout:x86_64 2026-02-25T08:03:02.974 DEBUG:teuthology.orchestra.run.trial059:> cat /etc/os-release 2026-02-25T08:03:03.030 INFO:teuthology.orchestra.run.trial059.stdout:NAME="CentOS Stream" 2026-02-25T08:03:03.030 INFO:teuthology.orchestra.run.trial059.stdout:VERSION="9" 2026-02-25T08:03:03.030 INFO:teuthology.orchestra.run.trial059.stdout:ID="centos" 2026-02-25T08:03:03.030 INFO:teuthology.orchestra.run.trial059.stdout:ID_LIKE="rhel fedora" 2026-02-25T08:03:03.030 INFO:teuthology.orchestra.run.trial059.stdout:VERSION_ID="9" 2026-02-25T08:03:03.030 INFO:teuthology.orchestra.run.trial059.stdout:PLATFORM_ID="platform:el9" 2026-02-25T08:03:03.030 INFO:teuthology.orchestra.run.trial059.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T08:03:03.030 INFO:teuthology.orchestra.run.trial059.stdout:ANSI_COLOR="0;31" 2026-02-25T08:03:03.030 INFO:teuthology.orchestra.run.trial059.stdout:LOGO="fedora-logo-icon" 2026-02-25T08:03:03.030 INFO:teuthology.orchestra.run.trial059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T08:03:03.030 INFO:teuthology.orchestra.run.trial059.stdout:HOME_URL="https://centos.org/" 2026-02-25T08:03:03.031 INFO:teuthology.orchestra.run.trial059.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T08:03:03.031 INFO:teuthology.orchestra.run.trial059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T08:03:03.031 INFO:teuthology.orchestra.run.trial059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T08:03:03.031 INFO:teuthology.lock.ops:Updating trial059.front.sepia.ceph.com on lock server 2026-02-25T08:03:03.110 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-25T08:03:03.122 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-25T08:03:03.133 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-25T08:03:03.133 DEBUG:teuthology.orchestra.run.trial009:> test '!' -e /home/ubuntu/cephtest 2026-02-25T08:03:03.135 DEBUG:teuthology.orchestra.run.trial059:> test '!' -e /home/ubuntu/cephtest 2026-02-25T08:03:03.150 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-25T08:03:03.162 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-25T08:03:03.162 DEBUG:teuthology.orchestra.run.trial009:> test -z $(ls -A /var/lib/ceph) 2026-02-25T08:03:03.193 DEBUG:teuthology.orchestra.run.trial059:> test -z $(ls -A /var/lib/ceph) 2026-02-25T08:03:03.210 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-25T08:03:03.379 INFO:teuthology.run_tasks:Running task kernel... 2026-02-25T08:03:03.398 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-25T08:03:03.398 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-25T08:03:03.399 DEBUG:teuthology.orchestra.run.trial009:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-25T08:03:03.399 DEBUG:teuthology.orchestra.run.trial059:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-25T08:03:03.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T08:03:03.414 DEBUG:teuthology.orchestra.run.trial059:> uname -r 2026-02-25T08:03:03.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T08:03:03.415 DEBUG:teuthology.orchestra.run.trial009:> uname -r 2026-02-25T08:03:03.468 INFO:teuthology.orchestra.run.trial059.stdout:5.14.0-681.el9.x86_64 2026-02-25T08:03:03.468 INFO:teuthology.task.kernel:Running kernel on trial059: 5.14.0-681.el9.x86_64 2026-02-25T08:03:03.468 DEBUG:teuthology.orchestra.run.trial059:> sudo yum install -y kernel 2026-02-25T08:03:03.471 INFO:teuthology.orchestra.run.trial009.stdout:5.14.0-681.el9.x86_64 2026-02-25T08:03:03.471 INFO:teuthology.task.kernel:Running kernel on trial009: 5.14.0-681.el9.x86_64 2026-02-25T08:03:03.471 DEBUG:teuthology.orchestra.run.trial009:> sudo yum install -y kernel 2026-02-25T08:03:04.949 INFO:teuthology.orchestra.run.trial059.stdout:CentOS Stream 9 - BaseOS 8.1 MB/s | 8.9 MB 00:01 2026-02-25T08:03:05.124 INFO:teuthology.orchestra.run.trial009.stdout:CentOS Stream 9 - BaseOS 7.0 MB/s | 8.9 MB 00:01 2026-02-25T08:03:07.664 INFO:teuthology.orchestra.run.trial009.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-25T08:03:08.023 INFO:teuthology.orchestra.run.trial059.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-25T08:03:11.667 INFO:teuthology.orchestra.run.trial009.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 8.0 MB 00:01 2026-02-25T08:03:12.043 INFO:teuthology.orchestra.run.trial059.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 8.0 MB 00:01 2026-02-25T08:03:12.871 INFO:teuthology.orchestra.run.trial009.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 20 kB 00:00 2026-02-25T08:03:12.963 INFO:teuthology.orchestra.run.trial059.stdout:CentOS Stream 9 - Extras packages 109 kB/s | 20 kB 00:00 2026-02-25T08:03:13.550 INFO:teuthology.orchestra.run.trial009.stdout:Extra Packages for Enterprise Linux 33 MB/s | 20 MB 00:00 2026-02-25T08:03:14.383 INFO:teuthology.orchestra.run.trial059.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2026-02-25T08:03:16.813 INFO:teuthology.orchestra.run.trial009.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-25T08:03:17.602 INFO:teuthology.orchestra.run.trial059.stdout:lab-extras 2.9 MB/s | 50 kB 00:00 2026-02-25T08:03:17.825 INFO:teuthology.orchestra.run.trial009.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-25T08:03:17.825 INFO:teuthology.orchestra.run.trial009.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-25T08:03:17.845 INFO:teuthology.orchestra.run.trial009.stdout:Dependencies resolved. 2026-02-25T08:03:17.846 INFO:teuthology.orchestra.run.trial009.stdout:================================================================================ 2026-02-25T08:03:17.847 INFO:teuthology.orchestra.run.trial009.stdout: Package Architecture Version Repository Size 2026-02-25T08:03:17.847 INFO:teuthology.orchestra.run.trial009.stdout:================================================================================ 2026-02-25T08:03:17.847 INFO:teuthology.orchestra.run.trial009.stdout:Installing: 2026-02-25T08:03:17.847 INFO:teuthology.orchestra.run.trial009.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-25T08:03:17.847 INFO:teuthology.orchestra.run.trial009.stdout:Installing dependencies: 2026-02-25T08:03:17.847 INFO:teuthology.orchestra.run.trial009.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-25T08:03:17.847 INFO:teuthology.orchestra.run.trial009.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-25T08:03:17.847 INFO:teuthology.orchestra.run.trial009.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-25T08:03:17.848 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:03:17.848 INFO:teuthology.orchestra.run.trial009.stdout:Transaction Summary 2026-02-25T08:03:17.848 INFO:teuthology.orchestra.run.trial009.stdout:================================================================================ 2026-02-25T08:03:17.848 INFO:teuthology.orchestra.run.trial009.stdout:Install 4 Packages 2026-02-25T08:03:17.848 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:03:17.848 INFO:teuthology.orchestra.run.trial009.stdout:Total download size: 89 M 2026-02-25T08:03:17.848 INFO:teuthology.orchestra.run.trial009.stdout:Installed size: 135 M 2026-02-25T08:03:17.849 INFO:teuthology.orchestra.run.trial009.stdout:Downloading Packages: 2026-02-25T08:03:18.176 INFO:teuthology.orchestra.run.trial009.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 14 MB/s | 901 kB 00:00 2026-02-25T08:03:18.253 INFO:teuthology.orchestra.run.trial009.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 122 MB/s | 17 MB 00:00 2026-02-25T08:03:18.351 INFO:teuthology.orchestra.run.trial009.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 178 MB/s | 31 MB 00:00 2026-02-25T08:03:18.425 INFO:teuthology.orchestra.run.trial009.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 128 MB/s | 40 MB 00:00 2026-02-25T08:03:18.426 INFO:teuthology.orchestra.run.trial009.stdout:-------------------------------------------------------------------------------- 2026-02-25T08:03:18.427 INFO:teuthology.orchestra.run.trial009.stdout:Total 153 MB/s | 89 MB 00:00 2026-02-25T08:03:18.609 INFO:teuthology.orchestra.run.trial059.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-25T08:03:18.609 INFO:teuthology.orchestra.run.trial059.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-25T08:03:18.619 INFO:teuthology.orchestra.run.trial009.stdout:Running transaction check 2026-02-25T08:03:18.629 INFO:teuthology.orchestra.run.trial059.stdout:Dependencies resolved. 2026-02-25T08:03:18.630 INFO:teuthology.orchestra.run.trial059.stdout:================================================================================ 2026-02-25T08:03:18.631 INFO:teuthology.orchestra.run.trial059.stdout: Package Architecture Version Repository Size 2026-02-25T08:03:18.631 INFO:teuthology.orchestra.run.trial059.stdout:================================================================================ 2026-02-25T08:03:18.631 INFO:teuthology.orchestra.run.trial059.stdout:Installing: 2026-02-25T08:03:18.631 INFO:teuthology.orchestra.run.trial059.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-25T08:03:18.631 INFO:teuthology.orchestra.run.trial059.stdout:Installing dependencies: 2026-02-25T08:03:18.631 INFO:teuthology.orchestra.run.trial059.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-25T08:03:18.631 INFO:teuthology.orchestra.run.trial059.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-25T08:03:18.632 INFO:teuthology.orchestra.run.trial059.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-25T08:03:18.632 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:03:18.632 INFO:teuthology.orchestra.run.trial059.stdout:Transaction Summary 2026-02-25T08:03:18.632 INFO:teuthology.orchestra.run.trial059.stdout:================================================================================ 2026-02-25T08:03:18.632 INFO:teuthology.orchestra.run.trial059.stdout:Install 4 Packages 2026-02-25T08:03:18.632 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:03:18.632 INFO:teuthology.orchestra.run.trial059.stdout:Total download size: 89 M 2026-02-25T08:03:18.632 INFO:teuthology.orchestra.run.trial059.stdout:Installed size: 135 M 2026-02-25T08:03:18.632 INFO:teuthology.orchestra.run.trial059.stdout:Downloading Packages: 2026-02-25T08:03:18.822 INFO:teuthology.orchestra.run.trial009.stdout:Transaction check succeeded. 2026-02-25T08:03:18.822 INFO:teuthology.orchestra.run.trial009.stdout:Running transaction test 2026-02-25T08:03:18.857 INFO:teuthology.orchestra.run.trial059.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 5.3 MB/s | 901 kB 00:00 2026-02-25T08:03:19.019 INFO:teuthology.orchestra.run.trial059.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 52 MB/s | 17 MB 00:00 2026-02-25T08:03:19.190 INFO:teuthology.orchestra.run.trial059.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 93 MB/s | 31 MB 00:00 2026-02-25T08:03:19.204 INFO:teuthology.orchestra.run.trial009.stdout:Transaction test succeeded. 2026-02-25T08:03:19.204 INFO:teuthology.orchestra.run.trial009.stdout:Running transaction 2026-02-25T08:03:19.287 INFO:teuthology.orchestra.run.trial059.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 67 MB/s | 40 MB 00:00 2026-02-25T08:03:19.287 INFO:teuthology.orchestra.run.trial059.stdout:-------------------------------------------------------------------------------- 2026-02-25T08:03:19.287 INFO:teuthology.orchestra.run.trial059.stdout:Total 136 MB/s | 89 MB 00:00 2026-02-25T08:03:19.480 INFO:teuthology.orchestra.run.trial059.stdout:Running transaction check 2026-02-25T08:03:19.687 INFO:teuthology.orchestra.run.trial059.stdout:Transaction check succeeded. 2026-02-25T08:03:19.687 INFO:teuthology.orchestra.run.trial059.stdout:Running transaction test 2026-02-25T08:03:20.069 INFO:teuthology.orchestra.run.trial059.stdout:Transaction test succeeded. 2026-02-25T08:03:20.070 INFO:teuthology.orchestra.run.trial059.stdout:Running transaction 2026-02-25T08:03:20.317 INFO:teuthology.orchestra.run.trial009.stdout: Preparing : 1/1 2026-02-25T08:03:20.625 INFO:teuthology.orchestra.run.trial009.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-25T08:03:20.647 INFO:teuthology.orchestra.run.trial009.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T08:03:21.173 INFO:teuthology.orchestra.run.trial059.stdout: Preparing : 1/1 2026-02-25T08:03:21.461 INFO:teuthology.orchestra.run.trial059.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-25T08:03:21.483 INFO:teuthology.orchestra.run.trial059.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T08:03:23.207 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T08:03:23.241 INFO:teuthology.orchestra.run.trial009.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T08:03:24.047 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T08:03:24.081 INFO:teuthology.orchestra.run.trial059.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T08:03:26.279 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T08:03:26.286 INFO:teuthology.orchestra.run.trial009.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T08:03:27.119 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T08:03:27.126 INFO:teuthology.orchestra.run.trial059.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T08:03:29.335 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T08:03:30.175 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T08:03:46.846 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T08:03:46.869 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-25T08:03:47.058 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T08:03:47.058 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-25T08:03:47.058 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T08:03:47.058 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T08:03:47.116 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T08:03:47.116 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:03:47.116 INFO:teuthology.orchestra.run.trial009.stdout:Installed: 2026-02-25T08:03:47.116 INFO:teuthology.orchestra.run.trial009.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-25T08:03:47.116 INFO:teuthology.orchestra.run.trial009.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-25T08:03:47.116 INFO:teuthology.orchestra.run.trial009.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-25T08:03:47.116 INFO:teuthology.orchestra.run.trial009.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-25T08:03:47.117 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:03:47.117 INFO:teuthology.orchestra.run.trial009.stdout:Complete! 2026-02-25T08:03:47.181 DEBUG:teuthology.orchestra.run.trial009:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T08:03:47.211 INFO:teuthology.orchestra.run.trial009.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T08:03:47.212 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T08:03:47.212 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-25T08:03:47.212 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-25T08:03:47.212 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-25T08:03:47.212 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-25T08:03:47.212 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial009.front.sepia.ceph.com, path=None, version=distro) 2026-02-25T08:03:47.213 DEBUG:teuthology.orchestra.run.trial009:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T08:03:47.276 INFO:teuthology.orchestra.run.trial009.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T08:03:47.278 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T08:03:47.278 DEBUG:teuthology.orchestra.run.trial009:> sudo rpm -qi grub2-tools 2026-02-25T08:03:47.346 INFO:teuthology.orchestra.run.trial009.stdout:Name : grub2-tools 2026-02-25T08:03:47.346 INFO:teuthology.orchestra.run.trial009.stdout:Epoch : 1 2026-02-25T08:03:47.346 INFO:teuthology.orchestra.run.trial009.stdout:Version : 2.06 2026-02-25T08:03:47.346 INFO:teuthology.orchestra.run.trial009.stdout:Release : 120.el9 2026-02-25T08:03:47.346 INFO:teuthology.orchestra.run.trial009.stdout:Architecture: x86_64 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:Group : Unspecified 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:Size : 9108611 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:License : GPLv3+ 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:Packager : builder@centos.org 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:Vendor : CentOS 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:Summary : Support tools for GRUB. 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:Description : 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:hardware devices. 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:03:47.347 INFO:teuthology.orchestra.run.trial009.stdout:This subpackage provides tools for support of all platforms. 2026-02-25T08:03:47.348 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-25T08:03:47.348 INFO:teuthology.task.kernel:Updating grub on trial009 to boot 5.14.0-686.el9.x86_64 2026-02-25T08:03:47.348 DEBUG:teuthology.orchestra.run.trial009:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-25T08:03:47.411 INFO:teuthology.orchestra.run.trial009.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-25T08:03:47.412 DEBUG:teuthology.orchestra.run.trial009:> sudo command -v grubby && echo yes || echo no 2026-02-25T08:03:47.477 INFO:teuthology.orchestra.run.trial009.stdout:/sbin/grubby 2026-02-25T08:03:47.478 INFO:teuthology.orchestra.run.trial009.stdout:yes 2026-02-25T08:03:47.478 DEBUG:teuthology.orchestra.run.trial009:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-25T08:03:47.495 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T08:03:47.520 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-25T08:03:47.542 INFO:teuthology.orchestra.run.trial009.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-25T08:03:47.542 DEBUG:teuthology.orchestra.run.trial009:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-25T08:03:47.615 DEBUG:teuthology.orchestra.run.trial009:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-25T08:03:47.709 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T08:03:47.709 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-25T08:03:47.709 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T08:03:47.709 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T08:03:47.765 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T08:03:47.765 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:03:47.765 INFO:teuthology.orchestra.run.trial059.stdout:Installed: 2026-02-25T08:03:47.765 INFO:teuthology.orchestra.run.trial059.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-25T08:03:47.765 INFO:teuthology.orchestra.run.trial059.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-25T08:03:47.765 INFO:teuthology.orchestra.run.trial059.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-25T08:03:47.765 INFO:teuthology.orchestra.run.trial059.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-25T08:03:47.765 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:03:47.765 INFO:teuthology.orchestra.run.trial059.stdout:Complete! 2026-02-25T08:03:47.821 INFO:teuthology.orchestra.run.trial009.stderr:Generating grub configuration file ... 2026-02-25T08:03:47.826 DEBUG:teuthology.orchestra.run.trial059:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T08:03:47.854 INFO:teuthology.orchestra.run.trial059.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T08:03:47.855 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T08:03:47.855 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-25T08:03:47.855 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-25T08:03:47.855 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-25T08:03:47.855 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2026-02-25T08:03:47.855 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial059.front.sepia.ceph.com, path=None, version=distro) 2026-02-25T08:03:47.855 DEBUG:teuthology.orchestra.run.trial059:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T08:03:47.890 INFO:teuthology.orchestra.run.trial009.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-25T08:03:47.897 INFO:teuthology.orchestra.run.trial009.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-25T08:03:47.919 INFO:teuthology.orchestra.run.trial059.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T08:03:47.921 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T08:03:47.921 DEBUG:teuthology.orchestra.run.trial059:> sudo rpm -qi grub2-tools 2026-02-25T08:03:47.989 INFO:teuthology.orchestra.run.trial059.stdout:Name : grub2-tools 2026-02-25T08:03:47.989 INFO:teuthology.orchestra.run.trial059.stdout:Epoch : 1 2026-02-25T08:03:47.989 INFO:teuthology.orchestra.run.trial059.stdout:Version : 2.06 2026-02-25T08:03:47.989 INFO:teuthology.orchestra.run.trial059.stdout:Release : 120.el9 2026-02-25T08:03:47.989 INFO:teuthology.orchestra.run.trial059.stdout:Architecture: x86_64 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:Group : Unspecified 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:Size : 9108611 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:License : GPLv3+ 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:Packager : builder@centos.org 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:Vendor : CentOS 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:Summary : Support tools for GRUB. 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:Description : 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:hardware devices. 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:03:47.990 INFO:teuthology.orchestra.run.trial059.stdout:This subpackage provides tools for support of all platforms. 2026-02-25T08:03:47.991 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-25T08:03:47.991 INFO:teuthology.task.kernel:Updating grub on trial059 to boot 5.14.0-686.el9.x86_64 2026-02-25T08:03:47.991 DEBUG:teuthology.orchestra.run.trial059:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-25T08:03:48.055 INFO:teuthology.orchestra.run.trial059.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-25T08:03:48.056 DEBUG:teuthology.orchestra.run.trial059:> sudo command -v grubby && echo yes || echo no 2026-02-25T08:03:48.120 INFO:teuthology.orchestra.run.trial059.stdout:/sbin/grubby 2026-02-25T08:03:48.122 INFO:teuthology.orchestra.run.trial059.stdout:yes 2026-02-25T08:03:48.122 DEBUG:teuthology.orchestra.run.trial059:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-25T08:03:48.155 INFO:teuthology.orchestra.run.trial009.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-25T08:03:48.162 INFO:teuthology.orchestra.run.trial009.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-25T08:03:48.186 INFO:teuthology.orchestra.run.trial059.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-25T08:03:48.187 DEBUG:teuthology.orchestra.run.trial059:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-25T08:03:48.196 INFO:teuthology.orchestra.run.trial009.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-25T08:03:48.203 INFO:teuthology.orchestra.run.trial009.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-25T08:03:48.235 INFO:teuthology.orchestra.run.trial009.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-25T08:03:48.242 INFO:teuthology.orchestra.run.trial009.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-25T08:03:48.260 DEBUG:teuthology.orchestra.run.trial059:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-25T08:03:48.265 INFO:teuthology.orchestra.run.trial009.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-25T08:03:48.272 INFO:teuthology.orchestra.run.trial009.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-25T08:03:48.359 INFO:teuthology.orchestra.run.trial009.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-25T08:03:48.368 INFO:teuthology.orchestra.run.trial009.stderr:done 2026-02-25T08:03:48.370 DEBUG:teuthology.orchestra.run.trial009:> test -d /sys/firmware/efi 2026-02-25T08:03:48.385 DEBUG:teuthology.orchestra.run.trial009:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-25T08:03:48.450 INFO:teuthology.orchestra.run.trial009.stdout:/boot/efi/EFI/BOOT 2026-02-25T08:03:48.451 INFO:teuthology.orchestra.run.trial009.stdout:/boot/efi/EFI/centos 2026-02-25T08:03:48.452 DEBUG:teuthology.orchestra.run.trial009:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-25T08:03:48.464 INFO:teuthology.orchestra.run.trial059.stderr:Generating grub configuration file ... 2026-02-25T08:03:48.517 INFO:teuthology.orchestra.run.trial009.stdout:no 2026-02-25T08:03:48.517 DEBUG:teuthology.orchestra.run.trial009:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-25T08:03:48.534 INFO:teuthology.orchestra.run.trial059.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-25T08:03:48.541 INFO:teuthology.orchestra.run.trial059.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-25T08:03:48.583 INFO:teuthology.orchestra.run.trial009.stdout:yes 2026-02-25T08:03:48.583 DEBUG:teuthology.orchestra.run.trial009:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-25T08:03:48.648 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial009 2026-02-25T08:03:48.648 DEBUG:teuthology.orchestra.run.trial009:> sudo bash -c ' 2026-02-25T08:03:48.648 DEBUG:teuthology.orchestra.run.trial009:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-25T08:03:48.648 DEBUG:teuthology.orchestra.run.trial009:> ' 2026-02-25T08:03:48.794 INFO:teuthology.orchestra.run.trial059.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-25T08:03:48.801 INFO:teuthology.orchestra.run.trial059.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-25T08:03:48.835 INFO:teuthology.orchestra.run.trial059.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-25T08:03:48.841 INFO:teuthology.orchestra.run.trial059.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-25T08:03:48.873 INFO:teuthology.orchestra.run.trial059.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-25T08:03:48.879 INFO:teuthology.orchestra.run.trial059.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-25T08:03:48.902 INFO:teuthology.orchestra.run.trial059.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-25T08:03:48.908 INFO:teuthology.orchestra.run.trial059.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-25T08:03:48.995 INFO:teuthology.orchestra.run.trial059.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-25T08:03:49.003 INFO:teuthology.orchestra.run.trial059.stderr:done 2026-02-25T08:03:49.005 DEBUG:teuthology.orchestra.run.trial059:> test -d /sys/firmware/efi 2026-02-25T08:03:49.021 DEBUG:teuthology.orchestra.run.trial059:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-25T08:03:49.086 INFO:teuthology.orchestra.run.trial059.stdout:/boot/efi/EFI/BOOT 2026-02-25T08:03:49.086 INFO:teuthology.orchestra.run.trial059.stdout:/boot/efi/EFI/centos 2026-02-25T08:03:49.088 DEBUG:teuthology.orchestra.run.trial059:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-25T08:03:49.153 INFO:teuthology.orchestra.run.trial059.stdout:no 2026-02-25T08:03:49.153 DEBUG:teuthology.orchestra.run.trial059:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-25T08:03:49.218 INFO:teuthology.orchestra.run.trial059.stdout:yes 2026-02-25T08:03:49.219 DEBUG:teuthology.orchestra.run.trial059:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-25T08:03:49.284 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial059 2026-02-25T08:03:49.284 DEBUG:teuthology.orchestra.run.trial059:> sudo bash -c ' 2026-02-25T08:03:49.284 DEBUG:teuthology.orchestra.run.trial059:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-25T08:03:49.284 DEBUG:teuthology.orchestra.run.trial059:> ' 2026-02-25T08:04:18.691 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-25T08:04:18.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial009.front.sepia.ceph.com' 2026-02-25T08:04:18.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T08:04:19.327 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2026-02-25T08:04:19.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial059.front.sepia.ceph.com' 2026-02-25T08:04:19.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T08:04:32.960 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.9 2026-02-25T08:04:33.600 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.59 2026-02-25T08:04:41.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial009.front.sepia.ceph.com' 2026-02-25T08:04:41.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T08:04:42.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial059.front.sepia.ceph.com' 2026-02-25T08:04:42.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T08:05:17.932 DEBUG:teuthology.orchestra.run.trial009:> true 2026-02-25T08:05:18.098 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial009.front.sepia.ceph.com' 2026-02-25T08:05:18.098 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-686.el9.x86_64"... 2026-02-25T08:05:18.098 DEBUG:teuthology.orchestra.run.trial009:> uname -r 2026-02-25T08:05:18.154 INFO:teuthology.orchestra.run.trial009.stdout:5.14.0-686.el9.x86_64 2026-02-25T08:05:18.154 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-25T08:05:18.154 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-25T08:05:18.154 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-25T08:05:18.427 DEBUG:teuthology.orchestra.run.trial059:> true 2026-02-25T08:05:18.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial059.front.sepia.ceph.com' 2026-02-25T08:05:18.583 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-686.el9.x86_64"... 2026-02-25T08:05:18.583 DEBUG:teuthology.orchestra.run.trial059:> uname -r 2026-02-25T08:05:18.639 INFO:teuthology.orchestra.run.trial059.stdout:5.14.0-686.el9.x86_64 2026-02-25T08:05:18.639 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-25T08:05:18.639 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-25T08:05:18.639 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-25T08:05:19.155 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-25T08:05:19.155 DEBUG:teuthology.orchestra.run.trial009:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-25T08:05:19.186 INFO:teuthology.orchestra.run.trial009.stdout:ttyS1 2026-02-25T08:05:19.208 DEBUG:teuthology.parallel:result is None 2026-02-25T08:05:19.640 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-25T08:05:19.640 DEBUG:teuthology.orchestra.run.trial059:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-25T08:05:19.669 INFO:teuthology.orchestra.run.trial059.stdout:ttyS1 2026-02-25T08:05:19.695 DEBUG:teuthology.parallel:result is None 2026-02-25T08:05:19.696 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-25T08:05:19.708 INFO:teuthology.task.internal:Creating test directory... 2026-02-25T08:05:19.708 DEBUG:teuthology.orchestra.run.trial009:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-25T08:05:19.710 DEBUG:teuthology.orchestra.run.trial059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-25T08:05:19.751 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-25T08:05:19.767 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-25T08:05:19.779 INFO:teuthology.task.internal:Creating archive directory... 2026-02-25T08:05:19.779 DEBUG:teuthology.orchestra.run.trial009:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-25T08:05:19.781 DEBUG:teuthology.orchestra.run.trial059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-25T08:05:19.811 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-25T08:05:19.824 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-25T08:05:19.824 DEBUG:teuthology.orchestra.run.trial009:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-25T08:05:19.837 DEBUG:teuthology.orchestra.run.trial059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-25T08:05:19.859 INFO:teuthology.orchestra.run.trial009.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T08:05:19.868 INFO:teuthology.orchestra.run.trial009.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T08:05:19.871 INFO:teuthology.orchestra.run.trial059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T08:05:19.879 INFO:teuthology.orchestra.run.trial059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T08:05:19.880 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-25T08:05:19.891 INFO:teuthology.task.internal:Configuring sudo... 2026-02-25T08:05:19.891 DEBUG:teuthology.orchestra.run.trial009:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-25T08:05:19.912 DEBUG:teuthology.orchestra.run.trial059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-25T08:05:19.944 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-25T08:05:19.958 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-25T08:05:19.958 DEBUG:teuthology.orchestra.run.trial009:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-25T08:05:19.977 DEBUG:teuthology.orchestra.run.trial059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-25T08:05:20.000 DEBUG:teuthology.orchestra.run.trial009:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T08:05:20.107 DEBUG:teuthology.orchestra.run.trial009:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T08:05:20.131 DEBUG:teuthology.orchestra.run.trial009:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T08:05:20.269 DEBUG:teuthology.orchestra.run.trial009:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T08:05:20.292 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:05:20.292 DEBUG:teuthology.orchestra.run.trial009:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-25T08:05:20.356 DEBUG:teuthology.orchestra.run.trial059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T08:05:20.469 DEBUG:teuthology.orchestra.run.trial059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T08:05:20.493 DEBUG:teuthology.orchestra.run.trial059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T08:05:20.621 DEBUG:teuthology.orchestra.run.trial059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T08:05:20.646 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-25T08:05:20.646 DEBUG:teuthology.orchestra.run.trial059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-25T08:05:20.711 DEBUG:teuthology.orchestra.run.trial009:> sudo service rsyslog restart 2026-02-25T08:05:20.713 DEBUG:teuthology.orchestra.run.trial059:> sudo service rsyslog restart 2026-02-25T08:05:20.740 INFO:teuthology.orchestra.run.trial009.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T08:05:20.778 INFO:teuthology.orchestra.run.trial059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T08:05:21.305 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-25T08:05:21.318 INFO:teuthology.task.internal:Starting timer... 2026-02-25T08:05:21.318 INFO:teuthology.run_tasks:Running task pcp... 2026-02-25T08:05:21.334 INFO:teuthology.run_tasks:Running task selinux... 2026-02-25T08:05:21.352 DEBUG:teuthology.orchestra.run.trial009:> sudo service auditd rotate 2026-02-25T08:05:21.383 INFO:teuthology.orchestra.run.trial009.stdout:Rotating logs: 2026-02-25T08:05:21.384 DEBUG:teuthology.orchestra.run.trial059:> sudo service auditd rotate 2026-02-25T08:05:21.413 INFO:teuthology.orchestra.run.trial059.stdout:Rotating logs: 2026-02-25T08:05:21.415 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-25T08:05:21.415 DEBUG:teuthology.orchestra.run.trial009:> /usr/sbin/getenforce 2026-02-25T08:05:21.440 INFO:teuthology.orchestra.run.trial009.stdout:Permissive 2026-02-25T08:05:21.440 DEBUG:teuthology.orchestra.run.trial059:> /usr/sbin/getenforce 2026-02-25T08:05:21.470 INFO:teuthology.orchestra.run.trial059.stdout:Permissive 2026-02-25T08:05:21.471 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial009.front.sepia.ceph.com': 'permissive', 'ubuntu@trial059.front.sepia.ceph.com': 'permissive'} 2026-02-25T08:05:21.471 DEBUG:teuthology.orchestra.run.trial009:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T08:05:21.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T08:05:21.504 DEBUG:teuthology.orchestra.run.trial059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T08:05:21.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T08:05:21.533 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-25T08:05:21.533 DEBUG:teuthology.orchestra.run.trial009:> sudo /usr/sbin/setenforce permissive 2026-02-25T08:05:21.568 DEBUG:teuthology.orchestra.run.trial059:> sudo /usr/sbin/setenforce permissive 2026-02-25T08:05:21.597 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-25T08:05:21.609 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-25T08:05:21.616 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-25T08:05:21.616 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial009.front.sepia.ceph.com,trial059.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-25T08:08:00.230 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial009.front.sepia.ceph.com'), Remote(name='ubuntu@trial059.front.sepia.ceph.com')] 2026-02-25T08:08:00.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial009.front.sepia.ceph.com' 2026-02-25T08:08:00.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T08:08:00.317 DEBUG:teuthology.orchestra.run.trial009:> true 2026-02-25T08:08:00.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial009.front.sepia.ceph.com' 2026-02-25T08:08:00.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial059.front.sepia.ceph.com' 2026-02-25T08:08:00.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T08:08:00.460 DEBUG:teuthology.orchestra.run.trial059:> true 2026-02-25T08:08:00.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial059.front.sepia.ceph.com' 2026-02-25T08:08:00.536 INFO:teuthology.run_tasks:Running task clock... 2026-02-25T08:08:00.549 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-25T08:08:00.549 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-25T08:08:00.549 DEBUG:teuthology.orchestra.run.trial009:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T08:08:00.551 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-25T08:08:00.551 DEBUG:teuthology.orchestra.run.trial059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T08:08:00.577 INFO:teuthology.orchestra.run.trial009.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-25T08:08:00.589 INFO:teuthology.orchestra.run.trial009.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-25T08:08:00.603 INFO:teuthology.orchestra.run.trial059.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-25T08:08:00.610 INFO:teuthology.orchestra.run.trial009.stderr:sudo: ntpd: command not found 2026-02-25T08:08:00.615 INFO:teuthology.orchestra.run.trial059.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-25T08:08:00.619 INFO:teuthology.orchestra.run.trial009.stdout:506 Cannot talk to daemon 2026-02-25T08:08:00.631 INFO:teuthology.orchestra.run.trial009.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-25T08:08:00.636 INFO:teuthology.orchestra.run.trial059.stderr:sudo: ntpd: command not found 2026-02-25T08:08:00.644 INFO:teuthology.orchestra.run.trial009.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-25T08:08:00.647 INFO:teuthology.orchestra.run.trial059.stdout:506 Cannot talk to daemon 2026-02-25T08:08:00.659 INFO:teuthology.orchestra.run.trial059.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-25T08:08:00.671 INFO:teuthology.orchestra.run.trial059.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-25T08:08:00.697 INFO:teuthology.orchestra.run.trial009.stderr:bash: line 1: ntpq: command not found 2026-02-25T08:08:00.721 INFO:teuthology.orchestra.run.trial059.stderr:bash: line 1: ntpq: command not found 2026-02-25T08:08:00.723 INFO:teuthology.orchestra.run.trial009.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T08:08:00.723 INFO:teuthology.orchestra.run.trial009.stdout:=============================================================================== 2026-02-25T08:08:00.723 INFO:teuthology.orchestra.run.trial009.stdout:^? chi2.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-25T08:08:00.723 INFO:teuthology.orchestra.run.trial009.stdout:^? wsip-24-249-17-250.dc.dc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-25T08:08:00.723 INFO:teuthology.orchestra.run.trial009.stdout:^? blotch.image1tech.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-25T08:08:00.723 INFO:teuthology.orchestra.run.trial009.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-25T08:08:00.735 INFO:teuthology.orchestra.run.trial059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T08:08:00.736 INFO:teuthology.orchestra.run.trial059.stdout:=============================================================================== 2026-02-25T08:08:00.736 INFO:teuthology.orchestra.run.trial059.stdout:^? ntp11.kernfusion.at 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-25T08:08:00.736 INFO:teuthology.orchestra.run.trial059.stdout:^? nyc3.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-25T08:08:00.736 INFO:teuthology.orchestra.run.trial059.stdout:^? time.gslb.gravinoc.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-25T08:08:00.736 INFO:teuthology.orchestra.run.trial059.stdout:^? ip74-208-14-149.pbiaas.c> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-25T08:08:00.737 INFO:teuthology.run_tasks:Running task install... 2026-02-25T08:08:00.747 DEBUG:teuthology.task.install:project ceph 2026-02-25T08:08:00.747 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '6aeb6975bc9a4790a399c9cc70dba9635d2a7819'}} 2026-02-25T08:08:00.747 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '6aeb6975bc9a4790a399c9cc70dba9635d2a7819'} 2026-02-25T08:08:00.747 INFO:teuthology.task.install:Using flavor: debug 2026-02-25T08:08:00.754 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-25T08:08:00.754 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-25T08:08:00.754 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6aeb6975bc9a4790a399c9cc70dba9635d2a7819', 'tag': None, 'wait_for_package': False} 2026-02-25T08:08:00.755 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=6aeb6975bc9a4790a399c9cc70dba9635d2a7819 2026-02-25T08:08:00.756 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6aeb6975bc9a4790a399c9cc70dba9635d2a7819', 'tag': None, 'wait_for_package': False} 2026-02-25T08:08:00.756 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=6aeb6975bc9a4790a399c9cc70dba9635d2a7819 2026-02-25T08:08:00.950 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-logstoremanager/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/centos/9/flavors/debug/ 2026-02-25T08:08:00.950 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5338.g6aeb6975 2026-02-25T08:08:00.962 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-logstoremanager/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/centos/9/flavors/debug/ 2026-02-25T08:08:00.962 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5338.g6aeb6975 2026-02-25T08:08:01.280 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-logstoremanager/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-logstoremanager/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-logstoremanager/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-25T08:08:01.280 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:08:01.280 DEBUG:teuthology.orchestra.run.trial009:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-25T08:08:01.307 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo, python3-pytest on remote rpm x86_64 2026-02-25T08:08:01.307 DEBUG:teuthology.orchestra.run.trial009:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-25T08:08:01.328 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-logstoremanager/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-logstoremanager/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-logstoremanager/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-25T08:08:01.329 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-25T08:08:01.329 DEBUG:teuthology.orchestra.run.trial059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-25T08:08:01.354 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo, python3-pytest on remote rpm x86_64 2026-02-25T08:08:01.354 DEBUG:teuthology.orchestra.run.trial059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-25T08:08:01.373 DEBUG:teuthology.orchestra.run.trial009:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-25T08:08:01.418 DEBUG:teuthology.orchestra.run.trial059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-25T08:08:01.447 DEBUG:teuthology.orchestra.run.trial009:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-25T08:08:01.490 DEBUG:teuthology.orchestra.run.trial059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-25T08:08:01.511 INFO:teuthology.orchestra.run.trial009.stdout:check_obsoletes = 1 2026-02-25T08:08:01.512 DEBUG:teuthology.orchestra.run.trial009:> sudo yum clean all 2026-02-25T08:08:01.553 INFO:teuthology.orchestra.run.trial059.stdout:check_obsoletes = 1 2026-02-25T08:08:01.554 DEBUG:teuthology.orchestra.run.trial059:> sudo yum clean all 2026-02-25T08:08:01.664 INFO:teuthology.orchestra.run.trial009.stdout:41 files removed 2026-02-25T08:08:01.678 DEBUG:teuthology.orchestra.run.trial009:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-osd-crimson ceph-osd-crimson-debuginfo python3-pytest 2026-02-25T08:08:01.700 INFO:teuthology.orchestra.run.trial059.stdout:41 files removed 2026-02-25T08:08:01.713 DEBUG:teuthology.orchestra.run.trial059:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-osd-crimson ceph-osd-crimson-debuginfo python3-pytest 2026-02-25T08:08:02.616 INFO:teuthology.orchestra.run.trial009.stdout:ceph packages for x86_64 119 kB/s | 94 kB 00:00 2026-02-25T08:08:02.789 INFO:teuthology.orchestra.run.trial059.stdout:ceph packages for x86_64 101 kB/s | 94 kB 00:00 2026-02-25T08:08:03.278 INFO:teuthology.orchestra.run.trial009.stdout:ceph noarch packages 39 kB/s | 24 kB 00:00 2026-02-25T08:08:03.865 INFO:teuthology.orchestra.run.trial009.stdout:ceph source packages 3.7 kB/s | 2.1 kB 00:00 2026-02-25T08:08:05.523 INFO:teuthology.orchestra.run.trial059.stdout:ceph noarch packages 9.0 kB/s | 24 kB 00:02 2026-02-25T08:08:05.812 INFO:teuthology.orchestra.run.trial009.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.9 MB 00:01 2026-02-25T08:08:06.115 INFO:teuthology.orchestra.run.trial059.stdout:ceph source packages 3.7 kB/s | 2.1 kB 00:00 2026-02-25T08:08:06.354 INFO:teuthology.orchestra.run.trial059.stdout:CentOS Stream 9 - BaseOS 41 MB/s | 8.9 MB 00:00 2026-02-25T08:08:09.094 INFO:teuthology.orchestra.run.trial009.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 27 MB 00:02 2026-02-25T08:08:12.006 INFO:teuthology.orchestra.run.trial009.stdout:CentOS Stream 9 - CRB 17 MB/s | 8.0 MB 00:00 2026-02-25T08:08:12.986 INFO:teuthology.orchestra.run.trial009.stdout:CentOS Stream 9 - Extras packages 90 kB/s | 20 kB 00:00 2026-02-25T08:08:15.762 INFO:teuthology.orchestra.run.trial059.stdout:CentOS Stream 9 - AppStream 3.0 MB/s | 27 MB 00:08 2026-02-25T08:08:18.652 INFO:teuthology.orchestra.run.trial059.stdout:CentOS Stream 9 - CRB 17 MB/s | 8.0 MB 00:00 2026-02-25T08:08:20.315 INFO:teuthology.orchestra.run.trial059.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 20 kB 00:00 2026-02-25T08:08:22.340 INFO:teuthology.orchestra.run.trial059.stdout:Extra Packages for Enterprise Linux 10 MB/s | 20 MB 00:01 2026-02-25T08:08:25.579 INFO:teuthology.orchestra.run.trial059.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-25T08:08:26.786 INFO:teuthology.orchestra.run.trial059.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-25T08:08:26.786 INFO:teuthology.orchestra.run.trial059.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-25T08:08:26.815 INFO:teuthology.orchestra.run.trial059.stdout:Dependencies resolved. 2026-02-25T08:08:26.819 INFO:teuthology.orchestra.run.trial059.stdout:======================================================================================= 2026-02-25T08:08:26.819 INFO:teuthology.orchestra.run.trial059.stdout: Package Arch Version Repository Size 2026-02-25T08:08:26.819 INFO:teuthology.orchestra.run.trial059.stdout:======================================================================================= 2026-02-25T08:08:26.819 INFO:teuthology.orchestra.run.trial059.stdout:Installing: 2026-02-25T08:08:26.819 INFO:teuthology.orchestra.run.trial059.stdout: ceph x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 6.5 k 2026-02-25T08:08:26.819 INFO:teuthology.orchestra.run.trial059.stdout: ceph-base x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 5.1 M 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: ceph-fuse x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 914 k 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 149 k 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mgr x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 937 k 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 184 k 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 51 M 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 7.4 M 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mgr-rook noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 50 k 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: ceph-osd x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 163 k 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: ceph-osd-classic x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 15 M 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: ceph-osd-crimson x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 88 M 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 433 M 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: ceph-radosgw x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 11 M 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: ceph-test x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 127 M 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: ceph-volume noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 301 k 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: cephadm noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 1.0 M 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: libcephfs-devel x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 37 k 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: libcephfs2 x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 860 k 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: librados-devel x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 124 k 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: python3-cephfs x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 204 k 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: python3-pytest noarch 6.2.2-7.el9 appstream 519 k 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: python3-rados x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 324 k 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: python3-rbd x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 306 k 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: python3-rgw x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 100 k 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: rbd-fuse x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 86 k 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: rbd-mirror x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 2.6 M 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: rbd-nbd x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 166 k 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout:Upgrading: 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: librados2 x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 3.3 M 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: librbd1 x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 2.7 M 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout:Installing dependencies: 2026-02-25T08:08:26.820 INFO:teuthology.orchestra.run.trial059.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: ceph-common x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 21 M 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 57 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mds x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 2.0 M 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 297 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mon x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 4.9 M 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 17 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: ceph-selinux x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 25 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 26 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: libcephsqlite x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 153 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: libradosstriper1 x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 263 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: librgw2 x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 5.6 M 2026-02-25T08:08:26.821 INFO:teuthology.orchestra.run.trial059.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-ceph-argparse x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 45 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-ceph-common x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 185 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-25T08:08:26.822 INFO:teuthology.orchestra.run.trial059.stdout: python3-iniconfig noarch 1.1.1-7.el9 appstream 17 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-pluggy noarch 0.13.1-7.el9 appstream 41 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-py noarch 1.10.0-6.el9 appstream 477 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-25T08:08:26.823 INFO:teuthology.orchestra.run.trial059.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout:Installing weak dependencies: 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: ceph-debugsource x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 12 M 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 22 k 2026-02-25T08:08:26.824 INFO:teuthology.orchestra.run.trial059.stdout: libcephfs-daemon x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 37 k 2026-02-25T08:08:26.825 INFO:teuthology.orchestra.run.trial059.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-25T08:08:26.825 INFO:teuthology.orchestra.run.trial059.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-25T08:08:26.825 INFO:teuthology.orchestra.run.trial059.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-25T08:08:26.825 INFO:teuthology.orchestra.run.trial059.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-25T08:08:26.825 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:08:26.825 INFO:teuthology.orchestra.run.trial059.stdout:Transaction Summary 2026-02-25T08:08:26.825 INFO:teuthology.orchestra.run.trial059.stdout:======================================================================================= 2026-02-25T08:08:26.825 INFO:teuthology.orchestra.run.trial059.stdout:Install 156 Packages 2026-02-25T08:08:26.825 INFO:teuthology.orchestra.run.trial059.stdout:Upgrade 2 Packages 2026-02-25T08:08:26.825 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:08:26.825 INFO:teuthology.orchestra.run.trial059.stdout:Total download size: 868 M 2026-02-25T08:08:26.825 INFO:teuthology.orchestra.run.trial059.stdout:Downloading Packages: 2026-02-25T08:08:27.607 INFO:teuthology.orchestra.run.trial059.stdout:(1/158): ceph-20.3.0-5338.g6aeb6975.el9.x86_64. 26 kB/s | 6.5 kB 00:00 2026-02-25T08:08:35.106 INFO:teuthology.orchestra.run.trial059.stdout:(2/158): ceph-base-20.3.0-5338.g6aeb6975.el9.x8 674 kB/s | 5.1 MB 00:07 2026-02-25T08:08:38.464 INFO:teuthology.orchestra.run.trial059.stdout:(3/158): ceph-fuse-20.3.0-5338.g6aeb6975.el9.x8 272 kB/s | 914 kB 00:03 2026-02-25T08:08:39.024 INFO:teuthology.orchestra.run.trial059.stdout:(4/158): ceph-immutable-object-cache-20.3.0-533 267 kB/s | 149 kB 00:00 2026-02-25T08:08:44.235 INFO:teuthology.orchestra.run.trial059.stdout:(5/158): ceph-mds-20.3.0-5338.g6aeb6975.el9.x86 397 kB/s | 2.0 MB 00:05 2026-02-25T08:08:46.057 INFO:teuthology.orchestra.run.trial059.stdout:(6/158): ceph-mgr-20.3.0-5338.g6aeb6975.el9.x86 514 kB/s | 937 kB 00:01 2026-02-25T08:08:54.641 INFO:teuthology.orchestra.run.trial059.stdout:(7/158): ceph-debugsource-20.3.0-5338.g6aeb6975 456 kB/s | 12 MB 00:27 2026-02-25T08:08:55.136 INFO:teuthology.orchestra.run.trial059.stdout:(8/158): ceph-osd-20.3.0-5338.g6aeb6975.el9.x86 330 kB/s | 163 kB 00:00 2026-02-25T08:08:55.155 INFO:teuthology.orchestra.run.trial059.stdout:(9/158): ceph-mon-20.3.0-5338.g6aeb6975.el9.x86 548 kB/s | 4.9 MB 00:09 2026-02-25T08:09:07.074 INFO:teuthology.orchestra.run.trial059.stdout:(10/158): ceph-common-20.3.0-5338.g6aeb6975.el9 537 kB/s | 21 MB 00:39 2026-02-25T08:09:38.873 INFO:teuthology.orchestra.run.trial059.stdout:(11/158): ceph-osd-classic-20.3.0-5338.g6aeb697 346 kB/s | 15 MB 00:43 2026-02-25T08:10:30.772 INFO:teuthology.orchestra.run.trial059.stdout:(12/158): ceph-radosgw-20.3.0-5338.g6aeb6975.el 221 kB/s | 11 MB 00:51 2026-02-25T08:10:30.954 INFO:teuthology.orchestra.run.trial059.stdout:(13/158): ceph-selinux-20.3.0-5338.g6aeb6975.el 138 kB/s | 25 kB 00:00 2026-02-25T08:12:34.708 INFO:teuthology.orchestra.run.trial009.stdout:Extra Packages for Enterprise Linux 80 kB/s | 20 MB 04:21 2026-02-25T08:12:37.971 INFO:teuthology.orchestra.run.trial009.stdout:lab-extras 1.4 MB/s | 50 kB 00:00 2026-02-25T08:12:39.167 INFO:teuthology.orchestra.run.trial009.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-25T08:12:39.168 INFO:teuthology.orchestra.run.trial009.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-25T08:12:39.196 INFO:teuthology.orchestra.run.trial009.stdout:Dependencies resolved. 2026-02-25T08:12:39.201 INFO:teuthology.orchestra.run.trial009.stdout:======================================================================================= 2026-02-25T08:12:39.201 INFO:teuthology.orchestra.run.trial009.stdout: Package Arch Version Repository Size 2026-02-25T08:12:39.201 INFO:teuthology.orchestra.run.trial009.stdout:======================================================================================= 2026-02-25T08:12:39.201 INFO:teuthology.orchestra.run.trial009.stdout:Installing: 2026-02-25T08:12:39.201 INFO:teuthology.orchestra.run.trial009.stdout: ceph x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 6.5 k 2026-02-25T08:12:39.202 INFO:teuthology.orchestra.run.trial009.stdout: ceph-base x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 5.1 M 2026-02-25T08:12:39.202 INFO:teuthology.orchestra.run.trial009.stdout: ceph-fuse x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 914 k 2026-02-25T08:12:39.202 INFO:teuthology.orchestra.run.trial009.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 149 k 2026-02-25T08:12:39.202 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mgr x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 937 k 2026-02-25T08:12:39.202 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 184 k 2026-02-25T08:12:39.202 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 51 M 2026-02-25T08:12:39.202 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 7.4 M 2026-02-25T08:12:39.202 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mgr-rook noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 50 k 2026-02-25T08:12:39.202 INFO:teuthology.orchestra.run.trial009.stdout: ceph-osd x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 163 k 2026-02-25T08:12:39.202 INFO:teuthology.orchestra.run.trial009.stdout: ceph-osd-classic x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 15 M 2026-02-25T08:12:39.202 INFO:teuthology.orchestra.run.trial009.stdout: ceph-osd-crimson x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 88 M 2026-02-25T08:12:39.203 INFO:teuthology.orchestra.run.trial009.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 433 M 2026-02-25T08:12:39.203 INFO:teuthology.orchestra.run.trial009.stdout: ceph-radosgw x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 11 M 2026-02-25T08:12:39.203 INFO:teuthology.orchestra.run.trial009.stdout: ceph-test x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 127 M 2026-02-25T08:12:39.203 INFO:teuthology.orchestra.run.trial009.stdout: ceph-volume noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 301 k 2026-02-25T08:12:39.203 INFO:teuthology.orchestra.run.trial009.stdout: cephadm noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 1.0 M 2026-02-25T08:12:39.203 INFO:teuthology.orchestra.run.trial009.stdout: libcephfs-devel x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 37 k 2026-02-25T08:12:39.203 INFO:teuthology.orchestra.run.trial009.stdout: libcephfs2 x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 860 k 2026-02-25T08:12:39.203 INFO:teuthology.orchestra.run.trial009.stdout: librados-devel x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 124 k 2026-02-25T08:12:39.203 INFO:teuthology.orchestra.run.trial009.stdout: python3-cephfs x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 204 k 2026-02-25T08:12:39.203 INFO:teuthology.orchestra.run.trial009.stdout: python3-pytest noarch 6.2.2-7.el9 appstream 519 k 2026-02-25T08:12:39.203 INFO:teuthology.orchestra.run.trial009.stdout: python3-rados x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 324 k 2026-02-25T08:12:39.203 INFO:teuthology.orchestra.run.trial009.stdout: python3-rbd x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 306 k 2026-02-25T08:12:39.204 INFO:teuthology.orchestra.run.trial009.stdout: python3-rgw x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 100 k 2026-02-25T08:12:39.204 INFO:teuthology.orchestra.run.trial009.stdout: rbd-fuse x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 86 k 2026-02-25T08:12:39.204 INFO:teuthology.orchestra.run.trial009.stdout: rbd-mirror x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 2.6 M 2026-02-25T08:12:39.204 INFO:teuthology.orchestra.run.trial009.stdout: rbd-nbd x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 166 k 2026-02-25T08:12:39.204 INFO:teuthology.orchestra.run.trial009.stdout:Upgrading: 2026-02-25T08:12:39.204 INFO:teuthology.orchestra.run.trial009.stdout: librados2 x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 3.3 M 2026-02-25T08:12:39.204 INFO:teuthology.orchestra.run.trial009.stdout: librbd1 x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 2.7 M 2026-02-25T08:12:39.204 INFO:teuthology.orchestra.run.trial009.stdout:Installing dependencies: 2026-02-25T08:12:39.204 INFO:teuthology.orchestra.run.trial009.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-25T08:12:39.204 INFO:teuthology.orchestra.run.trial009.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-25T08:12:39.204 INFO:teuthology.orchestra.run.trial009.stdout: ceph-common x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 21 M 2026-02-25T08:12:39.204 INFO:teuthology.orchestra.run.trial009.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 57 k 2026-02-25T08:12:39.205 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mds x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 2.0 M 2026-02-25T08:12:39.205 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 297 k 2026-02-25T08:12:39.205 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mon x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 4.9 M 2026-02-25T08:12:39.205 INFO:teuthology.orchestra.run.trial009.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 17 k 2026-02-25T08:12:39.205 INFO:teuthology.orchestra.run.trial009.stdout: ceph-selinux x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 25 k 2026-02-25T08:12:39.205 INFO:teuthology.orchestra.run.trial009.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-25T08:12:39.205 INFO:teuthology.orchestra.run.trial009.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-25T08:12:39.205 INFO:teuthology.orchestra.run.trial009.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-25T08:12:39.205 INFO:teuthology.orchestra.run.trial009.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-25T08:12:39.205 INFO:teuthology.orchestra.run.trial009.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-25T08:12:39.205 INFO:teuthology.orchestra.run.trial009.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-25T08:12:39.205 INFO:teuthology.orchestra.run.trial009.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-25T08:12:39.206 INFO:teuthology.orchestra.run.trial009.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-25T08:12:39.206 INFO:teuthology.orchestra.run.trial009.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-25T08:12:39.206 INFO:teuthology.orchestra.run.trial009.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-25T08:12:39.206 INFO:teuthology.orchestra.run.trial009.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-25T08:12:39.206 INFO:teuthology.orchestra.run.trial009.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-25T08:12:39.206 INFO:teuthology.orchestra.run.trial009.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 26 k 2026-02-25T08:12:39.206 INFO:teuthology.orchestra.run.trial009.stdout: libcephsqlite x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 153 k 2026-02-25T08:12:39.206 INFO:teuthology.orchestra.run.trial009.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-25T08:12:39.206 INFO:teuthology.orchestra.run.trial009.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-25T08:12:39.206 INFO:teuthology.orchestra.run.trial009.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-25T08:12:39.206 INFO:teuthology.orchestra.run.trial009.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-25T08:12:39.206 INFO:teuthology.orchestra.run.trial009.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-25T08:12:39.206 INFO:teuthology.orchestra.run.trial009.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-25T08:12:39.207 INFO:teuthology.orchestra.run.trial009.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-25T08:12:39.207 INFO:teuthology.orchestra.run.trial009.stdout: libradosstriper1 x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 263 k 2026-02-25T08:12:39.207 INFO:teuthology.orchestra.run.trial009.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-25T08:12:39.207 INFO:teuthology.orchestra.run.trial009.stdout: librgw2 x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 5.6 M 2026-02-25T08:12:39.207 INFO:teuthology.orchestra.run.trial009.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-25T08:12:39.207 INFO:teuthology.orchestra.run.trial009.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-25T08:12:39.207 INFO:teuthology.orchestra.run.trial009.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-25T08:12:39.207 INFO:teuthology.orchestra.run.trial009.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-25T08:12:39.207 INFO:teuthology.orchestra.run.trial009.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-25T08:12:39.207 INFO:teuthology.orchestra.run.trial009.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-25T08:12:39.207 INFO:teuthology.orchestra.run.trial009.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-25T08:12:39.207 INFO:teuthology.orchestra.run.trial009.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-25T08:12:39.207 INFO:teuthology.orchestra.run.trial009.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-25T08:12:39.208 INFO:teuthology.orchestra.run.trial009.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-25T08:12:39.208 INFO:teuthology.orchestra.run.trial009.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-25T08:12:39.208 INFO:teuthology.orchestra.run.trial009.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-25T08:12:39.208 INFO:teuthology.orchestra.run.trial009.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-25T08:12:39.208 INFO:teuthology.orchestra.run.trial009.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-25T08:12:39.208 INFO:teuthology.orchestra.run.trial009.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-25T08:12:39.208 INFO:teuthology.orchestra.run.trial009.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-25T08:12:39.208 INFO:teuthology.orchestra.run.trial009.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-25T08:12:39.208 INFO:teuthology.orchestra.run.trial009.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-25T08:12:39.208 INFO:teuthology.orchestra.run.trial009.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-25T08:12:39.208 INFO:teuthology.orchestra.run.trial009.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-25T08:12:39.208 INFO:teuthology.orchestra.run.trial009.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-25T08:12:39.208 INFO:teuthology.orchestra.run.trial009.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-25T08:12:39.209 INFO:teuthology.orchestra.run.trial009.stdout: python3-ceph-argparse x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 45 k 2026-02-25T08:12:39.209 INFO:teuthology.orchestra.run.trial009.stdout: python3-ceph-common x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 185 k 2026-02-25T08:12:39.209 INFO:teuthology.orchestra.run.trial009.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-25T08:12:39.209 INFO:teuthology.orchestra.run.trial009.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-25T08:12:39.209 INFO:teuthology.orchestra.run.trial009.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-25T08:12:39.209 INFO:teuthology.orchestra.run.trial009.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-25T08:12:39.209 INFO:teuthology.orchestra.run.trial009.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-25T08:12:39.209 INFO:teuthology.orchestra.run.trial009.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-25T08:12:39.209 INFO:teuthology.orchestra.run.trial009.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-25T08:12:39.209 INFO:teuthology.orchestra.run.trial009.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-25T08:12:39.209 INFO:teuthology.orchestra.run.trial009.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-25T08:12:39.209 INFO:teuthology.orchestra.run.trial009.stdout: python3-iniconfig noarch 1.1.1-7.el9 appstream 17 k 2026-02-25T08:12:39.210 INFO:teuthology.orchestra.run.trial009.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-25T08:12:39.210 INFO:teuthology.orchestra.run.trial009.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-25T08:12:39.210 INFO:teuthology.orchestra.run.trial009.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-25T08:12:39.210 INFO:teuthology.orchestra.run.trial009.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-25T08:12:39.210 INFO:teuthology.orchestra.run.trial009.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-25T08:12:39.210 INFO:teuthology.orchestra.run.trial009.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-25T08:12:39.210 INFO:teuthology.orchestra.run.trial009.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-25T08:12:39.210 INFO:teuthology.orchestra.run.trial009.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-25T08:12:39.210 INFO:teuthology.orchestra.run.trial009.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-25T08:12:39.210 INFO:teuthology.orchestra.run.trial009.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-25T08:12:39.210 INFO:teuthology.orchestra.run.trial009.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-25T08:12:39.210 INFO:teuthology.orchestra.run.trial009.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-25T08:12:39.210 INFO:teuthology.orchestra.run.trial009.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-25T08:12:39.211 INFO:teuthology.orchestra.run.trial009.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-25T08:12:39.211 INFO:teuthology.orchestra.run.trial009.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-25T08:12:39.211 INFO:teuthology.orchestra.run.trial009.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-25T08:12:39.211 INFO:teuthology.orchestra.run.trial009.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-25T08:12:39.211 INFO:teuthology.orchestra.run.trial009.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-25T08:12:39.211 INFO:teuthology.orchestra.run.trial009.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-25T08:12:39.211 INFO:teuthology.orchestra.run.trial009.stdout: python3-pluggy noarch 0.13.1-7.el9 appstream 41 k 2026-02-25T08:12:39.211 INFO:teuthology.orchestra.run.trial009.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-25T08:12:39.211 INFO:teuthology.orchestra.run.trial009.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-25T08:12:39.211 INFO:teuthology.orchestra.run.trial009.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-25T08:12:39.211 INFO:teuthology.orchestra.run.trial009.stdout: python3-py noarch 1.10.0-6.el9 appstream 477 k 2026-02-25T08:12:39.212 INFO:teuthology.orchestra.run.trial009.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-25T08:12:39.212 INFO:teuthology.orchestra.run.trial009.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-25T08:12:39.212 INFO:teuthology.orchestra.run.trial009.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-25T08:12:39.212 INFO:teuthology.orchestra.run.trial009.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-25T08:12:39.212 INFO:teuthology.orchestra.run.trial009.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-25T08:12:39.212 INFO:teuthology.orchestra.run.trial009.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-25T08:12:39.212 INFO:teuthology.orchestra.run.trial009.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-25T08:12:39.212 INFO:teuthology.orchestra.run.trial009.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-25T08:12:39.212 INFO:teuthology.orchestra.run.trial009.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-25T08:12:39.212 INFO:teuthology.orchestra.run.trial009.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-25T08:12:39.212 INFO:teuthology.orchestra.run.trial009.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-25T08:12:39.212 INFO:teuthology.orchestra.run.trial009.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-25T08:12:39.212 INFO:teuthology.orchestra.run.trial009.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-25T08:12:39.213 INFO:teuthology.orchestra.run.trial009.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-25T08:12:39.213 INFO:teuthology.orchestra.run.trial009.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-25T08:12:39.213 INFO:teuthology.orchestra.run.trial009.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-25T08:12:39.213 INFO:teuthology.orchestra.run.trial009.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-25T08:12:39.213 INFO:teuthology.orchestra.run.trial009.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-25T08:12:39.213 INFO:teuthology.orchestra.run.trial009.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-25T08:12:39.213 INFO:teuthology.orchestra.run.trial009.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-25T08:12:39.213 INFO:teuthology.orchestra.run.trial009.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-25T08:12:39.213 INFO:teuthology.orchestra.run.trial009.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-25T08:12:39.213 INFO:teuthology.orchestra.run.trial009.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-25T08:12:39.213 INFO:teuthology.orchestra.run.trial009.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-25T08:12:39.213 INFO:teuthology.orchestra.run.trial009.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-25T08:12:39.214 INFO:teuthology.orchestra.run.trial009.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-25T08:12:39.214 INFO:teuthology.orchestra.run.trial009.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-25T08:12:39.214 INFO:teuthology.orchestra.run.trial009.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-25T08:12:39.214 INFO:teuthology.orchestra.run.trial009.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-25T08:12:39.214 INFO:teuthology.orchestra.run.trial009.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-25T08:12:39.214 INFO:teuthology.orchestra.run.trial009.stdout:Installing weak dependencies: 2026-02-25T08:12:39.214 INFO:teuthology.orchestra.run.trial009.stdout: ceph-debugsource x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 12 M 2026-02-25T08:12:39.214 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5338.g6aeb6975.el9 ceph-noarch 22 k 2026-02-25T08:12:39.214 INFO:teuthology.orchestra.run.trial009.stdout: libcephfs-daemon x86_64 2:20.3.0-5338.g6aeb6975.el9 ceph 37 k 2026-02-25T08:12:39.214 INFO:teuthology.orchestra.run.trial009.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-25T08:12:39.214 INFO:teuthology.orchestra.run.trial009.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-25T08:12:39.214 INFO:teuthology.orchestra.run.trial009.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-25T08:12:39.214 INFO:teuthology.orchestra.run.trial009.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-25T08:12:39.215 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:12:39.215 INFO:teuthology.orchestra.run.trial009.stdout:Transaction Summary 2026-02-25T08:12:39.215 INFO:teuthology.orchestra.run.trial009.stdout:======================================================================================= 2026-02-25T08:12:39.215 INFO:teuthology.orchestra.run.trial009.stdout:Install 156 Packages 2026-02-25T08:12:39.215 INFO:teuthology.orchestra.run.trial009.stdout:Upgrade 2 Packages 2026-02-25T08:12:39.215 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:12:39.216 INFO:teuthology.orchestra.run.trial009.stdout:Total download size: 868 M 2026-02-25T08:12:39.216 INFO:teuthology.orchestra.run.trial009.stdout:Downloading Packages: 2026-02-25T08:12:40.715 INFO:teuthology.orchestra.run.trial009.stdout:(1/158): ceph-20.3.0-5338.g6aeb6975.el9.x86_64. 22 kB/s | 6.5 kB 00:00 2026-02-25T08:12:53.934 INFO:teuthology.orchestra.run.trial009.stdout:(2/158): ceph-base-20.3.0-5338.g6aeb6975.el9.x8 387 kB/s | 5.1 MB 00:13 2026-02-25T08:12:55.647 INFO:teuthology.orchestra.run.trial009.stdout:(3/158): ceph-fuse-20.3.0-5338.g6aeb6975.el9.x8 533 kB/s | 914 kB 00:01 2026-02-25T08:12:55.995 INFO:teuthology.orchestra.run.trial009.stdout:(4/158): ceph-immutable-object-cache-20.3.0-533 429 kB/s | 149 kB 00:00 2026-02-25T08:13:01.731 INFO:teuthology.orchestra.run.trial009.stdout:(5/158): ceph-mds-20.3.0-5338.g6aeb6975.el9.x86 361 kB/s | 2.0 MB 00:05 2026-02-25T08:13:04.461 INFO:teuthology.orchestra.run.trial009.stdout:(6/158): ceph-mgr-20.3.0-5338.g6aeb6975.el9.x86 343 kB/s | 937 kB 00:02 2026-02-25T08:13:08.860 INFO:teuthology.orchestra.run.trial009.stdout:(7/158): ceph-debugsource-20.3.0-5338.g6aeb6975 438 kB/s | 12 MB 00:28 2026-02-25T08:13:09.652 INFO:teuthology.orchestra.run.trial009.stdout:(8/158): ceph-osd-20.3.0-5338.g6aeb6975.el9.x86 206 kB/s | 163 kB 00:00 2026-02-25T08:13:12.906 INFO:teuthology.orchestra.run.trial009.stdout:(9/158): ceph-mon-20.3.0-5338.g6aeb6975.el9.x86 590 kB/s | 4.9 MB 00:08 2026-02-25T08:13:45.366 INFO:teuthology.orchestra.run.trial059.stdout:(14/158): ceph-osd-crimson-20.3.0-5338.g6aeb697 309 kB/s | 88 MB 04:50 2026-02-25T08:13:45.577 INFO:teuthology.orchestra.run.trial059.stdout:(15/158): libcephfs-daemon-20.3.0-5338.g6aeb697 176 kB/s | 37 kB 00:00 2026-02-25T08:13:45.787 INFO:teuthology.orchestra.run.trial059.stdout:(16/158): libcephfs-devel-20.3.0-5338.g6aeb6975 177 kB/s | 37 kB 00:00 2026-02-25T08:13:45.928 INFO:teuthology.orchestra.run.trial059.stdout:(17/158): libcephfs-proxy2-20.3.0-5338.g6aeb697 182 kB/s | 26 kB 00:00 2026-02-25T08:13:48.654 INFO:teuthology.orchestra.run.trial059.stdout:(18/158): libcephfs2-20.3.0-5338.g6aeb6975.el9. 316 kB/s | 860 kB 00:02 2026-02-25T08:13:49.284 INFO:teuthology.orchestra.run.trial059.stdout:(19/158): libcephsqlite-20.3.0-5338.g6aeb6975.e 243 kB/s | 153 kB 00:00 2026-02-25T08:13:49.841 INFO:teuthology.orchestra.run.trial059.stdout:(20/158): librados-devel-20.3.0-5338.g6aeb6975. 222 kB/s | 124 kB 00:00 2026-02-25T08:13:51.088 INFO:teuthology.orchestra.run.trial059.stdout:(21/158): libradosstriper1-20.3.0-5338.g6aeb697 211 kB/s | 263 kB 00:01 2026-02-25T08:13:53.299 INFO:teuthology.orchestra.run.trial009.stdout:(10/158): ceph-common-20.3.0-5338.g6aeb6975.el9 292 kB/s | 21 MB 01:12 2026-02-25T08:14:00.136 INFO:teuthology.orchestra.run.trial009.stdout:(11/158): ceph-osd-classic-20.3.0-5338.g6aeb697 299 kB/s | 15 MB 00:50 2026-02-25T08:14:11.085 INFO:teuthology.orchestra.run.trial059.stdout:(22/158): librgw2-20.3.0-5338.g6aeb6975.el9.x86 288 kB/s | 5.6 MB 00:19 2026-02-25T08:14:11.456 INFO:teuthology.orchestra.run.trial059.stdout:(23/158): python3-ceph-argparse-20.3.0-5338.g6a 122 kB/s | 45 kB 00:00 2026-02-25T08:14:12.403 INFO:teuthology.orchestra.run.trial059.stdout:(24/158): python3-ceph-common-20.3.0-5338.g6aeb 195 kB/s | 185 kB 00:00 2026-02-25T08:14:13.378 INFO:teuthology.orchestra.run.trial059.stdout:(25/158): python3-cephfs-20.3.0-5338.g6aeb6975. 209 kB/s | 204 kB 00:00 2026-02-25T08:14:14.775 INFO:teuthology.orchestra.run.trial059.stdout:(26/158): python3-rados-20.3.0-5338.g6aeb6975.e 232 kB/s | 324 kB 00:01 2026-02-25T08:14:16.317 INFO:teuthology.orchestra.run.trial059.stdout:(27/158): python3-rbd-20.3.0-5338.g6aeb6975.el9 198 kB/s | 306 kB 00:01 2026-02-25T08:14:16.803 INFO:teuthology.orchestra.run.trial059.stdout:(28/158): python3-rgw-20.3.0-5338.g6aeb6975.el9 206 kB/s | 100 kB 00:00 2026-02-25T08:14:17.387 INFO:teuthology.orchestra.run.trial059.stdout:(29/158): rbd-fuse-20.3.0-5338.g6aeb6975.el9.x8 148 kB/s | 86 kB 00:00 2026-02-25T08:14:30.583 INFO:teuthology.orchestra.run.trial059.stdout:(30/158): rbd-mirror-20.3.0-5338.g6aeb6975.el9. 201 kB/s | 2.6 MB 00:13 2026-02-25T08:14:31.233 INFO:teuthology.orchestra.run.trial059.stdout:(31/158): rbd-nbd-20.3.0-5338.g6aeb6975.el9.x86 256 kB/s | 166 kB 00:00 2026-02-25T08:14:31.654 INFO:teuthology.orchestra.run.trial059.stdout:(32/158): ceph-grafana-dashboards-20.3.0-5338.g 136 kB/s | 57 kB 00:00 2026-02-25T08:14:32.626 INFO:teuthology.orchestra.run.trial059.stdout:(33/158): ceph-mgr-cephadm-20.3.0-5338.g6aeb697 189 kB/s | 184 kB 00:00 2026-02-25T08:14:50.067 INFO:teuthology.orchestra.run.trial009.stdout:(12/158): ceph-radosgw-20.3.0-5338.g6aeb6975.el 229 kB/s | 11 MB 00:49 2026-02-25T08:14:50.208 INFO:teuthology.orchestra.run.trial009.stdout:(13/158): ceph-selinux-20.3.0-5338.g6aeb6975.el 177 kB/s | 25 kB 00:00 2026-02-25T08:17:16.143 INFO:teuthology.orchestra.run.trial009.stdout:(14/158): ceph-osd-crimson-20.3.0-5338.g6aeb697 369 kB/s | 88 MB 04:03 2026-02-25T08:17:16.214 INFO:teuthology.orchestra.run.trial009.stdout:(15/158): libcephfs-daemon-20.3.0-5338.g6aeb697 528 kB/s | 37 kB 00:00 2026-02-25T08:17:16.660 INFO:teuthology.orchestra.run.trial009.stdout:(16/158): libcephfs-devel-20.3.0-5338.g6aeb6975 84 kB/s | 37 kB 00:00 2026-02-25T08:17:16.799 INFO:teuthology.orchestra.run.trial009.stdout:(17/158): libcephfs-proxy2-20.3.0-5338.g6aeb697 184 kB/s | 26 kB 00:00 2026-02-25T08:17:19.116 INFO:teuthology.orchestra.run.trial009.stdout:(18/158): libcephfs2-20.3.0-5338.g6aeb6975.el9. 371 kB/s | 860 kB 00:02 2026-02-25T08:17:19.536 INFO:teuthology.orchestra.run.trial009.stdout:(19/158): libcephsqlite-20.3.0-5338.g6aeb6975.e 365 kB/s | 153 kB 00:00 2026-02-25T08:17:20.026 INFO:teuthology.orchestra.run.trial009.stdout:(20/158): librados-devel-20.3.0-5338.g6aeb6975. 252 kB/s | 124 kB 00:00 2026-02-25T08:17:21.285 INFO:teuthology.orchestra.run.trial009.stdout:(21/158): libradosstriper1-20.3.0-5338.g6aeb697 209 kB/s | 263 kB 00:01 2026-02-25T08:17:38.051 INFO:teuthology.orchestra.run.trial009.stdout:(22/158): librgw2-20.3.0-5338.g6aeb6975.el9.x86 344 kB/s | 5.6 MB 00:16 2026-02-25T08:17:38.192 INFO:teuthology.orchestra.run.trial009.stdout:(23/158): python3-ceph-argparse-20.3.0-5338.g6a 321 kB/s | 45 kB 00:00 2026-02-25T08:17:38.704 INFO:teuthology.orchestra.run.trial009.stdout:(24/158): python3-ceph-common-20.3.0-5338.g6aeb 361 kB/s | 185 kB 00:00 2026-02-25T08:17:39.264 INFO:teuthology.orchestra.run.trial009.stdout:(25/158): python3-cephfs-20.3.0-5338.g6aeb6975. 364 kB/s | 204 kB 00:00 2026-02-25T08:17:40.427 INFO:teuthology.orchestra.run.trial009.stdout:(26/158): python3-rados-20.3.0-5338.g6aeb6975.e 279 kB/s | 324 kB 00:01 2026-02-25T08:17:41.898 INFO:teuthology.orchestra.run.trial009.stdout:(27/158): python3-rbd-20.3.0-5338.g6aeb6975.el9 208 kB/s | 306 kB 00:01 2026-02-25T08:17:42.457 INFO:teuthology.orchestra.run.trial009.stdout:(28/158): python3-rgw-20.3.0-5338.g6aeb6975.el9 179 kB/s | 100 kB 00:00 2026-02-25T08:17:42.809 INFO:teuthology.orchestra.run.trial009.stdout:(29/158): rbd-fuse-20.3.0-5338.g6aeb6975.el9.x8 244 kB/s | 86 kB 00:00 2026-02-25T08:17:53.260 INFO:teuthology.orchestra.run.trial009.stdout:(30/158): rbd-mirror-20.3.0-5338.g6aeb6975.el9. 254 kB/s | 2.6 MB 00:10 2026-02-25T08:17:53.678 INFO:teuthology.orchestra.run.trial009.stdout:(31/158): rbd-nbd-20.3.0-5338.g6aeb6975.el9.x86 398 kB/s | 166 kB 00:00 2026-02-25T08:17:53.819 INFO:teuthology.orchestra.run.trial009.stdout:(32/158): ceph-grafana-dashboards-20.3.0-5338.g 405 kB/s | 57 kB 00:00 2026-02-25T08:17:54.242 INFO:teuthology.orchestra.run.trial009.stdout:(33/158): ceph-mgr-cephadm-20.3.0-5338.g6aeb697 435 kB/s | 184 kB 00:00 2026-02-25T08:18:04.855 INFO:teuthology.orchestra.run.trial059.stdout:(34/158): ceph-mgr-dashboard-20.3.0-5338.g6aeb6 244 kB/s | 51 MB 03:32 2026-02-25T08:18:38.942 INFO:teuthology.orchestra.run.trial059.stdout:(35/158): ceph-mgr-diskprediction-local-20.3.0- 223 kB/s | 7.4 MB 00:34 2026-02-25T08:18:39.245 INFO:teuthology.orchestra.run.trial059.stdout:(36/158): ceph-mgr-k8sevents-20.3.0-5338.g6aeb6 74 kB/s | 22 kB 00:00 2026-02-25T08:18:42.021 INFO:teuthology.orchestra.run.trial059.stdout:(37/158): ceph-mgr-modules-core-20.3.0-5338.g6a 107 kB/s | 297 kB 00:02 2026-02-25T08:18:42.373 INFO:teuthology.orchestra.run.trial059.stdout:(38/158): ceph-mgr-rook-20.3.0-5338.g6aeb6975.e 143 kB/s | 50 kB 00:00 2026-02-25T08:18:42.511 INFO:teuthology.orchestra.run.trial059.stdout:(39/158): ceph-prometheus-alerts-20.3.0-5338.g6 126 kB/s | 17 kB 00:00 2026-02-25T08:18:44.530 INFO:teuthology.orchestra.run.trial059.stdout:(40/158): ceph-volume-20.3.0-5338.g6aeb6975.el9 149 kB/s | 301 kB 00:02 2026-02-25T08:18:47.960 INFO:teuthology.orchestra.run.trial059.stdout:(41/158): cephadm-20.3.0-5338.g6aeb6975.el9.noa 303 kB/s | 1.0 MB 00:03 2026-02-25T08:18:49.518 INFO:teuthology.orchestra.run.trial059.stdout:(42/158): cryptsetup-2.8.1-3.el9.x86_64.rpm 225 kB/s | 351 kB 00:01 2026-02-25T08:18:49.911 INFO:teuthology.orchestra.run.trial059.stdout:(43/158): ceph-test-20.3.0-5338.g6aeb6975.el9.x 260 kB/s | 127 MB 08:18 2026-02-25T08:18:50.407 INFO:teuthology.orchestra.run.trial059.stdout:(44/158): ledmon-libs-1.1.0-3.el9.x86_64.rpm 81 kB/s | 40 kB 00:00 2026-02-25T08:18:50.652 INFO:teuthology.orchestra.run.trial059.stdout:(45/158): libatomic-11.5.0-14.el9.x86_64.rpm 93 kB/s | 23 kB 00:00 2026-02-25T08:18:51.059 INFO:teuthology.orchestra.run.trial059.stdout:(46/158): libconfig-1.7.2-9.el9.x86_64.rpm 177 kB/s | 72 kB 00:00 2026-02-25T08:18:51.702 INFO:teuthology.orchestra.run.trial059.stdout:(47/158): hwloc-libs-2.4.1-6.el9.x86_64.rpm 984 kB/s | 2.1 MB 00:02 2026-02-25T08:18:51.946 INFO:teuthology.orchestra.run.trial059.stdout:(48/158): libquadmath-11.5.0-14.el9.x86_64.rpm 756 kB/s | 184 kB 00:00 2026-02-25T08:18:52.110 INFO:teuthology.orchestra.run.trial059.stdout:(49/158): lksctp-tools-1.0.19-2.el9.x86_64.rpm 573 kB/s | 94 kB 00:00 2026-02-25T08:18:52.274 INFO:teuthology.orchestra.run.trial059.stdout:(50/158): mailcap-2.1.49-5.el9.noarch.rpm 203 kB/s | 33 kB 00:00 2026-02-25T08:18:52.685 INFO:teuthology.orchestra.run.trial059.stdout:(51/158): libgfortran-11.5.0-14.el9.x86_64.rpm 489 kB/s | 794 kB 00:01 2026-02-25T08:18:52.842 INFO:teuthology.orchestra.run.trial059.stdout:(52/158): nvme-cli-2.16-1.el9.x86_64.rpm 2.0 MB/s | 1.2 MB 00:00 2026-02-25T08:18:52.930 INFO:teuthology.orchestra.run.trial059.stdout:(53/158): pciutils-3.7.0-7.el9.x86_64.rpm 380 kB/s | 93 kB 00:00 2026-02-25T08:18:53.008 INFO:teuthology.orchestra.run.trial059.stdout:(54/158): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2026-02-25T08:18:53.419 INFO:teuthology.orchestra.run.trial059.stdout:(55/158): python3-cryptography-36.0.1-5.el9.x86 2.5 MB/s | 1.2 MB 00:00 2026-02-25T08:18:53.419 INFO:teuthology.orchestra.run.trial059.stdout:(56/158): python3-ply-3.11-14.el9.noarch.rpm 259 kB/s | 106 kB 00:00 2026-02-25T08:18:53.584 INFO:teuthology.orchestra.run.trial059.stdout:(57/158): python3-pycparser-2.20-6.el9.noarch.r 818 kB/s | 135 kB 00:00 2026-02-25T08:18:53.748 INFO:teuthology.orchestra.run.trial059.stdout:(58/158): python3-pyparsing-2.4.7-9.el9.noarch. 458 kB/s | 150 kB 00:00 2026-02-25T08:18:53.750 INFO:teuthology.orchestra.run.trial059.stdout:(59/158): python3-requests-2.25.1-10.el9.noarch 761 kB/s | 126 kB 00:00 2026-02-25T08:18:53.915 INFO:teuthology.orchestra.run.trial059.stdout:(60/158): python3-urllib3-1.26.5-7.el9.noarch.r 1.3 MB/s | 218 kB 00:00 2026-02-25T08:18:54.079 INFO:teuthology.orchestra.run.trial059.stdout:(61/158): unzip-6.0-59.el9.x86_64.rpm 554 kB/s | 182 kB 00:00 2026-02-25T08:18:54.080 INFO:teuthology.orchestra.run.trial059.stdout:(62/158): zip-3.0-35.el9.x86_64.rpm 1.6 MB/s | 266 kB 00:00 2026-02-25T08:18:54.771 INFO:teuthology.orchestra.run.trial059.stdout:(63/158): flexiblas-3.0.4-9.el9.x86_64.rpm 43 kB/s | 30 kB 00:00 2026-02-25T08:18:54.914 INFO:teuthology.orchestra.run.trial059.stdout:(64/158): boost-program-options-1.75.0-13.el9.x 124 kB/s | 104 kB 00:00 2026-02-25T08:18:54.999 INFO:teuthology.orchestra.run.trial059.stdout:(65/158): flexiblas-openblas-openmp-3.0.4-9.el9 175 kB/s | 15 kB 00:00 2026-02-25T08:18:55.278 INFO:teuthology.orchestra.run.trial059.stdout:(66/158): libasan8-15.2.1-7.el9.x86_64.rpm 1.8 MB/s | 525 kB 00:00 2026-02-25T08:18:55.364 INFO:teuthology.orchestra.run.trial059.stdout:(67/158): flexiblas-netlib-3.0.4-9.el9.x86_64.r 5.0 MB/s | 3.0 MB 00:00 2026-02-25T08:18:55.370 INFO:teuthology.orchestra.run.trial059.stdout:(68/158): libnbd-1.20.3-4.el9.x86_64.rpm 1.7 MB/s | 164 kB 00:00 2026-02-25T08:18:55.444 INFO:teuthology.orchestra.run.trial059.stdout:(69/158): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.0 MB/s | 160 kB 00:00 2026-02-25T08:18:55.452 INFO:teuthology.orchestra.run.trial059.stdout:(70/158): librabbitmq-0.11.0-7.el9.x86_64.rpm 557 kB/s | 45 kB 00:00 2026-02-25T08:18:55.533 INFO:teuthology.orchestra.run.trial059.stdout:(71/158): librdkafka-1.6.1-102.el9.x86_64.rpm 7.3 MB/s | 662 kB 00:00 2026-02-25T08:18:55.552 INFO:teuthology.orchestra.run.trial059.stdout:(72/158): libstoragemgmt-1.10.1-1.el9.x86_64.rp 2.4 MB/s | 246 kB 00:00 2026-02-25T08:18:55.616 INFO:teuthology.orchestra.run.trial059.stdout:(73/158): libubsan-11.5.0-14.el9.x86_64.rpm 2.1 MB/s | 176 kB 00:00 2026-02-25T08:18:55.650 INFO:teuthology.orchestra.run.trial059.stdout:(74/158): libxslt-1.1.34-12.el9.x86_64.rpm 2.3 MB/s | 233 kB 00:00 2026-02-25T08:18:55.698 INFO:teuthology.orchestra.run.trial059.stdout:(75/158): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.5 MB/s | 292 kB 00:00 2026-02-25T08:18:55.745 INFO:teuthology.orchestra.run.trial059.stdout:(76/158): lua-5.4.4-4.el9.x86_64.rpm 1.9 MB/s | 188 kB 00:00 2026-02-25T08:18:55.777 INFO:teuthology.orchestra.run.trial059.stdout:(77/158): openblas-0.3.29-1.el9.x86_64.rpm 535 kB/s | 42 kB 00:00 2026-02-25T08:18:55.873 INFO:teuthology.orchestra.run.trial059.stdout:(78/158): protobuf-3.14.0-17.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2026-02-25T08:18:56.090 INFO:teuthology.orchestra.run.trial059.stdout:(79/158): openblas-openmp-0.3.29-1.el9.x86_64.r 15 MB/s | 5.3 MB 00:00 2026-02-25T08:18:56.098 INFO:teuthology.orchestra.run.trial059.stdout:(80/158): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 6.0 MB 00:00 2026-02-25T08:18:56.172 INFO:teuthology.orchestra.run.trial059.stdout:(81/158): python3-devel-3.9.25-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2026-02-25T08:18:56.176 INFO:teuthology.orchestra.run.trial059.stdout:(82/158): python3-iniconfig-1.1.1-7.el9.noarch. 222 kB/s | 17 kB 00:00 2026-02-25T08:18:56.255 INFO:teuthology.orchestra.run.trial059.stdout:(83/158): python3-jmespath-1.0.1-1.el9.noarch.r 602 kB/s | 48 kB 00:00 2026-02-25T08:18:56.257 INFO:teuthology.orchestra.run.trial059.stdout:(84/158): python3-jinja2-2.11.3-8.el9.noarch.rp 2.9 MB/s | 249 kB 00:00 2026-02-25T08:18:56.335 INFO:teuthology.orchestra.run.trial059.stdout:(85/158): python3-libstoragemgmt-1.10.1-1.el9.x 2.2 MB/s | 177 kB 00:00 2026-02-25T08:18:56.349 INFO:teuthology.orchestra.run.trial059.stdout:(86/158): python3-lxml-4.6.5-3.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2026-02-25T08:18:56.419 INFO:teuthology.orchestra.run.trial059.stdout:(87/158): python3-markupsafe-1.1.1-12.el9.x86_6 417 kB/s | 35 kB 00:00 2026-02-25T08:18:56.500 INFO:teuthology.orchestra.run.trial059.stdout:(88/158): python3-numpy-f2py-1.23.5-2.el9.x86_6 5.3 MB/s | 442 kB 00:00 2026-02-25T08:18:56.547 INFO:teuthology.orchestra.run.trial059.stdout:(89/158): python3-numpy-1.23.5-2.el9.x86_64.rpm 31 MB/s | 6.1 MB 00:00 2026-02-25T08:18:56.579 INFO:teuthology.orchestra.run.trial059.stdout:(90/158): python3-packaging-20.9-5.el9.noarch.r 973 kB/s | 77 kB 00:00 2026-02-25T08:18:56.627 INFO:teuthology.orchestra.run.trial059.stdout:(91/158): python3-pluggy-0.13.1-7.el9.noarch.rp 519 kB/s | 41 kB 00:00 2026-02-25T08:18:56.659 INFO:teuthology.orchestra.run.trial059.stdout:(92/158): python3-protobuf-3.14.0-17.el9.noarch 3.3 MB/s | 267 kB 00:00 2026-02-25T08:18:56.709 INFO:teuthology.orchestra.run.trial059.stdout:(93/158): python3-py-1.10.0-6.el9.noarch.rpm 5.7 MB/s | 477 kB 00:00 2026-02-25T08:18:56.740 INFO:teuthology.orchestra.run.trial059.stdout:(94/158): python3-pyasn1-0.4.8-7.el9.noarch.rpm 1.9 MB/s | 157 kB 00:00 2026-02-25T08:18:56.791 INFO:teuthology.orchestra.run.trial059.stdout:(95/158): python3-pyasn1-modules-0.4.8-7.el9.no 3.3 MB/s | 277 kB 00:00 2026-02-25T08:18:56.822 INFO:teuthology.orchestra.run.trial059.stdout:(96/158): python3-pytest-6.2.2-7.el9.noarch.rpm 6.2 MB/s | 519 kB 00:00 2026-02-25T08:18:56.871 INFO:teuthology.orchestra.run.trial059.stdout:(97/158): python3-requests-oauthlib-1.3.0-12.el 672 kB/s | 54 kB 00:00 2026-02-25T08:18:56.950 INFO:teuthology.orchestra.run.trial059.stdout:(98/158): python3-toml-0.10.2-6.el9.noarch.rpm 524 kB/s | 42 kB 00:00 2026-02-25T08:18:57.030 INFO:teuthology.orchestra.run.trial059.stdout:(99/158): qatlib-25.08.0-2.el9.x86_64.rpm 2.9 MB/s | 240 kB 00:00 2026-02-25T08:18:57.110 INFO:teuthology.orchestra.run.trial059.stdout:(100/158): qatlib-service-25.08.0-2.el9.x86_64. 468 kB/s | 37 kB 00:00 2026-02-25T08:18:57.189 INFO:teuthology.orchestra.run.trial059.stdout:(101/158): qatzip-libs-1.3.1-1.el9.x86_64.rpm 838 kB/s | 66 kB 00:00 2026-02-25T08:18:57.269 INFO:teuthology.orchestra.run.trial059.stdout:(102/158): socat-1.7.4.1-8.el9.x86_64.rpm 3.7 MB/s | 303 kB 00:00 2026-02-25T08:18:57.349 INFO:teuthology.orchestra.run.trial059.stdout:(103/158): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.3 MB/s | 189 kB 00:00 2026-02-25T08:18:57.409 INFO:teuthology.orchestra.run.trial059.stdout:(104/158): python3-scipy-1.9.3-2.el9.x86_64.rpm 33 MB/s | 19 MB 00:00 2026-02-25T08:18:57.429 INFO:teuthology.orchestra.run.trial059.stdout:(105/158): xmlsec1-openssl-1.2.29-13.el9.x86_64 1.1 MB/s | 90 kB 00:00 2026-02-25T08:18:57.440 INFO:teuthology.orchestra.run.trial059.stdout:(106/158): lua-devel-5.4.4-4.el9.x86_64.rpm 2.1 MB/s | 22 kB 00:00 2026-02-25T08:18:57.460 INFO:teuthology.orchestra.run.trial059.stdout:(107/158): protobuf-compiler-3.14.0-17.el9.x86_ 43 MB/s | 862 kB 00:00 2026-02-25T08:18:57.488 INFO:teuthology.orchestra.run.trial059.stdout:(108/158): xmlstarlet-1.6.1-20.el9.x86_64.rpm 807 kB/s | 64 kB 00:00 2026-02-25T08:18:57.658 INFO:teuthology.orchestra.run.trial059.stdout:(109/158): gperftools-libs-2.9.1-3.el9.x86_64.r 1.8 MB/s | 308 kB 00:00 2026-02-25T08:18:57.661 INFO:teuthology.orchestra.run.trial059.stdout:(110/158): abseil-cpp-20211102.0-4.el9.x86_64.r 2.7 MB/s | 551 kB 00:00 2026-02-25T08:18:57.681 INFO:teuthology.orchestra.run.trial059.stdout:(111/158): grpc-data-1.46.7-10.el9.noarch.rpm 856 kB/s | 19 kB 00:00 2026-02-25T08:18:57.704 INFO:teuthology.orchestra.run.trial059.stdout:(112/158): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.1 MB/s | 25 kB 00:00 2026-02-25T08:18:57.728 INFO:teuthology.orchestra.run.trial059.stdout:(113/158): liboath-2.6.12-1.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2026-02-25T08:18:57.753 INFO:teuthology.orchestra.run.trial059.stdout:(114/158): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2026-02-25T08:18:57.767 INFO:teuthology.orchestra.run.trial059.stdout:(115/158): libarrow-9.0.0-15.el9.x86_64.rpm 42 MB/s | 4.4 MB 00:00 2026-02-25T08:18:57.782 INFO:teuthology.orchestra.run.trial059.stdout:(116/158): luarocks-3.9.2-5.el9.noarch.rpm 5.1 MB/s | 151 kB 00:00 2026-02-25T08:18:57.793 INFO:teuthology.orchestra.run.trial059.stdout:(117/158): parquet-libs-9.0.0-15.el9.x86_64.rpm 31 MB/s | 838 kB 00:00 2026-02-25T08:18:57.816 INFO:teuthology.orchestra.run.trial059.stdout:(118/158): python3-autocommand-2.2.2-8.el9.noar 1.3 MB/s | 29 kB 00:00 2026-02-25T08:18:57.832 INFO:teuthology.orchestra.run.trial059.stdout:(119/158): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2026-02-25T08:18:57.840 INFO:teuthology.orchestra.run.trial059.stdout:(120/158): python3-backports-tarfile-1.2.0-1.el 2.5 MB/s | 60 kB 00:00 2026-02-25T08:18:57.855 INFO:teuthology.orchestra.run.trial059.stdout:(121/158): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.9 MB/s | 43 kB 00:00 2026-02-25T08:18:57.863 INFO:teuthology.orchestra.run.trial059.stdout:(122/158): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2026-02-25T08:18:57.877 INFO:teuthology.orchestra.run.trial059.stdout:(123/158): python3-certifi-2023.05.07-4.el9.noa 637 kB/s | 14 kB 00:00 2026-02-25T08:18:57.886 INFO:teuthology.orchestra.run.trial059.stdout:(124/158): python3-cheroot-10.0.1-4.el9.noarch. 7.2 MB/s | 173 kB 00:00 2026-02-25T08:18:57.905 INFO:teuthology.orchestra.run.trial059.stdout:(125/158): python3-cherrypy-18.6.1-2.el9.noarch 12 MB/s | 358 kB 00:00 2026-02-25T08:18:57.910 INFO:teuthology.orchestra.run.trial059.stdout:(126/158): python3-google-auth-2.45.0-1.el9.noa 10 MB/s | 254 kB 00:00 2026-02-25T08:18:57.934 INFO:teuthology.orchestra.run.trial059.stdout:(127/158): python3-grpcio-tools-1.46.7-10.el9.x 6.0 MB/s | 144 kB 00:00 2026-02-25T08:18:57.957 INFO:teuthology.orchestra.run.trial059.stdout:(128/158): python3-influxdb-5.3.1-1.el9.noarch. 5.8 MB/s | 139 kB 00:00 2026-02-25T08:18:57.965 INFO:teuthology.orchestra.run.trial059.stdout:(129/158): python3-grpcio-1.46.7-10.el9.x86_64. 34 MB/s | 2.0 MB 00:00 2026-02-25T08:18:57.981 INFO:teuthology.orchestra.run.trial059.stdout:(130/158): python3-isodate-0.6.1-3.el9.noarch.r 2.4 MB/s | 56 kB 00:00 2026-02-25T08:18:57.988 INFO:teuthology.orchestra.run.trial059.stdout:(131/158): python3-jaraco-8.2.1-3.el9.noarch.rp 483 kB/s | 11 kB 00:00 2026-02-25T08:18:58.004 INFO:teuthology.orchestra.run.trial059.stdout:(132/158): python3-jaraco-classes-3.2.1-5.el9.n 766 kB/s | 18 kB 00:00 2026-02-25T08:18:58.010 INFO:teuthology.orchestra.run.trial059.stdout:(133/158): python3-jaraco-collections-3.0.0-8.e 1.0 MB/s | 23 kB 00:00 2026-02-25T08:18:58.027 INFO:teuthology.orchestra.run.trial059.stdout:(134/158): python3-jaraco-context-6.0.1-3.el9.n 853 kB/s | 20 kB 00:00 2026-02-25T08:18:58.032 INFO:teuthology.orchestra.run.trial059.stdout:(135/158): python3-jaraco-functools-3.5.0-2.el9 876 kB/s | 19 kB 00:00 2026-02-25T08:18:58.050 INFO:teuthology.orchestra.run.trial059.stdout:(136/158): python3-jaraco-text-4.0.0-2.el9.noar 1.1 MB/s | 26 kB 00:00 2026-02-25T08:18:58.062 INFO:teuthology.orchestra.run.trial059.stdout:(137/158): python3-kubernetes-26.1.0-3.el9.noar 35 MB/s | 1.0 MB 00:00 2026-02-25T08:18:58.074 INFO:teuthology.orchestra.run.trial059.stdout:(138/158): python3-more-itertools-8.12.0-2.el9. 3.3 MB/s | 79 kB 00:00 2026-02-25T08:18:58.085 INFO:teuthology.orchestra.run.trial059.stdout:(139/158): python3-msgpack-1.0.3-2.el9.x86_64.r 3.7 MB/s | 86 kB 00:00 2026-02-25T08:18:58.097 INFO:teuthology.orchestra.run.trial059.stdout:(140/158): python3-natsort-7.1.1-5.el9.noarch.r 2.4 MB/s | 58 kB 00:00 2026-02-25T08:18:58.107 INFO:teuthology.orchestra.run.trial059.stdout:(141/158): python3-portend-3.1.0-2.el9.noarch.r 732 kB/s | 16 kB 00:00 2026-02-25T08:18:58.121 INFO:teuthology.orchestra.run.trial059.stdout:(142/158): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.8 MB/s | 90 kB 00:00 2026-02-25T08:18:58.129 INFO:teuthology.orchestra.run.trial059.stdout:(143/158): python3-repoze-lru-0.7-16.el9.noarch 1.3 MB/s | 31 kB 00:00 2026-02-25T08:18:58.145 INFO:teuthology.orchestra.run.trial059.stdout:(144/158): python3-routes-2.5.1-5.el9.noarch.rp 7.7 MB/s | 188 kB 00:00 2026-02-25T08:18:58.152 INFO:teuthology.orchestra.run.trial059.stdout:(145/158): python3-rsa-4.9-2.el9.noarch.rpm 2.6 MB/s | 59 kB 00:00 2026-02-25T08:18:58.168 INFO:teuthology.orchestra.run.trial059.stdout:(146/158): python3-saml-1.16.0-1.el9.noarch.rpm 5.2 MB/s | 125 kB 00:00 2026-02-25T08:18:58.175 INFO:teuthology.orchestra.run.trial059.stdout:(147/158): python3-tempora-5.0.0-2.el9.noarch.r 1.6 MB/s | 36 kB 00:00 2026-02-25T08:18:58.192 INFO:teuthology.orchestra.run.trial059.stdout:(148/158): python3-typing-extensions-4.15.0-1.e 3.6 MB/s | 86 kB 00:00 2026-02-25T08:18:58.197 INFO:teuthology.orchestra.run.trial059.stdout:(149/158): python3-websocket-client-1.2.3-2.el9 3.9 MB/s | 90 kB 00:00 2026-02-25T08:18:58.216 INFO:teuthology.orchestra.run.trial059.stdout:(150/158): python3-xmlsec-1.3.13-1.el9.x86_64.r 2.0 MB/s | 48 kB 00:00 2026-02-25T08:18:58.220 INFO:teuthology.orchestra.run.trial059.stdout:(151/158): python3-xmltodict-0.12.0-15.el9.noar 995 kB/s | 22 kB 00:00 2026-02-25T08:18:58.239 INFO:teuthology.orchestra.run.trial059.stdout:(152/158): python3-zc-lockfile-2.0-10.el9.noarc 869 kB/s | 20 kB 00:00 2026-02-25T08:18:58.243 INFO:teuthology.orchestra.run.trial059.stdout:(153/158): re2-20211101-20.el9.x86_64.rpm 8.0 MB/s | 191 kB 00:00 2026-02-25T08:18:58.267 INFO:teuthology.orchestra.run.trial059.stdout:(154/158): yaml-cpp-0.6.3-5.el9.x86_64.rpm 5.0 MB/s | 122 kB 00:00 2026-02-25T08:18:58.269 INFO:teuthology.orchestra.run.trial059.stdout:(155/158): thrift-0.15.0-4.el9.x86_64.rpm 52 MB/s | 1.6 MB 00:00 2026-02-25T08:19:09.346 INFO:teuthology.orchestra.run.trial059.stdout:(156/158): librbd1-20.3.0-5338.g6aeb6975.el9.x8 249 kB/s | 2.7 MB 00:11 2026-02-25T08:19:11.744 INFO:teuthology.orchestra.run.trial059.stdout:(157/158): librados2-20.3.0-5338.g6aeb6975.el9. 249 kB/s | 3.3 MB 00:13 2026-02-25T08:20:17.720 INFO:teuthology.orchestra.run.trial009.stdout:(34/158): ceph-mgr-dashboard-20.3.0-5338.g6aeb6 362 kB/s | 51 MB 02:23 2026-02-25T08:20:40.465 INFO:teuthology.orchestra.run.trial009.stdout:(35/158): ceph-mgr-diskprediction-local-20.3.0- 334 kB/s | 7.4 MB 00:22 2026-02-25T08:20:40.535 INFO:teuthology.orchestra.run.trial009.stdout:(36/158): ceph-mgr-k8sevents-20.3.0-5338.g6aeb6 319 kB/s | 22 kB 00:00 2026-02-25T08:20:41.238 INFO:teuthology.orchestra.run.trial009.stdout:(37/158): ceph-mgr-modules-core-20.3.0-5338.g6a 422 kB/s | 297 kB 00:00 2026-02-25T08:20:41.450 INFO:teuthology.orchestra.run.trial009.stdout:(38/158): ceph-mgr-rook-20.3.0-5338.g6aeb6975.e 238 kB/s | 50 kB 00:00 2026-02-25T08:20:41.520 INFO:teuthology.orchestra.run.trial009.stdout:(39/158): ceph-prometheus-alerts-20.3.0-5338.g6 246 kB/s | 17 kB 00:00 2026-02-25T08:20:42.294 INFO:teuthology.orchestra.run.trial009.stdout:(40/158): ceph-volume-20.3.0-5338.g6aeb6975.el9 390 kB/s | 301 kB 00:00 2026-02-25T08:20:44.180 INFO:teuthology.orchestra.run.trial009.stdout:(41/158): cephadm-20.3.0-5338.g6aeb6975.el9.noa 552 kB/s | 1.0 MB 00:01 2026-02-25T08:20:44.732 INFO:teuthology.orchestra.run.trial009.stdout:(42/158): cryptsetup-2.8.1-3.el9.x86_64.rpm 636 kB/s | 351 kB 00:00 2026-02-25T08:20:45.053 INFO:teuthology.orchestra.run.trial009.stdout:(43/158): hwloc-libs-2.4.1-6.el9.x86_64.rpm 6.6 MB/s | 2.1 MB 00:00 2026-02-25T08:20:45.132 INFO:teuthology.orchestra.run.trial009.stdout:(44/158): ledmon-libs-1.1.0-3.el9.x86_64.rpm 510 kB/s | 40 kB 00:00 2026-02-25T08:20:45.211 INFO:teuthology.orchestra.run.trial009.stdout:(45/158): libatomic-11.5.0-14.el9.x86_64.rpm 291 kB/s | 23 kB 00:00 2026-02-25T08:20:45.290 INFO:teuthology.orchestra.run.trial009.stdout:(46/158): libconfig-1.7.2-9.el9.x86_64.rpm 907 kB/s | 72 kB 00:00 2026-02-25T08:20:45.387 INFO:teuthology.orchestra.run.trial009.stdout:(47/158): libgfortran-11.5.0-14.el9.x86_64.rpm 8.0 MB/s | 794 kB 00:00 2026-02-25T08:20:45.469 INFO:teuthology.orchestra.run.trial009.stdout:(48/158): libquadmath-11.5.0-14.el9.x86_64.rpm 2.2 MB/s | 184 kB 00:00 2026-02-25T08:20:45.549 INFO:teuthology.orchestra.run.trial009.stdout:(49/158): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2026-02-25T08:20:45.628 INFO:teuthology.orchestra.run.trial009.stdout:(50/158): mailcap-2.1.49-5.el9.noarch.rpm 421 kB/s | 33 kB 00:00 2026-02-25T08:20:45.735 INFO:teuthology.orchestra.run.trial009.stdout:(51/158): nvme-cli-2.16-1.el9.x86_64.rpm 11 MB/s | 1.2 MB 00:00 2026-02-25T08:20:45.815 INFO:teuthology.orchestra.run.trial009.stdout:(52/158): pciutils-3.7.0-7.el9.x86_64.rpm 1.1 MB/s | 93 kB 00:00 2026-02-25T08:20:45.899 INFO:teuthology.orchestra.run.trial009.stdout:(53/158): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 253 kB 00:00 2026-02-25T08:20:46.008 INFO:teuthology.orchestra.run.trial009.stdout:(54/158): python3-cryptography-36.0.1-5.el9.x86 11 MB/s | 1.2 MB 00:00 2026-02-25T08:20:46.090 INFO:teuthology.orchestra.run.trial009.stdout:(55/158): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2026-02-25T08:20:46.171 INFO:teuthology.orchestra.run.trial009.stdout:(56/158): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2026-02-25T08:20:46.253 INFO:teuthology.orchestra.run.trial009.stdout:(57/158): python3-pyparsing-2.4.7-9.el9.noarch. 1.8 MB/s | 150 kB 00:00 2026-02-25T08:20:46.334 INFO:teuthology.orchestra.run.trial009.stdout:(58/158): python3-requests-2.25.1-10.el9.noarch 1.5 MB/s | 126 kB 00:00 2026-02-25T08:20:46.417 INFO:teuthology.orchestra.run.trial009.stdout:(59/158): python3-urllib3-1.26.5-7.el9.noarch.r 2.6 MB/s | 218 kB 00:00 2026-02-25T08:20:46.499 INFO:teuthology.orchestra.run.trial009.stdout:(60/158): unzip-6.0-59.el9.x86_64.rpm 2.2 MB/s | 182 kB 00:00 2026-02-25T08:20:46.583 INFO:teuthology.orchestra.run.trial009.stdout:(61/158): zip-3.0-35.el9.x86_64.rpm 3.1 MB/s | 266 kB 00:00 2026-02-25T08:20:46.648 INFO:teuthology.orchestra.run.trial009.stdout:(62/158): boost-program-options-1.75.0-13.el9.x 1.6 MB/s | 104 kB 00:00 2026-02-25T08:20:46.669 INFO:teuthology.orchestra.run.trial009.stdout:(63/158): flexiblas-3.0.4-9.el9.x86_64.rpm 1.3 MB/s | 30 kB 00:00 2026-02-25T08:20:46.803 INFO:teuthology.orchestra.run.trial009.stdout:(64/158): flexiblas-netlib-3.0.4-9.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2026-02-25T08:20:46.825 INFO:teuthology.orchestra.run.trial009.stdout:(65/158): flexiblas-openblas-openmp-3.0.4-9.el9 681 kB/s | 15 kB 00:00 2026-02-25T08:20:46.849 INFO:teuthology.orchestra.run.trial009.stdout:(66/158): libasan8-15.2.1-7.el9.x86_64.rpm 21 MB/s | 525 kB 00:00 2026-02-25T08:20:46.873 INFO:teuthology.orchestra.run.trial009.stdout:(67/158): libnbd-1.20.3-4.el9.x86_64.rpm 6.8 MB/s | 164 kB 00:00 2026-02-25T08:20:46.896 INFO:teuthology.orchestra.run.trial009.stdout:(68/158): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.7 MB/s | 160 kB 00:00 2026-02-25T08:20:46.918 INFO:teuthology.orchestra.run.trial009.stdout:(69/158): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-25T08:20:46.942 INFO:teuthology.orchestra.run.trial009.stdout:(70/158): librdkafka-1.6.1-102.el9.x86_64.rpm 27 MB/s | 662 kB 00:00 2026-02-25T08:20:46.966 INFO:teuthology.orchestra.run.trial009.stdout:(71/158): libstoragemgmt-1.10.1-1.el9.x86_64.rp 10 MB/s | 246 kB 00:00 2026-02-25T08:20:46.990 INFO:teuthology.orchestra.run.trial009.stdout:(72/158): libubsan-11.5.0-14.el9.x86_64.rpm 7.4 MB/s | 176 kB 00:00 2026-02-25T08:20:47.013 INFO:teuthology.orchestra.run.trial009.stdout:(73/158): libxslt-1.1.34-12.el9.x86_64.rpm 9.6 MB/s | 233 kB 00:00 2026-02-25T08:20:47.037 INFO:teuthology.orchestra.run.trial009.stdout:(74/158): lttng-ust-2.12.0-6.el9.x86_64.rpm 12 MB/s | 292 kB 00:00 2026-02-25T08:20:47.061 INFO:teuthology.orchestra.run.trial009.stdout:(75/158): lua-5.4.4-4.el9.x86_64.rpm 7.9 MB/s | 188 kB 00:00 2026-02-25T08:20:47.083 INFO:teuthology.orchestra.run.trial009.stdout:(76/158): openblas-0.3.29-1.el9.x86_64.rpm 1.9 MB/s | 42 kB 00:00 2026-02-25T08:20:47.257 INFO:teuthology.orchestra.run.trial009.stdout:(77/158): openblas-openmp-0.3.29-1.el9.x86_64.r 30 MB/s | 5.3 MB 00:00 2026-02-25T08:20:47.304 INFO:teuthology.orchestra.run.trial009.stdout:(78/158): protobuf-3.14.0-17.el9.x86_64.rpm 22 MB/s | 1.0 MB 00:00 2026-02-25T08:20:47.500 INFO:teuthology.orchestra.run.trial009.stdout:(79/158): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 6.0 MB 00:00 2026-02-25T08:20:47.524 INFO:teuthology.orchestra.run.trial009.stdout:(80/158): python3-devel-3.9.25-3.el9.x86_64.rpm 9.8 MB/s | 244 kB 00:00 2026-02-25T08:20:47.547 INFO:teuthology.orchestra.run.trial009.stdout:(81/158): python3-iniconfig-1.1.1-7.el9.noarch. 782 kB/s | 17 kB 00:00 2026-02-25T08:20:47.571 INFO:teuthology.orchestra.run.trial009.stdout:(82/158): python3-jinja2-2.11.3-8.el9.noarch.rp 10 MB/s | 249 kB 00:00 2026-02-25T08:20:47.593 INFO:teuthology.orchestra.run.trial009.stdout:(83/158): python3-jmespath-1.0.1-1.el9.noarch.r 2.1 MB/s | 48 kB 00:00 2026-02-25T08:20:47.617 INFO:teuthology.orchestra.run.trial009.stdout:(84/158): python3-libstoragemgmt-1.10.1-1.el9.x 7.4 MB/s | 177 kB 00:00 2026-02-25T08:20:47.665 INFO:teuthology.orchestra.run.trial009.stdout:(85/158): python3-lxml-4.6.5-3.el9.x86_64.rpm 26 MB/s | 1.2 MB 00:00 2026-02-25T08:20:47.687 INFO:teuthology.orchestra.run.trial009.stdout:(86/158): python3-markupsafe-1.1.1-12.el9.x86_6 1.5 MB/s | 35 kB 00:00 2026-02-25T08:20:47.889 INFO:teuthology.orchestra.run.trial009.stdout:(87/158): python3-numpy-1.23.5-2.el9.x86_64.rpm 30 MB/s | 6.1 MB 00:00 2026-02-25T08:20:47.915 INFO:teuthology.orchestra.run.trial009.stdout:(88/158): python3-numpy-f2py-1.23.5-2.el9.x86_6 17 MB/s | 442 kB 00:00 2026-02-25T08:20:47.938 INFO:teuthology.orchestra.run.trial009.stdout:(89/158): python3-packaging-20.9-5.el9.noarch.r 3.3 MB/s | 77 kB 00:00 2026-02-25T08:20:47.961 INFO:teuthology.orchestra.run.trial009.stdout:(90/158): python3-pluggy-0.13.1-7.el9.noarch.rp 1.8 MB/s | 41 kB 00:00 2026-02-25T08:20:47.983 INFO:teuthology.orchestra.run.trial009.stdout:(91/158): python3-protobuf-3.14.0-17.el9.noarch 12 MB/s | 267 kB 00:00 2026-02-25T08:20:48.010 INFO:teuthology.orchestra.run.trial009.stdout:(92/158): python3-py-1.10.0-6.el9.noarch.rpm 18 MB/s | 477 kB 00:00 2026-02-25T08:20:48.035 INFO:teuthology.orchestra.run.trial009.stdout:(93/158): python3-pyasn1-0.4.8-7.el9.noarch.rpm 6.2 MB/s | 157 kB 00:00 2026-02-25T08:20:48.059 INFO:teuthology.orchestra.run.trial009.stdout:(94/158): python3-pyasn1-modules-0.4.8-7.el9.no 11 MB/s | 277 kB 00:00 2026-02-25T08:20:48.092 INFO:teuthology.orchestra.run.trial009.stdout:(95/158): python3-pytest-6.2.2-7.el9.noarch.rpm 16 MB/s | 519 kB 00:00 2026-02-25T08:20:48.115 INFO:teuthology.orchestra.run.trial009.stdout:(96/158): python3-requests-oauthlib-1.3.0-12.el 2.3 MB/s | 54 kB 00:00 2026-02-25T08:20:48.674 INFO:teuthology.orchestra.run.trial009.stdout:(97/158): python3-scipy-1.9.3-2.el9.x86_64.rpm 34 MB/s | 19 MB 00:00 2026-02-25T08:20:48.697 INFO:teuthology.orchestra.run.trial009.stdout:(98/158): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-25T08:20:48.720 INFO:teuthology.orchestra.run.trial009.stdout:(99/158): qatlib-25.08.0-2.el9.x86_64.rpm 10 MB/s | 240 kB 00:00 2026-02-25T08:20:48.742 INFO:teuthology.orchestra.run.trial009.stdout:(100/158): qatlib-service-25.08.0-2.el9.x86_64. 1.6 MB/s | 37 kB 00:00 2026-02-25T08:20:48.765 INFO:teuthology.orchestra.run.trial009.stdout:(101/158): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.9 MB/s | 66 kB 00:00 2026-02-25T08:20:48.787 INFO:teuthology.orchestra.run.trial009.stdout:(102/158): socat-1.7.4.1-8.el9.x86_64.rpm 13 MB/s | 303 kB 00:00 2026-02-25T08:20:48.811 INFO:teuthology.orchestra.run.trial009.stdout:(103/158): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.8 MB/s | 189 kB 00:00 2026-02-25T08:20:48.834 INFO:teuthology.orchestra.run.trial009.stdout:(104/158): xmlsec1-openssl-1.2.29-13.el9.x86_64 3.9 MB/s | 90 kB 00:00 2026-02-25T08:20:48.856 INFO:teuthology.orchestra.run.trial009.stdout:(105/158): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.8 MB/s | 64 kB 00:00 2026-02-25T08:20:48.941 INFO:teuthology.orchestra.run.trial009.stdout:(106/158): lua-devel-5.4.4-4.el9.x86_64.rpm 261 kB/s | 22 kB 00:00 2026-02-25T08:20:49.088 INFO:teuthology.orchestra.run.trial009.stdout:(107/158): protobuf-compiler-3.14.0-17.el9.x86_ 5.8 MB/s | 862 kB 00:00 2026-02-25T08:20:49.419 INFO:teuthology.orchestra.run.trial009.stdout:(108/158): abseil-cpp-20211102.0-4.el9.x86_64.r 1.6 MB/s | 551 kB 00:00 2026-02-25T08:20:49.470 INFO:teuthology.orchestra.run.trial009.stdout:(109/158): gperftools-libs-2.9.1-3.el9.x86_64.r 5.9 MB/s | 308 kB 00:00 2026-02-25T08:20:49.508 INFO:teuthology.orchestra.run.trial009.stdout:(110/158): grpc-data-1.46.7-10.el9.noarch.rpm 509 kB/s | 19 kB 00:00 2026-02-25T08:20:49.670 INFO:teuthology.orchestra.run.trial009.stdout:(111/158): libarrow-9.0.0-15.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2026-02-25T08:20:49.707 INFO:teuthology.orchestra.run.trial009.stdout:(112/158): libarrow-doc-9.0.0-15.el9.noarch.rpm 656 kB/s | 25 kB 00:00 2026-02-25T08:20:49.745 INFO:teuthology.orchestra.run.trial009.stdout:(113/158): liboath-2.6.12-1.el9.x86_64.rpm 1.3 MB/s | 49 kB 00:00 2026-02-25T08:20:49.784 INFO:teuthology.orchestra.run.trial009.stdout:(114/158): libunwind-1.6.2-1.el9.x86_64.rpm 1.7 MB/s | 67 kB 00:00 2026-02-25T08:20:49.822 INFO:teuthology.orchestra.run.trial009.stdout:(115/158): luarocks-3.9.2-5.el9.noarch.rpm 3.8 MB/s | 151 kB 00:00 2026-02-25T08:20:49.866 INFO:teuthology.orchestra.run.trial009.stdout:(116/158): parquet-libs-9.0.0-15.el9.x86_64.rpm 19 MB/s | 838 kB 00:00 2026-02-25T08:20:49.907 INFO:teuthology.orchestra.run.trial009.stdout:(117/158): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2026-02-25T08:20:49.945 INFO:teuthology.orchestra.run.trial009.stdout:(118/158): python3-autocommand-2.2.2-8.el9.noar 780 kB/s | 29 kB 00:00 2026-02-25T08:20:49.983 INFO:teuthology.orchestra.run.trial009.stdout:(119/158): python3-backports-tarfile-1.2.0-1.el 1.6 MB/s | 60 kB 00:00 2026-02-25T08:20:50.021 INFO:teuthology.orchestra.run.trial009.stdout:(120/158): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.1 MB/s | 43 kB 00:00 2026-02-25T08:20:50.059 INFO:teuthology.orchestra.run.trial009.stdout:(121/158): python3-cachetools-4.2.4-1.el9.noarc 851 kB/s | 32 kB 00:00 2026-02-25T08:20:50.096 INFO:teuthology.orchestra.run.trial009.stdout:(122/158): python3-certifi-2023.05.07-4.el9.noa 374 kB/s | 14 kB 00:00 2026-02-25T08:20:50.135 INFO:teuthology.orchestra.run.trial009.stdout:(123/158): python3-cheroot-10.0.1-4.el9.noarch. 4.4 MB/s | 173 kB 00:00 2026-02-25T08:20:50.175 INFO:teuthology.orchestra.run.trial009.stdout:(124/158): python3-cherrypy-18.6.1-2.el9.noarch 8.8 MB/s | 358 kB 00:00 2026-02-25T08:20:50.214 INFO:teuthology.orchestra.run.trial009.stdout:(125/158): python3-google-auth-2.45.0-1.el9.noa 6.4 MB/s | 254 kB 00:00 2026-02-25T08:20:50.266 INFO:teuthology.orchestra.run.trial009.stdout:(126/158): python3-grpcio-1.46.7-10.el9.x86_64. 40 MB/s | 2.0 MB 00:00 2026-02-25T08:20:50.304 INFO:teuthology.orchestra.run.trial009.stdout:(127/158): python3-grpcio-tools-1.46.7-10.el9.x 3.7 MB/s | 144 kB 00:00 2026-02-25T08:20:50.343 INFO:teuthology.orchestra.run.trial009.stdout:(128/158): python3-influxdb-5.3.1-1.el9.noarch. 3.5 MB/s | 139 kB 00:00 2026-02-25T08:20:50.381 INFO:teuthology.orchestra.run.trial009.stdout:(129/158): python3-isodate-0.6.1-3.el9.noarch.r 1.4 MB/s | 56 kB 00:00 2026-02-25T08:20:50.419 INFO:teuthology.orchestra.run.trial009.stdout:(130/158): python3-jaraco-8.2.1-3.el9.noarch.rp 284 kB/s | 11 kB 00:00 2026-02-25T08:20:50.456 INFO:teuthology.orchestra.run.trial009.stdout:(131/158): python3-jaraco-classes-3.2.1-5.el9.n 469 kB/s | 18 kB 00:00 2026-02-25T08:20:50.494 INFO:teuthology.orchestra.run.trial009.stdout:(132/158): python3-jaraco-collections-3.0.0-8.e 614 kB/s | 23 kB 00:00 2026-02-25T08:20:50.532 INFO:teuthology.orchestra.run.trial009.stdout:(133/158): python3-jaraco-context-6.0.1-3.el9.n 522 kB/s | 20 kB 00:00 2026-02-25T08:20:50.570 INFO:teuthology.orchestra.run.trial009.stdout:(134/158): python3-jaraco-functools-3.5.0-2.el9 516 kB/s | 19 kB 00:00 2026-02-25T08:20:50.608 INFO:teuthology.orchestra.run.trial009.stdout:(135/158): python3-jaraco-text-4.0.0-2.el9.noar 701 kB/s | 26 kB 00:00 2026-02-25T08:20:50.652 INFO:teuthology.orchestra.run.trial009.stdout:(136/158): python3-kubernetes-26.1.0-3.el9.noar 23 MB/s | 1.0 MB 00:00 2026-02-25T08:20:50.690 INFO:teuthology.orchestra.run.trial009.stdout:(137/158): python3-more-itertools-8.12.0-2.el9. 2.0 MB/s | 79 kB 00:00 2026-02-25T08:20:50.728 INFO:teuthology.orchestra.run.trial009.stdout:(138/158): python3-msgpack-1.0.3-2.el9.x86_64.r 2.2 MB/s | 86 kB 00:00 2026-02-25T08:20:50.766 INFO:teuthology.orchestra.run.trial009.stdout:(139/158): python3-natsort-7.1.1-5.el9.noarch.r 1.5 MB/s | 58 kB 00:00 2026-02-25T08:20:50.804 INFO:teuthology.orchestra.run.trial009.stdout:(140/158): python3-portend-3.1.0-2.el9.noarch.r 436 kB/s | 16 kB 00:00 2026-02-25T08:20:50.846 INFO:teuthology.orchestra.run.trial009.stdout:(141/158): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2026-02-25T08:20:50.883 INFO:teuthology.orchestra.run.trial009.stdout:(142/158): python3-repoze-lru-0.7-16.el9.noarch 817 kB/s | 31 kB 00:00 2026-02-25T08:20:50.922 INFO:teuthology.orchestra.run.trial009.stdout:(143/158): python3-routes-2.5.1-5.el9.noarch.rp 4.8 MB/s | 188 kB 00:00 2026-02-25T08:20:50.960 INFO:teuthology.orchestra.run.trial009.stdout:(144/158): python3-rsa-4.9-2.el9.noarch.rpm 1.5 MB/s | 59 kB 00:00 2026-02-25T08:20:50.998 INFO:teuthology.orchestra.run.trial009.stdout:(145/158): python3-saml-1.16.0-1.el9.noarch.rpm 3.2 MB/s | 125 kB 00:00 2026-02-25T08:20:51.036 INFO:teuthology.orchestra.run.trial009.stdout:(146/158): python3-tempora-5.0.0-2.el9.noarch.r 948 kB/s | 36 kB 00:00 2026-02-25T08:20:51.074 INFO:teuthology.orchestra.run.trial009.stdout:(147/158): python3-typing-extensions-4.15.0-1.e 2.2 MB/s | 86 kB 00:00 2026-02-25T08:20:51.112 INFO:teuthology.orchestra.run.trial009.stdout:(148/158): python3-websocket-client-1.2.3-2.el9 2.3 MB/s | 90 kB 00:00 2026-02-25T08:20:51.150 INFO:teuthology.orchestra.run.trial009.stdout:(149/158): python3-xmlsec-1.3.13-1.el9.x86_64.r 1.3 MB/s | 48 kB 00:00 2026-02-25T08:20:51.188 INFO:teuthology.orchestra.run.trial009.stdout:(150/158): python3-xmltodict-0.12.0-15.el9.noar 588 kB/s | 22 kB 00:00 2026-02-25T08:20:51.226 INFO:teuthology.orchestra.run.trial009.stdout:(151/158): python3-zc-lockfile-2.0-10.el9.noarc 530 kB/s | 20 kB 00:00 2026-02-25T08:20:51.265 INFO:teuthology.orchestra.run.trial009.stdout:(152/158): re2-20211101-20.el9.x86_64.rpm 4.8 MB/s | 191 kB 00:00 2026-02-25T08:20:51.313 INFO:teuthology.orchestra.run.trial009.stdout:(153/158): thrift-0.15.0-4.el9.x86_64.rpm 33 MB/s | 1.6 MB 00:00 2026-02-25T08:20:51.351 INFO:teuthology.orchestra.run.trial009.stdout:(154/158): yaml-cpp-0.6.3-5.el9.x86_64.rpm 3.1 MB/s | 122 kB 00:00 2026-02-25T08:21:00.339 INFO:teuthology.orchestra.run.trial009.stdout:(155/158): librados2-20.3.0-5338.g6aeb6975.el9. 374 kB/s | 3.3 MB 00:08 2026-02-25T08:21:08.282 INFO:teuthology.orchestra.run.trial009.stdout:(156/158): librbd1-20.3.0-5338.g6aeb6975.el9.x8 347 kB/s | 2.7 MB 00:07 2026-02-25T08:23:03.288 INFO:teuthology.orchestra.run.trial009.stdout:(157/158): ceph-test-20.3.0-5338.g6aeb6975.el9. 264 kB/s | 127 MB 08:13 2026-02-25T08:33:15.847 INFO:teuthology.orchestra.run.trial059.stdout:(158/158): ceph-osd-crimson-debuginfo-20.3.0-53 306 kB/s | 433 MB 24:08 2026-02-25T08:33:15.851 INFO:teuthology.orchestra.run.trial059.stdout:-------------------------------------------------------------------------------- 2026-02-25T08:33:15.852 INFO:teuthology.orchestra.run.trial059.stdout:Total 597 kB/s | 868 MB 24:49 2026-02-25T08:33:16.389 INFO:teuthology.orchestra.run.trial059.stdout:Running transaction check 2026-02-25T08:33:16.443 INFO:teuthology.orchestra.run.trial059.stdout:Transaction check succeeded. 2026-02-25T08:33:16.444 INFO:teuthology.orchestra.run.trial059.stdout:Running transaction test 2026-02-25T08:33:19.215 INFO:teuthology.orchestra.run.trial059.stdout:Transaction test succeeded. 2026-02-25T08:33:19.215 INFO:teuthology.orchestra.run.trial059.stdout:Running transaction 2026-02-25T08:33:22.052 INFO:teuthology.orchestra.run.trial059.stdout: Preparing : 1/1 2026-02-25T08:33:22.055 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/160 2026-02-25T08:33:22.063 INFO:teuthology.orchestra.run.trial059.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/160 2026-02-25T08:33:22.074 INFO:teuthology.orchestra.run.trial059.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/160 2026-02-25T08:33:22.221 INFO:teuthology.orchestra.run.trial059.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/160 2026-02-25T08:33:22.222 INFO:teuthology.orchestra.run.trial059.stdout: Upgrading : librados2-2:20.3.0-5338.g6aeb6975.el9.x86_64 5/160 2026-02-25T08:33:22.270 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: librados2-2:20.3.0-5338.g6aeb6975.el9.x86_64 5/160 2026-02-25T08:33:22.270 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libcephfs2-2:20.3.0-5338.g6aeb6975.el9.x86_64 6/160 2026-02-25T08:33:22.283 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: libcephfs2-2:20.3.0-5338.g6aeb6975.el9.x86_64 6/160 2026-02-25T08:33:22.285 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libcephfs-daemon-2:20.3.0-5338.g6aeb6975.el9.x86 7/160 2026-02-25T08:33:22.286 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libcephfs-proxy2-2:20.3.0-5338.g6aeb6975.el9.x86 8/160 2026-02-25T08:33:22.312 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5338.g6aeb6975.el9.x86 8/160 2026-02-25T08:33:22.318 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-rados-2:20.3.0-5338.g6aeb6975.el9.x86_64 9/160 2026-02-25T08:33:22.326 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 10/160 2026-02-25T08:33:22.329 INFO:teuthology.orchestra.run.trial059.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 11/160 2026-02-25T08:33:22.332 INFO:teuthology.orchestra.run.trial059.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 12/160 2026-02-25T08:33:22.333 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 13/160 2026-02-25T08:33:22.338 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 14/160 2026-02-25T08:33:22.453 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 15/160 2026-02-25T08:33:22.454 INFO:teuthology.orchestra.run.trial059.stdout: Upgrading : librbd1-2:20.3.0-5338.g6aeb6975.el9.x86_64 16/160 2026-02-25T08:33:22.496 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: librbd1-2:20.3.0-5338.g6aeb6975.el9.x86_64 16/160 2026-02-25T08:33:22.503 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 17/160 2026-02-25T08:33:22.510 INFO:teuthology.orchestra.run.trial059.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 18/160 2026-02-25T08:33:22.511 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libcephsqlite-2:20.3.0-5338.g6aeb6975.el9.x86_64 19/160 2026-02-25T08:33:22.533 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5338.g6aeb6975.el9.x86_64 19/160 2026-02-25T08:33:22.534 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libradosstriper1-2:20.3.0-5338.g6aeb6975.el9.x86 20/160 2026-02-25T08:33:22.545 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5338.g6aeb6975.el9.x86 20/160 2026-02-25T08:33:22.549 INFO:teuthology.orchestra.run.trial059.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 21/160 2026-02-25T08:33:22.579 INFO:teuthology.orchestra.run.trial059.stdout: Installing : re2-1:20211101-20.el9.x86_64 22/160 2026-02-25T08:33:22.584 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 23/160 2026-02-25T08:33:22.588 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 24/160 2026-02-25T08:33:22.609 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 25/160 2026-02-25T08:33:22.615 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 26/160 2026-02-25T08:33:22.617 INFO:teuthology.orchestra.run.trial059.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/160 2026-02-25T08:33:22.621 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 28/160 2026-02-25T08:33:22.622 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 29/160 2026-02-25T08:33:22.632 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 29/160 2026-02-25T08:33:22.637 INFO:teuthology.orchestra.run.trial059.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 30/160 2026-02-25T08:33:22.660 INFO:teuthology.orchestra.run.trial059.stdout: Installing : unzip-6.0-59.el9.x86_64 31/160 2026-02-25T08:33:22.673 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 32/160 2026-02-25T08:33:22.678 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 33/160 2026-02-25T08:33:22.681 INFO:teuthology.orchestra.run.trial059.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 34/160 2026-02-25T08:33:22.687 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 35/160 2026-02-25T08:33:22.689 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 36/160 2026-02-25T08:33:22.690 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 37/160 2026-02-25T08:33:22.700 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 38/160 2026-02-25T08:33:22.734 INFO:teuthology.orchestra.run.trial059.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 39/160 2026-02-25T08:33:22.739 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-ceph-common-2:20.3.0-5338.g6aeb6975.el9. 40/160 2026-02-25T08:33:22.750 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-ceph-argparse-2:20.3.0-5338.g6aeb6975.el 41/160 2026-02-25T08:33:22.761 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-cephfs-2:20.3.0-5338.g6aeb6975.el9.x86_6 42/160 2026-02-25T08:33:22.767 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 43/160 2026-02-25T08:33:22.791 INFO:teuthology.orchestra.run.trial059.stdout: Installing : zip-3.0-35.el9.x86_64 44/160 2026-02-25T08:33:22.794 INFO:teuthology.orchestra.run.trial059.stdout: Installing : luarocks-3.9.2-5.el9.noarch 45/160 2026-02-25T08:33:22.843 INFO:teuthology.orchestra.run.trial059.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 46/160 2026-02-25T08:33:22.856 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 47/160 2026-02-25T08:33:22.863 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/160 2026-02-25T08:33:22.867 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/160 2026-02-25T08:33:22.868 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/160 2026-02-25T08:33:22.873 INFO:teuthology.orchestra.run.trial059.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 51/160 2026-02-25T08:33:22.889 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 52/160 2026-02-25T08:33:22.894 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-rbd-2:20.3.0-5338.g6aeb6975.el9.x86_64 53/160 2026-02-25T08:33:22.898 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/160 2026-02-25T08:33:22.905 INFO:teuthology.orchestra.run.trial059.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 55/160 2026-02-25T08:33:22.914 INFO:teuthology.orchestra.run.trial059.stdout: Installing : librados-devel-2:20.3.0-5338.g6aeb6975.el9.x86_6 56/160 2026-02-25T08:33:22.926 INFO:teuthology.orchestra.run.trial059.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 57/160 2026-02-25T08:33:22.931 INFO:teuthology.orchestra.run.trial059.stdout: Installing : thrift-0.15.0-4.el9.x86_64 58/160 2026-02-25T08:33:22.934 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 59/160 2026-02-25T08:33:22.948 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 60/160 2026-02-25T08:33:22.952 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 61/160 2026-02-25T08:33:22.957 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 62/160 2026-02-25T08:33:22.969 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 63/160 2026-02-25T08:33:22.977 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 64/160 2026-02-25T08:33:22.984 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 65/160 2026-02-25T08:33:23.003 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 66/160 2026-02-25T08:33:23.014 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 67/160 2026-02-25T08:33:23.029 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 68/160 2026-02-25T08:33:23.034 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 69/160 2026-02-25T08:33:23.042 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/160 2026-02-25T08:33:23.081 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/160 2026-02-25T08:33:23.403 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/160 2026-02-25T08:33:23.412 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/160 2026-02-25T08:33:23.416 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/160 2026-02-25T08:33:23.422 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/160 2026-02-25T08:33:23.427 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/160 2026-02-25T08:33:23.431 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 77/160 2026-02-25T08:33:23.434 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/160 2026-02-25T08:33:23.442 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 79/160 2026-02-25T08:33:23.445 INFO:teuthology.orchestra.run.trial059.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 80/160 2026-02-25T08:33:23.446 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 81/160 2026-02-25T08:33:23.474 INFO:teuthology.orchestra.run.trial059.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 82/160 2026-02-25T08:33:23.517 INFO:teuthology.orchestra.run.trial059.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 83/160 2026-02-25T08:33:23.527 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 84/160 2026-02-25T08:33:23.573 INFO:teuthology.orchestra.run.trial059.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 85/160 2026-02-25T08:33:23.601 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-py-1.10.0-6.el9.noarch 86/160 2026-02-25T08:33:23.611 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 87/160 2026-02-25T08:33:23.618 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 88/160 2026-02-25T08:33:23.623 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-pluggy-0.13.1-7.el9.noarch 89/160 2026-02-25T08:33:23.630 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 90/160 2026-02-25T08:33:23.634 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 91/160 2026-02-25T08:33:23.668 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-iniconfig-1.1.1-7.el9.noarch 92/160 2026-02-25T08:33:23.891 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 93/160 2026-02-25T08:33:23.914 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 94/160 2026-02-25T08:33:23.918 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 95/160 2026-02-25T08:33:23.976 INFO:teuthology.orchestra.run.trial059.stdout: Installing : openblas-0.3.29-1.el9.x86_64 96/160 2026-02-25T08:33:23.978 INFO:teuthology.orchestra.run.trial059.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 97/160 2026-02-25T08:33:24.000 INFO:teuthology.orchestra.run.trial059.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 98/160 2026-02-25T08:33:24.322 INFO:teuthology.orchestra.run.trial059.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 99/160 2026-02-25T08:33:24.394 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 100/160 2026-02-25T08:33:25.061 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 101/160 2026-02-25T08:33:25.074 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 102/160 2026-02-25T08:33:25.080 INFO:teuthology.orchestra.run.trial059.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 103/160 2026-02-25T08:33:25.329 INFO:teuthology.orchestra.run.trial059.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 104/160 2026-02-25T08:33:25.330 INFO:teuthology.orchestra.run.trial059.stdout: Installing : librgw2-2:20.3.0-5338.g6aeb6975.el9.x86_64 105/160 2026-02-25T08:33:25.348 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: librgw2-2:20.3.0-5338.g6aeb6975.el9.x86_64 105/160 2026-02-25T08:33:25.349 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-rgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 106/160 2026-02-25T08:33:26.288 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-common-2:20.3.0-5338.g6aeb6975.el9.x86_64 107/160 2026-02-25T08:33:26.290 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-common-2:20.3.0-5338.g6aeb6975.el9.x86_64 107/160 2026-02-25T08:33:26.308 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-common-2:20.3.0-5338.g6aeb6975.el9.x86_64 107/160 2026-02-25T08:33:26.318 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 108/160 2026-02-25T08:33:26.325 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-packaging-20.9-5.el9.noarch 109/160 2026-02-25T08:33:26.338 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-ply-3.11-14.el9.noarch 110/160 2026-02-25T08:33:26.354 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 111/160 2026-02-25T08:33:26.429 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 112/160 2026-02-25T08:33:26.438 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 113/160 2026-02-25T08:33:26.461 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 114/160 2026-02-25T08:33:26.491 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 115/160 2026-02-25T08:33:26.542 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 116/160 2026-02-25T08:33:26.548 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 117/160 2026-02-25T08:33:26.551 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 118/160 2026-02-25T08:33:26.555 INFO:teuthology.orchestra.run.trial059.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 119/160 2026-02-25T08:33:26.558 INFO:teuthology.orchestra.run.trial059.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 120/160 2026-02-25T08:33:26.558 INFO:teuthology.orchestra.run.trial059.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 121/160 2026-02-25T08:33:26.576 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 121/160 2026-02-25T08:33:26.690 INFO:teuthology.orchestra.run.trial059.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 122/160 2026-02-25T08:33:26.692 INFO:teuthology.orchestra.run.trial059.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 123/160 2026-02-25T08:33:26.969 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 123/160 2026-02-25T08:33:26.969 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-25T08:33:26.969 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:33:27.228 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-base-2:20.3.0-5338.g6aeb6975.el9.x86_64 124/160 2026-02-25T08:33:27.264 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-base-2:20.3.0-5338.g6aeb6975.el9.x86_64 124/160 2026-02-25T08:33:27.264 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-25T08:33:27.264 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-25T08:33:27.264 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:33:27.273 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-selinux-2:20.3.0-5338.g6aeb6975.el9.x86_64 125/160 2026-02-25T08:33:31.938 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5338.g6aeb6975.el9.x86_64 125/160 2026-02-25T08:33:31.938 INFO:teuthology.orchestra.run.trial059.stdout:skipping the directory /sys 2026-02-25T08:33:31.938 INFO:teuthology.orchestra.run.trial059.stdout:skipping the directory /proc 2026-02-25T08:33:31.938 INFO:teuthology.orchestra.run.trial059.stdout:skipping the directory /mnt 2026-02-25T08:33:31.938 INFO:teuthology.orchestra.run.trial059.stdout:skipping the directory /var/tmp 2026-02-25T08:33:31.938 INFO:teuthology.orchestra.run.trial059.stdout:skipping the directory /home 2026-02-25T08:33:31.938 INFO:teuthology.orchestra.run.trial059.stdout:skipping the directory /root 2026-02-25T08:33:31.938 INFO:teuthology.orchestra.run.trial059.stdout:skipping the directory /tmp 2026-02-25T08:33:31.938 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:33:32.027 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-mds-2:20.3.0-5338.g6aeb6975.el9.x86_64 126/160 2026-02-25T08:33:32.048 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-mds-2:20.3.0-5338.g6aeb6975.el9.x86_64 126/160 2026-02-25T08:33:32.048 INFO:teuthology.orchestra.run.trial059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T08:33:32.048 INFO:teuthology.orchestra.run.trial059.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-25T08:33:32.048 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T08:33:32.048 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T08:33:32.049 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:33:32.252 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-mon-2:20.3.0-5338.g6aeb6975.el9.x86_64 127/160 2026-02-25T08:33:32.273 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-mon-2:20.3.0-5338.g6aeb6975.el9.x86_64 127/160 2026-02-25T08:33:32.273 INFO:teuthology.orchestra.run.trial059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T08:33:32.273 INFO:teuthology.orchestra.run.trial059.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-25T08:33:32.273 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T08:33:32.273 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T08:33:32.274 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:33:32.281 INFO:teuthology.orchestra.run.trial059.stdout: Installing : mailcap-2.1.49-5.el9.noarch 128/160 2026-02-25T08:33:32.282 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 129/160 2026-02-25T08:33:32.300 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 130/160 2026-02-25T08:33:32.300 INFO:teuthology.orchestra.run.trial059.stdout:Creating group 'qat' with GID 992. 2026-02-25T08:33:32.300 INFO:teuthology.orchestra.run.trial059.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-25T08:33:32.300 INFO:teuthology.orchestra.run.trial059.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-25T08:33:32.300 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:33:32.308 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 130/160 2026-02-25T08:33:32.331 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 130/160 2026-02-25T08:33:32.331 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-25T08:33:32.331 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:33:32.366 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 131/160 2026-02-25T08:33:32.957 INFO:teuthology.orchestra.run.trial059.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 132/160 2026-02-25T08:33:38.424 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-osd-classic-2:20.3.0-5338.g6aeb6975.el9.x86 133/160 2026-02-25T08:33:38.486 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-osd-crimson-2:20.3.0-5338.g6aeb6975.el9.x86 134/160 2026-02-25T08:33:38.488 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-volume-2:20.3.0-5338.g6aeb6975.el9.noarch 135/160 2026-02-25T08:33:38.501 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-volume-2:20.3.0-5338.g6aeb6975.el9.noarch 135/160 2026-02-25T08:33:38.501 INFO:teuthology.orchestra.run.trial059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T08:33:38.502 INFO:teuthology.orchestra.run.trial059.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-25T08:33:38.502 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:33:38.512 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-osd-2:20.3.0-5338.g6aeb6975.el9.x86_64 136/160 2026-02-25T08:33:38.534 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-osd-2:20.3.0-5338.g6aeb6975.el9.x86_64 136/160 2026-02-25T08:33:38.534 INFO:teuthology.orchestra.run.trial059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T08:33:38.534 INFO:teuthology.orchestra.run.trial059.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-25T08:33:38.534 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T08:33:38.534 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T08:33:38.534 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:33:38.590 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: cephadm-2:20.3.0-5338.g6aeb6975.el9.noarch 137/160 2026-02-25T08:33:38.592 INFO:teuthology.orchestra.run.trial059.stdout: Installing : cephadm-2:20.3.0-5338.g6aeb6975.el9.noarch 137/160 2026-02-25T08:33:38.601 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5338.g6aeb6975.e 138/160 2026-02-25T08:33:38.625 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5338.g6aeb6975. 139/160 2026-02-25T08:33:38.626 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5338.g6aeb6975.el9.noa 140/160 2026-02-25T08:33:41.526 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5338.g6aeb6975.el9.noa 140/160 2026-02-25T08:33:41.533 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5338.g6aeb6975.el9.n 141/160 2026-02-25T08:33:41.991 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5338.g6aeb6975.el9.n 141/160 2026-02-25T08:33:41.992 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5338.g6ae 142/160 2026-02-25T08:33:42.005 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5338.g6ae 142/160 2026-02-25T08:33:42.005 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5338.g6aeb6975.el9.n 143/160 2026-02-25T08:33:42.066 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5338.g6aeb6975.el9.n 143/160 2026-02-25T08:33:42.106 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5338.g6aeb6975.el 144/160 2026-02-25T08:33:42.107 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-mgr-2:20.3.0-5338.g6aeb6975.el9.x86_64 145/160 2026-02-25T08:33:42.127 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5338.g6aeb6975.el9.x86_64 145/160 2026-02-25T08:33:42.127 INFO:teuthology.orchestra.run.trial059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T08:33:42.127 INFO:teuthology.orchestra.run.trial059.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-25T08:33:42.128 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T08:33:42.128 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T08:33:42.128 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:33:42.139 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-mgr-rook-2:20.3.0-5338.g6aeb6975.el9.noarch 146/160 2026-02-25T08:33:44.381 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5338.g6aeb6975.el9.noarch 146/160 2026-02-25T08:34:06.857 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-debugsource-2:20.3.0-5338.g6aeb6975.el9.x86 147/160 2026-02-25T08:34:06.858 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5338.g6aeb69 148/160 2026-02-25T08:34:07.344 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-2:20.3.0-5338.g6aeb6975.el9.x86_64 149/160 2026-02-25T08:34:07.345 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-radosgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 150/160 2026-02-25T08:34:07.366 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 150/160 2026-02-25T08:34:07.366 INFO:teuthology.orchestra.run.trial059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T08:34:07.366 INFO:teuthology.orchestra.run.trial059.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-25T08:34:07.366 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T08:34:07.367 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T08:34:07.367 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:34:07.375 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5338.g6aeb6 151/160 2026-02-25T08:34:07.395 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5338.g6aeb6 151/160 2026-02-25T08:34:07.395 INFO:teuthology.orchestra.run.trial059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T08:34:07.395 INFO:teuthology.orchestra.run.trial059.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-25T08:34:07.395 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:34:07.516 INFO:teuthology.orchestra.run.trial059.stdout: Installing : rbd-mirror-2:20.3.0-5338.g6aeb6975.el9.x86_64 152/160 2026-02-25T08:34:07.538 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5338.g6aeb6975.el9.x86_64 152/160 2026-02-25T08:34:07.538 INFO:teuthology.orchestra.run.trial059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T08:34:07.538 INFO:teuthology.orchestra.run.trial059.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-25T08:34:07.538 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T08:34:07.538 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T08:34:07.538 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:34:14.536 INFO:teuthology.orchestra.run.trial059.stdout: Installing : python3-pytest-6.2.2-7.el9.noarch 153/160 2026-02-25T08:34:14.545 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-test-2:20.3.0-5338.g6aeb6975.el9.x86_64 154/160 2026-02-25T08:34:14.550 INFO:teuthology.orchestra.run.trial059.stdout: Installing : libcephfs-devel-2:20.3.0-5338.g6aeb6975.el9.x86_ 155/160 2026-02-25T08:34:14.559 INFO:teuthology.orchestra.run.trial059.stdout: Installing : rbd-fuse-2:20.3.0-5338.g6aeb6975.el9.x86_64 156/160 2026-02-25T08:34:14.599 INFO:teuthology.orchestra.run.trial059.stdout: Installing : rbd-nbd-2:20.3.0-5338.g6aeb6975.el9.x86_64 157/160 2026-02-25T08:34:14.602 INFO:teuthology.orchestra.run.trial059.stdout: Installing : ceph-fuse-2:20.3.0-5338.g6aeb6975.el9.x86_64 158/160 2026-02-25T08:34:14.602 INFO:teuthology.orchestra.run.trial059.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/160 2026-02-25T08:34:14.614 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/160 2026-02-25T08:34:14.615 INFO:teuthology.orchestra.run.trial059.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/160 2026-02-25T08:34:14.626 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2026-02-25T08:34:14.632 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5338.g6aeb6975.el9.x86 160/160 2026-02-25T08:34:14.657 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5338.g6aeb6975.el9.x86 160/160 2026-02-25T08:34:17.750 INFO:teuthology.orchestra.run.trial059.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2026-02-25T08:34:17.750 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-2:20.3.0-5338.g6aeb6975.el9.x86_64 1/160 2026-02-25T08:34:17.750 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-base-2:20.3.0-5338.g6aeb6975.el9.x86_64 2/160 2026-02-25T08:34:17.750 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-common-2:20.3.0-5338.g6aeb6975.el9.x86_64 3/160 2026-02-25T08:34:17.751 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-debugsource-2:20.3.0-5338.g6aeb6975.el9.x86 4/160 2026-02-25T08:34:17.751 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-fuse-2:20.3.0-5338.g6aeb6975.el9.x86_64 5/160 2026-02-25T08:34:17.751 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5338.g6aeb6 6/160 2026-02-25T08:34:17.751 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-mds-2:20.3.0-5338.g6aeb6975.el9.x86_64 7/160 2026-02-25T08:34:17.751 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-mgr-2:20.3.0-5338.g6aeb6975.el9.x86_64 8/160 2026-02-25T08:34:17.751 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-mon-2:20.3.0-5338.g6aeb6975.el9.x86_64 9/160 2026-02-25T08:34:17.751 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-osd-2:20.3.0-5338.g6aeb6975.el9.x86_64 10/160 2026-02-25T08:34:17.751 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-osd-classic-2:20.3.0-5338.g6aeb6975.el9.x86 11/160 2026-02-25T08:34:17.751 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5338.g6aeb6975.el9.x86 12/160 2026-02-25T08:34:17.751 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5338.g6aeb69 13/160 2026-02-25T08:34:17.751 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-radosgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 14/160 2026-02-25T08:34:17.751 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-selinux-2:20.3.0-5338.g6aeb6975.el9.x86_64 15/160 2026-02-25T08:34:17.752 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-test-2:20.3.0-5338.g6aeb6975.el9.x86_64 16/160 2026-02-25T08:34:17.752 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libcephfs-daemon-2:20.3.0-5338.g6aeb6975.el9.x86 17/160 2026-02-25T08:34:17.752 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libcephfs-devel-2:20.3.0-5338.g6aeb6975.el9.x86_ 18/160 2026-02-25T08:34:17.752 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5338.g6aeb6975.el9.x86 19/160 2026-02-25T08:34:17.752 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libcephfs2-2:20.3.0-5338.g6aeb6975.el9.x86_64 20/160 2026-02-25T08:34:17.752 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libcephsqlite-2:20.3.0-5338.g6aeb6975.el9.x86_64 21/160 2026-02-25T08:34:17.752 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : librados-devel-2:20.3.0-5338.g6aeb6975.el9.x86_6 22/160 2026-02-25T08:34:17.752 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libradosstriper1-2:20.3.0-5338.g6aeb6975.el9.x86 23/160 2026-02-25T08:34:17.752 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : librgw2-2:20.3.0-5338.g6aeb6975.el9.x86_64 24/160 2026-02-25T08:34:17.752 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5338.g6aeb6975.el 25/160 2026-02-25T08:34:17.752 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-ceph-common-2:20.3.0-5338.g6aeb6975.el9. 26/160 2026-02-25T08:34:17.752 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-cephfs-2:20.3.0-5338.g6aeb6975.el9.x86_6 27/160 2026-02-25T08:34:17.752 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-rados-2:20.3.0-5338.g6aeb6975.el9.x86_64 28/160 2026-02-25T08:34:17.753 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-rbd-2:20.3.0-5338.g6aeb6975.el9.x86_64 29/160 2026-02-25T08:34:17.753 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-rgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 30/160 2026-02-25T08:34:17.753 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : rbd-fuse-2:20.3.0-5338.g6aeb6975.el9.x86_64 31/160 2026-02-25T08:34:17.753 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : rbd-mirror-2:20.3.0-5338.g6aeb6975.el9.x86_64 32/160 2026-02-25T08:34:17.753 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : rbd-nbd-2:20.3.0-5338.g6aeb6975.el9.x86_64 33/160 2026-02-25T08:34:17.753 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5338.g6aeb6975. 34/160 2026-02-25T08:34:17.753 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5338.g6aeb6975.el9.noa 35/160 2026-02-25T08:34:17.753 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5338.g6aeb6975.el9.n 36/160 2026-02-25T08:34:17.753 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5338.g6ae 37/160 2026-02-25T08:34:17.753 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5338.g6aeb6975.el9.n 38/160 2026-02-25T08:34:17.753 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5338.g6aeb6975.el 39/160 2026-02-25T08:34:17.753 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5338.g6aeb6975.el9.noarch 40/160 2026-02-25T08:34:17.754 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5338.g6aeb6975.e 41/160 2026-02-25T08:34:17.754 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ceph-volume-2:20.3.0-5338.g6aeb6975.el9.noarch 42/160 2026-02-25T08:34:17.754 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : cephadm-2:20.3.0-5338.g6aeb6975.el9.noarch 43/160 2026-02-25T08:34:17.754 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 44/160 2026-02-25T08:34:17.754 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 45/160 2026-02-25T08:34:17.754 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 46/160 2026-02-25T08:34:17.754 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 47/160 2026-02-25T08:34:17.754 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 48/160 2026-02-25T08:34:17.754 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 49/160 2026-02-25T08:34:17.754 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 50/160 2026-02-25T08:34:17.754 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 51/160 2026-02-25T08:34:17.754 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 52/160 2026-02-25T08:34:17.754 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 53/160 2026-02-25T08:34:17.755 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 54/160 2026-02-25T08:34:17.755 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 55/160 2026-02-25T08:34:17.755 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 56/160 2026-02-25T08:34:17.755 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-ply-3.11-14.el9.noarch 57/160 2026-02-25T08:34:17.755 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 58/160 2026-02-25T08:34:17.755 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 59/160 2026-02-25T08:34:17.755 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 60/160 2026-02-25T08:34:17.755 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 61/160 2026-02-25T08:34:17.755 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : unzip-6.0-59.el9.x86_64 62/160 2026-02-25T08:34:17.755 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : zip-3.0-35.el9.x86_64 63/160 2026-02-25T08:34:17.755 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 64/160 2026-02-25T08:34:17.755 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 65/160 2026-02-25T08:34:17.756 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 66/160 2026-02-25T08:34:17.756 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 67/160 2026-02-25T08:34:17.756 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 68/160 2026-02-25T08:34:17.756 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 69/160 2026-02-25T08:34:17.756 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 70/160 2026-02-25T08:34:17.756 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 71/160 2026-02-25T08:34:17.756 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 72/160 2026-02-25T08:34:17.756 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 73/160 2026-02-25T08:34:17.756 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 74/160 2026-02-25T08:34:17.756 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 75/160 2026-02-25T08:34:17.756 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 76/160 2026-02-25T08:34:17.756 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : lua-5.4.4-4.el9.x86_64 77/160 2026-02-25T08:34:17.756 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 78/160 2026-02-25T08:34:17.757 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 79/160 2026-02-25T08:34:17.757 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 80/160 2026-02-25T08:34:17.757 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 81/160 2026-02-25T08:34:17.757 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 82/160 2026-02-25T08:34:17.757 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-iniconfig-1.1.1-7.el9.noarch 83/160 2026-02-25T08:34:17.757 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 84/160 2026-02-25T08:34:17.757 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 85/160 2026-02-25T08:34:17.757 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 86/160 2026-02-25T08:34:17.757 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 87/160 2026-02-25T08:34:17.757 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 88/160 2026-02-25T08:34:17.757 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 89/160 2026-02-25T08:34:17.757 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 90/160 2026-02-25T08:34:17.757 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 91/160 2026-02-25T08:34:17.758 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-pluggy-0.13.1-7.el9.noarch 92/160 2026-02-25T08:34:17.758 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 93/160 2026-02-25T08:34:17.758 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-py-1.10.0-6.el9.noarch 94/160 2026-02-25T08:34:17.758 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 95/160 2026-02-25T08:34:17.758 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 96/160 2026-02-25T08:34:17.758 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-pytest-6.2.2-7.el9.noarch 97/160 2026-02-25T08:34:17.758 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 98/160 2026-02-25T08:34:17.758 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 99/160 2026-02-25T08:34:17.758 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 100/160 2026-02-25T08:34:17.758 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 101/160 2026-02-25T08:34:17.758 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 102/160 2026-02-25T08:34:17.758 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 103/160 2026-02-25T08:34:17.759 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 104/160 2026-02-25T08:34:17.759 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 105/160 2026-02-25T08:34:17.759 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 106/160 2026-02-25T08:34:17.759 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 107/160 2026-02-25T08:34:17.759 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 108/160 2026-02-25T08:34:17.759 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 109/160 2026-02-25T08:34:17.759 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 110/160 2026-02-25T08:34:17.759 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 111/160 2026-02-25T08:34:17.759 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 112/160 2026-02-25T08:34:17.759 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 113/160 2026-02-25T08:34:17.759 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 114/160 2026-02-25T08:34:17.759 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 115/160 2026-02-25T08:34:17.759 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 116/160 2026-02-25T08:34:17.760 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 117/160 2026-02-25T08:34:17.760 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 118/160 2026-02-25T08:34:17.760 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 119/160 2026-02-25T08:34:17.760 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 120/160 2026-02-25T08:34:17.760 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 121/160 2026-02-25T08:34:17.760 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 122/160 2026-02-25T08:34:17.760 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 123/160 2026-02-25T08:34:17.760 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 124/160 2026-02-25T08:34:17.760 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 125/160 2026-02-25T08:34:17.760 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 126/160 2026-02-25T08:34:17.760 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 127/160 2026-02-25T08:34:17.760 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 128/160 2026-02-25T08:34:17.760 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 129/160 2026-02-25T08:34:17.761 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 130/160 2026-02-25T08:34:17.761 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 131/160 2026-02-25T08:34:17.761 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 132/160 2026-02-25T08:34:17.761 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 133/160 2026-02-25T08:34:17.761 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 134/160 2026-02-25T08:34:17.761 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 135/160 2026-02-25T08:34:17.761 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 136/160 2026-02-25T08:34:17.761 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 137/160 2026-02-25T08:34:17.761 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 138/160 2026-02-25T08:34:17.761 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 139/160 2026-02-25T08:34:17.761 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 140/160 2026-02-25T08:34:17.761 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 141/160 2026-02-25T08:34:17.761 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 142/160 2026-02-25T08:34:17.762 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 143/160 2026-02-25T08:34:17.762 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 144/160 2026-02-25T08:34:17.762 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 145/160 2026-02-25T08:34:17.762 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 146/160 2026-02-25T08:34:17.762 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 147/160 2026-02-25T08:34:17.762 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 148/160 2026-02-25T08:34:17.762 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 149/160 2026-02-25T08:34:17.762 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 150/160 2026-02-25T08:34:17.762 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 151/160 2026-02-25T08:34:17.762 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 152/160 2026-02-25T08:34:17.762 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 153/160 2026-02-25T08:34:17.762 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : re2-1:20211101-20.el9.x86_64 154/160 2026-02-25T08:34:17.763 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 155/160 2026-02-25T08:34:17.763 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 156/160 2026-02-25T08:34:17.763 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : librados2-2:20.3.0-5338.g6aeb6975.el9.x86_64 157/160 2026-02-25T08:34:17.763 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 158/160 2026-02-25T08:34:17.763 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : librbd1-2:20.3.0-5338.g6aeb6975.el9.x86_64 159/160 2026-02-25T08:34:17.824 INFO:teuthology.orchestra.run.trial059.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 160/160 2026-02-25T08:34:17.824 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:34:17.824 INFO:teuthology.orchestra.run.trial059.stdout:Upgraded: 2026-02-25T08:34:17.825 INFO:teuthology.orchestra.run.trial059.stdout: librados2-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.825 INFO:teuthology.orchestra.run.trial059.stdout: librbd1-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.825 INFO:teuthology.orchestra.run.trial059.stdout:Installed: 2026-02-25T08:34:17.825 INFO:teuthology.orchestra.run.trial059.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-25T08:34:17.825 INFO:teuthology.orchestra.run.trial059.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-25T08:34:17.825 INFO:teuthology.orchestra.run.trial059.stdout: ceph-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.825 INFO:teuthology.orchestra.run.trial059.stdout: ceph-base-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.825 INFO:teuthology.orchestra.run.trial059.stdout: ceph-common-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.825 INFO:teuthology.orchestra.run.trial059.stdout: ceph-debugsource-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.825 INFO:teuthology.orchestra.run.trial059.stdout: ceph-fuse-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.826 INFO:teuthology.orchestra.run.trial059.stdout: ceph-grafana-dashboards-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:34:17.826 INFO:teuthology.orchestra.run.trial059.stdout: ceph-immutable-object-cache-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.826 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mds-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.826 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mgr-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.826 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mgr-cephadm-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:34:17.826 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mgr-dashboard-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:34:17.826 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:34:17.826 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mgr-k8sevents-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:34:17.826 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mgr-modules-core-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:34:17.826 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mgr-rook-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:34:17.826 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mon-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.826 INFO:teuthology.orchestra.run.trial059.stdout: ceph-osd-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.827 INFO:teuthology.orchestra.run.trial059.stdout: ceph-osd-classic-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.827 INFO:teuthology.orchestra.run.trial059.stdout: ceph-osd-crimson-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.827 INFO:teuthology.orchestra.run.trial059.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.827 INFO:teuthology.orchestra.run.trial059.stdout: ceph-prometheus-alerts-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:34:17.827 INFO:teuthology.orchestra.run.trial059.stdout: ceph-radosgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.827 INFO:teuthology.orchestra.run.trial059.stdout: ceph-selinux-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.827 INFO:teuthology.orchestra.run.trial059.stdout: ceph-test-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.827 INFO:teuthology.orchestra.run.trial059.stdout: ceph-volume-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:34:17.827 INFO:teuthology.orchestra.run.trial059.stdout: cephadm-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:34:17.827 INFO:teuthology.orchestra.run.trial059.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-25T08:34:17.827 INFO:teuthology.orchestra.run.trial059.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-25T08:34:17.827 INFO:teuthology.orchestra.run.trial059.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-25T08:34:17.828 INFO:teuthology.orchestra.run.trial059.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-25T08:34:17.828 INFO:teuthology.orchestra.run.trial059.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-25T08:34:17.828 INFO:teuthology.orchestra.run.trial059.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-25T08:34:17.828 INFO:teuthology.orchestra.run.trial059.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-25T08:34:17.828 INFO:teuthology.orchestra.run.trial059.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-25T08:34:17.828 INFO:teuthology.orchestra.run.trial059.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-25T08:34:17.828 INFO:teuthology.orchestra.run.trial059.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-25T08:34:17.828 INFO:teuthology.orchestra.run.trial059.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-25T08:34:17.828 INFO:teuthology.orchestra.run.trial059.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-25T08:34:17.828 INFO:teuthology.orchestra.run.trial059.stdout: libcephfs-daemon-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.828 INFO:teuthology.orchestra.run.trial059.stdout: libcephfs-devel-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.828 INFO:teuthology.orchestra.run.trial059.stdout: libcephfs-proxy2-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.828 INFO:teuthology.orchestra.run.trial059.stdout: libcephfs2-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.829 INFO:teuthology.orchestra.run.trial059.stdout: libcephsqlite-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.829 INFO:teuthology.orchestra.run.trial059.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-25T08:34:17.829 INFO:teuthology.orchestra.run.trial059.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-25T08:34:17.829 INFO:teuthology.orchestra.run.trial059.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-25T08:34:17.829 INFO:teuthology.orchestra.run.trial059.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-25T08:34:17.829 INFO:teuthology.orchestra.run.trial059.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-25T08:34:17.829 INFO:teuthology.orchestra.run.trial059.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-25T08:34:17.829 INFO:teuthology.orchestra.run.trial059.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-25T08:34:17.829 INFO:teuthology.orchestra.run.trial059.stdout: librados-devel-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.829 INFO:teuthology.orchestra.run.trial059.stdout: libradosstriper1-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.829 INFO:teuthology.orchestra.run.trial059.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-25T08:34:17.829 INFO:teuthology.orchestra.run.trial059.stdout: librgw2-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.829 INFO:teuthology.orchestra.run.trial059.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T08:34:17.830 INFO:teuthology.orchestra.run.trial059.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-25T08:34:17.830 INFO:teuthology.orchestra.run.trial059.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-25T08:34:17.830 INFO:teuthology.orchestra.run.trial059.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-25T08:34:17.830 INFO:teuthology.orchestra.run.trial059.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-25T08:34:17.830 INFO:teuthology.orchestra.run.trial059.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-25T08:34:17.830 INFO:teuthology.orchestra.run.trial059.stdout: lua-5.4.4-4.el9.x86_64 2026-02-25T08:34:17.830 INFO:teuthology.orchestra.run.trial059.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-25T08:34:17.830 INFO:teuthology.orchestra.run.trial059.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-25T08:34:17.830 INFO:teuthology.orchestra.run.trial059.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-25T08:34:17.830 INFO:teuthology.orchestra.run.trial059.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-25T08:34:17.830 INFO:teuthology.orchestra.run.trial059.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-25T08:34:17.830 INFO:teuthology.orchestra.run.trial059.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-25T08:34:17.831 INFO:teuthology.orchestra.run.trial059.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-25T08:34:17.831 INFO:teuthology.orchestra.run.trial059.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-25T08:34:17.831 INFO:teuthology.orchestra.run.trial059.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-25T08:34:17.831 INFO:teuthology.orchestra.run.trial059.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-25T08:34:17.831 INFO:teuthology.orchestra.run.trial059.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-25T08:34:17.831 INFO:teuthology.orchestra.run.trial059.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-25T08:34:17.831 INFO:teuthology.orchestra.run.trial059.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-25T08:34:17.831 INFO:teuthology.orchestra.run.trial059.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-25T08:34:17.831 INFO:teuthology.orchestra.run.trial059.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-25T08:34:17.831 INFO:teuthology.orchestra.run.trial059.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-25T08:34:17.831 INFO:teuthology.orchestra.run.trial059.stdout: python3-ceph-argparse-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.831 INFO:teuthology.orchestra.run.trial059.stdout: python3-ceph-common-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.831 INFO:teuthology.orchestra.run.trial059.stdout: python3-cephfs-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.832 INFO:teuthology.orchestra.run.trial059.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-25T08:34:17.832 INFO:teuthology.orchestra.run.trial059.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-25T08:34:17.832 INFO:teuthology.orchestra.run.trial059.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-25T08:34:17.832 INFO:teuthology.orchestra.run.trial059.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-25T08:34:17.832 INFO:teuthology.orchestra.run.trial059.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-25T08:34:17.832 INFO:teuthology.orchestra.run.trial059.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-25T08:34:17.832 INFO:teuthology.orchestra.run.trial059.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-25T08:34:17.832 INFO:teuthology.orchestra.run.trial059.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-25T08:34:17.832 INFO:teuthology.orchestra.run.trial059.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-25T08:34:17.832 INFO:teuthology.orchestra.run.trial059.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-25T08:34:17.832 INFO:teuthology.orchestra.run.trial059.stdout: python3-iniconfig-1.1.1-7.el9.noarch 2026-02-25T08:34:17.832 INFO:teuthology.orchestra.run.trial059.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-25T08:34:17.832 INFO:teuthology.orchestra.run.trial059.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-25T08:34:17.833 INFO:teuthology.orchestra.run.trial059.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-25T08:34:17.833 INFO:teuthology.orchestra.run.trial059.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-25T08:34:17.833 INFO:teuthology.orchestra.run.trial059.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-25T08:34:17.833 INFO:teuthology.orchestra.run.trial059.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-25T08:34:17.833 INFO:teuthology.orchestra.run.trial059.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-25T08:34:17.833 INFO:teuthology.orchestra.run.trial059.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-25T08:34:17.833 INFO:teuthology.orchestra.run.trial059.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-25T08:34:17.833 INFO:teuthology.orchestra.run.trial059.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-25T08:34:17.833 INFO:teuthology.orchestra.run.trial059.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T08:34:17.833 INFO:teuthology.orchestra.run.trial059.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-25T08:34:17.833 INFO:teuthology.orchestra.run.trial059.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-25T08:34:17.833 INFO:teuthology.orchestra.run.trial059.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-25T08:34:17.834 INFO:teuthology.orchestra.run.trial059.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-25T08:34:17.834 INFO:teuthology.orchestra.run.trial059.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-25T08:34:17.834 INFO:teuthology.orchestra.run.trial059.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-25T08:34:17.834 INFO:teuthology.orchestra.run.trial059.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-25T08:34:17.834 INFO:teuthology.orchestra.run.trial059.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-25T08:34:17.834 INFO:teuthology.orchestra.run.trial059.stdout: python3-pluggy-0.13.1-7.el9.noarch 2026-02-25T08:34:17.834 INFO:teuthology.orchestra.run.trial059.stdout: python3-ply-3.11-14.el9.noarch 2026-02-25T08:34:17.834 INFO:teuthology.orchestra.run.trial059.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-25T08:34:17.834 INFO:teuthology.orchestra.run.trial059.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-25T08:34:17.834 INFO:teuthology.orchestra.run.trial059.stdout: python3-py-1.10.0-6.el9.noarch 2026-02-25T08:34:17.834 INFO:teuthology.orchestra.run.trial059.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-25T08:34:17.834 INFO:teuthology.orchestra.run.trial059.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-25T08:34:17.834 INFO:teuthology.orchestra.run.trial059.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-25T08:34:17.835 INFO:teuthology.orchestra.run.trial059.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-25T08:34:17.835 INFO:teuthology.orchestra.run.trial059.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-25T08:34:17.835 INFO:teuthology.orchestra.run.trial059.stdout: python3-pytest-6.2.2-7.el9.noarch 2026-02-25T08:34:17.835 INFO:teuthology.orchestra.run.trial059.stdout: python3-rados-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.835 INFO:teuthology.orchestra.run.trial059.stdout: python3-rbd-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.835 INFO:teuthology.orchestra.run.trial059.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-25T08:34:17.835 INFO:teuthology.orchestra.run.trial059.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-25T08:34:17.835 INFO:teuthology.orchestra.run.trial059.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-25T08:34:17.835 INFO:teuthology.orchestra.run.trial059.stdout: python3-rgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.835 INFO:teuthology.orchestra.run.trial059.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-25T08:34:17.835 INFO:teuthology.orchestra.run.trial059.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-25T08:34:17.835 INFO:teuthology.orchestra.run.trial059.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-25T08:34:17.835 INFO:teuthology.orchestra.run.trial059.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-25T08:34:17.836 INFO:teuthology.orchestra.run.trial059.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-25T08:34:17.836 INFO:teuthology.orchestra.run.trial059.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-25T08:34:17.836 INFO:teuthology.orchestra.run.trial059.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-25T08:34:17.836 INFO:teuthology.orchestra.run.trial059.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-25T08:34:17.836 INFO:teuthology.orchestra.run.trial059.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-25T08:34:17.836 INFO:teuthology.orchestra.run.trial059.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-25T08:34:17.836 INFO:teuthology.orchestra.run.trial059.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-25T08:34:17.836 INFO:teuthology.orchestra.run.trial059.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-25T08:34:17.836 INFO:teuthology.orchestra.run.trial059.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-25T08:34:17.836 INFO:teuthology.orchestra.run.trial059.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-25T08:34:17.836 INFO:teuthology.orchestra.run.trial059.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-25T08:34:17.836 INFO:teuthology.orchestra.run.trial059.stdout: rbd-fuse-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.836 INFO:teuthology.orchestra.run.trial059.stdout: rbd-mirror-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.837 INFO:teuthology.orchestra.run.trial059.stdout: rbd-nbd-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:34:17.837 INFO:teuthology.orchestra.run.trial059.stdout: re2-1:20211101-20.el9.x86_64 2026-02-25T08:34:17.837 INFO:teuthology.orchestra.run.trial059.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-25T08:34:17.837 INFO:teuthology.orchestra.run.trial059.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-25T08:34:17.837 INFO:teuthology.orchestra.run.trial059.stdout: unzip-6.0-59.el9.x86_64 2026-02-25T08:34:17.837 INFO:teuthology.orchestra.run.trial059.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-25T08:34:17.837 INFO:teuthology.orchestra.run.trial059.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-25T08:34:17.837 INFO:teuthology.orchestra.run.trial059.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-25T08:34:17.837 INFO:teuthology.orchestra.run.trial059.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-25T08:34:17.837 INFO:teuthology.orchestra.run.trial059.stdout: zip-3.0-35.el9.x86_64 2026-02-25T08:34:17.837 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:34:17.837 INFO:teuthology.orchestra.run.trial059.stdout:Complete! 2026-02-25T08:34:17.980 DEBUG:teuthology.parallel:result is None 2026-02-25T08:36:52.509 INFO:teuthology.orchestra.run.trial009.stdout:(158/158): ceph-osd-crimson-debuginfo-20.3.0-53 321 kB/s | 433 MB 22:59 2026-02-25T08:36:52.511 INFO:teuthology.orchestra.run.trial009.stdout:-------------------------------------------------------------------------------- 2026-02-25T08:36:52.511 INFO:teuthology.orchestra.run.trial009.stdout:Total 612 kB/s | 868 MB 24:13 2026-02-25T08:36:53.065 INFO:teuthology.orchestra.run.trial009.stdout:Running transaction check 2026-02-25T08:36:53.118 INFO:teuthology.orchestra.run.trial009.stdout:Transaction check succeeded. 2026-02-25T08:36:53.118 INFO:teuthology.orchestra.run.trial009.stdout:Running transaction test 2026-02-25T08:36:55.880 INFO:teuthology.orchestra.run.trial009.stdout:Transaction test succeeded. 2026-02-25T08:36:55.881 INFO:teuthology.orchestra.run.trial009.stdout:Running transaction 2026-02-25T08:36:58.719 INFO:teuthology.orchestra.run.trial009.stdout: Preparing : 1/1 2026-02-25T08:36:58.722 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/160 2026-02-25T08:36:58.730 INFO:teuthology.orchestra.run.trial009.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/160 2026-02-25T08:36:58.741 INFO:teuthology.orchestra.run.trial009.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/160 2026-02-25T08:36:58.888 INFO:teuthology.orchestra.run.trial009.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/160 2026-02-25T08:36:58.889 INFO:teuthology.orchestra.run.trial009.stdout: Upgrading : librados2-2:20.3.0-5338.g6aeb6975.el9.x86_64 5/160 2026-02-25T08:36:58.938 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: librados2-2:20.3.0-5338.g6aeb6975.el9.x86_64 5/160 2026-02-25T08:36:58.939 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libcephfs2-2:20.3.0-5338.g6aeb6975.el9.x86_64 6/160 2026-02-25T08:36:58.952 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: libcephfs2-2:20.3.0-5338.g6aeb6975.el9.x86_64 6/160 2026-02-25T08:36:58.954 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libcephfs-daemon-2:20.3.0-5338.g6aeb6975.el9.x86 7/160 2026-02-25T08:36:58.954 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libcephfs-proxy2-2:20.3.0-5338.g6aeb6975.el9.x86 8/160 2026-02-25T08:36:58.982 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5338.g6aeb6975.el9.x86 8/160 2026-02-25T08:36:58.988 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-rados-2:20.3.0-5338.g6aeb6975.el9.x86_64 9/160 2026-02-25T08:36:58.996 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 10/160 2026-02-25T08:36:58.998 INFO:teuthology.orchestra.run.trial009.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 11/160 2026-02-25T08:36:59.001 INFO:teuthology.orchestra.run.trial009.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 12/160 2026-02-25T08:36:59.003 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 13/160 2026-02-25T08:36:59.008 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 14/160 2026-02-25T08:36:59.124 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 15/160 2026-02-25T08:36:59.125 INFO:teuthology.orchestra.run.trial009.stdout: Upgrading : librbd1-2:20.3.0-5338.g6aeb6975.el9.x86_64 16/160 2026-02-25T08:36:59.167 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: librbd1-2:20.3.0-5338.g6aeb6975.el9.x86_64 16/160 2026-02-25T08:36:59.172 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 17/160 2026-02-25T08:36:59.180 INFO:teuthology.orchestra.run.trial009.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 18/160 2026-02-25T08:36:59.181 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libcephsqlite-2:20.3.0-5338.g6aeb6975.el9.x86_64 19/160 2026-02-25T08:36:59.203 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5338.g6aeb6975.el9.x86_64 19/160 2026-02-25T08:36:59.204 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libradosstriper1-2:20.3.0-5338.g6aeb6975.el9.x86 20/160 2026-02-25T08:36:59.216 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5338.g6aeb6975.el9.x86 20/160 2026-02-25T08:36:59.220 INFO:teuthology.orchestra.run.trial009.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 21/160 2026-02-25T08:36:59.253 INFO:teuthology.orchestra.run.trial009.stdout: Installing : re2-1:20211101-20.el9.x86_64 22/160 2026-02-25T08:36:59.258 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 23/160 2026-02-25T08:36:59.262 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 24/160 2026-02-25T08:36:59.283 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 25/160 2026-02-25T08:36:59.289 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 26/160 2026-02-25T08:36:59.291 INFO:teuthology.orchestra.run.trial009.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/160 2026-02-25T08:36:59.296 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 28/160 2026-02-25T08:36:59.296 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 29/160 2026-02-25T08:36:59.307 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 29/160 2026-02-25T08:36:59.312 INFO:teuthology.orchestra.run.trial009.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 30/160 2026-02-25T08:36:59.335 INFO:teuthology.orchestra.run.trial009.stdout: Installing : unzip-6.0-59.el9.x86_64 31/160 2026-02-25T08:36:59.348 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 32/160 2026-02-25T08:36:59.354 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 33/160 2026-02-25T08:36:59.357 INFO:teuthology.orchestra.run.trial009.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 34/160 2026-02-25T08:36:59.363 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 35/160 2026-02-25T08:36:59.364 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 36/160 2026-02-25T08:36:59.366 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 37/160 2026-02-25T08:36:59.375 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 38/160 2026-02-25T08:36:59.409 INFO:teuthology.orchestra.run.trial009.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 39/160 2026-02-25T08:36:59.414 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-ceph-common-2:20.3.0-5338.g6aeb6975.el9. 40/160 2026-02-25T08:36:59.425 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-ceph-argparse-2:20.3.0-5338.g6aeb6975.el 41/160 2026-02-25T08:36:59.436 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-cephfs-2:20.3.0-5338.g6aeb6975.el9.x86_6 42/160 2026-02-25T08:36:59.443 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 43/160 2026-02-25T08:36:59.467 INFO:teuthology.orchestra.run.trial009.stdout: Installing : zip-3.0-35.el9.x86_64 44/160 2026-02-25T08:36:59.470 INFO:teuthology.orchestra.run.trial009.stdout: Installing : luarocks-3.9.2-5.el9.noarch 45/160 2026-02-25T08:36:59.520 INFO:teuthology.orchestra.run.trial009.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 46/160 2026-02-25T08:36:59.533 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 47/160 2026-02-25T08:36:59.540 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/160 2026-02-25T08:36:59.543 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/160 2026-02-25T08:36:59.545 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/160 2026-02-25T08:36:59.550 INFO:teuthology.orchestra.run.trial009.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 51/160 2026-02-25T08:36:59.566 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 52/160 2026-02-25T08:36:59.571 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-rbd-2:20.3.0-5338.g6aeb6975.el9.x86_64 53/160 2026-02-25T08:36:59.575 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/160 2026-02-25T08:36:59.582 INFO:teuthology.orchestra.run.trial009.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 55/160 2026-02-25T08:36:59.591 INFO:teuthology.orchestra.run.trial009.stdout: Installing : librados-devel-2:20.3.0-5338.g6aeb6975.el9.x86_6 56/160 2026-02-25T08:36:59.602 INFO:teuthology.orchestra.run.trial009.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 57/160 2026-02-25T08:36:59.607 INFO:teuthology.orchestra.run.trial009.stdout: Installing : thrift-0.15.0-4.el9.x86_64 58/160 2026-02-25T08:36:59.610 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 59/160 2026-02-25T08:36:59.625 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 60/160 2026-02-25T08:36:59.629 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 61/160 2026-02-25T08:36:59.634 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 62/160 2026-02-25T08:36:59.645 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 63/160 2026-02-25T08:36:59.654 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 64/160 2026-02-25T08:36:59.661 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 65/160 2026-02-25T08:36:59.680 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 66/160 2026-02-25T08:36:59.691 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 67/160 2026-02-25T08:36:59.707 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 68/160 2026-02-25T08:36:59.711 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 69/160 2026-02-25T08:36:59.719 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/160 2026-02-25T08:36:59.759 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/160 2026-02-25T08:37:00.082 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/160 2026-02-25T08:37:00.091 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/160 2026-02-25T08:37:00.095 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/160 2026-02-25T08:37:00.101 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/160 2026-02-25T08:37:00.107 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/160 2026-02-25T08:37:00.111 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 77/160 2026-02-25T08:37:00.113 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/160 2026-02-25T08:37:00.119 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 79/160 2026-02-25T08:37:00.122 INFO:teuthology.orchestra.run.trial009.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 80/160 2026-02-25T08:37:00.123 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 81/160 2026-02-25T08:37:00.152 INFO:teuthology.orchestra.run.trial009.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 82/160 2026-02-25T08:37:00.194 INFO:teuthology.orchestra.run.trial009.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 83/160 2026-02-25T08:37:00.204 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 84/160 2026-02-25T08:37:00.250 INFO:teuthology.orchestra.run.trial009.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 85/160 2026-02-25T08:37:00.279 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-py-1.10.0-6.el9.noarch 86/160 2026-02-25T08:37:00.289 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 87/160 2026-02-25T08:37:00.296 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 88/160 2026-02-25T08:37:00.301 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-pluggy-0.13.1-7.el9.noarch 89/160 2026-02-25T08:37:00.308 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 90/160 2026-02-25T08:37:00.312 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 91/160 2026-02-25T08:37:00.346 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-iniconfig-1.1.1-7.el9.noarch 92/160 2026-02-25T08:37:00.569 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 93/160 2026-02-25T08:37:00.593 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 94/160 2026-02-25T08:37:00.596 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 95/160 2026-02-25T08:37:00.654 INFO:teuthology.orchestra.run.trial009.stdout: Installing : openblas-0.3.29-1.el9.x86_64 96/160 2026-02-25T08:37:00.656 INFO:teuthology.orchestra.run.trial009.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 97/160 2026-02-25T08:37:00.677 INFO:teuthology.orchestra.run.trial009.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 98/160 2026-02-25T08:37:01.001 INFO:teuthology.orchestra.run.trial009.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 99/160 2026-02-25T08:37:01.073 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 100/160 2026-02-25T08:37:01.745 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 101/160 2026-02-25T08:37:01.759 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 102/160 2026-02-25T08:37:01.765 INFO:teuthology.orchestra.run.trial009.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 103/160 2026-02-25T08:37:02.017 INFO:teuthology.orchestra.run.trial009.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 104/160 2026-02-25T08:37:02.018 INFO:teuthology.orchestra.run.trial009.stdout: Installing : librgw2-2:20.3.0-5338.g6aeb6975.el9.x86_64 105/160 2026-02-25T08:37:02.036 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: librgw2-2:20.3.0-5338.g6aeb6975.el9.x86_64 105/160 2026-02-25T08:37:02.037 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-rgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 106/160 2026-02-25T08:37:02.990 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-common-2:20.3.0-5338.g6aeb6975.el9.x86_64 107/160 2026-02-25T08:37:02.992 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-common-2:20.3.0-5338.g6aeb6975.el9.x86_64 107/160 2026-02-25T08:37:03.010 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-common-2:20.3.0-5338.g6aeb6975.el9.x86_64 107/160 2026-02-25T08:37:03.020 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 108/160 2026-02-25T08:37:03.026 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-packaging-20.9-5.el9.noarch 109/160 2026-02-25T08:37:03.040 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-ply-3.11-14.el9.noarch 110/160 2026-02-25T08:37:03.056 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 111/160 2026-02-25T08:37:03.131 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 112/160 2026-02-25T08:37:03.140 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 113/160 2026-02-25T08:37:03.163 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 114/160 2026-02-25T08:37:03.193 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 115/160 2026-02-25T08:37:03.243 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 116/160 2026-02-25T08:37:03.249 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 117/160 2026-02-25T08:37:03.253 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 118/160 2026-02-25T08:37:03.258 INFO:teuthology.orchestra.run.trial009.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 119/160 2026-02-25T08:37:03.261 INFO:teuthology.orchestra.run.trial009.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 120/160 2026-02-25T08:37:03.261 INFO:teuthology.orchestra.run.trial009.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 121/160 2026-02-25T08:37:03.278 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 121/160 2026-02-25T08:37:03.393 INFO:teuthology.orchestra.run.trial009.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 122/160 2026-02-25T08:37:03.395 INFO:teuthology.orchestra.run.trial009.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 123/160 2026-02-25T08:37:03.675 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 123/160 2026-02-25T08:37:03.676 INFO:teuthology.orchestra.run.trial009.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-25T08:37:03.676 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:37:03.935 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-base-2:20.3.0-5338.g6aeb6975.el9.x86_64 124/160 2026-02-25T08:37:03.977 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-base-2:20.3.0-5338.g6aeb6975.el9.x86_64 124/160 2026-02-25T08:37:03.978 INFO:teuthology.orchestra.run.trial009.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-25T08:37:03.978 INFO:teuthology.orchestra.run.trial009.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-25T08:37:03.978 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:37:03.981 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-selinux-2:20.3.0-5338.g6aeb6975.el9.x86_64 125/160 2026-02-25T08:37:08.696 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5338.g6aeb6975.el9.x86_64 125/160 2026-02-25T08:37:08.697 INFO:teuthology.orchestra.run.trial009.stdout:skipping the directory /sys 2026-02-25T08:37:08.697 INFO:teuthology.orchestra.run.trial009.stdout:skipping the directory /proc 2026-02-25T08:37:08.697 INFO:teuthology.orchestra.run.trial009.stdout:skipping the directory /mnt 2026-02-25T08:37:08.697 INFO:teuthology.orchestra.run.trial009.stdout:skipping the directory /var/tmp 2026-02-25T08:37:08.697 INFO:teuthology.orchestra.run.trial009.stdout:skipping the directory /home 2026-02-25T08:37:08.697 INFO:teuthology.orchestra.run.trial009.stdout:skipping the directory /root 2026-02-25T08:37:08.697 INFO:teuthology.orchestra.run.trial009.stdout:skipping the directory /tmp 2026-02-25T08:37:08.697 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:37:08.785 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-mds-2:20.3.0-5338.g6aeb6975.el9.x86_64 126/160 2026-02-25T08:37:08.808 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-mds-2:20.3.0-5338.g6aeb6975.el9.x86_64 126/160 2026-02-25T08:37:08.808 INFO:teuthology.orchestra.run.trial009.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T08:37:08.808 INFO:teuthology.orchestra.run.trial009.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-25T08:37:08.808 INFO:teuthology.orchestra.run.trial009.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T08:37:08.808 INFO:teuthology.orchestra.run.trial009.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T08:37:08.808 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:37:09.019 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-mon-2:20.3.0-5338.g6aeb6975.el9.x86_64 127/160 2026-02-25T08:37:09.040 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-mon-2:20.3.0-5338.g6aeb6975.el9.x86_64 127/160 2026-02-25T08:37:09.041 INFO:teuthology.orchestra.run.trial009.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T08:37:09.041 INFO:teuthology.orchestra.run.trial009.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-25T08:37:09.041 INFO:teuthology.orchestra.run.trial009.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T08:37:09.041 INFO:teuthology.orchestra.run.trial009.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T08:37:09.041 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:37:09.047 INFO:teuthology.orchestra.run.trial009.stdout: Installing : mailcap-2.1.49-5.el9.noarch 128/160 2026-02-25T08:37:09.049 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 129/160 2026-02-25T08:37:09.067 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 130/160 2026-02-25T08:37:09.067 INFO:teuthology.orchestra.run.trial009.stdout:Creating group 'qat' with GID 992. 2026-02-25T08:37:09.067 INFO:teuthology.orchestra.run.trial009.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-25T08:37:09.067 INFO:teuthology.orchestra.run.trial009.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-25T08:37:09.067 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:37:09.076 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 130/160 2026-02-25T08:37:09.100 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 130/160 2026-02-25T08:37:09.100 INFO:teuthology.orchestra.run.trial009.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-25T08:37:09.100 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:37:09.136 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 131/160 2026-02-25T08:37:09.735 INFO:teuthology.orchestra.run.trial009.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 132/160 2026-02-25T08:37:15.241 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-osd-classic-2:20.3.0-5338.g6aeb6975.el9.x86 133/160 2026-02-25T08:37:15.305 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-osd-crimson-2:20.3.0-5338.g6aeb6975.el9.x86 134/160 2026-02-25T08:37:15.307 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-volume-2:20.3.0-5338.g6aeb6975.el9.noarch 135/160 2026-02-25T08:37:15.321 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-volume-2:20.3.0-5338.g6aeb6975.el9.noarch 135/160 2026-02-25T08:37:15.321 INFO:teuthology.orchestra.run.trial009.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T08:37:15.321 INFO:teuthology.orchestra.run.trial009.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-25T08:37:15.322 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:37:15.332 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-osd-2:20.3.0-5338.g6aeb6975.el9.x86_64 136/160 2026-02-25T08:37:15.355 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-osd-2:20.3.0-5338.g6aeb6975.el9.x86_64 136/160 2026-02-25T08:37:15.356 INFO:teuthology.orchestra.run.trial009.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T08:37:15.356 INFO:teuthology.orchestra.run.trial009.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-25T08:37:15.356 INFO:teuthology.orchestra.run.trial009.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T08:37:15.356 INFO:teuthology.orchestra.run.trial009.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T08:37:15.356 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:37:15.413 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: cephadm-2:20.3.0-5338.g6aeb6975.el9.noarch 137/160 2026-02-25T08:37:15.415 INFO:teuthology.orchestra.run.trial009.stdout: Installing : cephadm-2:20.3.0-5338.g6aeb6975.el9.noarch 137/160 2026-02-25T08:37:15.424 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5338.g6aeb6975.e 138/160 2026-02-25T08:37:15.448 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5338.g6aeb6975. 139/160 2026-02-25T08:37:15.449 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5338.g6aeb6975.el9.noa 140/160 2026-02-25T08:37:18.377 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5338.g6aeb6975.el9.noa 140/160 2026-02-25T08:37:18.384 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5338.g6aeb6975.el9.n 141/160 2026-02-25T08:37:18.841 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5338.g6aeb6975.el9.n 141/160 2026-02-25T08:37:18.842 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5338.g6ae 142/160 2026-02-25T08:37:18.853 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5338.g6ae 142/160 2026-02-25T08:37:18.854 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5338.g6aeb6975.el9.n 143/160 2026-02-25T08:37:18.916 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5338.g6aeb6975.el9.n 143/160 2026-02-25T08:37:18.956 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5338.g6aeb6975.el 144/160 2026-02-25T08:37:18.958 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-mgr-2:20.3.0-5338.g6aeb6975.el9.x86_64 145/160 2026-02-25T08:37:18.979 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5338.g6aeb6975.el9.x86_64 145/160 2026-02-25T08:37:18.979 INFO:teuthology.orchestra.run.trial009.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T08:37:18.979 INFO:teuthology.orchestra.run.trial009.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-25T08:37:18.979 INFO:teuthology.orchestra.run.trial009.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T08:37:18.979 INFO:teuthology.orchestra.run.trial009.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T08:37:18.979 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:37:18.990 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-mgr-rook-2:20.3.0-5338.g6aeb6975.el9.noarch 146/160 2026-02-25T08:37:21.229 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5338.g6aeb6975.el9.noarch 146/160 2026-02-25T08:37:43.932 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-debugsource-2:20.3.0-5338.g6aeb6975.el9.x86 147/160 2026-02-25T08:37:43.933 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5338.g6aeb69 148/160 2026-02-25T08:37:44.427 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-2:20.3.0-5338.g6aeb6975.el9.x86_64 149/160 2026-02-25T08:37:44.444 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-radosgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 150/160 2026-02-25T08:37:44.465 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 150/160 2026-02-25T08:37:44.465 INFO:teuthology.orchestra.run.trial009.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T08:37:44.465 INFO:teuthology.orchestra.run.trial009.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-25T08:37:44.465 INFO:teuthology.orchestra.run.trial009.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T08:37:44.465 INFO:teuthology.orchestra.run.trial009.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T08:37:44.466 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:37:44.505 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5338.g6aeb6 151/160 2026-02-25T08:37:44.525 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5338.g6aeb6 151/160 2026-02-25T08:37:44.526 INFO:teuthology.orchestra.run.trial009.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T08:37:44.526 INFO:teuthology.orchestra.run.trial009.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-25T08:37:44.526 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:37:44.714 INFO:teuthology.orchestra.run.trial009.stdout: Installing : rbd-mirror-2:20.3.0-5338.g6aeb6975.el9.x86_64 152/160 2026-02-25T08:37:44.734 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5338.g6aeb6975.el9.x86_64 152/160 2026-02-25T08:37:44.735 INFO:teuthology.orchestra.run.trial009.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T08:37:44.735 INFO:teuthology.orchestra.run.trial009.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-25T08:37:44.735 INFO:teuthology.orchestra.run.trial009.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T08:37:44.735 INFO:teuthology.orchestra.run.trial009.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T08:37:44.735 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:37:51.826 INFO:teuthology.orchestra.run.trial009.stdout: Installing : python3-pytest-6.2.2-7.el9.noarch 153/160 2026-02-25T08:37:51.834 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-test-2:20.3.0-5338.g6aeb6975.el9.x86_64 154/160 2026-02-25T08:37:51.839 INFO:teuthology.orchestra.run.trial009.stdout: Installing : libcephfs-devel-2:20.3.0-5338.g6aeb6975.el9.x86_ 155/160 2026-02-25T08:37:51.848 INFO:teuthology.orchestra.run.trial009.stdout: Installing : rbd-fuse-2:20.3.0-5338.g6aeb6975.el9.x86_64 156/160 2026-02-25T08:37:51.889 INFO:teuthology.orchestra.run.trial009.stdout: Installing : rbd-nbd-2:20.3.0-5338.g6aeb6975.el9.x86_64 157/160 2026-02-25T08:37:51.892 INFO:teuthology.orchestra.run.trial009.stdout: Installing : ceph-fuse-2:20.3.0-5338.g6aeb6975.el9.x86_64 158/160 2026-02-25T08:37:51.892 INFO:teuthology.orchestra.run.trial009.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/160 2026-02-25T08:37:51.905 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/160 2026-02-25T08:37:51.905 INFO:teuthology.orchestra.run.trial009.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/160 2026-02-25T08:37:51.916 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2026-02-25T08:37:51.923 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5338.g6aeb6975.el9.x86 160/160 2026-02-25T08:37:51.948 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5338.g6aeb6975.el9.x86 160/160 2026-02-25T08:37:55.006 INFO:teuthology.orchestra.run.trial009.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2026-02-25T08:37:55.006 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-2:20.3.0-5338.g6aeb6975.el9.x86_64 1/160 2026-02-25T08:37:55.006 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-base-2:20.3.0-5338.g6aeb6975.el9.x86_64 2/160 2026-02-25T08:37:55.006 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-common-2:20.3.0-5338.g6aeb6975.el9.x86_64 3/160 2026-02-25T08:37:55.006 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-debugsource-2:20.3.0-5338.g6aeb6975.el9.x86 4/160 2026-02-25T08:37:55.006 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-fuse-2:20.3.0-5338.g6aeb6975.el9.x86_64 5/160 2026-02-25T08:37:55.006 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5338.g6aeb6 6/160 2026-02-25T08:37:55.006 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-mds-2:20.3.0-5338.g6aeb6975.el9.x86_64 7/160 2026-02-25T08:37:55.007 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-mgr-2:20.3.0-5338.g6aeb6975.el9.x86_64 8/160 2026-02-25T08:37:55.007 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-mon-2:20.3.0-5338.g6aeb6975.el9.x86_64 9/160 2026-02-25T08:37:55.007 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-osd-2:20.3.0-5338.g6aeb6975.el9.x86_64 10/160 2026-02-25T08:37:55.007 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-osd-classic-2:20.3.0-5338.g6aeb6975.el9.x86 11/160 2026-02-25T08:37:55.007 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5338.g6aeb6975.el9.x86 12/160 2026-02-25T08:37:55.007 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5338.g6aeb69 13/160 2026-02-25T08:37:55.007 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-radosgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 14/160 2026-02-25T08:37:55.007 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-selinux-2:20.3.0-5338.g6aeb6975.el9.x86_64 15/160 2026-02-25T08:37:55.007 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-test-2:20.3.0-5338.g6aeb6975.el9.x86_64 16/160 2026-02-25T08:37:55.007 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libcephfs-daemon-2:20.3.0-5338.g6aeb6975.el9.x86 17/160 2026-02-25T08:37:55.007 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libcephfs-devel-2:20.3.0-5338.g6aeb6975.el9.x86_ 18/160 2026-02-25T08:37:55.007 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5338.g6aeb6975.el9.x86 19/160 2026-02-25T08:37:55.008 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libcephfs2-2:20.3.0-5338.g6aeb6975.el9.x86_64 20/160 2026-02-25T08:37:55.008 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libcephsqlite-2:20.3.0-5338.g6aeb6975.el9.x86_64 21/160 2026-02-25T08:37:55.008 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : librados-devel-2:20.3.0-5338.g6aeb6975.el9.x86_6 22/160 2026-02-25T08:37:55.008 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libradosstriper1-2:20.3.0-5338.g6aeb6975.el9.x86 23/160 2026-02-25T08:37:55.008 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : librgw2-2:20.3.0-5338.g6aeb6975.el9.x86_64 24/160 2026-02-25T08:37:55.008 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5338.g6aeb6975.el 25/160 2026-02-25T08:37:55.008 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-ceph-common-2:20.3.0-5338.g6aeb6975.el9. 26/160 2026-02-25T08:37:55.008 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-cephfs-2:20.3.0-5338.g6aeb6975.el9.x86_6 27/160 2026-02-25T08:37:55.008 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-rados-2:20.3.0-5338.g6aeb6975.el9.x86_64 28/160 2026-02-25T08:37:55.008 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-rbd-2:20.3.0-5338.g6aeb6975.el9.x86_64 29/160 2026-02-25T08:37:55.008 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-rgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 30/160 2026-02-25T08:37:55.008 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : rbd-fuse-2:20.3.0-5338.g6aeb6975.el9.x86_64 31/160 2026-02-25T08:37:55.009 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : rbd-mirror-2:20.3.0-5338.g6aeb6975.el9.x86_64 32/160 2026-02-25T08:37:55.009 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : rbd-nbd-2:20.3.0-5338.g6aeb6975.el9.x86_64 33/160 2026-02-25T08:37:55.009 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5338.g6aeb6975. 34/160 2026-02-25T08:37:55.009 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5338.g6aeb6975.el9.noa 35/160 2026-02-25T08:37:55.009 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5338.g6aeb6975.el9.n 36/160 2026-02-25T08:37:55.009 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5338.g6ae 37/160 2026-02-25T08:37:55.009 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5338.g6aeb6975.el9.n 38/160 2026-02-25T08:37:55.009 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5338.g6aeb6975.el 39/160 2026-02-25T08:37:55.009 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5338.g6aeb6975.el9.noarch 40/160 2026-02-25T08:37:55.009 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5338.g6aeb6975.e 41/160 2026-02-25T08:37:55.009 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ceph-volume-2:20.3.0-5338.g6aeb6975.el9.noarch 42/160 2026-02-25T08:37:55.009 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : cephadm-2:20.3.0-5338.g6aeb6975.el9.noarch 43/160 2026-02-25T08:37:55.010 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 44/160 2026-02-25T08:37:55.010 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 45/160 2026-02-25T08:37:55.010 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 46/160 2026-02-25T08:37:55.010 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 47/160 2026-02-25T08:37:55.010 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 48/160 2026-02-25T08:37:55.010 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 49/160 2026-02-25T08:37:55.010 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 50/160 2026-02-25T08:37:55.010 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 51/160 2026-02-25T08:37:55.010 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 52/160 2026-02-25T08:37:55.010 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 53/160 2026-02-25T08:37:55.010 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 54/160 2026-02-25T08:37:55.010 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 55/160 2026-02-25T08:37:55.010 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 56/160 2026-02-25T08:37:55.011 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-ply-3.11-14.el9.noarch 57/160 2026-02-25T08:37:55.011 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 58/160 2026-02-25T08:37:55.011 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 59/160 2026-02-25T08:37:55.011 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 60/160 2026-02-25T08:37:55.011 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 61/160 2026-02-25T08:37:55.011 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : unzip-6.0-59.el9.x86_64 62/160 2026-02-25T08:37:55.011 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : zip-3.0-35.el9.x86_64 63/160 2026-02-25T08:37:55.011 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 64/160 2026-02-25T08:37:55.011 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 65/160 2026-02-25T08:37:55.011 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 66/160 2026-02-25T08:37:55.011 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 67/160 2026-02-25T08:37:55.011 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 68/160 2026-02-25T08:37:55.011 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 69/160 2026-02-25T08:37:55.012 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 70/160 2026-02-25T08:37:55.012 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 71/160 2026-02-25T08:37:55.012 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 72/160 2026-02-25T08:37:55.012 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 73/160 2026-02-25T08:37:55.012 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 74/160 2026-02-25T08:37:55.012 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 75/160 2026-02-25T08:37:55.012 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 76/160 2026-02-25T08:37:55.012 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : lua-5.4.4-4.el9.x86_64 77/160 2026-02-25T08:37:55.012 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 78/160 2026-02-25T08:37:55.012 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 79/160 2026-02-25T08:37:55.012 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 80/160 2026-02-25T08:37:55.012 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 81/160 2026-02-25T08:37:55.012 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 82/160 2026-02-25T08:37:55.013 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-iniconfig-1.1.1-7.el9.noarch 83/160 2026-02-25T08:37:55.013 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 84/160 2026-02-25T08:37:55.013 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 85/160 2026-02-25T08:37:55.013 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 86/160 2026-02-25T08:37:55.013 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 87/160 2026-02-25T08:37:55.013 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 88/160 2026-02-25T08:37:55.013 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 89/160 2026-02-25T08:37:55.013 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 90/160 2026-02-25T08:37:55.013 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 91/160 2026-02-25T08:37:55.013 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-pluggy-0.13.1-7.el9.noarch 92/160 2026-02-25T08:37:55.013 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 93/160 2026-02-25T08:37:55.013 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-py-1.10.0-6.el9.noarch 94/160 2026-02-25T08:37:55.013 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 95/160 2026-02-25T08:37:55.014 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 96/160 2026-02-25T08:37:55.014 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-pytest-6.2.2-7.el9.noarch 97/160 2026-02-25T08:37:55.014 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 98/160 2026-02-25T08:37:55.014 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 99/160 2026-02-25T08:37:55.014 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 100/160 2026-02-25T08:37:55.014 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 101/160 2026-02-25T08:37:55.014 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 102/160 2026-02-25T08:37:55.014 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 103/160 2026-02-25T08:37:55.014 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 104/160 2026-02-25T08:37:55.014 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 105/160 2026-02-25T08:37:55.014 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 106/160 2026-02-25T08:37:55.014 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 107/160 2026-02-25T08:37:55.015 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 108/160 2026-02-25T08:37:55.015 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 109/160 2026-02-25T08:37:55.015 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 110/160 2026-02-25T08:37:55.015 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 111/160 2026-02-25T08:37:55.015 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 112/160 2026-02-25T08:37:55.015 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 113/160 2026-02-25T08:37:55.015 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 114/160 2026-02-25T08:37:55.015 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 115/160 2026-02-25T08:37:55.015 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 116/160 2026-02-25T08:37:55.015 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 117/160 2026-02-25T08:37:55.015 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 118/160 2026-02-25T08:37:55.015 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 119/160 2026-02-25T08:37:55.015 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 120/160 2026-02-25T08:37:55.016 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 121/160 2026-02-25T08:37:55.016 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 122/160 2026-02-25T08:37:55.016 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 123/160 2026-02-25T08:37:55.016 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 124/160 2026-02-25T08:37:55.016 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 125/160 2026-02-25T08:37:55.016 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 126/160 2026-02-25T08:37:55.016 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 127/160 2026-02-25T08:37:55.016 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 128/160 2026-02-25T08:37:55.016 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 129/160 2026-02-25T08:37:55.016 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 130/160 2026-02-25T08:37:55.016 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 131/160 2026-02-25T08:37:55.016 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 132/160 2026-02-25T08:37:55.016 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 133/160 2026-02-25T08:37:55.017 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 134/160 2026-02-25T08:37:55.017 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 135/160 2026-02-25T08:37:55.017 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 136/160 2026-02-25T08:37:55.017 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 137/160 2026-02-25T08:37:55.017 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 138/160 2026-02-25T08:37:55.017 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 139/160 2026-02-25T08:37:55.017 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 140/160 2026-02-25T08:37:55.017 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 141/160 2026-02-25T08:37:55.017 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 142/160 2026-02-25T08:37:55.017 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 143/160 2026-02-25T08:37:55.017 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 144/160 2026-02-25T08:37:55.018 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 145/160 2026-02-25T08:37:55.018 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 146/160 2026-02-25T08:37:55.018 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 147/160 2026-02-25T08:37:55.018 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 148/160 2026-02-25T08:37:55.018 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 149/160 2026-02-25T08:37:55.018 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 150/160 2026-02-25T08:37:55.018 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 151/160 2026-02-25T08:37:55.018 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 152/160 2026-02-25T08:37:55.018 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 153/160 2026-02-25T08:37:55.018 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : re2-1:20211101-20.el9.x86_64 154/160 2026-02-25T08:37:55.018 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 155/160 2026-02-25T08:37:55.019 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 156/160 2026-02-25T08:37:55.019 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : librados2-2:20.3.0-5338.g6aeb6975.el9.x86_64 157/160 2026-02-25T08:37:55.019 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 158/160 2026-02-25T08:37:55.019 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : librbd1-2:20.3.0-5338.g6aeb6975.el9.x86_64 159/160 2026-02-25T08:37:55.079 INFO:teuthology.orchestra.run.trial009.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 160/160 2026-02-25T08:37:55.080 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:37:55.080 INFO:teuthology.orchestra.run.trial009.stdout:Upgraded: 2026-02-25T08:37:55.080 INFO:teuthology.orchestra.run.trial009.stdout: librados2-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.080 INFO:teuthology.orchestra.run.trial009.stdout: librbd1-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.080 INFO:teuthology.orchestra.run.trial009.stdout:Installed: 2026-02-25T08:37:55.080 INFO:teuthology.orchestra.run.trial009.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-25T08:37:55.080 INFO:teuthology.orchestra.run.trial009.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-25T08:37:55.080 INFO:teuthology.orchestra.run.trial009.stdout: ceph-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.080 INFO:teuthology.orchestra.run.trial009.stdout: ceph-base-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.080 INFO:teuthology.orchestra.run.trial009.stdout: ceph-common-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.080 INFO:teuthology.orchestra.run.trial009.stdout: ceph-debugsource-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.081 INFO:teuthology.orchestra.run.trial009.stdout: ceph-fuse-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.081 INFO:teuthology.orchestra.run.trial009.stdout: ceph-grafana-dashboards-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:37:55.081 INFO:teuthology.orchestra.run.trial009.stdout: ceph-immutable-object-cache-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.081 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mds-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.081 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mgr-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.081 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mgr-cephadm-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:37:55.081 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mgr-dashboard-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:37:55.081 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:37:55.081 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mgr-k8sevents-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:37:55.081 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mgr-modules-core-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:37:55.081 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mgr-rook-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:37:55.081 INFO:teuthology.orchestra.run.trial009.stdout: ceph-mon-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.082 INFO:teuthology.orchestra.run.trial009.stdout: ceph-osd-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.082 INFO:teuthology.orchestra.run.trial009.stdout: ceph-osd-classic-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.082 INFO:teuthology.orchestra.run.trial009.stdout: ceph-osd-crimson-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.082 INFO:teuthology.orchestra.run.trial009.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.082 INFO:teuthology.orchestra.run.trial009.stdout: ceph-prometheus-alerts-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:37:55.082 INFO:teuthology.orchestra.run.trial009.stdout: ceph-radosgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.082 INFO:teuthology.orchestra.run.trial009.stdout: ceph-selinux-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.082 INFO:teuthology.orchestra.run.trial009.stdout: ceph-test-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.082 INFO:teuthology.orchestra.run.trial009.stdout: ceph-volume-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:37:55.082 INFO:teuthology.orchestra.run.trial009.stdout: cephadm-2:20.3.0-5338.g6aeb6975.el9.noarch 2026-02-25T08:37:55.082 INFO:teuthology.orchestra.run.trial009.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-25T08:37:55.082 INFO:teuthology.orchestra.run.trial009.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-25T08:37:55.083 INFO:teuthology.orchestra.run.trial009.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-25T08:37:55.083 INFO:teuthology.orchestra.run.trial009.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-25T08:37:55.083 INFO:teuthology.orchestra.run.trial009.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-25T08:37:55.083 INFO:teuthology.orchestra.run.trial009.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-25T08:37:55.083 INFO:teuthology.orchestra.run.trial009.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-25T08:37:55.083 INFO:teuthology.orchestra.run.trial009.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-25T08:37:55.083 INFO:teuthology.orchestra.run.trial009.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-25T08:37:55.083 INFO:teuthology.orchestra.run.trial009.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-25T08:37:55.083 INFO:teuthology.orchestra.run.trial009.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-25T08:37:55.083 INFO:teuthology.orchestra.run.trial009.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-25T08:37:55.083 INFO:teuthology.orchestra.run.trial009.stdout: libcephfs-daemon-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.083 INFO:teuthology.orchestra.run.trial009.stdout: libcephfs-devel-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.083 INFO:teuthology.orchestra.run.trial009.stdout: libcephfs-proxy2-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.084 INFO:teuthology.orchestra.run.trial009.stdout: libcephfs2-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.084 INFO:teuthology.orchestra.run.trial009.stdout: libcephsqlite-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.084 INFO:teuthology.orchestra.run.trial009.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-25T08:37:55.084 INFO:teuthology.orchestra.run.trial009.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-25T08:37:55.084 INFO:teuthology.orchestra.run.trial009.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-25T08:37:55.084 INFO:teuthology.orchestra.run.trial009.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-25T08:37:55.084 INFO:teuthology.orchestra.run.trial009.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-25T08:37:55.084 INFO:teuthology.orchestra.run.trial009.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-25T08:37:55.084 INFO:teuthology.orchestra.run.trial009.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-25T08:37:55.084 INFO:teuthology.orchestra.run.trial009.stdout: librados-devel-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.084 INFO:teuthology.orchestra.run.trial009.stdout: libradosstriper1-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.084 INFO:teuthology.orchestra.run.trial009.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-25T08:37:55.085 INFO:teuthology.orchestra.run.trial009.stdout: librgw2-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.085 INFO:teuthology.orchestra.run.trial009.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T08:37:55.085 INFO:teuthology.orchestra.run.trial009.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-25T08:37:55.085 INFO:teuthology.orchestra.run.trial009.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-25T08:37:55.085 INFO:teuthology.orchestra.run.trial009.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-25T08:37:55.085 INFO:teuthology.orchestra.run.trial009.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-25T08:37:55.085 INFO:teuthology.orchestra.run.trial009.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-25T08:37:55.085 INFO:teuthology.orchestra.run.trial009.stdout: lua-5.4.4-4.el9.x86_64 2026-02-25T08:37:55.085 INFO:teuthology.orchestra.run.trial009.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-25T08:37:55.085 INFO:teuthology.orchestra.run.trial009.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-25T08:37:55.085 INFO:teuthology.orchestra.run.trial009.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-25T08:37:55.085 INFO:teuthology.orchestra.run.trial009.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-25T08:37:55.085 INFO:teuthology.orchestra.run.trial009.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-25T08:37:55.086 INFO:teuthology.orchestra.run.trial009.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-25T08:37:55.086 INFO:teuthology.orchestra.run.trial009.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-25T08:37:55.086 INFO:teuthology.orchestra.run.trial009.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-25T08:37:55.086 INFO:teuthology.orchestra.run.trial009.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-25T08:37:55.086 INFO:teuthology.orchestra.run.trial009.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-25T08:37:55.086 INFO:teuthology.orchestra.run.trial009.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-25T08:37:55.086 INFO:teuthology.orchestra.run.trial009.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-25T08:37:55.086 INFO:teuthology.orchestra.run.trial009.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-25T08:37:55.086 INFO:teuthology.orchestra.run.trial009.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-25T08:37:55.086 INFO:teuthology.orchestra.run.trial009.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-25T08:37:55.086 INFO:teuthology.orchestra.run.trial009.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-25T08:37:55.086 INFO:teuthology.orchestra.run.trial009.stdout: python3-ceph-argparse-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.087 INFO:teuthology.orchestra.run.trial009.stdout: python3-ceph-common-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.087 INFO:teuthology.orchestra.run.trial009.stdout: python3-cephfs-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.087 INFO:teuthology.orchestra.run.trial009.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-25T08:37:55.087 INFO:teuthology.orchestra.run.trial009.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-25T08:37:55.087 INFO:teuthology.orchestra.run.trial009.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-25T08:37:55.087 INFO:teuthology.orchestra.run.trial009.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-25T08:37:55.087 INFO:teuthology.orchestra.run.trial009.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-25T08:37:55.087 INFO:teuthology.orchestra.run.trial009.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-25T08:37:55.087 INFO:teuthology.orchestra.run.trial009.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-25T08:37:55.087 INFO:teuthology.orchestra.run.trial009.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-25T08:37:55.088 INFO:teuthology.orchestra.run.trial009.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-25T08:37:55.088 INFO:teuthology.orchestra.run.trial009.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-25T08:37:55.088 INFO:teuthology.orchestra.run.trial009.stdout: python3-iniconfig-1.1.1-7.el9.noarch 2026-02-25T08:37:55.088 INFO:teuthology.orchestra.run.trial009.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-25T08:37:55.088 INFO:teuthology.orchestra.run.trial009.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-25T08:37:55.088 INFO:teuthology.orchestra.run.trial009.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-25T08:37:55.088 INFO:teuthology.orchestra.run.trial009.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-25T08:37:55.088 INFO:teuthology.orchestra.run.trial009.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-25T08:37:55.088 INFO:teuthology.orchestra.run.trial009.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-25T08:37:55.088 INFO:teuthology.orchestra.run.trial009.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-25T08:37:55.089 INFO:teuthology.orchestra.run.trial009.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-25T08:37:55.089 INFO:teuthology.orchestra.run.trial009.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-25T08:37:55.089 INFO:teuthology.orchestra.run.trial009.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-25T08:37:55.089 INFO:teuthology.orchestra.run.trial009.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T08:37:55.089 INFO:teuthology.orchestra.run.trial009.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-25T08:37:55.089 INFO:teuthology.orchestra.run.trial009.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-25T08:37:55.089 INFO:teuthology.orchestra.run.trial009.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-25T08:37:55.089 INFO:teuthology.orchestra.run.trial009.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-25T08:37:55.089 INFO:teuthology.orchestra.run.trial009.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-25T08:37:55.089 INFO:teuthology.orchestra.run.trial009.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-25T08:37:55.089 INFO:teuthology.orchestra.run.trial009.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-25T08:37:55.090 INFO:teuthology.orchestra.run.trial009.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-25T08:37:55.090 INFO:teuthology.orchestra.run.trial009.stdout: python3-pluggy-0.13.1-7.el9.noarch 2026-02-25T08:37:55.090 INFO:teuthology.orchestra.run.trial009.stdout: python3-ply-3.11-14.el9.noarch 2026-02-25T08:37:55.090 INFO:teuthology.orchestra.run.trial009.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-25T08:37:55.090 INFO:teuthology.orchestra.run.trial009.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-25T08:37:55.090 INFO:teuthology.orchestra.run.trial009.stdout: python3-py-1.10.0-6.el9.noarch 2026-02-25T08:37:55.090 INFO:teuthology.orchestra.run.trial009.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-25T08:37:55.090 INFO:teuthology.orchestra.run.trial009.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-25T08:37:55.090 INFO:teuthology.orchestra.run.trial009.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-25T08:37:55.090 INFO:teuthology.orchestra.run.trial009.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-25T08:37:55.090 INFO:teuthology.orchestra.run.trial009.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-25T08:37:55.090 INFO:teuthology.orchestra.run.trial009.stdout: python3-pytest-6.2.2-7.el9.noarch 2026-02-25T08:37:55.091 INFO:teuthology.orchestra.run.trial009.stdout: python3-rados-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.091 INFO:teuthology.orchestra.run.trial009.stdout: python3-rbd-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.091 INFO:teuthology.orchestra.run.trial009.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-25T08:37:55.091 INFO:teuthology.orchestra.run.trial009.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-25T08:37:55.091 INFO:teuthology.orchestra.run.trial009.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-25T08:37:55.091 INFO:teuthology.orchestra.run.trial009.stdout: python3-rgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.091 INFO:teuthology.orchestra.run.trial009.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-25T08:37:55.091 INFO:teuthology.orchestra.run.trial009.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-25T08:37:55.091 INFO:teuthology.orchestra.run.trial009.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-25T08:37:55.091 INFO:teuthology.orchestra.run.trial009.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-25T08:37:55.091 INFO:teuthology.orchestra.run.trial009.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-25T08:37:55.091 INFO:teuthology.orchestra.run.trial009.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-25T08:37:55.092 INFO:teuthology.orchestra.run.trial009.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-25T08:37:55.092 INFO:teuthology.orchestra.run.trial009.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-25T08:37:55.092 INFO:teuthology.orchestra.run.trial009.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-25T08:37:55.092 INFO:teuthology.orchestra.run.trial009.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-25T08:37:55.092 INFO:teuthology.orchestra.run.trial009.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-25T08:37:55.092 INFO:teuthology.orchestra.run.trial009.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-25T08:37:55.092 INFO:teuthology.orchestra.run.trial009.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-25T08:37:55.092 INFO:teuthology.orchestra.run.trial009.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-25T08:37:55.092 INFO:teuthology.orchestra.run.trial009.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-25T08:37:55.092 INFO:teuthology.orchestra.run.trial009.stdout: rbd-fuse-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.092 INFO:teuthology.orchestra.run.trial009.stdout: rbd-mirror-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.092 INFO:teuthology.orchestra.run.trial009.stdout: rbd-nbd-2:20.3.0-5338.g6aeb6975.el9.x86_64 2026-02-25T08:37:55.092 INFO:teuthology.orchestra.run.trial009.stdout: re2-1:20211101-20.el9.x86_64 2026-02-25T08:37:55.093 INFO:teuthology.orchestra.run.trial009.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-25T08:37:55.093 INFO:teuthology.orchestra.run.trial009.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-25T08:37:55.093 INFO:teuthology.orchestra.run.trial009.stdout: unzip-6.0-59.el9.x86_64 2026-02-25T08:37:55.093 INFO:teuthology.orchestra.run.trial009.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-25T08:37:55.093 INFO:teuthology.orchestra.run.trial009.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-25T08:37:55.093 INFO:teuthology.orchestra.run.trial009.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-25T08:37:55.093 INFO:teuthology.orchestra.run.trial009.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-25T08:37:55.093 INFO:teuthology.orchestra.run.trial009.stdout: zip-3.0-35.el9.x86_64 2026-02-25T08:37:55.093 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:37:55.093 INFO:teuthology.orchestra.run.trial009.stdout:Complete! 2026-02-25T08:37:55.229 DEBUG:teuthology.parallel:result is None 2026-02-25T08:37:55.229 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=6aeb6975bc9a4790a399c9cc70dba9635d2a7819 2026-02-25T08:37:55.351 DEBUG:teuthology.orchestra.run.trial009:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-25T08:37:55.373 INFO:teuthology.orchestra.run.trial009.stdout:20.3.0-5338.g6aeb6975.el9 2026-02-25T08:37:55.373 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5338.g6aeb6975.el9 2026-02-25T08:37:55.373 INFO:teuthology.task.install:The correct ceph version 20.3.0-5338.g6aeb6975 is installed. 2026-02-25T08:37:55.375 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=6aeb6975bc9a4790a399c9cc70dba9635d2a7819 2026-02-25T08:37:55.519 DEBUG:teuthology.orchestra.run.trial059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-25T08:37:55.552 INFO:teuthology.orchestra.run.trial059.stdout:20.3.0-5338.g6aeb6975.el9 2026-02-25T08:37:55.552 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5338.g6aeb6975.el9 2026-02-25T08:37:55.552 INFO:teuthology.task.install:The correct ceph version 20.3.0-5338.g6aeb6975 is installed. 2026-02-25T08:37:55.555 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-25T08:37:55.555 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:37:55.555 DEBUG:teuthology.orchestra.run.trial009:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-25T08:37:55.583 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-25T08:37:55.583 DEBUG:teuthology.orchestra.run.trial059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-25T08:37:55.617 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-25T08:37:55.618 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:37:55.618 DEBUG:teuthology.orchestra.run.trial009:> sudo dd of=/usr/bin/daemon-helper 2026-02-25T08:37:55.648 DEBUG:teuthology.orchestra.run.trial009:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-25T08:37:55.713 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-25T08:37:55.713 DEBUG:teuthology.orchestra.run.trial059:> sudo dd of=/usr/bin/daemon-helper 2026-02-25T08:37:55.739 DEBUG:teuthology.orchestra.run.trial059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-25T08:37:55.803 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-25T08:37:55.803 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:37:55.803 DEBUG:teuthology.orchestra.run.trial009:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-25T08:37:55.829 DEBUG:teuthology.orchestra.run.trial009:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-25T08:37:55.892 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-25T08:37:55.892 DEBUG:teuthology.orchestra.run.trial059:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-25T08:37:55.918 DEBUG:teuthology.orchestra.run.trial059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-25T08:37:55.983 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-25T08:37:55.983 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:37:55.983 DEBUG:teuthology.orchestra.run.trial009:> sudo dd of=/usr/bin/stdin-killer 2026-02-25T08:37:56.009 DEBUG:teuthology.orchestra.run.trial009:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-25T08:37:56.074 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-25T08:37:56.074 DEBUG:teuthology.orchestra.run.trial059:> sudo dd of=/usr/bin/stdin-killer 2026-02-25T08:37:56.100 DEBUG:teuthology.orchestra.run.trial059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-25T08:37:56.163 INFO:teuthology.run_tasks:Running task pexec... 2026-02-25T08:37:56.181 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-25T08:37:56.181 DEBUG:teuthology.orchestra.run.trial009:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-25T08:37:56.182 DEBUG:teuthology.orchestra.run.trial059:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-25T08:37:56.185 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial009.front.sepia.ceph.com 2026-02-25T08:37:56.185 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-25T08:37:56.206 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial059.front.sepia.ceph.com 2026-02-25T08:37:56.206 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-25T08:37:56.236 DEBUG:teuthology.parallel:result is None 2026-02-25T08:37:56.256 DEBUG:teuthology.parallel:result is None 2026-02-25T08:37:56.256 INFO:teuthology.run_tasks:Running task install... 2026-02-25T08:37:56.270 DEBUG:teuthology.task.install:project ceph 2026-02-25T08:37:56.270 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '6aeb6975bc9a4790a399c9cc70dba9635d2a7819'}} 2026-02-25T08:37:56.271 DEBUG:teuthology.task.install:config {'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '6aeb6975bc9a4790a399c9cc70dba9635d2a7819'} 2026-02-25T08:37:56.271 INFO:teuthology.task.install:Using flavor: debug 2026-02-25T08:37:56.279 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-25T08:37:56.280 INFO:teuthology.task.install:extra packages: [] 2026-02-25T08:37:56.280 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6aeb6975bc9a4790a399c9cc70dba9635d2a7819', 'tag': None, 'wait_for_package': False} 2026-02-25T08:37:56.280 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=6aeb6975bc9a4790a399c9cc70dba9635d2a7819 2026-02-25T08:37:56.282 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6aeb6975bc9a4790a399c9cc70dba9635d2a7819', 'tag': None, 'wait_for_package': False} 2026-02-25T08:37:56.283 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=6aeb6975bc9a4790a399c9cc70dba9635d2a7819 2026-02-25T08:37:56.474 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-logstoremanager/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/centos/9/flavors/debug/ 2026-02-25T08:37:56.474 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5338.g6aeb6975 2026-02-25T08:37:56.487 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-logstoremanager/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/centos/9/flavors/debug/ 2026-02-25T08:37:56.487 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5338.g6aeb6975 2026-02-25T08:37:56.855 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-logstoremanager/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-logstoremanager/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-logstoremanager/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-25T08:37:56.855 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:37:56.855 DEBUG:teuthology.orchestra.run.trial009:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-25T08:37:56.881 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-pytest on remote rpm x86_64 2026-02-25T08:37:56.881 DEBUG:teuthology.orchestra.run.trial009:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-25T08:37:56.900 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-logstoremanager/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-logstoremanager/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-logstoremanager/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-25T08:37:56.900 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-25T08:37:56.900 DEBUG:teuthology.orchestra.run.trial059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-25T08:37:56.926 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-pytest on remote rpm x86_64 2026-02-25T08:37:56.927 DEBUG:teuthology.orchestra.run.trial059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6aeb6975bc9a4790a399c9cc70dba9635d2a7819/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-25T08:37:56.945 DEBUG:teuthology.orchestra.run.trial009:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-25T08:37:56.992 DEBUG:teuthology.orchestra.run.trial059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-25T08:37:57.010 DEBUG:teuthology.orchestra.run.trial009:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-25T08:37:57.056 DEBUG:teuthology.orchestra.run.trial059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-25T08:37:57.066 INFO:teuthology.orchestra.run.trial009.stdout:check_obsoletes = 1 2026-02-25T08:37:57.075 DEBUG:teuthology.orchestra.run.trial009:> sudo yum clean all 2026-02-25T08:37:57.112 INFO:teuthology.orchestra.run.trial059.stdout:check_obsoletes = 1 2026-02-25T08:37:57.123 DEBUG:teuthology.orchestra.run.trial059:> sudo yum clean all 2026-02-25T08:37:57.237 INFO:teuthology.orchestra.run.trial009.stdout:56 files removed 2026-02-25T08:37:57.253 DEBUG:teuthology.orchestra.run.trial009:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-pytest 2026-02-25T08:37:57.285 INFO:teuthology.orchestra.run.trial059.stdout:56 files removed 2026-02-25T08:37:57.301 DEBUG:teuthology.orchestra.run.trial059:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-pytest 2026-02-25T08:37:58.132 INFO:teuthology.orchestra.run.trial009.stdout:ceph packages for x86_64 130 kB/s | 94 kB 00:00 2026-02-25T08:37:58.173 INFO:teuthology.orchestra.run.trial059.stdout:ceph packages for x86_64 131 kB/s | 94 kB 00:00 2026-02-25T08:37:58.811 INFO:teuthology.orchestra.run.trial009.stdout:ceph noarch packages 38 kB/s | 24 kB 00:00 2026-02-25T08:37:58.840 INFO:teuthology.orchestra.run.trial059.stdout:ceph noarch packages 38 kB/s | 24 kB 00:00 2026-02-25T08:37:59.402 INFO:teuthology.orchestra.run.trial009.stdout:ceph source packages 3.7 kB/s | 2.1 kB 00:00 2026-02-25T08:37:59.457 INFO:teuthology.orchestra.run.trial059.stdout:ceph source packages 3.5 kB/s | 2.1 kB 00:00 2026-02-25T08:38:03.197 INFO:teuthology.orchestra.run.trial059.stdout:CentOS Stream 9 - BaseOS 2.4 MB/s | 8.9 MB 00:03 2026-02-25T08:38:06.641 INFO:teuthology.orchestra.run.trial059.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 27 MB 00:02 2026-02-25T08:38:07.962 INFO:teuthology.orchestra.run.trial009.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-25T08:38:10.066 INFO:teuthology.orchestra.run.trial059.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 8.0 MB 00:01 2026-02-25T08:38:11.943 INFO:teuthology.orchestra.run.trial059.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-25T08:38:13.275 INFO:teuthology.orchestra.run.trial059.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2026-02-25T08:38:14.104 INFO:teuthology.orchestra.run.trial009.stdout:CentOS Stream 9 - AppStream 4.8 MB/s | 27 MB 00:05 2026-02-25T08:38:16.472 INFO:teuthology.orchestra.run.trial059.stdout:lab-extras 2.0 MB/s | 50 kB 00:00 2026-02-25T08:38:17.644 INFO:teuthology.orchestra.run.trial059.stdout:Package ceph-radosgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.644 INFO:teuthology.orchestra.run.trial059.stdout:Package ceph-test-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.645 INFO:teuthology.orchestra.run.trial059.stdout:Package ceph-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.645 INFO:teuthology.orchestra.run.trial059.stdout:Package ceph-base-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.645 INFO:teuthology.orchestra.run.trial059.stdout:Package cephadm-2:20.3.0-5338.g6aeb6975.el9.noarch is already installed. 2026-02-25T08:38:17.646 INFO:teuthology.orchestra.run.trial059.stdout:Package ceph-immutable-object-cache-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.646 INFO:teuthology.orchestra.run.trial059.stdout:Package ceph-mgr-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.647 INFO:teuthology.orchestra.run.trial059.stdout:Package ceph-mgr-dashboard-2:20.3.0-5338.g6aeb6975.el9.noarch is already installed. 2026-02-25T08:38:17.647 INFO:teuthology.orchestra.run.trial059.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5338.g6aeb6975.el9.noarch is already installed. 2026-02-25T08:38:17.648 INFO:teuthology.orchestra.run.trial059.stdout:Package ceph-mgr-rook-2:20.3.0-5338.g6aeb6975.el9.noarch is already installed. 2026-02-25T08:38:17.648 INFO:teuthology.orchestra.run.trial059.stdout:Package ceph-mgr-cephadm-2:20.3.0-5338.g6aeb6975.el9.noarch is already installed. 2026-02-25T08:38:17.649 INFO:teuthology.orchestra.run.trial059.stdout:Package ceph-osd-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.649 INFO:teuthology.orchestra.run.trial059.stdout:Package ceph-osd-classic-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.650 INFO:teuthology.orchestra.run.trial059.stdout:Package ceph-fuse-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.650 INFO:teuthology.orchestra.run.trial059.stdout:Package ceph-volume-2:20.3.0-5338.g6aeb6975.el9.noarch is already installed. 2026-02-25T08:38:17.650 INFO:teuthology.orchestra.run.trial059.stdout:Package librados-devel-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.651 INFO:teuthology.orchestra.run.trial059.stdout:Package libcephfs2-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.651 INFO:teuthology.orchestra.run.trial059.stdout:Package libcephfs-devel-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.651 INFO:teuthology.orchestra.run.trial059.stdout:Package librados2-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.652 INFO:teuthology.orchestra.run.trial059.stdout:Package librbd1-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.652 INFO:teuthology.orchestra.run.trial059.stdout:Package python3-rados-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.653 INFO:teuthology.orchestra.run.trial059.stdout:Package python3-rgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.653 INFO:teuthology.orchestra.run.trial059.stdout:Package python3-cephfs-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.654 INFO:teuthology.orchestra.run.trial059.stdout:Package python3-rbd-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.654 INFO:teuthology.orchestra.run.trial059.stdout:Package rbd-fuse-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.655 INFO:teuthology.orchestra.run.trial059.stdout:Package rbd-mirror-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.655 INFO:teuthology.orchestra.run.trial059.stdout:Package rbd-nbd-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:17.655 INFO:teuthology.orchestra.run.trial059.stdout:Package python3-pytest-6.2.2-7.el9.noarch is already installed. 2026-02-25T08:38:17.674 INFO:teuthology.orchestra.run.trial059.stdout:Dependencies resolved. 2026-02-25T08:38:17.674 INFO:teuthology.orchestra.run.trial059.stdout:Nothing to do. 2026-02-25T08:38:17.674 INFO:teuthology.orchestra.run.trial059.stdout:Complete! 2026-02-25T08:38:17.702 DEBUG:teuthology.parallel:result is None 2026-02-25T08:38:18.002 INFO:teuthology.orchestra.run.trial009.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 8.0 MB 00:01 2026-02-25T08:38:21.271 INFO:teuthology.orchestra.run.trial009.stdout:CentOS Stream 9 - Extras packages 8.0 kB/s | 20 kB 00:02 2026-02-25T08:38:21.993 INFO:teuthology.orchestra.run.trial009.stdout:Extra Packages for Enterprise Linux 31 MB/s | 20 MB 00:00 2026-02-25T08:38:25.247 INFO:teuthology.orchestra.run.trial009.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-25T08:38:26.434 INFO:teuthology.orchestra.run.trial009.stdout:Package ceph-radosgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.435 INFO:teuthology.orchestra.run.trial009.stdout:Package ceph-test-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.435 INFO:teuthology.orchestra.run.trial009.stdout:Package ceph-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.435 INFO:teuthology.orchestra.run.trial009.stdout:Package ceph-base-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.436 INFO:teuthology.orchestra.run.trial009.stdout:Package cephadm-2:20.3.0-5338.g6aeb6975.el9.noarch is already installed. 2026-02-25T08:38:26.436 INFO:teuthology.orchestra.run.trial009.stdout:Package ceph-immutable-object-cache-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.436 INFO:teuthology.orchestra.run.trial009.stdout:Package ceph-mgr-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.437 INFO:teuthology.orchestra.run.trial009.stdout:Package ceph-mgr-dashboard-2:20.3.0-5338.g6aeb6975.el9.noarch is already installed. 2026-02-25T08:38:26.437 INFO:teuthology.orchestra.run.trial009.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5338.g6aeb6975.el9.noarch is already installed. 2026-02-25T08:38:26.438 INFO:teuthology.orchestra.run.trial009.stdout:Package ceph-mgr-rook-2:20.3.0-5338.g6aeb6975.el9.noarch is already installed. 2026-02-25T08:38:26.438 INFO:teuthology.orchestra.run.trial009.stdout:Package ceph-mgr-cephadm-2:20.3.0-5338.g6aeb6975.el9.noarch is already installed. 2026-02-25T08:38:26.439 INFO:teuthology.orchestra.run.trial009.stdout:Package ceph-osd-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.439 INFO:teuthology.orchestra.run.trial009.stdout:Package ceph-osd-classic-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.440 INFO:teuthology.orchestra.run.trial009.stdout:Package ceph-fuse-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.440 INFO:teuthology.orchestra.run.trial009.stdout:Package ceph-volume-2:20.3.0-5338.g6aeb6975.el9.noarch is already installed. 2026-02-25T08:38:26.440 INFO:teuthology.orchestra.run.trial009.stdout:Package librados-devel-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.441 INFO:teuthology.orchestra.run.trial009.stdout:Package libcephfs2-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.441 INFO:teuthology.orchestra.run.trial009.stdout:Package libcephfs-devel-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.442 INFO:teuthology.orchestra.run.trial009.stdout:Package librados2-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.442 INFO:teuthology.orchestra.run.trial009.stdout:Package librbd1-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.443 INFO:teuthology.orchestra.run.trial009.stdout:Package python3-rados-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.443 INFO:teuthology.orchestra.run.trial009.stdout:Package python3-rgw-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.443 INFO:teuthology.orchestra.run.trial009.stdout:Package python3-cephfs-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.444 INFO:teuthology.orchestra.run.trial009.stdout:Package python3-rbd-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.444 INFO:teuthology.orchestra.run.trial009.stdout:Package rbd-fuse-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.445 INFO:teuthology.orchestra.run.trial009.stdout:Package rbd-mirror-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.445 INFO:teuthology.orchestra.run.trial009.stdout:Package rbd-nbd-2:20.3.0-5338.g6aeb6975.el9.x86_64 is already installed. 2026-02-25T08:38:26.446 INFO:teuthology.orchestra.run.trial009.stdout:Package python3-pytest-6.2.2-7.el9.noarch is already installed. 2026-02-25T08:38:26.464 INFO:teuthology.orchestra.run.trial009.stdout:Dependencies resolved. 2026-02-25T08:38:26.464 INFO:teuthology.orchestra.run.trial009.stdout:Nothing to do. 2026-02-25T08:38:26.464 INFO:teuthology.orchestra.run.trial009.stdout:Complete! 2026-02-25T08:38:26.491 DEBUG:teuthology.parallel:result is None 2026-02-25T08:38:26.492 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=6aeb6975bc9a4790a399c9cc70dba9635d2a7819 2026-02-25T08:38:26.656 DEBUG:teuthology.orchestra.run.trial009:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-25T08:38:26.677 INFO:teuthology.orchestra.run.trial009.stdout:20.3.0-5338.g6aeb6975.el9 2026-02-25T08:38:26.677 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5338.g6aeb6975.el9 2026-02-25T08:38:26.678 INFO:teuthology.task.install:The correct ceph version 20.3.0-5338.g6aeb6975 is installed. 2026-02-25T08:38:26.680 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=6aeb6975bc9a4790a399c9cc70dba9635d2a7819 2026-02-25T08:38:26.835 DEBUG:teuthology.orchestra.run.trial059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-25T08:38:26.856 INFO:teuthology.orchestra.run.trial059.stdout:20.3.0-5338.g6aeb6975.el9 2026-02-25T08:38:26.857 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5338.g6aeb6975.el9 2026-02-25T08:38:26.857 INFO:teuthology.task.install:The correct ceph version 20.3.0-5338.g6aeb6975 is installed. 2026-02-25T08:38:26.859 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-25T08:38:26.859 INFO:teuthology.run_tasks:Running task ceph... 2026-02-25T08:38:26.967 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-25T08:38:26.968 DEBUG:teuthology.orchestra.run.trial009:> sudo chmod 777 /var/log/ceph 2026-02-25T08:38:26.969 DEBUG:teuthology.orchestra.run.trial059:> sudo chmod 777 /var/log/ceph 2026-02-25T08:38:26.993 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-25T08:38:26.994 DEBUG:teuthology.orchestra.run.trial009:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-25T08:38:27.034 DEBUG:teuthology.orchestra.run.trial059:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-25T08:38:27.058 INFO:tasks.ceph:Creating extra log directories... 2026-02-25T08:38:27.058 DEBUG:teuthology.orchestra.run.trial009:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-25T08:38:27.099 DEBUG:teuthology.orchestra.run.trial059:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-25T08:38:27.136 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-25T08:38:27.136 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-25T08:38:27.137 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/matan-2026-02-25_07:55:35-crimson-rados-wip-logstoremanager-distro-debug-trial/69099', 'branch': 'wip-logstoremanager', 'description': 'crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/rados_python}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '69099', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'matan-2026-02-25_07:55:35-crimson-rados-wip-logstoremanager-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-logstoremanager'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)'], 'sha1': '6aeb6975bc9a4790a399c9cc70dba9635d2a7819'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '6aeb6975bc9a4790a399c9cc70dba9635d2a7819'}}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': 'c32469671c6b0222f786dd36c34eb702f780a11d'}}, 'owner': 'scheduled_matan@soko04.front.sepia.ceph.com', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 869, 'sha1': '6aeb6975bc9a4790a399c9cc70dba9635d2a7819', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_c32469671c6b0222f786dd36c34eb702f780a11d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': 'c32469671c6b0222f786dd36c34eb702f780a11d', 'targets': {'trial009.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDiUDklaRD/6Oz7AkjGSM5Hg+P73hZIlbLL0EuS+qnU1RsSC5WZlE4I0o4PLpIB7olkqCwW57VdwlkMlPBRMS9I=', 'trial059.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAyIXwbEb0ytPwSRyh/mkeLj4NC6kyGR1yX0BtN+2E0BbOY/o8zl1XtmRZOrUS9A5LxwGpMDe4oYk3+4xpxh1D0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '6aeb6975bc9a4790a399c9cc70dba9635d2a7819'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)'], 'sha1': '6aeb6975bc9a4790a399c9cc70dba9635d2a7819', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ["rados/test_python.sh -m 'not (wait or tier or ec)'"]}, 'timeout': '1h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-25_07:55:35', 'tube': 'trial', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699'} 2026-02-25T08:38:27.137 DEBUG:teuthology.orchestra.run.trial009:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-25T08:38:27.163 DEBUG:teuthology.orchestra.run.trial059:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-25T08:38:27.180 DEBUG:teuthology.orchestra.run.trial009:> sudo install -d -m0777 -- /var/run/ceph 2026-02-25T08:38:27.219 DEBUG:teuthology.orchestra.run.trial059:> sudo install -d -m0777 -- /var/run/ceph 2026-02-25T08:38:27.243 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:38:27.244 DEBUG:teuthology.orchestra.run.trial009:> dd if=/scratch_devs of=/dev/stdout 2026-02-25T08:38:27.299 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-25T08:38:27.299 DEBUG:teuthology.orchestra.run.trial009:> stat /dev/vg_nvme/lv_1 2026-02-25T08:38:27.355 INFO:teuthology.orchestra.run.trial009.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-25T08:38:27.355 INFO:teuthology.orchestra.run.trial009.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T08:38:27.356 INFO:teuthology.orchestra.run.trial009.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-25T08:38:27.356 INFO:teuthology.orchestra.run.trial009.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T08:38:27.356 INFO:teuthology.orchestra.run.trial009.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T08:38:27.356 INFO:teuthology.orchestra.run.trial009.stdout:Access: 2026-02-25 08:37:52.158209041 +0000 2026-02-25T08:38:27.356 INFO:teuthology.orchestra.run.trial009.stdout:Modify: 2026-02-25 08:37:03.703870774 +0000 2026-02-25T08:38:27.356 INFO:teuthology.orchestra.run.trial009.stdout:Change: 2026-02-25 08:37:03.703870774 +0000 2026-02-25T08:38:27.356 INFO:teuthology.orchestra.run.trial009.stdout: Birth: 2026-02-25 08:37:03.703870774 +0000 2026-02-25T08:38:27.356 DEBUG:teuthology.orchestra.run.trial009:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-25T08:38:27.419 INFO:teuthology.orchestra.run.trial009.stderr:1+0 records in 2026-02-25T08:38:27.419 INFO:teuthology.orchestra.run.trial009.stderr:1+0 records out 2026-02-25T08:38:27.419 INFO:teuthology.orchestra.run.trial009.stderr:512 bytes copied, 0.000246418 s, 2.1 MB/s 2026-02-25T08:38:27.420 DEBUG:teuthology.orchestra.run.trial009:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-25T08:38:27.477 DEBUG:teuthology.orchestra.run.trial009:> stat /dev/vg_nvme/lv_2 2026-02-25T08:38:27.532 INFO:teuthology.orchestra.run.trial009.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-25T08:38:27.533 INFO:teuthology.orchestra.run.trial009.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T08:38:27.533 INFO:teuthology.orchestra.run.trial009.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-25T08:38:27.533 INFO:teuthology.orchestra.run.trial009.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T08:38:27.533 INFO:teuthology.orchestra.run.trial009.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T08:38:27.533 INFO:teuthology.orchestra.run.trial009.stdout:Access: 2026-02-25 08:37:52.158209041 +0000 2026-02-25T08:38:27.533 INFO:teuthology.orchestra.run.trial009.stdout:Modify: 2026-02-25 08:37:03.702870788 +0000 2026-02-25T08:38:27.533 INFO:teuthology.orchestra.run.trial009.stdout:Change: 2026-02-25 08:37:03.702870788 +0000 2026-02-25T08:38:27.533 INFO:teuthology.orchestra.run.trial009.stdout: Birth: 2026-02-25 08:37:03.702870788 +0000 2026-02-25T08:38:27.534 DEBUG:teuthology.orchestra.run.trial009:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-25T08:38:27.595 INFO:teuthology.orchestra.run.trial009.stderr:1+0 records in 2026-02-25T08:38:27.595 INFO:teuthology.orchestra.run.trial009.stderr:1+0 records out 2026-02-25T08:38:27.595 INFO:teuthology.orchestra.run.trial009.stderr:512 bytes copied, 0.000225409 s, 2.3 MB/s 2026-02-25T08:38:27.597 DEBUG:teuthology.orchestra.run.trial009:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-25T08:38:27.654 DEBUG:teuthology.orchestra.run.trial009:> stat /dev/vg_nvme/lv_3 2026-02-25T08:38:27.710 INFO:teuthology.orchestra.run.trial009.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-25T08:38:27.710 INFO:teuthology.orchestra.run.trial009.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T08:38:27.710 INFO:teuthology.orchestra.run.trial009.stdout:Device: 6h/6d Inode: 1289 Links: 1 2026-02-25T08:38:27.711 INFO:teuthology.orchestra.run.trial009.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T08:38:27.711 INFO:teuthology.orchestra.run.trial009.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T08:38:27.711 INFO:teuthology.orchestra.run.trial009.stdout:Access: 2026-02-25 08:37:52.158209041 +0000 2026-02-25T08:38:27.711 INFO:teuthology.orchestra.run.trial009.stdout:Modify: 2026-02-25 08:37:03.701870802 +0000 2026-02-25T08:38:27.711 INFO:teuthology.orchestra.run.trial009.stdout:Change: 2026-02-25 08:37:03.701870802 +0000 2026-02-25T08:38:27.711 INFO:teuthology.orchestra.run.trial009.stdout: Birth: 2026-02-25 08:37:03.701870802 +0000 2026-02-25T08:38:27.711 DEBUG:teuthology.orchestra.run.trial009:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-25T08:38:27.773 INFO:teuthology.orchestra.run.trial009.stderr:1+0 records in 2026-02-25T08:38:27.773 INFO:teuthology.orchestra.run.trial009.stderr:1+0 records out 2026-02-25T08:38:27.774 INFO:teuthology.orchestra.run.trial009.stderr:512 bytes copied, 0.000145931 s, 3.5 MB/s 2026-02-25T08:38:27.775 DEBUG:teuthology.orchestra.run.trial009:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-25T08:38:27.832 DEBUG:teuthology.orchestra.run.trial009:> stat /dev/vg_nvme/lv_4 2026-02-25T08:38:27.888 INFO:teuthology.orchestra.run.trial009.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-25T08:38:27.888 INFO:teuthology.orchestra.run.trial009.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T08:38:27.888 INFO:teuthology.orchestra.run.trial009.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-25T08:38:27.888 INFO:teuthology.orchestra.run.trial009.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T08:38:27.889 INFO:teuthology.orchestra.run.trial009.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T08:38:27.889 INFO:teuthology.orchestra.run.trial009.stdout:Access: 2026-02-25 08:37:52.158209041 +0000 2026-02-25T08:38:27.889 INFO:teuthology.orchestra.run.trial009.stdout:Modify: 2026-02-25 08:37:03.701870802 +0000 2026-02-25T08:38:27.889 INFO:teuthology.orchestra.run.trial009.stdout:Change: 2026-02-25 08:37:03.701870802 +0000 2026-02-25T08:38:27.889 INFO:teuthology.orchestra.run.trial009.stdout: Birth: 2026-02-25 08:37:03.701870802 +0000 2026-02-25T08:38:27.889 DEBUG:teuthology.orchestra.run.trial009:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-25T08:38:27.951 INFO:teuthology.orchestra.run.trial009.stderr:1+0 records in 2026-02-25T08:38:27.951 INFO:teuthology.orchestra.run.trial009.stderr:1+0 records out 2026-02-25T08:38:27.951 INFO:teuthology.orchestra.run.trial009.stderr:512 bytes copied, 0.00015074 s, 3.4 MB/s 2026-02-25T08:38:27.952 DEBUG:teuthology.orchestra.run.trial009:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-25T08:38:28.008 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-25T08:38:28.009 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-25T08:38:28.009 DEBUG:teuthology.orchestra.run.trial059:> dd if=/scratch_devs of=/dev/stdout 2026-02-25T08:38:28.028 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-25T08:38:28.028 DEBUG:teuthology.orchestra.run.trial059:> stat /dev/vg_nvme/lv_1 2026-02-25T08:38:28.084 INFO:teuthology.orchestra.run.trial059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-25T08:38:28.084 INFO:teuthology.orchestra.run.trial059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T08:38:28.084 INFO:teuthology.orchestra.run.trial059.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-25T08:38:28.084 INFO:teuthology.orchestra.run.trial059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T08:38:28.085 INFO:teuthology.orchestra.run.trial059.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T08:38:28.085 INFO:teuthology.orchestra.run.trial059.stdout:Access: 2026-02-25 08:34:14.861728609 +0000 2026-02-25T08:38:28.085 INFO:teuthology.orchestra.run.trial059.stdout:Modify: 2026-02-25 08:33:26.995337764 +0000 2026-02-25T08:38:28.085 INFO:teuthology.orchestra.run.trial059.stdout:Change: 2026-02-25 08:33:26.995337764 +0000 2026-02-25T08:38:28.085 INFO:teuthology.orchestra.run.trial059.stdout: Birth: 2026-02-25 08:33:26.995337764 +0000 2026-02-25T08:38:28.085 DEBUG:teuthology.orchestra.run.trial059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-25T08:38:28.146 INFO:teuthology.orchestra.run.trial059.stderr:1+0 records in 2026-02-25T08:38:28.146 INFO:teuthology.orchestra.run.trial059.stderr:1+0 records out 2026-02-25T08:38:28.147 INFO:teuthology.orchestra.run.trial059.stderr:512 bytes copied, 0.000240628 s, 2.1 MB/s 2026-02-25T08:38:28.148 DEBUG:teuthology.orchestra.run.trial059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-25T08:38:28.204 DEBUG:teuthology.orchestra.run.trial059:> stat /dev/vg_nvme/lv_2 2026-02-25T08:38:28.262 INFO:teuthology.orchestra.run.trial059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-25T08:38:28.262 INFO:teuthology.orchestra.run.trial059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T08:38:28.262 INFO:teuthology.orchestra.run.trial059.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-25T08:38:28.262 INFO:teuthology.orchestra.run.trial059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T08:38:28.262 INFO:teuthology.orchestra.run.trial059.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T08:38:28.262 INFO:teuthology.orchestra.run.trial059.stdout:Access: 2026-02-25 08:34:14.862728596 +0000 2026-02-25T08:38:28.263 INFO:teuthology.orchestra.run.trial059.stdout:Modify: 2026-02-25 08:33:26.997337738 +0000 2026-02-25T08:38:28.263 INFO:teuthology.orchestra.run.trial059.stdout:Change: 2026-02-25 08:33:26.997337738 +0000 2026-02-25T08:38:28.263 INFO:teuthology.orchestra.run.trial059.stdout: Birth: 2026-02-25 08:33:26.997337738 +0000 2026-02-25T08:38:28.263 DEBUG:teuthology.orchestra.run.trial059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-25T08:38:28.323 INFO:teuthology.orchestra.run.trial059.stderr:1+0 records in 2026-02-25T08:38:28.323 INFO:teuthology.orchestra.run.trial059.stderr:1+0 records out 2026-02-25T08:38:28.323 INFO:teuthology.orchestra.run.trial059.stderr:512 bytes copied, 0.00020919 s, 2.4 MB/s 2026-02-25T08:38:28.324 DEBUG:teuthology.orchestra.run.trial059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-25T08:38:28.381 DEBUG:teuthology.orchestra.run.trial059:> stat /dev/vg_nvme/lv_3 2026-02-25T08:38:28.438 INFO:teuthology.orchestra.run.trial059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-25T08:38:28.438 INFO:teuthology.orchestra.run.trial059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T08:38:28.438 INFO:teuthology.orchestra.run.trial059.stdout:Device: 6h/6d Inode: 1293 Links: 1 2026-02-25T08:38:28.438 INFO:teuthology.orchestra.run.trial059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T08:38:28.439 INFO:teuthology.orchestra.run.trial059.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T08:38:28.439 INFO:teuthology.orchestra.run.trial059.stdout:Access: 2026-02-25 08:34:14.862728596 +0000 2026-02-25T08:38:28.439 INFO:teuthology.orchestra.run.trial059.stdout:Modify: 2026-02-25 08:33:26.994337776 +0000 2026-02-25T08:38:28.439 INFO:teuthology.orchestra.run.trial059.stdout:Change: 2026-02-25 08:33:26.994337776 +0000 2026-02-25T08:38:28.439 INFO:teuthology.orchestra.run.trial059.stdout: Birth: 2026-02-25 08:33:26.994337776 +0000 2026-02-25T08:38:28.439 DEBUG:teuthology.orchestra.run.trial059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-25T08:38:28.501 INFO:teuthology.orchestra.run.trial059.stderr:1+0 records in 2026-02-25T08:38:28.501 INFO:teuthology.orchestra.run.trial059.stderr:1+0 records out 2026-02-25T08:38:28.501 INFO:teuthology.orchestra.run.trial059.stderr:512 bytes copied, 0.000146243 s, 3.5 MB/s 2026-02-25T08:38:28.502 DEBUG:teuthology.orchestra.run.trial059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-25T08:38:28.560 DEBUG:teuthology.orchestra.run.trial059:> stat /dev/vg_nvme/lv_4 2026-02-25T08:38:28.616 INFO:teuthology.orchestra.run.trial059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-25T08:38:28.616 INFO:teuthology.orchestra.run.trial059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T08:38:28.616 INFO:teuthology.orchestra.run.trial059.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-25T08:38:28.617 INFO:teuthology.orchestra.run.trial059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T08:38:28.617 INFO:teuthology.orchestra.run.trial059.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T08:38:28.617 INFO:teuthology.orchestra.run.trial059.stdout:Access: 2026-02-25 08:34:14.862728596 +0000 2026-02-25T08:38:28.617 INFO:teuthology.orchestra.run.trial059.stdout:Modify: 2026-02-25 08:33:26.995337764 +0000 2026-02-25T08:38:28.617 INFO:teuthology.orchestra.run.trial059.stdout:Change: 2026-02-25 08:33:26.995337764 +0000 2026-02-25T08:38:28.617 INFO:teuthology.orchestra.run.trial059.stdout: Birth: 2026-02-25 08:33:26.995337764 +0000 2026-02-25T08:38:28.617 DEBUG:teuthology.orchestra.run.trial059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-25T08:38:28.679 INFO:teuthology.orchestra.run.trial059.stderr:1+0 records in 2026-02-25T08:38:28.679 INFO:teuthology.orchestra.run.trial059.stderr:1+0 records out 2026-02-25T08:38:28.679 INFO:teuthology.orchestra.run.trial059.stderr:512 bytes copied, 0.000149569 s, 3.4 MB/s 2026-02-25T08:38:28.681 DEBUG:teuthology.orchestra.run.trial059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-25T08:38:28.738 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-25T08:38:28.738 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial009.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial059.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-25T08:38:28.738 INFO:tasks.ceph:Generating config... 2026-02-25T08:38:28.741 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-25T08:38:28.741 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-25T08:38:28.741 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-25T08:38:28.741 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-25T08:38:28.741 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-25T08:38:28.742 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-25T08:38:28.742 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-25T08:38:28.742 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-25T08:38:28.742 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-25T08:38:28.742 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-25T08:38:28.742 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-25T08:38:28.742 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-25T08:38:28.742 INFO:tasks.ceph:[osd] debug ms = 20 2026-02-25T08:38:28.742 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-25T08:38:28.742 INFO:tasks.ceph:[osd] debug seastore = 20 2026-02-25T08:38:28.742 INFO:tasks.ceph:[osd] debug seastore backref = 20 2026-02-25T08:38:28.743 INFO:tasks.ceph:[osd] debug seastore cache = 20 2026-02-25T08:38:28.743 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2026-02-25T08:38:28.743 INFO:tasks.ceph:[osd] debug seastore device = 20 2026-02-25T08:38:28.743 INFO:tasks.ceph:[osd] debug seastore epm = 20 2026-02-25T08:38:28.743 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2026-02-25T08:38:28.743 INFO:tasks.ceph:[osd] debug seastore journal = 20 2026-02-25T08:38:28.743 INFO:tasks.ceph:[osd] debug seastore lba = 20 2026-02-25T08:38:28.743 INFO:tasks.ceph:[osd] debug seastore odata = 20 2026-02-25T08:38:28.743 INFO:tasks.ceph:[osd] debug seastore omap = 20 2026-02-25T08:38:28.743 INFO:tasks.ceph:[osd] debug seastore onode = 20 2026-02-25T08:38:28.743 INFO:tasks.ceph:[osd] debug seastore t = 20 2026-02-25T08:38:28.743 INFO:tasks.ceph:[osd] debug seastore tm = 20 2026-02-25T08:38:28.743 INFO:tasks.ceph:[osd] osd objectstore = seastore 2026-02-25T08:38:28.744 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-25T08:38:28.744 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-25T08:38:28.744 INFO:tasks.ceph:[osd] seastore main device type = RANDOM_BLOCK_SSD 2026-02-25T08:38:28.744 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-25T08:38:28.744 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-25T08:38:28.744 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-25T08:38:28.744 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-25T08:38:28.744 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-25T08:38:28.744 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-25T08:38:28.744 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-25T08:38:28.744 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-25T08:38:28.744 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-25T08:38:28.745 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-25T08:38:28.745 INFO:tasks.ceph:Setting up mon.a... 2026-02-25T08:38:28.745 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-25T08:38:28.788 INFO:teuthology.orchestra.run.trial009.stdout:creating /etc/ceph/ceph.keyring 2026-02-25T08:38:28.791 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-25T08:38:28.875 DEBUG:teuthology.orchestra.run.trial009:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-25T08:38:28.939 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.9')] 2026-02-25T08:38:28.940 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.9', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-25T08:38:28.941 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:38:28.941 DEBUG:teuthology.orchestra.run.trial009:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-25T08:38:28.995 DEBUG:teuthology.orchestra.run.trial009:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.9 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-25T08:38:29.074 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:38:29.072+0000 7f7ad4c2bf40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:29.074 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:38:29.072+0000 7f7ad4c2bf40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:29.075 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:38:29.072+0000 7f7ad4c2bf40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:29.076 INFO:teuthology.orchestra.run.trial009.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-25T08:38:29.076 INFO:teuthology.orchestra.run.trial009.stdout:monmaptool: generated fsid 864c6132-1c9b-4620-b7bf-62f54427687f 2026-02-25T08:38:29.076 INFO:teuthology.orchestra.run.trial009.stdout:setting min_mon_release = tentacle 2026-02-25T08:38:29.076 INFO:teuthology.orchestra.run.trial009.stdout:epoch 0 2026-02-25T08:38:29.076 INFO:teuthology.orchestra.run.trial009.stdout:fsid 864c6132-1c9b-4620-b7bf-62f54427687f 2026-02-25T08:38:29.076 INFO:teuthology.orchestra.run.trial009.stdout:last_changed 2026-02-25T08:38:29.073883+0000 2026-02-25T08:38:29.076 INFO:teuthology.orchestra.run.trial009.stdout:created 2026-02-25T08:38:29.073883+0000 2026-02-25T08:38:29.077 INFO:teuthology.orchestra.run.trial009.stdout:min_mon_release 20 (tentacle) 2026-02-25T08:38:29.077 INFO:teuthology.orchestra.run.trial009.stdout:election_strategy: 1 2026-02-25T08:38:29.077 INFO:teuthology.orchestra.run.trial009.stdout:0: [v2:10.20.193.9:3300/0,v1:10.20.193.9:6789/0] mon.a 2026-02-25T08:38:29.077 INFO:teuthology.orchestra.run.trial009.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-25T08:38:29.078 DEBUG:teuthology.orchestra.run.trial009:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-25T08:38:29.132 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 864c6132-1c9b-4620-b7bf-62f54427687f... 2026-02-25T08:38:29.133 DEBUG:teuthology.orchestra.run.trial009:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-25T08:38:29.174 DEBUG:teuthology.orchestra.run.trial059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-25T08:38:29.213 INFO:teuthology.orchestra.run.trial009.stdout:[global] 2026-02-25T08:38:29.213 INFO:teuthology.orchestra.run.trial009.stdout: chdir = "" 2026-02-25T08:38:29.213 INFO:teuthology.orchestra.run.trial009.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-25T08:38:29.213 INFO:teuthology.orchestra.run.trial009.stdout: auth supported = cephx 2026-02-25T08:38:29.213 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.213 INFO:teuthology.orchestra.run.trial009.stdout: filestore xattr use omap = true 2026-02-25T08:38:29.214 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.214 INFO:teuthology.orchestra.run.trial009.stdout: mon clock drift allowed = 1.000 2026-02-25T08:38:29.214 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.214 INFO:teuthology.orchestra.run.trial009.stdout: osd crush chooseleaf type = 0 2026-02-25T08:38:29.214 INFO:teuthology.orchestra.run.trial009.stdout: auth debug = true 2026-02-25T08:38:29.214 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.214 INFO:teuthology.orchestra.run.trial009.stdout: ms die on old message = true 2026-02-25T08:38:29.214 INFO:teuthology.orchestra.run.trial009.stdout: ms die on bug = true 2026-02-25T08:38:29.214 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.214 INFO:teuthology.orchestra.run.trial009.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-25T08:38:29.214 INFO:teuthology.orchestra.run.trial009.stdout: mon pg warn max object skew = 0 2026-02-25T08:38:29.215 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.215 INFO:teuthology.orchestra.run.trial009.stdout: # disable pg_autoscaler by default for new pools 2026-02-25T08:38:29.215 INFO:teuthology.orchestra.run.trial009.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-25T08:38:29.215 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.215 INFO:teuthology.orchestra.run.trial009.stdout: osd pool default size = 2 2026-02-25T08:38:29.215 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.215 INFO:teuthology.orchestra.run.trial009.stdout: mon osd allow primary affinity = true 2026-02-25T08:38:29.215 INFO:teuthology.orchestra.run.trial009.stdout: mon osd allow pg remap = true 2026-02-25T08:38:29.215 INFO:teuthology.orchestra.run.trial009.stdout: mon warn on legacy crush tunables = false 2026-02-25T08:38:29.215 INFO:teuthology.orchestra.run.trial009.stdout: mon warn on crush straw calc version zero = false 2026-02-25T08:38:29.215 INFO:teuthology.orchestra.run.trial009.stdout: mon warn on no sortbitwise = false 2026-02-25T08:38:29.215 INFO:teuthology.orchestra.run.trial009.stdout: mon warn on osd down out interval zero = false 2026-02-25T08:38:29.216 INFO:teuthology.orchestra.run.trial009.stdout: mon warn on too few osds = false 2026-02-25T08:38:29.216 INFO:teuthology.orchestra.run.trial009.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-25T08:38:29.216 INFO:teuthology.orchestra.run.trial009.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-25T08:38:29.216 INFO:teuthology.orchestra.run.trial009.stdout: mon_allow_pool_size_one = true 2026-02-25T08:38:29.216 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.216 INFO:teuthology.orchestra.run.trial009.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-25T08:38:29.216 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.216 INFO:teuthology.orchestra.run.trial009.stdout: osd default data pool replay window = 5 2026-02-25T08:38:29.216 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.216 INFO:teuthology.orchestra.run.trial009.stdout: mon allow pool delete = true 2026-02-25T08:38:29.216 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.216 INFO:teuthology.orchestra.run.trial009.stdout: mon cluster log file level = debug 2026-02-25T08:38:29.217 INFO:teuthology.orchestra.run.trial009.stdout: debug asserts on shutdown = true 2026-02-25T08:38:29.217 INFO:teuthology.orchestra.run.trial009.stdout: mon health detail to clog = false 2026-02-25T08:38:29.217 INFO:teuthology.orchestra.run.trial009.stdout: mon host = 10.20.193.9 2026-02-25T08:38:29.217 INFO:teuthology.orchestra.run.trial009.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-25T08:38:29.217 INFO:teuthology.orchestra.run.trial009.stdout: ms client mode = crc 2026-02-25T08:38:29.217 INFO:teuthology.orchestra.run.trial009.stdout: ms cluster mode = crc 2026-02-25T08:38:29.217 INFO:teuthology.orchestra.run.trial009.stdout: ms mon client mode = crc 2026-02-25T08:38:29.217 INFO:teuthology.orchestra.run.trial009.stdout: ms mon cluster mode = crc 2026-02-25T08:38:29.217 INFO:teuthology.orchestra.run.trial009.stdout: ms mon service mode = crc 2026-02-25T08:38:29.217 INFO:teuthology.orchestra.run.trial009.stdout: ms service mode = crc 2026-02-25T08:38:29.217 INFO:teuthology.orchestra.run.trial009.stdout: fsid = 864c6132-1c9b-4620-b7bf-62f54427687f 2026-02-25T08:38:29.217 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.218 INFO:teuthology.orchestra.run.trial009.stdout:[osd] 2026-02-25T08:38:29.218 INFO:teuthology.orchestra.run.trial009.stdout: osd journal size = 100 2026-02-25T08:38:29.218 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.218 INFO:teuthology.orchestra.run.trial009.stdout: osd scrub load threshold = 5.0 2026-02-25T08:38:29.218 INFO:teuthology.orchestra.run.trial009.stdout: osd scrub max interval = 600 2026-02-25T08:38:29.218 INFO:teuthology.orchestra.run.trial009.stdout: osd mclock profile = high_recovery_ops 2026-02-25T08:38:29.218 INFO:teuthology.orchestra.run.trial009.stdout: osd mclock skip benchmark = true 2026-02-25T08:38:29.218 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.218 INFO:teuthology.orchestra.run.trial009.stdout: osd recover clone overlap = true 2026-02-25T08:38:29.218 INFO:teuthology.orchestra.run.trial009.stdout: osd recovery max chunk = 1048576 2026-02-25T08:38:29.218 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.218 INFO:teuthology.orchestra.run.trial009.stdout: osd debug shutdown = true 2026-02-25T08:38:29.218 INFO:teuthology.orchestra.run.trial009.stdout: osd debug op order = true 2026-02-25T08:38:29.219 INFO:teuthology.orchestra.run.trial009.stdout: osd debug verify stray on activate = true 2026-02-25T08:38:29.219 INFO:teuthology.orchestra.run.trial009.stdout: osd debug trim objects = true 2026-02-25T08:38:29.219 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.219 INFO:teuthology.orchestra.run.trial009.stdout: osd open classes on start = true 2026-02-25T08:38:29.219 INFO:teuthology.orchestra.run.trial009.stdout: osd debug pg log writeout = true 2026-02-25T08:38:29.219 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.219 INFO:teuthology.orchestra.run.trial009.stdout: osd deep scrub update digest min age = 30 2026-02-25T08:38:29.219 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.219 INFO:teuthology.orchestra.run.trial009.stdout: osd map max advance = 10 2026-02-25T08:38:29.219 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.219 INFO:teuthology.orchestra.run.trial009.stdout: journal zero on create = true 2026-02-25T08:38:29.219 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.220 INFO:teuthology.orchestra.run.trial009.stdout: filestore ondisk finisher threads = 3 2026-02-25T08:38:29.220 INFO:teuthology.orchestra.run.trial009.stdout: filestore apply finisher threads = 3 2026-02-25T08:38:29.220 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.220 INFO:teuthology.orchestra.run.trial009.stdout: bdev debug aio = true 2026-02-25T08:38:29.220 INFO:teuthology.orchestra.run.trial009.stdout: osd debug misdirected ops = true 2026-02-25T08:38:29.220 INFO:teuthology.orchestra.run.trial009.stdout: debug monc = 20 2026-02-25T08:38:29.220 INFO:teuthology.orchestra.run.trial009.stdout: crimson cpu num = 4 2026-02-25T08:38:29.220 INFO:teuthology.orchestra.run.trial009.stdout: crimson osd obc lru size = 10 2026-02-25T08:38:29.220 INFO:teuthology.orchestra.run.trial009.stdout: debug ms = 20 2026-02-25T08:38:29.220 INFO:teuthology.orchestra.run.trial009.stdout: debug osd = 20 2026-02-25T08:38:29.220 INFO:teuthology.orchestra.run.trial009.stdout: debug seastore = 20 2026-02-25T08:38:29.220 INFO:teuthology.orchestra.run.trial009.stdout: debug seastore backref = 20 2026-02-25T08:38:29.220 INFO:teuthology.orchestra.run.trial009.stdout: debug seastore cache = 20 2026-02-25T08:38:29.221 INFO:teuthology.orchestra.run.trial009.stdout: debug seastore cleaner = 20 2026-02-25T08:38:29.221 INFO:teuthology.orchestra.run.trial009.stdout: debug seastore device = 20 2026-02-25T08:38:29.221 INFO:teuthology.orchestra.run.trial009.stdout: debug seastore epm = 20 2026-02-25T08:38:29.221 INFO:teuthology.orchestra.run.trial009.stdout: debug seastore fixedkv tree = 20 2026-02-25T08:38:29.221 INFO:teuthology.orchestra.run.trial009.stdout: debug seastore journal = 20 2026-02-25T08:38:29.221 INFO:teuthology.orchestra.run.trial009.stdout: debug seastore lba = 20 2026-02-25T08:38:29.221 INFO:teuthology.orchestra.run.trial009.stdout: debug seastore odata = 20 2026-02-25T08:38:29.221 INFO:teuthology.orchestra.run.trial009.stdout: debug seastore omap = 20 2026-02-25T08:38:29.221 INFO:teuthology.orchestra.run.trial009.stdout: debug seastore onode = 20 2026-02-25T08:38:29.221 INFO:teuthology.orchestra.run.trial009.stdout: debug seastore t = 20 2026-02-25T08:38:29.221 INFO:teuthology.orchestra.run.trial009.stdout: debug seastore tm = 20 2026-02-25T08:38:29.221 INFO:teuthology.orchestra.run.trial009.stdout: osd objectstore = seastore 2026-02-25T08:38:29.221 INFO:teuthology.orchestra.run.trial009.stdout: osd shutdown pgref assert = True 2026-02-25T08:38:29.222 INFO:teuthology.orchestra.run.trial009.stdout: seastore cachepin size pershard = 64M 2026-02-25T08:38:29.222 INFO:teuthology.orchestra.run.trial009.stdout: seastore main device type = RANDOM_BLOCK_SSD 2026-02-25T08:38:29.222 INFO:teuthology.orchestra.run.trial009.stdout: seastore max concurrent transactions = 8 2026-02-25T08:38:29.222 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.222 INFO:teuthology.orchestra.run.trial009.stdout:[mgr] 2026-02-25T08:38:29.222 INFO:teuthology.orchestra.run.trial009.stdout: debug ms = 1 2026-02-25T08:38:29.222 INFO:teuthology.orchestra.run.trial009.stdout: debug mgr = 20 2026-02-25T08:38:29.222 INFO:teuthology.orchestra.run.trial009.stdout: debug mon = 20 2026-02-25T08:38:29.222 INFO:teuthology.orchestra.run.trial009.stdout: debug auth = 20 2026-02-25T08:38:29.222 INFO:teuthology.orchestra.run.trial009.stdout: mon reweight min pgs per osd = 4 2026-02-25T08:38:29.222 INFO:teuthology.orchestra.run.trial009.stdout: mon reweight min bytes per osd = 10 2026-02-25T08:38:29.222 INFO:teuthology.orchestra.run.trial009.stdout: mgr/telemetry/nag = false 2026-02-25T08:38:29.222 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.223 INFO:teuthology.orchestra.run.trial009.stdout:[mon] 2026-02-25T08:38:29.223 INFO:teuthology.orchestra.run.trial009.stdout: debug ms = 1 2026-02-25T08:38:29.223 INFO:teuthology.orchestra.run.trial009.stdout: debug mon = 20 2026-02-25T08:38:29.223 INFO:teuthology.orchestra.run.trial009.stdout: debug paxos = 20 2026-02-25T08:38:29.223 INFO:teuthology.orchestra.run.trial009.stdout: debug auth = 20 2026-02-25T08:38:29.223 INFO:teuthology.orchestra.run.trial009.stdout: mon data avail warn = 5 2026-02-25T08:38:29.223 INFO:teuthology.orchestra.run.trial009.stdout: mon mgr mkfs grace = 240 2026-02-25T08:38:29.223 INFO:teuthology.orchestra.run.trial009.stdout: mon reweight min pgs per osd = 4 2026-02-25T08:38:29.223 INFO:teuthology.orchestra.run.trial009.stdout: mon osd reporter subtree level = osd 2026-02-25T08:38:29.223 INFO:teuthology.orchestra.run.trial009.stdout: mon osd prime pg temp = true 2026-02-25T08:38:29.223 INFO:teuthology.orchestra.run.trial009.stdout: mon reweight min bytes per osd = 10 2026-02-25T08:38:29.223 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.224 INFO:teuthology.orchestra.run.trial009.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-25T08:38:29.224 INFO:teuthology.orchestra.run.trial009.stdout: auth mon ticket ttl = 660 # 11m 2026-02-25T08:38:29.224 INFO:teuthology.orchestra.run.trial009.stdout: auth service ticket ttl = 240 # 4m 2026-02-25T08:38:29.224 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.224 INFO:teuthology.orchestra.run.trial009.stdout: # don't complain about insecure global_id in the test suite 2026-02-25T08:38:29.224 INFO:teuthology.orchestra.run.trial009.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-25T08:38:29.224 INFO:teuthology.orchestra.run.trial009.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-25T08:38:29.224 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.224 INFO:teuthology.orchestra.run.trial009.stdout: # 1m isn't quite enough 2026-02-25T08:38:29.224 INFO:teuthology.orchestra.run.trial009.stdout: mon_down_mkfs_grace = 2m 2026-02-25T08:38:29.224 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.224 INFO:teuthology.orchestra.run.trial009.stdout: mon_warn_on_filestore_osds = false 2026-02-25T08:38:29.225 INFO:teuthology.orchestra.run.trial009.stdout: mon min osdmap epochs = 50 2026-02-25T08:38:29.225 INFO:teuthology.orchestra.run.trial009.stdout: mon osdmap full prune interval = 2 2026-02-25T08:38:29.225 INFO:teuthology.orchestra.run.trial009.stdout: mon osdmap full prune min = 15 2026-02-25T08:38:29.225 INFO:teuthology.orchestra.run.trial009.stdout: mon osdmap full prune txsize = 2 2026-02-25T08:38:29.225 INFO:teuthology.orchestra.run.trial009.stdout: paxos service trim min = 10 2026-02-25T08:38:29.225 INFO:teuthology.orchestra.run.trial009.stdout: osd pool default crimson = True 2026-02-25T08:38:29.225 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:29.225 INFO:teuthology.orchestra.run.trial009.stdout:[client] 2026-02-25T08:38:29.225 INFO:teuthology.orchestra.run.trial009.stdout: rgw cache enabled = true 2026-02-25T08:38:29.225 INFO:teuthology.orchestra.run.trial009.stdout: rgw enable ops log = true 2026-02-25T08:38:29.225 INFO:teuthology.orchestra.run.trial009.stdout: rgw enable usage log = true 2026-02-25T08:38:29.225 INFO:teuthology.orchestra.run.trial009.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-25T08:38:29.225 INFO:teuthology.orchestra.run.trial009.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-25T08:38:29.226 INFO:teuthology.orchestra.run.trial009.stdout:[mon.a] 2026-02-25T08:38:29.228 INFO:teuthology.orchestra.run.trial059.stdout:[global] 2026-02-25T08:38:29.228 INFO:teuthology.orchestra.run.trial059.stdout: chdir = "" 2026-02-25T08:38:29.228 INFO:teuthology.orchestra.run.trial059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-25T08:38:29.228 INFO:teuthology.orchestra.run.trial059.stdout: auth supported = cephx 2026-02-25T08:38:29.228 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.228 INFO:teuthology.orchestra.run.trial059.stdout: filestore xattr use omap = true 2026-02-25T08:38:29.228 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.228 INFO:teuthology.orchestra.run.trial059.stdout: mon clock drift allowed = 1.000 2026-02-25T08:38:29.228 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.228 INFO:teuthology.orchestra.run.trial059.stdout: osd crush chooseleaf type = 0 2026-02-25T08:38:29.229 INFO:teuthology.orchestra.run.trial059.stdout: auth debug = true 2026-02-25T08:38:29.229 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.229 INFO:teuthology.orchestra.run.trial059.stdout: ms die on old message = true 2026-02-25T08:38:29.229 INFO:teuthology.orchestra.run.trial059.stdout: ms die on bug = true 2026-02-25T08:38:29.229 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.229 INFO:teuthology.orchestra.run.trial059.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-25T08:38:29.229 INFO:teuthology.orchestra.run.trial059.stdout: mon pg warn max object skew = 0 2026-02-25T08:38:29.229 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.229 INFO:teuthology.orchestra.run.trial059.stdout: # disable pg_autoscaler by default for new pools 2026-02-25T08:38:29.229 INFO:teuthology.orchestra.run.trial059.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-25T08:38:29.229 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.230 INFO:teuthology.orchestra.run.trial059.stdout: osd pool default size = 2 2026-02-25T08:38:29.230 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.230 INFO:teuthology.orchestra.run.trial059.stdout: mon osd allow primary affinity = true 2026-02-25T08:38:29.230 INFO:teuthology.orchestra.run.trial059.stdout: mon osd allow pg remap = true 2026-02-25T08:38:29.230 INFO:teuthology.orchestra.run.trial059.stdout: mon warn on legacy crush tunables = false 2026-02-25T08:38:29.230 INFO:teuthology.orchestra.run.trial059.stdout: mon warn on crush straw calc version zero = false 2026-02-25T08:38:29.230 INFO:teuthology.orchestra.run.trial059.stdout: mon warn on no sortbitwise = false 2026-02-25T08:38:29.230 INFO:teuthology.orchestra.run.trial059.stdout: mon warn on osd down out interval zero = false 2026-02-25T08:38:29.230 INFO:teuthology.orchestra.run.trial059.stdout: mon warn on too few osds = false 2026-02-25T08:38:29.230 INFO:teuthology.orchestra.run.trial059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-25T08:38:29.230 INFO:teuthology.orchestra.run.trial059.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-25T08:38:29.230 INFO:teuthology.orchestra.run.trial059.stdout: mon_allow_pool_size_one = true 2026-02-25T08:38:29.230 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.231 INFO:teuthology.orchestra.run.trial059.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-25T08:38:29.231 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.231 INFO:teuthology.orchestra.run.trial059.stdout: osd default data pool replay window = 5 2026-02-25T08:38:29.231 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.231 INFO:teuthology.orchestra.run.trial059.stdout: mon allow pool delete = true 2026-02-25T08:38:29.231 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.231 INFO:teuthology.orchestra.run.trial059.stdout: mon cluster log file level = debug 2026-02-25T08:38:29.231 INFO:teuthology.orchestra.run.trial059.stdout: debug asserts on shutdown = true 2026-02-25T08:38:29.231 INFO:teuthology.orchestra.run.trial059.stdout: mon health detail to clog = false 2026-02-25T08:38:29.231 INFO:teuthology.orchestra.run.trial059.stdout: mon host = 10.20.193.9 2026-02-25T08:38:29.231 INFO:teuthology.orchestra.run.trial059.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-25T08:38:29.231 INFO:teuthology.orchestra.run.trial059.stdout: ms client mode = crc 2026-02-25T08:38:29.231 INFO:teuthology.orchestra.run.trial059.stdout: ms cluster mode = crc 2026-02-25T08:38:29.232 INFO:teuthology.orchestra.run.trial059.stdout: ms mon client mode = crc 2026-02-25T08:38:29.232 INFO:teuthology.orchestra.run.trial059.stdout: ms mon cluster mode = crc 2026-02-25T08:38:29.232 INFO:teuthology.orchestra.run.trial059.stdout: ms mon service mode = crc 2026-02-25T08:38:29.232 INFO:teuthology.orchestra.run.trial059.stdout: ms service mode = crc 2026-02-25T08:38:29.232 INFO:teuthology.orchestra.run.trial059.stdout: fsid = 864c6132-1c9b-4620-b7bf-62f54427687f 2026-02-25T08:38:29.232 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.232 INFO:teuthology.orchestra.run.trial059.stdout:[osd] 2026-02-25T08:38:29.232 INFO:teuthology.orchestra.run.trial059.stdout: osd journal size = 100 2026-02-25T08:38:29.232 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.232 INFO:teuthology.orchestra.run.trial059.stdout: osd scrub load threshold = 5.0 2026-02-25T08:38:29.232 INFO:teuthology.orchestra.run.trial059.stdout: osd scrub max interval = 600 2026-02-25T08:38:29.232 INFO:teuthology.orchestra.run.trial059.stdout: osd mclock profile = high_recovery_ops 2026-02-25T08:38:29.233 INFO:teuthology.orchestra.run.trial059.stdout: osd mclock skip benchmark = true 2026-02-25T08:38:29.233 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.233 INFO:teuthology.orchestra.run.trial059.stdout: osd recover clone overlap = true 2026-02-25T08:38:29.233 INFO:teuthology.orchestra.run.trial059.stdout: osd recovery max chunk = 1048576 2026-02-25T08:38:29.233 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.233 INFO:teuthology.orchestra.run.trial059.stdout: osd debug shutdown = true 2026-02-25T08:38:29.233 INFO:teuthology.orchestra.run.trial059.stdout: osd debug op order = true 2026-02-25T08:38:29.233 INFO:teuthology.orchestra.run.trial059.stdout: osd debug verify stray on activate = true 2026-02-25T08:38:29.233 INFO:teuthology.orchestra.run.trial059.stdout: osd debug trim objects = true 2026-02-25T08:38:29.233 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.233 INFO:teuthology.orchestra.run.trial059.stdout: osd open classes on start = true 2026-02-25T08:38:29.233 INFO:teuthology.orchestra.run.trial059.stdout: osd debug pg log writeout = true 2026-02-25T08:38:29.233 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.234 INFO:teuthology.orchestra.run.trial059.stdout: osd deep scrub update digest min age = 30 2026-02-25T08:38:29.234 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.234 INFO:teuthology.orchestra.run.trial059.stdout: osd map max advance = 10 2026-02-25T08:38:29.234 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.234 INFO:teuthology.orchestra.run.trial059.stdout: journal zero on create = true 2026-02-25T08:38:29.234 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.234 INFO:teuthology.orchestra.run.trial059.stdout: filestore ondisk finisher threads = 3 2026-02-25T08:38:29.234 INFO:teuthology.orchestra.run.trial059.stdout: filestore apply finisher threads = 3 2026-02-25T08:38:29.234 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.234 INFO:teuthology.orchestra.run.trial059.stdout: bdev debug aio = true 2026-02-25T08:38:29.234 INFO:teuthology.orchestra.run.trial059.stdout: osd debug misdirected ops = true 2026-02-25T08:38:29.234 INFO:teuthology.orchestra.run.trial059.stdout: debug monc = 20 2026-02-25T08:38:29.234 INFO:teuthology.orchestra.run.trial059.stdout: crimson cpu num = 4 2026-02-25T08:38:29.235 INFO:teuthology.orchestra.run.trial059.stdout: crimson osd obc lru size = 10 2026-02-25T08:38:29.235 INFO:teuthology.orchestra.run.trial059.stdout: debug ms = 20 2026-02-25T08:38:29.235 INFO:teuthology.orchestra.run.trial059.stdout: debug osd = 20 2026-02-25T08:38:29.235 INFO:teuthology.orchestra.run.trial059.stdout: debug seastore = 20 2026-02-25T08:38:29.235 INFO:teuthology.orchestra.run.trial059.stdout: debug seastore backref = 20 2026-02-25T08:38:29.235 INFO:teuthology.orchestra.run.trial059.stdout: debug seastore cache = 20 2026-02-25T08:38:29.235 INFO:teuthology.orchestra.run.trial059.stdout: debug seastore cleaner = 20 2026-02-25T08:38:29.235 INFO:teuthology.orchestra.run.trial059.stdout: debug seastore device = 20 2026-02-25T08:38:29.235 INFO:teuthology.orchestra.run.trial059.stdout: debug seastore epm = 20 2026-02-25T08:38:29.235 INFO:teuthology.orchestra.run.trial059.stdout: debug seastore fixedkv tree = 20 2026-02-25T08:38:29.235 INFO:teuthology.orchestra.run.trial059.stdout: debug seastore journal = 20 2026-02-25T08:38:29.235 INFO:teuthology.orchestra.run.trial059.stdout: debug seastore lba = 20 2026-02-25T08:38:29.235 INFO:teuthology.orchestra.run.trial059.stdout: debug seastore odata = 20 2026-02-25T08:38:29.236 INFO:teuthology.orchestra.run.trial059.stdout: debug seastore omap = 20 2026-02-25T08:38:29.236 INFO:teuthology.orchestra.run.trial059.stdout: debug seastore onode = 20 2026-02-25T08:38:29.236 INFO:teuthology.orchestra.run.trial059.stdout: debug seastore t = 20 2026-02-25T08:38:29.236 INFO:teuthology.orchestra.run.trial059.stdout: debug seastore tm = 20 2026-02-25T08:38:29.236 INFO:teuthology.orchestra.run.trial059.stdout: osd objectstore = seastore 2026-02-25T08:38:29.236 INFO:teuthology.orchestra.run.trial059.stdout: osd shutdown pgref assert = True 2026-02-25T08:38:29.236 INFO:teuthology.orchestra.run.trial059.stdout: seastore cachepin size pershard = 64M 2026-02-25T08:38:29.236 INFO:teuthology.orchestra.run.trial059.stdout: seastore main device type = RANDOM_BLOCK_SSD 2026-02-25T08:38:29.236 INFO:teuthology.orchestra.run.trial059.stdout: seastore max concurrent transactions = 8 2026-02-25T08:38:29.236 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.236 INFO:teuthology.orchestra.run.trial059.stdout:[mgr] 2026-02-25T08:38:29.236 INFO:teuthology.orchestra.run.trial059.stdout: debug ms = 1 2026-02-25T08:38:29.236 INFO:teuthology.orchestra.run.trial059.stdout: debug mgr = 20 2026-02-25T08:38:29.237 INFO:teuthology.orchestra.run.trial059.stdout: debug mon = 20 2026-02-25T08:38:29.237 INFO:teuthology.orchestra.run.trial059.stdout: debug auth = 20 2026-02-25T08:38:29.237 INFO:teuthology.orchestra.run.trial059.stdout: mon reweight min pgs per osd = 4 2026-02-25T08:38:29.237 INFO:teuthology.orchestra.run.trial059.stdout: mon reweight min bytes per osd = 10 2026-02-25T08:38:29.237 INFO:teuthology.orchestra.run.trial059.stdout: mgr/telemetry/nag = false 2026-02-25T08:38:29.237 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.237 INFO:teuthology.orchestra.run.trial059.stdout:[mon] 2026-02-25T08:38:29.237 INFO:teuthology.orchestra.run.trial059.stdout: debug ms = 1 2026-02-25T08:38:29.237 INFO:teuthology.orchestra.run.trial059.stdout: debug mon = 20 2026-02-25T08:38:29.237 INFO:teuthology.orchestra.run.trial059.stdout: debug paxos = 20 2026-02-25T08:38:29.237 INFO:teuthology.orchestra.run.trial059.stdout: debug auth = 20 2026-02-25T08:38:29.237 INFO:teuthology.orchestra.run.trial059.stdout: mon data avail warn = 5 2026-02-25T08:38:29.237 INFO:teuthology.orchestra.run.trial059.stdout: mon mgr mkfs grace = 240 2026-02-25T08:38:29.238 INFO:teuthology.orchestra.run.trial059.stdout: mon reweight min pgs per osd = 4 2026-02-25T08:38:29.238 INFO:teuthology.orchestra.run.trial059.stdout: mon osd reporter subtree level = osd 2026-02-25T08:38:29.238 INFO:teuthology.orchestra.run.trial059.stdout: mon osd prime pg temp = true 2026-02-25T08:38:29.238 INFO:teuthology.orchestra.run.trial059.stdout: mon reweight min bytes per osd = 10 2026-02-25T08:38:29.238 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.238 INFO:teuthology.orchestra.run.trial059.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-25T08:38:29.238 INFO:teuthology.orchestra.run.trial059.stdout: auth mon ticket ttl = 660 # 11m 2026-02-25T08:38:29.238 INFO:teuthology.orchestra.run.trial059.stdout: auth service ticket ttl = 240 # 4m 2026-02-25T08:38:29.238 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.238 INFO:teuthology.orchestra.run.trial059.stdout: # don't complain about insecure global_id in the test suite 2026-02-25T08:38:29.238 INFO:teuthology.orchestra.run.trial059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-25T08:38:29.238 INFO:teuthology.orchestra.run.trial059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-25T08:38:29.239 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.239 INFO:teuthology.orchestra.run.trial059.stdout: # 1m isn't quite enough 2026-02-25T08:38:29.239 INFO:teuthology.orchestra.run.trial059.stdout: mon_down_mkfs_grace = 2m 2026-02-25T08:38:29.239 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.239 INFO:teuthology.orchestra.run.trial059.stdout: mon_warn_on_filestore_osds = false 2026-02-25T08:38:29.239 INFO:teuthology.orchestra.run.trial059.stdout: mon min osdmap epochs = 50 2026-02-25T08:38:29.239 INFO:teuthology.orchestra.run.trial059.stdout: mon osdmap full prune interval = 2 2026-02-25T08:38:29.239 INFO:teuthology.orchestra.run.trial059.stdout: mon osdmap full prune min = 15 2026-02-25T08:38:29.239 INFO:teuthology.orchestra.run.trial059.stdout: mon osdmap full prune txsize = 2 2026-02-25T08:38:29.239 INFO:teuthology.orchestra.run.trial059.stdout: paxos service trim min = 10 2026-02-25T08:38:29.239 INFO:teuthology.orchestra.run.trial059.stdout: osd pool default crimson = True 2026-02-25T08:38:29.239 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-25T08:38:29.239 INFO:teuthology.orchestra.run.trial059.stdout:[client] 2026-02-25T08:38:29.240 INFO:teuthology.orchestra.run.trial059.stdout: rgw cache enabled = true 2026-02-25T08:38:29.240 INFO:teuthology.orchestra.run.trial059.stdout: rgw enable ops log = true 2026-02-25T08:38:29.240 INFO:teuthology.orchestra.run.trial059.stdout: rgw enable usage log = true 2026-02-25T08:38:29.240 INFO:teuthology.orchestra.run.trial059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-25T08:38:29.240 INFO:teuthology.orchestra.run.trial059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-25T08:38:29.240 INFO:teuthology.orchestra.run.trial059.stdout:[mon.a] 2026-02-25T08:38:29.240 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-25T08:38:29.241 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-25T08:38:29.317 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-25T08:38:29.317 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:38:29.317 DEBUG:teuthology.orchestra.run.trial009:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-25T08:38:29.334 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:38:29.335 DEBUG:teuthology.orchestra.run.trial009:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-25T08:38:29.391 INFO:tasks.ceph:Sending monmap to node ubuntu@trial009.front.sepia.ceph.com 2026-02-25T08:38:29.391 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:38:29.392 DEBUG:teuthology.orchestra.run.trial009:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-25T08:38:29.392 DEBUG:teuthology.orchestra.run.trial009:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-25T08:38:29.464 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:38:29.465 DEBUG:teuthology.orchestra.run.trial009:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-25T08:38:29.521 INFO:tasks.ceph:Sending monmap to node ubuntu@trial059.front.sepia.ceph.com 2026-02-25T08:38:29.521 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-25T08:38:29.521 DEBUG:teuthology.orchestra.run.trial059:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-25T08:38:29.521 DEBUG:teuthology.orchestra.run.trial059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-25T08:38:29.556 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-25T08:38:29.556 DEBUG:teuthology.orchestra.run.trial059:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-25T08:38:29.611 INFO:tasks.ceph:Setting up mon nodes... 2026-02-25T08:38:29.612 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-25T08:38:29.612 DEBUG:teuthology.orchestra.run.trial059:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-25T08:38:29.702 INFO:teuthology.orchestra.run.trial059.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-25T08:38:29.704 INFO:tasks.ceph:Setting up mds nodes... 2026-02-25T08:38:29.705 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-25T08:38:29.705 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-25T08:38:29.748 INFO:teuthology.orchestra.run.trial009.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-25T08:38:29.760 DEBUG:teuthology.orchestra.run.trial059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-25T08:38:29.803 INFO:teuthology.orchestra.run.trial059.stdout:creating /etc/ceph/ceph.client.1.keyring 2026-02-25T08:38:29.815 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-25T08:38:29.816 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial009.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial059.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-25T08:38:29.816 DEBUG:teuthology.orchestra.run.trial009:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-25T08:38:29.841 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-25T08:38:29.841 INFO:tasks.ceph:role: osd.0 2026-02-25T08:38:29.841 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial009.front.sepia.ceph.com 2026-02-25T08:38:29.841 DEBUG:teuthology.orchestra.run.trial009:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-25T08:38:29.906 INFO:teuthology.orchestra.run.trial009.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T08:38:29.906 INFO:teuthology.orchestra.run.trial009.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T08:38:29.906 INFO:teuthology.orchestra.run.trial009.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T08:38:29.906 INFO:teuthology.orchestra.run.trial009.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T08:38:29.906 INFO:teuthology.orchestra.run.trial009.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T08:38:29.907 INFO:teuthology.orchestra.run.trial009.stdout: = sunit=0 swidth=0 blks 2026-02-25T08:38:29.907 INFO:teuthology.orchestra.run.trial009.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T08:38:29.907 INFO:teuthology.orchestra.run.trial009.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T08:38:29.907 INFO:teuthology.orchestra.run.trial009.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T08:38:29.907 INFO:teuthology.orchestra.run.trial009.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T08:38:30.480 INFO:teuthology.orchestra.run.trial009.stdout:Discarding blocks...Done. 2026-02-25T08:38:30.482 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial009.front.sepia.ceph.com -o noatime 2026-02-25T08:38:30.482 DEBUG:teuthology.orchestra.run.trial009:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-25T08:38:30.550 DEBUG:teuthology.orchestra.run.trial009:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-25T08:38:30.617 DEBUG:teuthology.orchestra.run.trial009:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-25T08:38:30.681 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-25T08:38:30.681 INFO:tasks.ceph:role: osd.1 2026-02-25T08:38:30.681 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial009.front.sepia.ceph.com 2026-02-25T08:38:30.681 DEBUG:teuthology.orchestra.run.trial009:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-25T08:38:30.746 INFO:teuthology.orchestra.run.trial009.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T08:38:30.746 INFO:teuthology.orchestra.run.trial009.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T08:38:30.746 INFO:teuthology.orchestra.run.trial009.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T08:38:30.746 INFO:teuthology.orchestra.run.trial009.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T08:38:30.747 INFO:teuthology.orchestra.run.trial009.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T08:38:30.747 INFO:teuthology.orchestra.run.trial009.stdout: = sunit=0 swidth=0 blks 2026-02-25T08:38:30.747 INFO:teuthology.orchestra.run.trial009.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T08:38:30.747 INFO:teuthology.orchestra.run.trial009.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T08:38:30.747 INFO:teuthology.orchestra.run.trial009.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T08:38:30.747 INFO:teuthology.orchestra.run.trial009.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T08:38:31.307 INFO:teuthology.orchestra.run.trial009.stdout:Discarding blocks...Done. 2026-02-25T08:38:31.309 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial009.front.sepia.ceph.com -o noatime 2026-02-25T08:38:31.310 DEBUG:teuthology.orchestra.run.trial009:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-25T08:38:31.382 DEBUG:teuthology.orchestra.run.trial009:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-25T08:38:31.451 DEBUG:teuthology.orchestra.run.trial009:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T08:38:31.603 INFO:teuthology.orchestra.run.trial009.stderr:INFO  osd - OSD::main: parsing early config 2026-02-25T08:38:31.659 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:31,658 seastar - Reactor backend: linux-aio 2026-02-25T08:38:31.670 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:31,670 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-25T08:38:31.670 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:31,670 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-25T08:38:31.672 INFO:teuthology.orchestra.run.trial009.stderr:==36801==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-25T08:38:31.728 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:31,727 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-25T08:38:31.728 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:31,727 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-25T08:38:31.728 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:31,727 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-25T08:38:31.728 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:31,727 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-25T08:38:31.728 INFO:teuthology.orchestra.run.trial009.stderr:DEBUG 2026-02-25 08:38:31,727 [shard 0:main] seastar - reactor::drain 2026-02-25T08:38:33.788 INFO:teuthology.orchestra.run.trial009.stderr:----------------------------------------------------- 2026-02-25T08:38:33.789 INFO:teuthology.orchestra.run.trial009.stderr:Suppressions used: 2026-02-25T08:38:33.789 INFO:teuthology.orchestra.run.trial009.stderr: count bytes template 2026-02-25T08:38:33.789 INFO:teuthology.orchestra.run.trial009.stderr: 1 8 MallocExtension::Register 2026-02-25T08:38:33.789 INFO:teuthology.orchestra.run.trial009.stderr:----------------------------------------------------- 2026-02-25T08:38:33.789 INFO:teuthology.orchestra.run.trial009.stderr: 2026-02-25T08:38:33.808 INFO:teuthology.orchestra.run.trial009.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-25T08:38:33.808 INFO:teuthology.orchestra.run.trial009.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-25T08:38:33.849 INFO:teuthology.orchestra.run.trial009.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-25T08:38:33.849 INFO:teuthology.orchestra.run.trial009.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-25T08:38:33.856 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:33,856 seastar - Reactor backend: linux-aio 2026-02-25T08:38:33.867 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:33,867 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-25T08:38:33.867 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:33,867 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-25T08:38:33.871 INFO:teuthology.orchestra.run.trial009.stderr:==36799==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-25T08:38:33.872 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:33,871 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-25T08:38:33.929 INFO:teuthology.orchestra.run.trial009.stderr:DEBUG 2026-02-25 08:38:33,928 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-25T08:38:34.009 INFO:teuthology.orchestra.run.trial009.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cc1d /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15e37 0x9f0ff73 0x9f1a337 0x78b69db 0x7ba11e3 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x7044244 0x7048045 0x704845b 0x73b7c8f 0x73b7d14 0x73b7e16 0x73b7f0e 0x74780b4 0x72214da 0x7266e18 0x7398e9a 0x73efcd2 0x7221561 0x726701f 0x755dcc5 0x73b7f93 0x73b8071 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:34.009 INFO:teuthology.orchestra.run.trial009.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f 0x9ef6c1b 0x9ef6ea0 0x9f1372b 0x9f18413 0x9ed89e1 0x9ed79e1 0x7ba18b1 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x7044244 0x7048045 0x704845b 0x73b7c8f 0x73b7d14 0x73b7e16 0x73b7f0e 0x74780b4 0x72214da 0x7266e18 0x7398e9a 0x73efcd2 0x7221561 0x726701f 0x755dcc5 0x73b7f93 0x73b8071 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:34.010 INFO:teuthology.orchestra.run.trial009.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15eaf 0x9e21a6a 0x9e21e1c 0x9e220d2 0x9e22b81 0x9e2307f 0x9e236af 0x9e23819 0x9f03b89 0x9f1698c 0x9ed89e1 0x9ed79e1 0x7ba18b1 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x7044244 0x7048045 0x704845b 0x73b7c8f 0x73b7d14 0x73b7e16 0x73b7f0e 0x74780b4 0x72214da 0x7266e18 0x7398e9a 0x73efcd2 0x7221561 0x726701f 0x755dcc5 0x73b7f93 0x73b8071 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:34.159 INFO:teuthology.orchestra.run.trial009.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297e4 /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x318273f 0x9e21d5d 0x9e220d2 0x9e22b81 0x9e2307f 0x9e236af 0x9e23819 0x9f03b89 0x9f1698c 0x9ed89e1 0x9ed79e1 0x7ba18b1 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x6fec95e 0x6ed2592 0x73b5492 0x73b5517 0x73b5619 0x73b5711 0x7477f38 0x72201a5 0x7260160 0x73973b5 0x73ea713 0x722022c 0x7260367 0x755b9c5 0x73b5796 0x73b5874 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:34.159 INFO:teuthology.orchestra.run.trial009.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f 0x318129f 0x9e21b22 0x9e21e1c 0x9e220d2 0x9e22694 0x9e2ab3b 0x9e2b21b 0x9f13d68 0x9f18413 0x9ed89e1 0x9ed79e1 0x7ba18b1 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x6fec95e 0x6ed2592 0x73b5492 0x73b5517 0x73b5619 0x73b5711 0x7477f38 0x72201a5 0x7260160 0x73973b5 0x73ea713 0x722022c 0x7260367 0x755b9c5 0x73b5796 0x73b5874 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:34.159 INFO:teuthology.orchestra.run.trial009.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x16b36a /lib64/libasan.so.8+0xb0541 /lib64/libasan.so.8+0xb1437 0xb7ac87 0x10a27ac 0xf47938 0x9e26106 0x9e263b3 0x9f138a5 0x9f18413 0x9ed89e1 0x9ed79e1 0x7ba18b1 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x6fec95e 0x6ed2592 0x73b5492 0x73b5517 0x73b5619 0x73b5711 0x7477f38 0x72201a5 0x7260160 0x73973b5 0x73ea713 0x722022c 0x7260367 0x755b9c5 0x73b5796 0x73b5874 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:36.307 INFO:teuthology.orchestra.run.trial009.stderr:----------------------------------------------------- 2026-02-25T08:38:36.308 INFO:teuthology.orchestra.run.trial009.stderr:Suppressions used: 2026-02-25T08:38:36.308 INFO:teuthology.orchestra.run.trial009.stderr: count bytes template 2026-02-25T08:38:36.308 INFO:teuthology.orchestra.run.trial009.stderr: 1 8 MallocExtension::Register 2026-02-25T08:38:36.308 INFO:teuthology.orchestra.run.trial009.stderr:----------------------------------------------------- 2026-02-25T08:38:36.308 INFO:teuthology.orchestra.run.trial009.stderr: 2026-02-25T08:38:36.340 DEBUG:teuthology.orchestra.run.trial009:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-25T08:38:36.366 DEBUG:teuthology.orchestra.run.trial009:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T08:38:36.518 INFO:teuthology.orchestra.run.trial009.stderr:INFO  osd - OSD::main: parsing early config 2026-02-25T08:38:36.571 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:36,570 seastar - Reactor backend: linux-aio 2026-02-25T08:38:36.582 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:36,582 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-25T08:38:36.582 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:36,582 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-25T08:38:36.585 INFO:teuthology.orchestra.run.trial009.stderr:==36870==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-25T08:38:36.639 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:36,638 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-25T08:38:36.639 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:36,638 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-25T08:38:36.639 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:36,638 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-25T08:38:36.640 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:36,638 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-25T08:38:36.640 INFO:teuthology.orchestra.run.trial009.stderr:DEBUG 2026-02-25 08:38:36,638 [shard 0:main] seastar - reactor::drain 2026-02-25T08:38:38.702 INFO:teuthology.orchestra.run.trial009.stderr:----------------------------------------------------- 2026-02-25T08:38:38.702 INFO:teuthology.orchestra.run.trial009.stderr:Suppressions used: 2026-02-25T08:38:38.702 INFO:teuthology.orchestra.run.trial009.stderr: count bytes template 2026-02-25T08:38:38.702 INFO:teuthology.orchestra.run.trial009.stderr: 1 8 MallocExtension::Register 2026-02-25T08:38:38.702 INFO:teuthology.orchestra.run.trial009.stderr:----------------------------------------------------- 2026-02-25T08:38:38.702 INFO:teuthology.orchestra.run.trial009.stderr: 2026-02-25T08:38:38.721 INFO:teuthology.orchestra.run.trial009.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-25T08:38:38.721 INFO:teuthology.orchestra.run.trial009.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-25T08:38:38.772 INFO:teuthology.orchestra.run.trial009.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-25T08:38:38.772 INFO:teuthology.orchestra.run.trial009.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-25T08:38:38.780 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:38,779 seastar - Reactor backend: linux-aio 2026-02-25T08:38:38.789 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:38,789 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-25T08:38:38.790 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:38,789 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-25T08:38:38.793 INFO:teuthology.orchestra.run.trial009.stderr:==36868==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-25T08:38:38.793 INFO:teuthology.orchestra.run.trial009.stderr:INFO 2026-02-25 08:38:38,792 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-25T08:38:38.851 INFO:teuthology.orchestra.run.trial009.stderr:DEBUG 2026-02-25 08:38:38,851 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-25T08:38:38.932 INFO:teuthology.orchestra.run.trial009.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x12976b /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x157c7 0xca7484 0xcb94be 0x9e695c1 0x9f186e4 0x9ed89e1 0x9ed79e1 0x7ba18b1 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x7044244 0x7048045 0x704845b 0x73b7c8f 0x73b7d14 0x73b7e16 0x73b7f0e 0x74780b4 0x72214da 0x7266e18 0x7398e9a 0x73efcd2 0x7221561 0x726701f 0x755dcc5 0x73b7f93 0x73b8071 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:38.932 INFO:teuthology.orchestra.run.trial009.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x8eea /lib64/libasan.so.8+0xedc45 0xe40f5d 0x9ef6526 0x9ef66e2 0x9ef684b 0x9ef6976 0x9ef6ea0 0x9f1372b 0x9f18413 0x9ed89e1 0x9ed79e1 0x7ba18b1 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x7044244 0x7048045 0x704845b 0x73b7c8f 0x73b7d14 0x73b7e16 0x73b7f0e 0x74780b4 0x72214da 0x7266e18 0x7398e9a 0x73efcd2 0x7221561 0x726701f 0x755dcc5 0x73b7f93 0x73b8071 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:38.932 INFO:teuthology.orchestra.run.trial009.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff9c81fee1 0xffffffff9c8203b0 0xffffffff9c69525e 0xffffffff9c9e7269 0xffffffff9c9ca7d5 0xffffffff9c9d4bab 0xffffffff9c9d500b 0xffffffff9c6910d2 0xffffffff9d350451 0xffffffff9d400ba2 2026-02-25T08:38:38.932 INFO:teuthology.orchestra.run.trial009.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc589 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x9eeb07e 0x9eeb14a 0x9f13269 0x9f18413 0x9ed89e1 0x9ed79e1 0x7ba18b1 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x7044244 0x7048045 0x704845b 0x73b7c8f 0x73b7d14 0x73b7e16 0x73b7f0e 0x74780b4 0x72214da 0x7266e18 0x7398e9a 0x73efcd2 0x7221561 0x726701f 0x755dcc5 0x73b7f93 0x73b8071 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:38.932 INFO:teuthology.orchestra.run.trial009.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff9c691052 0xffffffff9d350451 0xffffffff9d400ba2 2026-02-25T08:38:39.081 INFO:teuthology.orchestra.run.trial009.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x119106 /lib64/libasan.so.8+0xebbf /lib64/libasan.so.8+0xef905 0x3185724 0x31858fe 0x3185bb5 0x3185b7a 0x3185caa 0x6f4328c 0x9ef901e 0x9ef9236 0x9ef9508 0x7ba18ef 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x6fec95e 0x6ed2592 0x73b5492 0x73b5517 0x73b5619 0x73b5711 0x7477f38 0x72201a5 0x7260160 0x73973b5 0x73ea713 0x722022c 0x7260367 0x755b9c5 0x73b5796 0x73b5874 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:39.081 INFO:teuthology.orchestra.run.trial009.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x158a9 0x10a2823 0xf47938 0x9e218ac 0x9e21ba9 0x9e21e1c 0x9e22e1c 0x9e2338a 0x9e236af 0x9e23819 0x9f03b89 0x9f1698c 0x9ed89e1 0x9ed79e1 0x7ba18b1 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x6fec95e 0x6ed2592 0x73b5492 0x73b5517 0x73b5619 0x73b5711 0x7477f38 0x72201a5 0x7260160 0x73973b5 0x73ea713 0x722022c 0x7260367 0x755b9c5 0x73b5796 0x73b5874 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:39.082 INFO:teuthology.orchestra.run.trial009.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f 0x9e21977 0x9e21ba9 0x9e21e1c 0x9e220d2 0x9e22b81 0x9e2307f 0x9e236af 0x9e23819 0x9f03b89 0x9f1698c 0x9ed89e1 0x9ed79e1 0x7ba18b1 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x6fec95e 0x6ed2592 0x73b5492 0x73b5517 0x73b5619 0x73b5711 0x7477f38 0x72201a5 0x7260160 0x73973b5 0x73ea713 0x722022c 0x7260367 0x755b9c5 0x73b5796 0x73b5874 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:41.238 INFO:teuthology.orchestra.run.trial009.stderr:----------------------------------------------------- 2026-02-25T08:38:41.239 INFO:teuthology.orchestra.run.trial009.stderr:Suppressions used: 2026-02-25T08:38:41.239 INFO:teuthology.orchestra.run.trial009.stderr: count bytes template 2026-02-25T08:38:41.239 INFO:teuthology.orchestra.run.trial009.stderr: 1 8 MallocExtension::Register 2026-02-25T08:38:41.239 INFO:teuthology.orchestra.run.trial009.stderr:----------------------------------------------------- 2026-02-25T08:38:41.239 INFO:teuthology.orchestra.run.trial009.stderr: 2026-02-25T08:38:41.271 DEBUG:teuthology.orchestra.run.trial009:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-25T08:38:41.296 DEBUG:teuthology.orchestra.run.trial059:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-25T08:38:41.322 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-25T08:38:41.322 INFO:tasks.ceph:role: osd.2 2026-02-25T08:38:41.322 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial059.front.sepia.ceph.com 2026-02-25T08:38:41.323 DEBUG:teuthology.orchestra.run.trial059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-25T08:38:41.386 INFO:teuthology.orchestra.run.trial059.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T08:38:41.387 INFO:teuthology.orchestra.run.trial059.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T08:38:41.387 INFO:teuthology.orchestra.run.trial059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T08:38:41.387 INFO:teuthology.orchestra.run.trial059.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T08:38:41.387 INFO:teuthology.orchestra.run.trial059.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T08:38:41.387 INFO:teuthology.orchestra.run.trial059.stdout: = sunit=0 swidth=0 blks 2026-02-25T08:38:41.387 INFO:teuthology.orchestra.run.trial059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T08:38:41.387 INFO:teuthology.orchestra.run.trial059.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T08:38:41.387 INFO:teuthology.orchestra.run.trial059.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T08:38:41.387 INFO:teuthology.orchestra.run.trial059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T08:38:41.964 INFO:teuthology.orchestra.run.trial059.stdout:Discarding blocks...Done. 2026-02-25T08:38:41.966 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial059.front.sepia.ceph.com -o noatime 2026-02-25T08:38:41.966 DEBUG:teuthology.orchestra.run.trial059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-25T08:38:42.032 DEBUG:teuthology.orchestra.run.trial059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-25T08:38:42.099 DEBUG:teuthology.orchestra.run.trial059:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-25T08:38:42.162 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-25T08:38:42.162 INFO:tasks.ceph:role: osd.3 2026-02-25T08:38:42.162 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial059.front.sepia.ceph.com 2026-02-25T08:38:42.162 DEBUG:teuthology.orchestra.run.trial059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-25T08:38:42.228 INFO:teuthology.orchestra.run.trial059.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T08:38:42.228 INFO:teuthology.orchestra.run.trial059.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T08:38:42.228 INFO:teuthology.orchestra.run.trial059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T08:38:42.228 INFO:teuthology.orchestra.run.trial059.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T08:38:42.228 INFO:teuthology.orchestra.run.trial059.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T08:38:42.228 INFO:teuthology.orchestra.run.trial059.stdout: = sunit=0 swidth=0 blks 2026-02-25T08:38:42.228 INFO:teuthology.orchestra.run.trial059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T08:38:42.228 INFO:teuthology.orchestra.run.trial059.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T08:38:42.228 INFO:teuthology.orchestra.run.trial059.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T08:38:42.228 INFO:teuthology.orchestra.run.trial059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T08:38:42.787 INFO:teuthology.orchestra.run.trial059.stdout:Discarding blocks...Done. 2026-02-25T08:38:42.789 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial059.front.sepia.ceph.com -o noatime 2026-02-25T08:38:42.790 DEBUG:teuthology.orchestra.run.trial059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2026-02-25T08:38:42.858 DEBUG:teuthology.orchestra.run.trial059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-25T08:38:42.924 DEBUG:teuthology.orchestra.run.trial059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T08:38:43.076 INFO:teuthology.orchestra.run.trial059.stderr:INFO  osd - OSD::main: parsing early config 2026-02-25T08:38:43.136 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:43,135 seastar - Reactor backend: linux-aio 2026-02-25T08:38:43.153 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:43,152 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-25T08:38:43.153 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:43,153 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-25T08:38:43.155 INFO:teuthology.orchestra.run.trial059.stderr:==36852==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-25T08:38:43.210 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:43,209 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-25T08:38:43.211 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:43,209 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-25T08:38:43.211 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:43,210 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-25T08:38:43.211 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:43,210 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-25T08:38:43.211 INFO:teuthology.orchestra.run.trial059.stderr:DEBUG 2026-02-25 08:38:43,210 [shard 0:main] seastar - reactor::drain 2026-02-25T08:38:45.279 INFO:teuthology.orchestra.run.trial059.stderr:----------------------------------------------------- 2026-02-25T08:38:45.280 INFO:teuthology.orchestra.run.trial059.stderr:Suppressions used: 2026-02-25T08:38:45.280 INFO:teuthology.orchestra.run.trial059.stderr: count bytes template 2026-02-25T08:38:45.280 INFO:teuthology.orchestra.run.trial059.stderr: 1 8 MallocExtension::Register 2026-02-25T08:38:45.280 INFO:teuthology.orchestra.run.trial059.stderr:----------------------------------------------------- 2026-02-25T08:38:45.280 INFO:teuthology.orchestra.run.trial059.stderr: 2026-02-25T08:38:45.299 INFO:teuthology.orchestra.run.trial059.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-25T08:38:45.299 INFO:teuthology.orchestra.run.trial059.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-25T08:38:45.341 INFO:teuthology.orchestra.run.trial059.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-25T08:38:45.341 INFO:teuthology.orchestra.run.trial059.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-25T08:38:45.348 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:45,347 seastar - Reactor backend: linux-aio 2026-02-25T08:38:45.359 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:45,358 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-25T08:38:45.359 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:45,359 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-25T08:38:45.363 INFO:teuthology.orchestra.run.trial059.stderr:==36850==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-25T08:38:45.364 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:45,363 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-25T08:38:45.422 INFO:teuthology.orchestra.run.trial059.stderr:DEBUG 2026-02-25 08:38:45,422 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-25T08:38:45.503 INFO:teuthology.orchestra.run.trial059.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xfd18c /lib64/libasan.so.8+0xedcb5 0xe40f5d 0x9d7520f 0x9eec474 0x9eec56d 0x7ba1220 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x7044244 0x7048045 0x704845b 0x73b7c8f 0x73b7d14 0x73b7e16 0x73b7f0e 0x74780b4 0x72214da 0x7266e18 0x7398e9a 0x73efcd2 0x7221561 0x726701f 0x755dcc5 0x73b7f93 0x73b8071 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:45.503 INFO:teuthology.orchestra.run.trial059.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6583 /lib64/libasan.so.8+0x15197 0x9e21748 0x9e21ba9 0x9e21e1c 0x9e22e1c 0x9e2ae9f 0x9e2b21b 0x9f13d68 0x9f18413 0x9ed89e1 0x9ed79e1 0x7ba18b1 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x7044244 0x7048045 0x704845b 0x73b7c8f 0x73b7d14 0x73b7e16 0x73b7f0e 0x74780b4 0x72214da 0x7266e18 0x7398e9a 0x73efcd2 0x7221561 0x726701f 0x755dcc5 0x73b7f93 0x73b8071 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:45.503 INFO:teuthology.orchestra.run.trial059.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xf4ea2 /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x157c7 0x10a2823 0xf47938 0x9e26106 0x9e263b3 0x9f138a5 0x9f18413 0x9ed89e1 0x9ed79e1 0x7ba18b1 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x7044244 0x7048045 0x704845b 0x73b7c8f 0x73b7d14 0x73b7e16 0x73b7f0e 0x74780b4 0x72214da 0x7266e18 0x7398e9a 0x73efcd2 0x7221561 0x726701f 0x755dcc5 0x73b7f93 0x73b8071 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:45.652 INFO:teuthology.orchestra.run.trial059.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f 0x113805f 0xf4792d 0x9e216df 0x9e21ba9 0x9e21e1c 0x9e220d2 0x9e22694 0x9e2ab3b 0x9e2b21b 0x9f13d68 0x9f18413 0x9ed89e1 0x9ed79e1 0x7ba18b1 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x6fec95e 0x6ed2592 0x73b5492 0x73b5517 0x73b5619 0x73b5711 0x7477f38 0x72201a5 0x7260160 0x73973b5 0x73ea713 0x722022c 0x7260367 0x755b9c5 0x73b5796 0x73b5874 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:45.653 INFO:teuthology.orchestra.run.trial059.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1583b 0x12449a3 0x1244bee 0xff5a58 0x9d756f4 0x9eec474 0x9eec56d 0x7ba1825 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x6fec95e 0x6ed2592 0x73b5492 0x73b5517 0x73b5619 0x73b5711 0x7477f38 0x72201a5 0x7260160 0x73973b5 0x73ea713 0x722022c 0x7260367 0x755b9c5 0x73b5796 0x73b5874 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:45.653 INFO:teuthology.orchestra.run.trial059.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x8eea /lib64/libasan.so.8+0xedc45 0xe40f5d 0x9ef6526 0x9ef66e2 0x9ef684b 0x9ef6976 0x9ef6ea0 0x9f1372b 0x9f18413 0x9ed89e1 0x9ed79e1 0x7ba18b1 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x6fec95e 0x6ed2592 0x73b5492 0x73b5517 0x73b5619 0x73b5711 0x7477f38 0x72201a5 0x7260160 0x73973b5 0x73ea713 0x722022c 0x7260367 0x755b9c5 0x73b5796 0x73b5874 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:45.653 INFO:teuthology.orchestra.run.trial059.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff8dc94317 0xffffffff8de20057 0xffffffff8de203b0 0xffffffff8dc9525e 0xffffffff8dfe7269 0xffffffff8dfca7d5 0xffffffff8dfd4bab 0xffffffff8dfd500b 0xffffffff8dc910d2 0xffffffff8e950451 0xffffffff8ea00ba2 2026-02-25T08:38:47.800 INFO:teuthology.orchestra.run.trial059.stderr:----------------------------------------------------- 2026-02-25T08:38:47.801 INFO:teuthology.orchestra.run.trial059.stderr:Suppressions used: 2026-02-25T08:38:47.801 INFO:teuthology.orchestra.run.trial059.stderr: count bytes template 2026-02-25T08:38:47.801 INFO:teuthology.orchestra.run.trial059.stderr: 1 8 MallocExtension::Register 2026-02-25T08:38:47.801 INFO:teuthology.orchestra.run.trial059.stderr:----------------------------------------------------- 2026-02-25T08:38:47.801 INFO:teuthology.orchestra.run.trial059.stderr: 2026-02-25T08:38:47.830 DEBUG:teuthology.orchestra.run.trial059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-25T08:38:47.856 DEBUG:teuthology.orchestra.run.trial059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T08:38:48.006 INFO:teuthology.orchestra.run.trial059.stderr:INFO  osd - OSD::main: parsing early config 2026-02-25T08:38:48.062 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:48,061 seastar - Reactor backend: linux-aio 2026-02-25T08:38:48.073 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:48,072 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-25T08:38:48.073 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:48,072 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-25T08:38:48.075 INFO:teuthology.orchestra.run.trial059.stderr:==36919==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-25T08:38:48.129 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:48,128 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-25T08:38:48.130 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:48,128 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-25T08:38:48.130 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:48,128 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-25T08:38:48.130 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:48,128 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-25T08:38:48.130 INFO:teuthology.orchestra.run.trial059.stderr:DEBUG 2026-02-25 08:38:48,129 [shard 0:main] seastar - reactor::drain 2026-02-25T08:38:50.194 INFO:teuthology.orchestra.run.trial059.stderr:----------------------------------------------------- 2026-02-25T08:38:50.194 INFO:teuthology.orchestra.run.trial059.stderr:Suppressions used: 2026-02-25T08:38:50.194 INFO:teuthology.orchestra.run.trial059.stderr: count bytes template 2026-02-25T08:38:50.194 INFO:teuthology.orchestra.run.trial059.stderr: 1 8 MallocExtension::Register 2026-02-25T08:38:50.194 INFO:teuthology.orchestra.run.trial059.stderr:----------------------------------------------------- 2026-02-25T08:38:50.194 INFO:teuthology.orchestra.run.trial059.stderr: 2026-02-25T08:38:50.213 INFO:teuthology.orchestra.run.trial059.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-25T08:38:50.213 INFO:teuthology.orchestra.run.trial059.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-25T08:38:50.257 INFO:teuthology.orchestra.run.trial059.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-25T08:38:50.257 INFO:teuthology.orchestra.run.trial059.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-25T08:38:50.263 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:50,263 seastar - Reactor backend: linux-aio 2026-02-25T08:38:50.276 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:50,276 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-25T08:38:50.276 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:50,276 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-25T08:38:50.280 INFO:teuthology.orchestra.run.trial059.stderr:==36917==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-25T08:38:50.280 INFO:teuthology.orchestra.run.trial059.stderr:INFO 2026-02-25 08:38:50,280 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-25T08:38:50.337 INFO:teuthology.orchestra.run.trial059.stderr:DEBUG 2026-02-25 08:38:50,337 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-25T08:38:50.417 INFO:teuthology.orchestra.run.trial059.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f 0x9e21737 0x9e21ba9 0x9e21e1c 0x9e23b43 0x9f03032 0x9f03487 0x9f03972 0x9f03d05 0x9f1698c 0x9ed89e1 0x9ed79e1 0x7ba18b1 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x7044244 0x7048045 0x704845b 0x73b7c8f 0x73b7d14 0x73b7e16 0x73b7f0e 0x74780b4 0x72214da 0x7266e18 0x7398e9a 0x73efcd2 0x7221561 0x726701f 0x755dcc5 0x73b7f93 0x73b8071 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:50.417 INFO:teuthology.orchestra.run.trial059.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x11916f /lib64/libasan.so.8+0xc5f4 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x9e7a6b1 0x9e7a770 0x9e7aa18 0x9f09007 0x9f097c6 0x9f09d0c 0x9f13f9a 0x9f18413 0x9ed89e1 0x9ed79e1 0x7ba18b1 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x7044244 0x7048045 0x704845b 0x73b7c8f 0x73b7d14 0x73b7e16 0x73b7f0e 0x74780b4 0x72214da 0x7266e18 0x7398e9a 0x73efcd2 0x7221561 0x726701f 0x755dcc5 0x73b7f93 0x73b8071 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:50.417 INFO:teuthology.orchestra.run.trial059.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f 0xe40d96 0x9d73524 0x9d73668 0x9d7374d 0x9d739a9 0x9d73a9c 0x9d73b78 0x9d73df4 0x9d73ead 0x9d7439b 0x9d7479f 0x9d74a5c 0x9f165e1 0x9ed89e1 0x9ed79e1 0x7ba18b1 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x7044244 0x7048045 0x704845b 0x73b7c8f 0x73b7d14 0x73b7e16 0x73b7f0e 0x74780b4 0x72214da 0x7266e18 0x7398e9a 0x73efcd2 0x7221561 0x726701f 0x755dcc5 0x73b7f93 0x73b8071 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:50.567 INFO:teuthology.orchestra.run.trial059.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f 0x7ba1180 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x6fec95e 0x6ed2592 0x73b5492 0x73b5517 0x73b5619 0x73b5711 0x7477f38 0x72201a5 0x7260160 0x73973b5 0x73ea713 0x722022c 0x7260367 0x755b9c5 0x73b5796 0x73b5874 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:50.568 INFO:teuthology.orchestra.run.trial059.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x16b37d /lib64/libasan.so.8+0xb0541 /lib64/libasan.so.8+0xb1437 0xb7ac87 0x10a27ac 0xf47938 0x9f0a303 0x9f0f82c 0x9f0fe6a 0x9f1a337 0x78b69db 0x7ba11e3 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x6fec95e 0x6ed2592 0x73b5492 0x73b5517 0x73b5619 0x73b5711 0x7477f38 0x72201a5 0x7260160 0x73973b5 0x73ea713 0x722022c 0x7260367 0x755b9c5 0x73b5796 0x73b5874 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:50.568 INFO:teuthology.orchestra.run.trial059.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9ff8dc8 0x9ff90b1 0xa059a4f 0xa05a242 0xa05a4b0 0xa05a5f8 0xa05aab7 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x118c56 /lib64/libasan.so.8+0xebbf /lib64/libasan.so.8+0xef905 0x3185724 0x31858fe 0x3185bb5 0x3185caa 0x6f4328c 0x9ef901e 0x9ef9236 0x9ef9508 0x7ba18ef 0x7bab3d4 0x7a28841 0x7a561e3 0x716287f 0x6fec95e 0x6ed2592 0x73b5492 0x73b5517 0x73b5619 0x73b5711 0x7477f38 0x72201a5 0x7260160 0x73973b5 0x73ea713 0x722022c 0x7260367 0x755b9c5 0x73b5796 0x73b5874 0x7397530 0x7495d5a 0x7529f3a 0x7529fb5 0x755ba46 0x747862e 0x75ba6f2 0xa0b3917 0xa007bec 0xa0e1387 0xa149b6a 0xa1645fa 0xa164c76 0x272f695 0xa772b80 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-25T08:38:52.711 INFO:teuthology.orchestra.run.trial059.stderr:----------------------------------------------------- 2026-02-25T08:38:52.711 INFO:teuthology.orchestra.run.trial059.stderr:Suppressions used: 2026-02-25T08:38:52.712 INFO:teuthology.orchestra.run.trial059.stderr: count bytes template 2026-02-25T08:38:52.712 INFO:teuthology.orchestra.run.trial059.stderr: 1 8 MallocExtension::Register 2026-02-25T08:38:52.712 INFO:teuthology.orchestra.run.trial059.stderr:----------------------------------------------------- 2026-02-25T08:38:52.712 INFO:teuthology.orchestra.run.trial059.stderr: 2026-02-25T08:38:52.743 DEBUG:teuthology.orchestra.run.trial059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-25T08:38:52.769 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-25T08:38:52.769 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:38:52.769 DEBUG:teuthology.orchestra.run.trial009:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-25T08:38:52.795 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:38:52.795 DEBUG:teuthology.orchestra.run.trial009:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-25T08:38:52.859 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-25T08:38:52.860 DEBUG:teuthology.orchestra.run.trial059:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-25T08:38:52.886 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-25T08:38:52.886 DEBUG:teuthology.orchestra.run.trial059:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-25T08:38:52.949 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-25T08:38:52.949 DEBUG:teuthology.orchestra.run.trial059:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-25T08:38:53.012 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:38:53.012 DEBUG:teuthology.orchestra.run.trial009:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-25T08:38:53.028 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-25T08:38:53.029 DEBUG:teuthology.orchestra.run.trial059:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2026-02-25T08:38:53.069 INFO:tasks.ceph:Adding keys to all mons... 2026-02-25T08:38:53.069 DEBUG:teuthology.orchestra.run.trial009:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-25T08:38:53.093 INFO:teuthology.orchestra.run.trial009.stdout:[osd.0] 2026-02-25T08:38:53.093 INFO:teuthology.orchestra.run.trial009.stdout: key = AQAJtZ5pDJWPNxAAAx8EZNLaMhTRLbyfDsuXrQ== 2026-02-25T08:38:53.093 INFO:teuthology.orchestra.run.trial009.stdout:[osd.1] 2026-02-25T08:38:53.093 INFO:teuthology.orchestra.run.trial009.stdout: key = AQAOtZ5pRUr3MhAAd1kNT6mVbLgETsz+L6hPmg== 2026-02-25T08:38:53.093 INFO:teuthology.orchestra.run.trial009.stdout:[mgr.x] 2026-02-25T08:38:53.093 INFO:teuthology.orchestra.run.trial009.stdout: key = AQAFtZ5pb1nRKRAAZRSz1zxLCeCJfcghi+fSPQ== 2026-02-25T08:38:53.093 INFO:teuthology.orchestra.run.trial009.stdout:[osd.2] 2026-02-25T08:38:53.093 INFO:teuthology.orchestra.run.trial009.stdout: key = AQAVtZ5p2ulkGRAA71PxRNbwcU9uMdFgn/VQjQ== 2026-02-25T08:38:53.093 INFO:teuthology.orchestra.run.trial009.stdout:[osd.3] 2026-02-25T08:38:53.094 INFO:teuthology.orchestra.run.trial009.stdout: key = AQAatZ5piEZTFBAA0aKX2CQPpfqtSFFNtFOaGA== 2026-02-25T08:38:53.094 INFO:teuthology.orchestra.run.trial009.stdout:[client.0] 2026-02-25T08:38:53.094 INFO:teuthology.orchestra.run.trial009.stdout: key = AQAFtZ5pJLuRLBAALPjrEf7plUzhmNZxpaxvug== 2026-02-25T08:38:53.094 INFO:teuthology.orchestra.run.trial009.stdout:[client.1] 2026-02-25T08:38:53.094 INFO:teuthology.orchestra.run.trial009.stdout: key = AQAFtZ5pAL3XLxAAcEwKUzwEFjhS7H3LXMJ+UQ== 2026-02-25T08:38:53.095 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T08:38:53.183 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T08:38:53.232 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-25T08:38:53.281 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T08:38:53.330 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T08:38:53.379 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-25T08:38:53.430 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-25T08:38:53.481 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-25T08:38:53.481 DEBUG:teuthology.orchestra.run.trial009:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-25T08:38:53.506 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-25T08:38:53.592 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:38:53.590+0000 7fef23842c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:53.592 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:38:53.590+0000 7fef23842c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:53.604 DEBUG:teuthology.orchestra.run.trial009:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-25T08:38:53.628 DEBUG:teuthology.orchestra.run.trial009:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-25T08:38:53.685 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-25T08:38:53.685 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-25T08:38:53.686 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-25T08:38:53.727 INFO:tasks.ceph.mon.a:Started 2026-02-25T08:38:53.727 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-25T08:38:53.727 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-25T08:38:53.728 DEBUG:teuthology.orchestra.run.trial059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-25T08:38:53.730 INFO:tasks.ceph.mgr.x:Started 2026-02-25T08:38:53.730 DEBUG:tasks.ceph:set 0 configs 2026-02-25T08:38:53.731 DEBUG:teuthology.orchestra.run.trial009:> sudo ceph --cluster ceph config dump 2026-02-25T08:38:53.787 INFO:tasks.ceph.mon.a.trial009.stderr:2026-02-25T08:38:53.785+0000 7f1cdf0a2c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:53.788 INFO:tasks.ceph.mon.a.trial009.stderr:2026-02-25T08:38:53.785+0000 7f1cdf0a2c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:53.788 INFO:tasks.ceph.mon.a.trial009.stderr:2026-02-25T08:38:53.786+0000 7f1cdf0a2c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:53.790 INFO:tasks.ceph.mgr.x.trial059.stderr:2026-02-25T08:38:53.788+0000 7f7972030fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:53.804 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:38:53.800+0000 7f22e7b64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:53.808 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:38:53.806+0000 7f22e7b64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:53.814 INFO:tasks.ceph.mgr.x.trial059.stderr:2026-02-25T08:38:53.812+0000 7f7972030fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:53.814 INFO:tasks.ceph.mgr.x.trial059.stderr:2026-02-25T08:38:53.813+0000 7f7972030fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:53.841 INFO:teuthology.orchestra.run.trial009.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-25T08:38:53.847 INFO:tasks.ceph:Setting crush tunables to default 2026-02-25T08:38:53.847 DEBUG:teuthology.orchestra.run.trial009:> sudo ceph --cluster ceph osd crush tunables default 2026-02-25T08:38:53.924 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:38:53.919+0000 7f3b430cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:53.926 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:38:53.925+0000 7f3b430cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:53.963 INFO:teuthology.orchestra.run.trial009.stderr:adjusted tunables profile to default 2026-02-25T08:38:53.972 INFO:tasks.ceph:check_enable_crimson: True 2026-02-25T08:38:53.972 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-25T08:38:53.973 DEBUG:teuthology.orchestra.run.trial009:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-25T08:38:54.045 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:38:54.040+0000 7fb6b07cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:54.047 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:38:54.046+0000 7fb6b07cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:54.086 INFO:tasks.ceph.mon.a.trial009.stderr:2026-02-25T08:38:54.084+0000 7f1cd67f1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-25T08:38:54.086 INFO:tasks.ceph.mon.a.trial009.stderr:Please be aware that this feature is experimental, untested, 2026-02-25T08:38:54.086 INFO:tasks.ceph.mon.a.trial009.stderr:unsupported, and may result in data corruption, data loss, 2026-02-25T08:38:54.086 INFO:tasks.ceph.mon.a.trial009.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-25T08:38:54.086 INFO:tasks.ceph.mon.a.trial009.stderr:feature with important data. 2026-02-25T08:38:54.086 INFO:tasks.ceph.mon.a.trial009.stderr: 2026-02-25T08:38:54.658 INFO:tasks.ceph.mgr.x.trial059.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-25T08:38:54.658 INFO:tasks.ceph.mgr.x.trial059.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-25T08:38:54.658 INFO:tasks.ceph.mgr.x.trial059.stderr: from numpy import show_config as show_numpy_config 2026-02-25T08:38:54.975 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-25T08:38:54.975 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:38:54.975 DEBUG:teuthology.orchestra.run.trial009:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-25T08:38:55.000 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:38:55.000 DEBUG:teuthology.orchestra.run.trial009:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-25T08:38:55.064 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-25T08:38:55.064 DEBUG:teuthology.orchestra.run.trial059:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-25T08:38:55.089 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-25T08:38:55.089 DEBUG:teuthology.orchestra.run.trial059:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-25T08:38:55.153 DEBUG:teuthology.orchestra.run.trial059:> sudo ceph --cluster ceph osd new 08eaef4c-a709-4cb0-9bd5-cd7698b3c29f 0 2026-02-25T08:38:55.268 INFO:teuthology.orchestra.run.trial059.stderr:2026-02-25T08:38:55.262+0000 7fa128c11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:55.270 INFO:teuthology.orchestra.run.trial059.stderr:2026-02-25T08:38:55.268+0000 7fa128c11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:55.308 INFO:teuthology.orchestra.run.trial059.stdout:0 2026-02-25T08:38:55.316 DEBUG:teuthology.orchestra.run.trial059:> sudo ceph --cluster ceph osd new d3c936d9-0068-4832-8e94-706b81084d4a 1 2026-02-25T08:38:55.391 INFO:teuthology.orchestra.run.trial059.stderr:2026-02-25T08:38:55.385+0000 7f828bb0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:55.393 INFO:teuthology.orchestra.run.trial059.stderr:2026-02-25T08:38:55.391+0000 7f828bb0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:55.432 INFO:teuthology.orchestra.run.trial059.stdout:1 2026-02-25T08:38:55.441 DEBUG:teuthology.orchestra.run.trial059:> sudo ceph --cluster ceph osd new ed0c9b25-bffe-4250-9093-a1ef55469878 2 2026-02-25T08:38:55.517 INFO:teuthology.orchestra.run.trial059.stderr:2026-02-25T08:38:55.512+0000 7fe492d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:55.519 INFO:teuthology.orchestra.run.trial059.stderr:2026-02-25T08:38:55.517+0000 7fe492d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:55.558 INFO:teuthology.orchestra.run.trial059.stdout:2 2026-02-25T08:38:55.567 DEBUG:teuthology.orchestra.run.trial059:> sudo ceph --cluster ceph osd new 673cc133-8da7-49dc-9d33-43ef24d8a399 3 2026-02-25T08:38:55.642 INFO:teuthology.orchestra.run.trial059.stderr:2026-02-25T08:38:55.637+0000 7f2cb1e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:55.644 INFO:teuthology.orchestra.run.trial059.stderr:2026-02-25T08:38:55.642+0000 7f2cb1e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:55.683 INFO:teuthology.orchestra.run.trial059.stdout:3 2026-02-25T08:38:55.691 DEBUG:teuthology.orchestra.run.trial009:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-25T08:38:55.718 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-25T08:38:55.719 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-25T08:38:55.761 INFO:tasks.ceph.osd.0:Started 2026-02-25T08:38:55.761 DEBUG:teuthology.orchestra.run.trial009:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-25T08:38:55.789 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-25T08:38:55.789 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-25T08:38:55.831 INFO:tasks.ceph.osd.1:Started 2026-02-25T08:38:55.831 DEBUG:teuthology.orchestra.run.trial059:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-25T08:38:55.859 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-25T08:38:55.859 DEBUG:teuthology.orchestra.run.trial059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-25T08:38:55.901 INFO:tasks.ceph.osd.2:Started 2026-02-25T08:38:55.901 DEBUG:teuthology.orchestra.run.trial059:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2026-02-25T08:38:55.928 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-25T08:38:55.928 DEBUG:teuthology.orchestra.run.trial059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2026-02-25T08:38:55.970 INFO:tasks.ceph.osd.3:Started 2026-02-25T08:38:55.970 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T08:38:56.047 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:38:56.044+0000 7f56b5e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:56.050 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:38:56.049+0000 7f56b5e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:56.084 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:38:56.084 INFO:teuthology.orchestra.run.trial009.stdout:{"epoch":7,"fsid":"864c6132-1c9b-4620-b7bf-62f54427687f","created":"2026-02-25T08:38:53.799625+0000","modified":"2026-02-25T08:38:55.682585+0000","last_up_change":"0.000000","last_in_change":"2026-02-25T08:38:55.682585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"08eaef4c-a709-4cb0-9bd5-cd7698b3c29f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d3c936d9-0068-4832-8e94-706b81084d4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ed0c9b25-bffe-4250-9093-a1ef55469878","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"673cc133-8da7-49dc-9d33-43ef24d8a399","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T08:38:56.091 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-25T08:38:56.091 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-25T08:38:56.493 DEBUG:teuthology.orchestra.run.trial009:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-25T08:38:56.559 INFO:teuthology.misc.health.trial009.stderr:2026-02-25T08:38:56.555+0000 7f06cec5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:56.562 INFO:teuthology.misc.health.trial009.stderr:2026-02-25T08:38:56.560+0000 7f06cec5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:38:56.595 INFO:teuthology.misc.health.trial009.stdout: 2026-02-25T08:38:56.595 INFO:teuthology.misc.health.trial009.stdout:{"epoch":7,"fsid":"864c6132-1c9b-4620-b7bf-62f54427687f","created":"2026-02-25T08:38:53.799625+0000","modified":"2026-02-25T08:38:55.682585+0000","last_up_change":"0.000000","last_in_change":"2026-02-25T08:38:55.682585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"08eaef4c-a709-4cb0-9bd5-cd7698b3c29f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d3c936d9-0068-4832-8e94-706b81084d4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ed0c9b25-bffe-4250-9093-a1ef55469878","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"673cc133-8da7-49dc-9d33-43ef24d8a399","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T08:38:56.601 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-25T08:38:57.004 INFO:tasks.ceph.mgr.x.trial059.stderr:2026-02-25T08:38:57.002+0000 7f788d656640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-25T08:39:03.005 DEBUG:teuthology.orchestra.run.trial009:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-25T08:39:03.077 INFO:teuthology.misc.health.trial009.stderr:2026-02-25T08:39:03.073+0000 7efebbe5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:03.079 INFO:teuthology.misc.health.trial009.stderr:2026-02-25T08:39:03.078+0000 7efebbe5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:03.191 INFO:teuthology.misc.health.trial009.stdout: 2026-02-25T08:39:03.191 INFO:teuthology.misc.health.trial009.stdout:{"epoch":11,"fsid":"864c6132-1c9b-4620-b7bf-62f54427687f","created":"2026-02-25T08:38:53.799625+0000","modified":"2026-02-25T08:39:03.014409+0000","last_up_change":"2026-02-25T08:39:03.014409+0000","last_in_change":"2026-02-25T08:38:55.682585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"08eaef4c-a709-4cb0-9bd5-cd7698b3c29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6803","nonce":2930705883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6804","nonce":2930705883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6806","nonce":2930705883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6807","nonce":2930705883}]},"public_addr":"10.20.193.9:6803/2930705883","cluster_addr":"10.20.193.9:6804/2930705883","heartbeat_back_addr":"10.20.193.9:6806/2930705883","heartbeat_front_addr":"10.20.193.9:6807/2930705883","state":["exists","up"]},{"osd":1,"uuid":"d3c936d9-0068-4832-8e94-706b81084d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6800","nonce":4153606934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6801","nonce":4153606934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6802","nonce":4153606934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6805","nonce":4153606934}]},"public_addr":"10.20.193.9:6800/4153606934","cluster_addr":"10.20.193.9:6801/4153606934","heartbeat_back_addr":"10.20.193.9:6802/4153606934","heartbeat_front_addr":"10.20.193.9:6805/4153606934","state":["exists","up"]},{"osd":2,"uuid":"ed0c9b25-bffe-4250-9093-a1ef55469878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6803","nonce":1150076135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6804","nonce":1150076135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6809","nonce":1150076135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6808","nonce":1150076135}]},"public_addr":"10.20.193.59:6803/1150076135","cluster_addr":"10.20.193.59:6804/1150076135","heartbeat_back_addr":"10.20.193.59:6809/1150076135","heartbeat_front_addr":"10.20.193.59:6808/1150076135","state":["exists","up"]},{"osd":3,"uuid":"673cc133-8da7-49dc-9d33-43ef24d8a399","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6802","nonce":57555495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6805","nonce":57555495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6807","nonce":57555495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6806","nonce":57555495}]},"public_addr":"10.20.193.59:6802/57555495","cluster_addr":"10.20.193.59:6805/57555495","heartbeat_back_addr":"10.20.193.59:6807/57555495","heartbeat_front_addr":"10.20.193.59:6806/57555495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T08:39:03.198 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-25T08:39:03.198 INFO:tasks.ceph:Creating RBD pool 2026-02-25T08:39:03.198 DEBUG:teuthology.orchestra.run.trial009:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-25T08:39:03.274 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:03.268+0000 7f8c29e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:03.276 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:03.275+0000 7f8c29e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:04.026 INFO:teuthology.orchestra.run.trial009.stderr:pool 'rbd' created 2026-02-25T08:39:04.039 DEBUG:teuthology.orchestra.run.trial009:> rbd --cluster ceph pool init rbd 2026-02-25T08:39:04.084 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:04.082+0000 7f33dcfee240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:04.084 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:04.082+0000 7f33dcfee240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:04.088 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:04.086+0000 7f33dcfee240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:07.059 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-25T08:39:07.060 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-25T08:39:07.061 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-25T08:39:07.139 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:07.134+0000 7f1a4d6cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:07.142 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:07.140+0000 7f1a4d6cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:07.255 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:39:07.265 INFO:teuthology.orchestra.run.trial009.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-25T08:39:07.265 INFO:tasks.ceph_manager:config epoch is 1 2026-02-25T08:39:07.266 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-25T08:39:07.266 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-25T08:39:07.266 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-25T08:39:07.343 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:07.339+0000 7f89c14cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:07.346 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:07.344+0000 7f89c14cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:07.490 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:39:07.500 INFO:teuthology.orchestra.run.trial009.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6800","nonce":1353031191},{"type":"v1","addr":"10.20.193.59:6801","nonce":1353031191}]},"active_addr":"10.20.193.59:6801/1353031191","active_change":"2026-02-25T08:38:55.997745+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.59:0","nonce":1715167072}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.59:0","nonce":472379034}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.59:0","nonce":1041896694}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.59:0","nonce":2238563188}]}]} 2026-02-25T08:39:07.504 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-25T08:39:07.504 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-25T08:39:07.504 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T08:39:07.580 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:07.576+0000 7f1240ffd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:07.582 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:07.581+0000 7f1240ffd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:07.696 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:39:07.696 INFO:teuthology.orchestra.run.trial009.stdout:{"epoch":15,"fsid":"864c6132-1c9b-4620-b7bf-62f54427687f","created":"2026-02-25T08:38:53.799625+0000","modified":"2026-02-25T08:39:07.031361+0000","last_up_change":"2026-02-25T08:39:03.014409+0000","last_in_change":"2026-02-25T08:38:55.682585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-25T08:39:03.390813+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-25T08:39:04.022360+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"08eaef4c-a709-4cb0-9bd5-cd7698b3c29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6803","nonce":2930705883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6804","nonce":2930705883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6806","nonce":2930705883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6807","nonce":2930705883}]},"public_addr":"10.20.193.9:6803/2930705883","cluster_addr":"10.20.193.9:6804/2930705883","heartbeat_back_addr":"10.20.193.9:6806/2930705883","heartbeat_front_addr":"10.20.193.9:6807/2930705883","state":["exists","up"]},{"osd":1,"uuid":"d3c936d9-0068-4832-8e94-706b81084d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6800","nonce":4153606934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6801","nonce":4153606934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6802","nonce":4153606934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6805","nonce":4153606934}]},"public_addr":"10.20.193.9:6800/4153606934","cluster_addr":"10.20.193.9:6801/4153606934","heartbeat_back_addr":"10.20.193.9:6802/4153606934","heartbeat_front_addr":"10.20.193.9:6805/4153606934","state":["exists","up"]},{"osd":2,"uuid":"ed0c9b25-bffe-4250-9093-a1ef55469878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6803","nonce":1150076135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6804","nonce":1150076135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6809","nonce":1150076135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6808","nonce":1150076135}]},"public_addr":"10.20.193.59:6803/1150076135","cluster_addr":"10.20.193.59:6804/1150076135","heartbeat_back_addr":"10.20.193.59:6809/1150076135","heartbeat_front_addr":"10.20.193.59:6808/1150076135","state":["exists","up"]},{"osd":3,"uuid":"673cc133-8da7-49dc-9d33-43ef24d8a399","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6802","nonce":57555495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6805","nonce":57555495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6807","nonce":57555495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6806","nonce":57555495}]},"public_addr":"10.20.193.59:6802/57555495","cluster_addr":"10.20.193.59:6805/57555495","heartbeat_back_addr":"10.20.193.59:6807/57555495","heartbeat_front_addr":"10.20.193.59:6806/57555495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T08:39:07.706 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-25T08:39:07.706 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T08:39:07.783 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:07.779+0000 7f083ea5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:07.785 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:07.783+0000 7f083ea5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:07.897 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:39:07.897 INFO:teuthology.orchestra.run.trial009.stdout:{"epoch":15,"fsid":"864c6132-1c9b-4620-b7bf-62f54427687f","created":"2026-02-25T08:38:53.799625+0000","modified":"2026-02-25T08:39:07.031361+0000","last_up_change":"2026-02-25T08:39:03.014409+0000","last_in_change":"2026-02-25T08:38:55.682585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-25T08:39:03.390813+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-25T08:39:04.022360+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"08eaef4c-a709-4cb0-9bd5-cd7698b3c29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6803","nonce":2930705883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6804","nonce":2930705883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6806","nonce":2930705883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6807","nonce":2930705883}]},"public_addr":"10.20.193.9:6803/2930705883","cluster_addr":"10.20.193.9:6804/2930705883","heartbeat_back_addr":"10.20.193.9:6806/2930705883","heartbeat_front_addr":"10.20.193.9:6807/2930705883","state":["exists","up"]},{"osd":1,"uuid":"d3c936d9-0068-4832-8e94-706b81084d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6800","nonce":4153606934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6801","nonce":4153606934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6802","nonce":4153606934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6805","nonce":4153606934}]},"public_addr":"10.20.193.9:6800/4153606934","cluster_addr":"10.20.193.9:6801/4153606934","heartbeat_back_addr":"10.20.193.9:6802/4153606934","heartbeat_front_addr":"10.20.193.9:6805/4153606934","state":["exists","up"]},{"osd":2,"uuid":"ed0c9b25-bffe-4250-9093-a1ef55469878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6803","nonce":1150076135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6804","nonce":1150076135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6809","nonce":1150076135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6808","nonce":1150076135}]},"public_addr":"10.20.193.59:6803/1150076135","cluster_addr":"10.20.193.59:6804/1150076135","heartbeat_back_addr":"10.20.193.59:6809/1150076135","heartbeat_front_addr":"10.20.193.59:6808/1150076135","state":["exists","up"]},{"osd":3,"uuid":"673cc133-8da7-49dc-9d33-43ef24d8a399","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6802","nonce":57555495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6805","nonce":57555495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6807","nonce":57555495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6806","nonce":57555495}]},"public_addr":"10.20.193.59:6802/57555495","cluster_addr":"10.20.193.59:6805/57555495","heartbeat_back_addr":"10.20.193.59:6807/57555495","heartbeat_front_addr":"10.20.193.59:6806/57555495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T08:39:07.907 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-25T08:39:07.907 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-25T08:39:07.908 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-25T08:39:07.908 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-25T08:39:07.992 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:07.987+0000 7f31c9e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:07.993 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:07.987+0000 7f0b3781a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:07.993 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:07.988+0000 7f189905a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:07.993 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:07.988+0000 7f468d1a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:07.995 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:07.993+0000 7f0b3781a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:07.995 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:07.993+0000 7f31c9e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:07.995 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:07.993+0000 7f189905a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:07.996 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:07.993+0000 7f468d1a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:08.013 INFO:teuthology.orchestra.run.trial009.stdout:42949672965 2026-02-25T08:39:08.014 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-25T08:39:08.015 INFO:teuthology.orchestra.run.trial009.stdout:47244640260 2026-02-25T08:39:08.015 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-25T08:39:08.016 INFO:teuthology.orchestra.run.trial009.stdout:47244640260 2026-02-25T08:39:08.017 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-25T08:39:08.017 INFO:teuthology.orchestra.run.trial009.stdout:47244640260 2026-02-25T08:39:08.018 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-25T08:39:08.136 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:08.132+0000 7fef68e8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:08.137 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:08.132+0000 7f21f7b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:08.137 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:08.132+0000 7f90d59f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:08.139 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:08.138+0000 7fef68e8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:08.140 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:08.138+0000 7f21f7b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:08.140 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:08.138+0000 7f90d59f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:08.140 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:08.136+0000 7fe1a6ddc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:08.150 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:08.148+0000 7fe1a6ddc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:08.254 INFO:teuthology.orchestra.run.trial009.stdout:47244640260 2026-02-25T08:39:08.256 INFO:teuthology.orchestra.run.trial009.stdout:47244640260 2026-02-25T08:39:08.257 INFO:teuthology.orchestra.run.trial009.stdout:42949672965 2026-02-25T08:39:08.264 INFO:teuthology.orchestra.run.trial009.stdout:47244640260 2026-02-25T08:39:08.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.0 2026-02-25T08:39:08.267 DEBUG:teuthology.parallel:result is None 2026-02-25T08:39:08.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.2 2026-02-25T08:39:08.269 DEBUG:teuthology.parallel:result is None 2026-02-25T08:39:08.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.1 2026-02-25T08:39:08.270 DEBUG:teuthology.parallel:result is None 2026-02-25T08:39:08.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.3 2026-02-25T08:39:08.276 DEBUG:teuthology.parallel:result is None 2026-02-25T08:39:08.276 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-25T08:39:08.276 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T08:39:08.392 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:08.388+0000 7fe4cae5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:08.395 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:08.393+0000 7fe4cae5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:08.505 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:39:08.506 INFO:teuthology.orchestra.run.trial009.stderr:dumped all 2026-02-25T08:39:08.515 INFO:teuthology.orchestra.run.trial009.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-25T08:39:08.006992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83889024,"kb_used_data":83889024,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125826112,"statfs":{"total":214748299264,"available":128845938688,"internally_reserved":0,"allocated":85902360576,"data_stored":85902360576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.041517+0000","last_change":"2026-02-25T08:39:07.045542+0000","last_active":"2026-02-25T08:39:07.041517+0000","last_peered":"2026-02-25T08:39:07.041517+0000","last_clean":"2026-02-25T08:39:07.041517+0000","last_became_active":"2026-02-25T08:39:05.066794+0000","last_became_peered":"2026-02-25T08:39:05.066794+0000","last_unstale":"2026-02-25T08:39:07.041517+0000","last_undegraded":"2026-02-25T08:39:07.041517+0000","last_fullsized":"2026-02-25T08:39:07.041517+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.043383+0000","last_change":"2026-02-25T08:39:07.045411+0000","last_active":"2026-02-25T08:39:07.043383+0000","last_peered":"2026-02-25T08:39:07.043383+0000","last_clean":"2026-02-25T08:39:07.043383+0000","last_became_active":"2026-02-25T08:39:05.065104+0000","last_became_peered":"2026-02-25T08:39:05.065104+0000","last_unstale":"2026-02-25T08:39:07.043383+0000","last_undegraded":"2026-02-25T08:39:07.043383+0000","last_fullsized":"2026-02-25T08:39:07.043383+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.043773+0000","last_change":"2026-02-25T08:39:07.045738+0000","last_active":"2026-02-25T08:39:07.043773+0000","last_peered":"2026-02-25T08:39:07.043773+0000","last_clean":"2026-02-25T08:39:07.043773+0000","last_became_active":"2026-02-25T08:39:05.069478+0000","last_became_peered":"2026-02-25T08:39:05.069478+0000","last_unstale":"2026-02-25T08:39:07.043773+0000","last_undegraded":"2026-02-25T08:39:07.043773+0000","last_fullsized":"2026-02-25T08:39:07.043773+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.043837+0000","last_change":"2026-02-25T08:39:07.045912+0000","last_active":"2026-02-25T08:39:07.043837+0000","last_peered":"2026-02-25T08:39:07.043837+0000","last_clean":"2026-02-25T08:39:07.043837+0000","last_became_active":"2026-02-25T08:39:05.062319+0000","last_became_peered":"2026-02-25T08:39:05.062319+0000","last_unstale":"2026-02-25T08:39:07.043837+0000","last_undegraded":"2026-02-25T08:39:07.043837+0000","last_fullsized":"2026-02-25T08:39:07.043837+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":81,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.043762+0000","last_change":"2026-02-25T08:39:05.080267+0000","last_active":"2026-02-25T08:39:07.043762+0000","last_peered":"2026-02-25T08:39:07.043762+0000","last_clean":"2026-02-25T08:39:07.043762+0000","last_became_active":"2026-02-25T08:39:05.067451+0000","last_became_peered":"2026-02-25T08:39:05.067451+0000","last_unstale":"2026-02-25T08:39:07.043762+0000","last_undegraded":"2026-02-25T08:39:07.043762+0000","last_fullsized":"2026-02-25T08:39:07.043762+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.041667+0000","last_change":"2026-02-25T08:39:07.044303+0000","last_active":"2026-02-25T08:39:07.041667+0000","last_peered":"2026-02-25T08:39:07.041667+0000","last_clean":"2026-02-25T08:39:07.041667+0000","last_became_active":"2026-02-25T08:39:05.066212+0000","last_became_peered":"2026-02-25T08:39:05.066212+0000","last_unstale":"2026-02-25T08:39:07.041667+0000","last_undegraded":"2026-02-25T08:39:07.041667+0000","last_fullsized":"2026-02-25T08:39:07.041667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.044809+0000","last_change":"2026-02-25T08:39:07.044809+0000","last_active":"2026-02-25T08:39:07.044809+0000","last_peered":"2026-02-25T08:39:07.044809+0000","last_clean":"2026-02-25T08:39:07.044809+0000","last_became_active":"2026-02-25T08:39:05.060963+0000","last_became_peered":"2026-02-25T08:39:05.060963+0000","last_unstale":"2026-02-25T08:39:07.044809+0000","last_undegraded":"2026-02-25T08:39:07.044809+0000","last_fullsized":"2026-02-25T08:39:07.044809+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.044085+0000","last_change":"2026-02-25T08:39:07.046493+0000","last_active":"2026-02-25T08:39:07.044085+0000","last_peered":"2026-02-25T08:39:07.044085+0000","last_clean":"2026-02-25T08:39:07.044085+0000","last_became_active":"2026-02-25T08:39:05.065571+0000","last_became_peered":"2026-02-25T08:39:05.065571+0000","last_unstale":"2026-02-25T08:39:07.044085+0000","last_undegraded":"2026-02-25T08:39:07.044085+0000","last_fullsized":"2026-02-25T08:39:07.044085+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.041878+0000","last_change":"2026-02-25T08:39:07.045617+0000","last_active":"2026-02-25T08:39:07.041878+0000","last_peered":"2026-02-25T08:39:07.041878+0000","last_clean":"2026-02-25T08:39:07.041878+0000","last_became_active":"2026-02-25T08:39:05.069458+0000","last_became_peered":"2026-02-25T08:39:05.069458+0000","last_unstale":"2026-02-25T08:39:07.041878+0000","last_undegraded":"2026-02-25T08:39:07.041878+0000","last_fullsized":"2026-02-25T08:39:07.041878+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211058688,"internally_reserved":0,"allocated":21476016128,"data_stored":21476016128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96634044416,"internally_reserved":0,"allocated":64427180032,"data_stored":64427180032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972664,"kb_used_data":20972664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456120,"statfs":{"total":53687074816,"available":32211066880,"internally_reserved":0,"allocated":21476007936,"data_stored":21476007936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971880,"kb_used_data":20971880,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456904,"statfs":{"total":53687074816,"available":32211869696,"internally_reserved":0,"allocated":21475205120,"data_stored":21475205120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972600,"kb_used_data":20972600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456184,"statfs":{"total":53687074816,"available":32211132416,"internally_reserved":0,"allocated":21475942400,"data_stored":21475942400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971880,"kb_used_data":20971880,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456904,"statfs":{"total":53687074816,"available":32211869696,"internally_reserved":0,"allocated":21475205120,"data_stored":21475205120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211124224,"internally_reserved":0,"allocated":21475950592,"data_stored":21475950592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211861504,"internally_reserved":0,"allocated":21475213312,"data_stored":21475213312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32211058688,"internally_reserved":0,"allocated":21476016128,"data_stored":21476016128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32211058688,"internally_reserved":0,"allocated":21476016128,"data_stored":21476016128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T08:39:08.517 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T08:39:08.593 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:08.590+0000 7fc6301dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:08.596 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:08.594+0000 7fc6301dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:08.707 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:39:08.708 INFO:teuthology.orchestra.run.trial009.stderr:dumped all 2026-02-25T08:39:08.717 INFO:teuthology.orchestra.run.trial009.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-25T08:39:08.006992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83889024,"kb_used_data":83889024,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125826112,"statfs":{"total":214748299264,"available":128845938688,"internally_reserved":0,"allocated":85902360576,"data_stored":85902360576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.041517+0000","last_change":"2026-02-25T08:39:07.045542+0000","last_active":"2026-02-25T08:39:07.041517+0000","last_peered":"2026-02-25T08:39:07.041517+0000","last_clean":"2026-02-25T08:39:07.041517+0000","last_became_active":"2026-02-25T08:39:05.066794+0000","last_became_peered":"2026-02-25T08:39:05.066794+0000","last_unstale":"2026-02-25T08:39:07.041517+0000","last_undegraded":"2026-02-25T08:39:07.041517+0000","last_fullsized":"2026-02-25T08:39:07.041517+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.043383+0000","last_change":"2026-02-25T08:39:07.045411+0000","last_active":"2026-02-25T08:39:07.043383+0000","last_peered":"2026-02-25T08:39:07.043383+0000","last_clean":"2026-02-25T08:39:07.043383+0000","last_became_active":"2026-02-25T08:39:05.065104+0000","last_became_peered":"2026-02-25T08:39:05.065104+0000","last_unstale":"2026-02-25T08:39:07.043383+0000","last_undegraded":"2026-02-25T08:39:07.043383+0000","last_fullsized":"2026-02-25T08:39:07.043383+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.043773+0000","last_change":"2026-02-25T08:39:07.045738+0000","last_active":"2026-02-25T08:39:07.043773+0000","last_peered":"2026-02-25T08:39:07.043773+0000","last_clean":"2026-02-25T08:39:07.043773+0000","last_became_active":"2026-02-25T08:39:05.069478+0000","last_became_peered":"2026-02-25T08:39:05.069478+0000","last_unstale":"2026-02-25T08:39:07.043773+0000","last_undegraded":"2026-02-25T08:39:07.043773+0000","last_fullsized":"2026-02-25T08:39:07.043773+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.043837+0000","last_change":"2026-02-25T08:39:07.045912+0000","last_active":"2026-02-25T08:39:07.043837+0000","last_peered":"2026-02-25T08:39:07.043837+0000","last_clean":"2026-02-25T08:39:07.043837+0000","last_became_active":"2026-02-25T08:39:05.062319+0000","last_became_peered":"2026-02-25T08:39:05.062319+0000","last_unstale":"2026-02-25T08:39:07.043837+0000","last_undegraded":"2026-02-25T08:39:07.043837+0000","last_fullsized":"2026-02-25T08:39:07.043837+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":81,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.043762+0000","last_change":"2026-02-25T08:39:05.080267+0000","last_active":"2026-02-25T08:39:07.043762+0000","last_peered":"2026-02-25T08:39:07.043762+0000","last_clean":"2026-02-25T08:39:07.043762+0000","last_became_active":"2026-02-25T08:39:05.067451+0000","last_became_peered":"2026-02-25T08:39:05.067451+0000","last_unstale":"2026-02-25T08:39:07.043762+0000","last_undegraded":"2026-02-25T08:39:07.043762+0000","last_fullsized":"2026-02-25T08:39:07.043762+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.041667+0000","last_change":"2026-02-25T08:39:07.044303+0000","last_active":"2026-02-25T08:39:07.041667+0000","last_peered":"2026-02-25T08:39:07.041667+0000","last_clean":"2026-02-25T08:39:07.041667+0000","last_became_active":"2026-02-25T08:39:05.066212+0000","last_became_peered":"2026-02-25T08:39:05.066212+0000","last_unstale":"2026-02-25T08:39:07.041667+0000","last_undegraded":"2026-02-25T08:39:07.041667+0000","last_fullsized":"2026-02-25T08:39:07.041667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.044809+0000","last_change":"2026-02-25T08:39:07.044809+0000","last_active":"2026-02-25T08:39:07.044809+0000","last_peered":"2026-02-25T08:39:07.044809+0000","last_clean":"2026-02-25T08:39:07.044809+0000","last_became_active":"2026-02-25T08:39:05.060963+0000","last_became_peered":"2026-02-25T08:39:05.060963+0000","last_unstale":"2026-02-25T08:39:07.044809+0000","last_undegraded":"2026-02-25T08:39:07.044809+0000","last_fullsized":"2026-02-25T08:39:07.044809+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.044085+0000","last_change":"2026-02-25T08:39:07.046493+0000","last_active":"2026-02-25T08:39:07.044085+0000","last_peered":"2026-02-25T08:39:07.044085+0000","last_clean":"2026-02-25T08:39:07.044085+0000","last_became_active":"2026-02-25T08:39:05.065571+0000","last_became_peered":"2026-02-25T08:39:05.065571+0000","last_unstale":"2026-02-25T08:39:07.044085+0000","last_undegraded":"2026-02-25T08:39:07.044085+0000","last_fullsized":"2026-02-25T08:39:07.044085+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T08:39:07.041878+0000","last_change":"2026-02-25T08:39:07.045617+0000","last_active":"2026-02-25T08:39:07.041878+0000","last_peered":"2026-02-25T08:39:07.041878+0000","last_clean":"2026-02-25T08:39:07.041878+0000","last_became_active":"2026-02-25T08:39:05.069458+0000","last_became_peered":"2026-02-25T08:39:05.069458+0000","last_unstale":"2026-02-25T08:39:07.041878+0000","last_undegraded":"2026-02-25T08:39:07.041878+0000","last_fullsized":"2026-02-25T08:39:07.041878+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211058688,"internally_reserved":0,"allocated":21476016128,"data_stored":21476016128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96634044416,"internally_reserved":0,"allocated":64427180032,"data_stored":64427180032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972664,"kb_used_data":20972664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456120,"statfs":{"total":53687074816,"available":32211066880,"internally_reserved":0,"allocated":21476007936,"data_stored":21476007936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971880,"kb_used_data":20971880,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456904,"statfs":{"total":53687074816,"available":32211869696,"internally_reserved":0,"allocated":21475205120,"data_stored":21475205120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972600,"kb_used_data":20972600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456184,"statfs":{"total":53687074816,"available":32211132416,"internally_reserved":0,"allocated":21475942400,"data_stored":21475942400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971880,"kb_used_data":20971880,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456904,"statfs":{"total":53687074816,"available":32211869696,"internally_reserved":0,"allocated":21475205120,"data_stored":21475205120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211124224,"internally_reserved":0,"allocated":21475950592,"data_stored":21475950592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211861504,"internally_reserved":0,"allocated":21475213312,"data_stored":21475213312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32211058688,"internally_reserved":0,"allocated":21476016128,"data_stored":21476016128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32211058688,"internally_reserved":0,"allocated":21476016128,"data_stored":21476016128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T08:39:08.718 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-25T08:39:08.718 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-25T08:39:08.718 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-25T08:39:08.719 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-25T08:39:08.794 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:08.791+0000 7fd998acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:08.796 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:39:08.795+0000 7fd998acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:08.935 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:39:08.936 INFO:teuthology.orchestra.run.trial009.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-25T08:39:08.945 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-25T08:39:08.945 INFO:teuthology.run_tasks:Running task workunit... 2026-02-25T08:39:08.970 INFO:tasks.workunit:Pulling workunits from ref c32469671c6b0222f786dd36c34eb702f780a11d 2026-02-25T08:39:08.970 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-25T08:39:08.970 DEBUG:teuthology.orchestra.run.trial009:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-25T08:39:08.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T08:39:08.988 INFO:teuthology.orchestra.run.trial009.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-25T08:39:08.988 DEBUG:teuthology.orchestra.run.trial009:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-25T08:39:09.046 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-25T08:39:09.046 DEBUG:teuthology.orchestra.run.trial009:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-25T08:39:09.102 INFO:tasks.workunit:timeout=1h 2026-02-25T08:39:09.102 INFO:tasks.workunit:cleanup=True 2026-02-25T08:39:09.103 DEBUG:teuthology.orchestra.run.trial009:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c32469671c6b0222f786dd36c34eb702f780a11d 2026-02-25T08:39:09.165 INFO:tasks.workunit.client.0.trial009.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-25T08:39:31.928 INFO:tasks.workunit.client.0.trial009.stderr:Note: switching to 'c32469671c6b0222f786dd36c34eb702f780a11d'. 2026-02-25T08:39:31.928 INFO:tasks.workunit.client.0.trial009.stderr: 2026-02-25T08:39:31.928 INFO:tasks.workunit.client.0.trial009.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-25T08:39:31.928 INFO:tasks.workunit.client.0.trial009.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-25T08:39:31.928 INFO:tasks.workunit.client.0.trial009.stderr:state without impacting any branches by switching back to a branch. 2026-02-25T08:39:31.928 INFO:tasks.workunit.client.0.trial009.stderr: 2026-02-25T08:39:31.929 INFO:tasks.workunit.client.0.trial009.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-25T08:39:31.929 INFO:tasks.workunit.client.0.trial009.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-25T08:39:31.929 INFO:tasks.workunit.client.0.trial009.stderr: 2026-02-25T08:39:31.929 INFO:tasks.workunit.client.0.trial009.stderr: git switch -c 2026-02-25T08:39:31.929 INFO:tasks.workunit.client.0.trial009.stderr: 2026-02-25T08:39:31.929 INFO:tasks.workunit.client.0.trial009.stderr:Or undo this operation with: 2026-02-25T08:39:31.929 INFO:tasks.workunit.client.0.trial009.stderr: 2026-02-25T08:39:31.929 INFO:tasks.workunit.client.0.trial009.stderr: git switch - 2026-02-25T08:39:31.929 INFO:tasks.workunit.client.0.trial009.stderr: 2026-02-25T08:39:31.929 INFO:tasks.workunit.client.0.trial009.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-25T08:39:31.929 INFO:tasks.workunit.client.0.trial009.stderr: 2026-02-25T08:39:31.930 INFO:tasks.workunit.client.0.trial009.stderr:HEAD is now at c32469671c6 Merge pull request #66090 from rhcs-dashboard/73674-create-rule-certmgr 2026-02-25T08:39:31.931 DEBUG:teuthology.orchestra.run.trial009:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-25T08:39:31.989 INFO:tasks.workunit.client.0.trial009.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-25T08:39:31.991 INFO:tasks.workunit.client.0.trial009.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-25T08:39:31.991 INFO:tasks.workunit.client.0.trial009.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-25T08:39:32.089 INFO:tasks.workunit.client.0.trial009.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-25T08:39:32.122 INFO:tasks.workunit.client.0.trial009.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-25T08:39:32.148 INFO:tasks.workunit.client.0.trial009.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-25T08:39:32.150 INFO:tasks.workunit.client.0.trial009.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-25T08:39:32.150 INFO:tasks.workunit.client.0.trial009.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-25T08:39:32.175 INFO:tasks.workunit.client.0.trial009.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-25T08:39:32.179 DEBUG:teuthology.orchestra.run.trial009:> set -ex 2026-02-25T08:39:32.179 DEBUG:teuthology.orchestra.run.trial009:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-25T08:39:32.236 INFO:tasks.workunit:Running workunits matching rados/test_python.sh on client.0... 2026-02-25T08:39:32.239 INFO:tasks.workunit:Running workunit rados/test_python.sh... 2026-02-25T08:39:32.239 DEBUG:teuthology.orchestra.run.trial009:workunit test rados/test_python.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c32469671c6b0222f786dd36c34eb702f780a11d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh -m 'not (wait or tier or ec)' 2026-02-25T08:39:32.295 INFO:tasks.workunit.client.0.trial009.stderr:+ ceph osd pool create rbd 2026-02-25T08:39:32.350 INFO:tasks.workunit.client.0.trial009.stderr:2026-02-25T08:39:32.345+0000 7fe14a70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:32.352 INFO:tasks.workunit.client.0.trial009.stderr:2026-02-25T08:39:32.351+0000 7fe14a70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:39:32.520 INFO:tasks.workunit.client.0.trial009.stderr:pool 'rbd' already exists 2026-02-25T08:39:32.527 INFO:tasks.workunit.client.0.trial009.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh 2026-02-25T08:39:32.528 INFO:tasks.workunit.client.0.trial009.stderr:+ python3 -m pytest -v /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/../../../src/test/pybind/test_rados.py -m 'not (wait or tier or ec)' 2026-02-25T08:39:32.602 INFO:tasks.workunit.client.0.trial009.stdout:============================= test session starts ============================== 2026-02-25T08:39:32.602 INFO:tasks.workunit.client.0.trial009.stdout:platform linux -- Python 3.9.25, pytest-6.2.2, py-1.10.0, pluggy-0.13.1 -- /usr/bin/python3 2026-02-25T08:39:32.602 INFO:tasks.workunit.client.0.trial009.stdout:cachedir: .pytest_cache 2026-02-25T08:39:32.602 INFO:tasks.workunit.client.0.trial009.stdout:rootdir: /home/ubuntu/cephtest/clone.client.0/src/test/pybind, configfile: pytest.ini 2026-02-25T08:39:32.740 INFO:tasks.workunit.client.0.trial009.stdout:collecting ... collected 91 items / 5 deselected / 86 selected 2026-02-25T08:39:32.740 INFO:tasks.workunit.client.0.trial009.stdout: 2026-02-25T08:39:32.746 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::test_rados_init_error PASSED [ 1%] 2026-02-25T08:39:32.795 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::test_rados_init PASSED [ 2%] 2026-02-25T08:39:32.807 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::test_ioctx_context_manager PASSED [ 3%] 2026-02-25T08:39:32.813 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::test_parse_argv PASSED [ 4%] 2026-02-25T08:39:32.817 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::test_parse_argv_empty_str PASSED [ 5%] 2026-02-25T08:39:32.824 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRadosStateError::test_configuring PASSED [ 6%] 2026-02-25T08:39:32.836 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRadosStateError::test_connected PASSED [ 8%] 2026-02-25T08:39:32.848 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRadosStateError::test_shutdown PASSED [ 9%] 2026-02-25T08:39:32.864 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_ping_monitor PASSED [ 10%] 2026-02-25T08:39:32.877 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_annotations PASSED [ 11%] 2026-02-25T08:39:34.060 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_create PASSED [ 12%] 2026-02-25T08:39:36.064 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_create_utf8 PASSED [ 13%] 2026-02-25T08:39:38.070 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_pool_lookup_utf8 PASSED [ 15%] 2026-02-25T08:39:40.080 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_eexist PASSED [ 16%] 2026-02-25T08:39:48.116 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_list_pools PASSED [ 17%] 2026-02-25T08:39:48.133 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_get_fsid PASSED [ 18%] 2026-02-25T08:39:49.124 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_blocklist_add PASSED [ 19%] 2026-02-25T08:39:49.141 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_get_cluster_stats PASSED [ 20%] 2026-02-25T08:39:49.156 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_monitor_log PASSED [ 22%] 2026-02-25T08:39:52.137 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_last_version PASSED [ 23%] 2026-02-25T08:39:54.811 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_stats PASSED [ 24%] 2026-02-25T08:39:58.824 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_write PASSED [ 25%] 2026-02-25T08:40:02.846 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_write_full PASSED [ 26%] 2026-02-25T08:40:06.862 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_writesame PASSED [ 27%] 2026-02-25T08:40:10.877 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_append PASSED [ 29%] 2026-02-25T08:40:14.897 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_write_zeros PASSED [ 30%] 2026-02-25T08:40:18.913 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_trunc PASSED [ 31%] 2026-02-25T08:40:22.929 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_cmpext PASSED [ 32%] 2026-02-25T08:40:26.826 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_list_objects_empty PASSED [ 33%] 2026-02-25T08:40:30.843 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_read_crc PASSED [ 34%] 2026-02-25T08:40:34.856 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_list_objects PASSED [ 36%] 2026-02-25T08:40:38.816 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_list_ns_objects PASSED [ 37%] 2026-02-25T08:40:42.828 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_xattrs PASSED [ 38%] 2026-02-25T08:40:46.842 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_obj_xattrs PASSED [ 39%] 2026-02-25T08:40:49.821 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_pool_id PASSED [ 40%] 2026-02-25T08:40:52.826 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_pool_name PASSED [ 41%] 2026-02-25T08:40:57.856 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_create_snap PASSED [ 43%] 2026-02-25T08:41:00.826 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_list_snaps_empty PASSED [ 44%] 2026-02-25T08:41:06.847 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_list_snaps PASSED [ 45%] 2026-02-25T08:41:10.827 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_lookup_snap PASSED [ 46%] 2026-02-25T08:41:14.844 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_snap_timestamp PASSED [ 47%] 2026-02-25T08:41:19.825 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_remove_snap PASSED [ 48%] 2026-02-25T08:41:25.845 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_snap_rollback PASSED [ 50%] 2026-02-25T08:41:31.864 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_snap_rollback_removed PASSED [ 51%] 2026-02-25T08:41:37.889 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_snap_read PASSED [ 52%] 2026-02-25T08:41:41.837 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_set_omap PASSED [ 53%] 2026-02-25T08:41:45.852 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_set_omap_aio PASSED [ 54%] 2026-02-25T08:41:49.834 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_write_ops PASSED [ 55%] 2026-02-25T08:41:53.845 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_execute_op PASSED [ 56%] 2026-02-25T08:41:57.864 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_writesame_op PASSED [ 58%] 2026-02-25T08:42:01.840 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_omap_vals_by_keys PASSED [ 59%] 2026-02-25T08:42:05.856 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_omap_keys PASSED [ 60%] 2026-02-25T08:42:09.838 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_clear_omap PASSED [ 61%] 2026-02-25T08:42:13.851 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_remove_omap_range2 PASSED [ 62%] 2026-02-25T08:42:17.864 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_omap_cmp PASSED [ 63%] 2026-02-25T08:42:21.846 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_cmpext_op PASSED [ 65%] 2026-02-25T08:42:25.861 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_xattrs_op PASSED [ 66%] 2026-02-25T08:42:28.842 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_locator PASSED [ 67%] 2026-02-25T08:42:32.851 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_operate_aio_write_op PASSED [ 68%] 2026-02-25T08:42:36.863 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_write PASSED [ 69%] 2026-02-25T08:42:40.880 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_cmpext PASSED [ 70%] 2026-02-25T08:42:44.896 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_rmxattr PASSED [ 72%] 2026-02-25T08:42:48.846 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_write_no_comp_ref PASSED [ 73%] 2026-02-25T08:42:52.851 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_append PASSED [ 74%] 2026-02-25T08:42:56.869 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_write_full PASSED [ 75%] 2026-02-25T08:43:00.886 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_writesame PASSED [ 76%] 2026-02-25T08:43:04.902 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_stat PASSED [ 77%] 2026-02-25T08:43:08.850 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_remove PASSED [ 79%] 2026-02-25T08:43:12.857 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_lock PASSED [ 80%] 2026-02-25T08:43:16.871 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_execute PASSED [ 81%] 2026-02-25T08:43:20.889 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_execute PASSED [ 82%] 2026-02-25T08:43:24.903 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_setxattr PASSED [ 83%] 2026-02-25T08:43:33.868 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_applications PASSED [ 84%] 2026-02-25T08:43:36.876 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_service_daemon PASSED [ 86%] 2026-02-25T08:43:39.857 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_alignment PASSED [ 87%] 2026-02-25T08:43:42.864 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx2::test_get_last_version PASSED [ 88%] 2026-02-25T08:43:45.877 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx2::test_get_stats PASSED [ 89%] 2026-02-25T08:43:48.857 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestObject::test_read PASSED [ 90%] 2026-02-25T08:43:51.864 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestObject::test_seek PASSED [ 91%] 2026-02-25T08:43:54.878 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestObject::test_write PASSED [ 93%] 2026-02-25T08:44:02.900 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoCtxSelfManagedSnaps::test PASSED [ 94%] 2026-02-25T08:44:02.917 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestCommand::test_monmap_dump PASSED [ 95%] 2026-02-25T08:44:02.978 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestCommand::test_osd_bench PASSED [ 96%] 2026-02-25T08:44:03.908 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestCommand::test_ceph_osd_pool_create_utf8 PASSED [ 97%] 2026-02-25T08:44:09.930 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestWatchNotify::test PASSED [ 98%] 2026-02-25T08:44:15.948 INFO:tasks.workunit.client.0.trial009.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestWatchNotify::test_aio_notify PASSED [100%] 2026-02-25T08:44:15.948 INFO:tasks.workunit.client.0.trial009.stdout: 2026-02-25T08:44:15.948 INFO:tasks.workunit.client.0.trial009.stdout:================= 86 passed, 5 deselected in 283.35s (0:04:43) ================= 2026-02-25T08:44:15.964 INFO:tasks.workunit.client.0.trial009.stderr:+ exit 0 2026-02-25T08:44:15.964 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-25T08:44:15.964 DEBUG:teuthology.orchestra.run.trial009:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-25T08:44:16.034 INFO:tasks.workunit:Stopping ["rados/test_python.sh -m 'not (wait or tier or ec)'"] on client.0... 2026-02-25T08:44:16.034 DEBUG:teuthology.orchestra.run.trial009:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-25T08:44:16.431 DEBUG:teuthology.parallel:result is None 2026-02-25T08:44:16.432 DEBUG:teuthology.orchestra.run.trial009:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-25T08:44:16.457 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-25T08:44:16.457 DEBUG:teuthology.orchestra.run.trial009:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-25T08:44:16.513 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-25T08:44:16.513 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-25T08:44:16.528 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-25T08:44:16.529 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T08:44:16.629 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:16.625+0000 7f0f24174640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:16.631 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:16.631+0000 7f0f24174640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:16.746 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:44:16.746 INFO:teuthology.orchestra.run.trial009.stderr:dumped all 2026-02-25T08:44:16.755 INFO:teuthology.orchestra.run.trial009.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2026-02-25T08:44:16.054497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83901280,"kb_used_data":83901280,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125813856,"statfs":{"total":214748299264,"available":128833388544,"internally_reserved":0,"allocated":85914910720,"data_stored":85914910720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.126784"},"pg_stats":[{"pgid":"73.f","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.981367+0000","last_change":"2026-02-25T08:44:04.999897+0000","last_active":"2026-02-25T08:44:12.981367+0000","last_peered":"2026-02-25T08:44:12.981367+0000","last_clean":"2026-02-25T08:44:12.981367+0000","last_became_active":"2026-02-25T08:44:04.994536+0000","last_became_peered":"2026-02-25T08:44:04.994536+0000","last_unstale":"2026-02-25T08:44:12.981367+0000","last_undegraded":"2026-02-25T08:44:12.981367+0000","last_fullsized":"2026-02-25T08:44:12.981367+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.e","version":"0'0","reported_seq":23,"reported_epoch":293,"state":"active+clean","last_fresh":"2026-02-25T08:44:11.978140+0000","last_change":"2026-02-25T08:44:04.993806+0000","last_active":"2026-02-25T08:44:11.978140+0000","last_peered":"2026-02-25T08:44:11.978140+0000","last_clean":"2026-02-25T08:44:11.978140+0000","last_became_active":"2026-02-25T08:44:04.989733+0000","last_became_peered":"2026-02-25T08:44:04.989733+0000","last_unstale":"2026-02-25T08:44:11.978140+0000","last_undegraded":"2026-02-25T08:44:11.978140+0000","last_fullsized":"2026-02-25T08:44:11.978140+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.d","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.980657+0000","last_change":"2026-02-25T08:44:05.007912+0000","last_active":"2026-02-25T08:44:12.980657+0000","last_peered":"2026-02-25T08:44:12.980657+0000","last_clean":"2026-02-25T08:44:12.980657+0000","last_became_active":"2026-02-25T08:44:04.989310+0000","last_became_peered":"2026-02-25T08:44:04.989310+0000","last_unstale":"2026-02-25T08:44:12.980657+0000","last_undegraded":"2026-02-25T08:44:12.980657+0000","last_fullsized":"2026-02-25T08:44:12.980657+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.c","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.981951+0000","last_change":"2026-02-25T08:44:05.011182+0000","last_active":"2026-02-25T08:44:12.981951+0000","last_peered":"2026-02-25T08:44:12.981951+0000","last_clean":"2026-02-25T08:44:12.981951+0000","last_became_active":"2026-02-25T08:44:05.007215+0000","last_became_peered":"2026-02-25T08:44:05.007215+0000","last_unstale":"2026-02-25T08:44:12.981951+0000","last_undegraded":"2026-02-25T08:44:12.981951+0000","last_fullsized":"2026-02-25T08:44:12.981951+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.b","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.981978+0000","last_change":"2026-02-25T08:44:04.996601+0000","last_active":"2026-02-25T08:44:12.981978+0000","last_peered":"2026-02-25T08:44:12.981978+0000","last_clean":"2026-02-25T08:44:12.981978+0000","last_became_active":"2026-02-25T08:44:04.992595+0000","last_became_peered":"2026-02-25T08:44:04.992595+0000","last_unstale":"2026-02-25T08:44:12.981978+0000","last_undegraded":"2026-02-25T08:44:12.981978+0000","last_fullsized":"2026-02-25T08:44:12.981978+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.a","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.988479+0000","last_change":"2026-02-25T08:44:04.992304+0000","last_active":"2026-02-25T08:44:12.988479+0000","last_peered":"2026-02-25T08:44:12.988479+0000","last_clean":"2026-02-25T08:44:12.988479+0000","last_became_active":"2026-02-25T08:44:04.986497+0000","last_became_peered":"2026-02-25T08:44:04.986497+0000","last_unstale":"2026-02-25T08:44:12.988479+0000","last_undegraded":"2026-02-25T08:44:12.988479+0000","last_fullsized":"2026-02-25T08:44:12.988479+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.9","version":"0'0","reported_seq":23,"reported_epoch":293,"state":"active+clean","last_fresh":"2026-02-25T08:44:11.978364+0000","last_change":"2026-02-25T08:44:05.005758+0000","last_active":"2026-02-25T08:44:11.978364+0000","last_peered":"2026-02-25T08:44:11.978364+0000","last_clean":"2026-02-25T08:44:11.978364+0000","last_became_active":"2026-02-25T08:44:05.001726+0000","last_became_peered":"2026-02-25T08:44:05.001726+0000","last_unstale":"2026-02-25T08:44:11.978364+0000","last_undegraded":"2026-02-25T08:44:11.978364+0000","last_fullsized":"2026-02-25T08:44:11.978364+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.8","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.982493+0000","last_change":"2026-02-25T08:44:05.039530+0000","last_active":"2026-02-25T08:44:12.982493+0000","last_peered":"2026-02-25T08:44:12.982493+0000","last_clean":"2026-02-25T08:44:12.982493+0000","last_became_active":"2026-02-25T08:44:05.035607+0000","last_became_peered":"2026-02-25T08:44:05.035607+0000","last_unstale":"2026-02-25T08:44:12.982493+0000","last_undegraded":"2026-02-25T08:44:12.982493+0000","last_fullsized":"2026-02-25T08:44:12.982493+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.7","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.988171+0000","last_change":"2026-02-25T08:44:05.021080+0000","last_active":"2026-02-25T08:44:12.988171+0000","last_peered":"2026-02-25T08:44:12.988171+0000","last_clean":"2026-02-25T08:44:12.988171+0000","last_became_active":"2026-02-25T08:44:05.014263+0000","last_became_peered":"2026-02-25T08:44:05.014263+0000","last_unstale":"2026-02-25T08:44:12.988171+0000","last_undegraded":"2026-02-25T08:44:12.988171+0000","last_fullsized":"2026-02-25T08:44:12.988171+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.6","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.982858+0000","last_change":"2026-02-25T08:44:05.005104+0000","last_active":"2026-02-25T08:44:12.982858+0000","last_peered":"2026-02-25T08:44:12.982858+0000","last_clean":"2026-02-25T08:44:12.982858+0000","last_became_active":"2026-02-25T08:44:04.999446+0000","last_became_peered":"2026-02-25T08:44:04.999446+0000","last_unstale":"2026-02-25T08:44:12.982858+0000","last_undegraded":"2026-02-25T08:44:12.982858+0000","last_fullsized":"2026-02-25T08:44:12.982858+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.5","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.980282+0000","last_change":"2026-02-25T08:44:05.029482+0000","last_active":"2026-02-25T08:44:12.980282+0000","last_peered":"2026-02-25T08:44:12.980282+0000","last_clean":"2026-02-25T08:44:12.980282+0000","last_became_active":"2026-02-25T08:44:04.987531+0000","last_became_peered":"2026-02-25T08:44:04.987531+0000","last_unstale":"2026-02-25T08:44:12.980282+0000","last_undegraded":"2026-02-25T08:44:12.980282+0000","last_fullsized":"2026-02-25T08:44:12.980282+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.4","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.980950+0000","last_change":"2026-02-25T08:44:05.011406+0000","last_active":"2026-02-25T08:44:12.980950+0000","last_peered":"2026-02-25T08:44:12.980950+0000","last_clean":"2026-02-25T08:44:12.980950+0000","last_became_active":"2026-02-25T08:44:04.995832+0000","last_became_peered":"2026-02-25T08:44:04.995832+0000","last_unstale":"2026-02-25T08:44:12.980950+0000","last_undegraded":"2026-02-25T08:44:12.980950+0000","last_fullsized":"2026-02-25T08:44:12.980950+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.3","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.982653+0000","last_change":"2026-02-25T08:44:05.014234+0000","last_active":"2026-02-25T08:44:12.982653+0000","last_peered":"2026-02-25T08:44:12.982653+0000","last_clean":"2026-02-25T08:44:12.982653+0000","last_became_active":"2026-02-25T08:44:04.998048+0000","last_became_peered":"2026-02-25T08:44:04.998048+0000","last_unstale":"2026-02-25T08:44:12.982653+0000","last_undegraded":"2026-02-25T08:44:12.982653+0000","last_fullsized":"2026-02-25T08:44:12.982653+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.2","version":"0'0","reported_seq":23,"reported_epoch":293,"state":"active+clean","last_fresh":"2026-02-25T08:44:11.976742+0000","last_change":"2026-02-25T08:44:05.077645+0000","last_active":"2026-02-25T08:44:11.976742+0000","last_peered":"2026-02-25T08:44:11.976742+0000","last_clean":"2026-02-25T08:44:11.976742+0000","last_became_active":"2026-02-25T08:44:05.070640+0000","last_became_peered":"2026-02-25T08:44:05.070640+0000","last_unstale":"2026-02-25T08:44:11.976742+0000","last_undegraded":"2026-02-25T08:44:11.976742+0000","last_fullsized":"2026-02-25T08:44:11.976742+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.1","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.987065+0000","last_change":"2026-02-25T08:44:05.020320+0000","last_active":"2026-02-25T08:44:12.987065+0000","last_peered":"2026-02-25T08:44:12.987065+0000","last_clean":"2026-02-25T08:44:12.987065+0000","last_became_active":"2026-02-25T08:44:05.000080+0000","last_became_peered":"2026-02-25T08:44:05.000080+0000","last_unstale":"2026-02-25T08:44:12.987065+0000","last_undegraded":"2026-02-25T08:44:12.987065+0000","last_fullsized":"2026-02-25T08:44:12.987065+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.0","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.983458+0000","last_change":"2026-02-25T08:44:05.056957+0000","last_active":"2026-02-25T08:44:12.983458+0000","last_peered":"2026-02-25T08:44:12.983458+0000","last_clean":"2026-02-25T08:44:12.983458+0000","last_became_active":"2026-02-25T08:44:05.044355+0000","last_became_peered":"2026-02-25T08:44:05.044355+0000","last_unstale":"2026-02-25T08:44:12.983458+0000","last_undegraded":"2026-02-25T08:44:12.983458+0000","last_fullsized":"2026-02-25T08:44:12.983458+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.987786+0000","last_change":"2026-02-25T08:39:07.045617+0000","last_active":"2026-02-25T08:44:12.987786+0000","last_peered":"2026-02-25T08:44:12.987786+0000","last_clean":"2026-02-25T08:44:12.987786+0000","last_became_active":"2026-02-25T08:39:05.069458+0000","last_became_peered":"2026-02-25T08:39:05.069458+0000","last_unstale":"2026-02-25T08:44:12.987786+0000","last_undegraded":"2026-02-25T08:44:12.987786+0000","last_fullsized":"2026-02-25T08:44:12.987786+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.990181+0000","last_change":"2026-02-25T08:39:07.046493+0000","last_active":"2026-02-25T08:44:12.990181+0000","last_peered":"2026-02-25T08:44:12.990181+0000","last_clean":"2026-02-25T08:44:12.990181+0000","last_became_active":"2026-02-25T08:39:05.065571+0000","last_became_peered":"2026-02-25T08:39:05.065571+0000","last_unstale":"2026-02-25T08:44:12.990181+0000","last_undegraded":"2026-02-25T08:44:12.990181+0000","last_fullsized":"2026-02-25T08:44:12.990181+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":854,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.980973+0000","last_change":"2026-02-25T08:39:07.044809+0000","last_active":"2026-02-25T08:44:12.980973+0000","last_peered":"2026-02-25T08:44:12.980973+0000","last_clean":"2026-02-25T08:44:12.980973+0000","last_became_active":"2026-02-25T08:39:05.060963+0000","last_became_peered":"2026-02-25T08:39:05.060963+0000","last_unstale":"2026-02-25T08:44:12.980973+0000","last_undegraded":"2026-02-25T08:44:12.980973+0000","last_fullsized":"2026-02-25T08:44:12.980973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":850,"reported_epoch":293,"state":"active+clean","last_fresh":"2026-02-25T08:44:11.977172+0000","last_change":"2026-02-25T08:39:07.044303+0000","last_active":"2026-02-25T08:44:11.977172+0000","last_peered":"2026-02-25T08:44:11.977172+0000","last_clean":"2026-02-25T08:44:11.977172+0000","last_became_active":"2026-02-25T08:39:05.066212+0000","last_became_peered":"2026-02-25T08:39:05.066212+0000","last_unstale":"2026-02-25T08:44:11.977172+0000","last_undegraded":"2026-02-25T08:44:11.977172+0000","last_fullsized":"2026-02-25T08:44:11.977172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":918,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.987860+0000","last_change":"2026-02-25T08:39:05.080267+0000","last_active":"2026-02-25T08:44:12.987860+0000","last_peered":"2026-02-25T08:44:12.987860+0000","last_clean":"2026-02-25T08:44:12.987860+0000","last_became_active":"2026-02-25T08:39:05.067451+0000","last_became_peered":"2026-02-25T08:39:05.067451+0000","last_unstale":"2026-02-25T08:44:12.987860+0000","last_undegraded":"2026-02-25T08:44:12.987860+0000","last_fullsized":"2026-02-25T08:44:12.987860+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":849,"reported_epoch":293,"state":"active+clean","last_fresh":"2026-02-25T08:44:11.978611+0000","last_change":"2026-02-25T08:39:07.045912+0000","last_active":"2026-02-25T08:44:11.978611+0000","last_peered":"2026-02-25T08:44:11.978611+0000","last_clean":"2026-02-25T08:44:11.978611+0000","last_became_active":"2026-02-25T08:39:05.062319+0000","last_became_peered":"2026-02-25T08:39:05.062319+0000","last_unstale":"2026-02-25T08:44:11.978611+0000","last_undegraded":"2026-02-25T08:44:11.978611+0000","last_fullsized":"2026-02-25T08:44:11.978611+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.981713+0000","last_change":"2026-02-25T08:39:07.045738+0000","last_active":"2026-02-25T08:44:12.981713+0000","last_peered":"2026-02-25T08:44:12.981713+0000","last_clean":"2026-02-25T08:44:12.981713+0000","last_became_active":"2026-02-25T08:39:05.069478+0000","last_became_peered":"2026-02-25T08:39:05.069478+0000","last_unstale":"2026-02-25T08:44:12.981713+0000","last_undegraded":"2026-02-25T08:44:12.981713+0000","last_fullsized":"2026-02-25T08:44:12.981713+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.988937+0000","last_change":"2026-02-25T08:39:07.045411+0000","last_active":"2026-02-25T08:44:12.988937+0000","last_peered":"2026-02-25T08:44:12.988937+0000","last_clean":"2026-02-25T08:44:12.988937+0000","last_became_active":"2026-02-25T08:39:05.065104+0000","last_became_peered":"2026-02-25T08:39:05.065104+0000","last_unstale":"2026-02-25T08:44:12.988937+0000","last_undegraded":"2026-02-25T08:44:12.988937+0000","last_fullsized":"2026-02-25T08:44:12.988937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.988835+0000","last_change":"2026-02-25T08:39:07.045542+0000","last_active":"2026-02-25T08:44:12.988835+0000","last_peered":"2026-02-25T08:44:12.988835+0000","last_clean":"2026-02-25T08:44:12.988835+0000","last_became_active":"2026-02-25T08:39:05.066794+0000","last_became_peered":"2026-02-25T08:39:05.066794+0000","last_unstale":"2026-02-25T08:44:12.988835+0000","last_undegraded":"2026-02-25T08:44:12.988835+0000","last_fullsized":"2026-02-25T08:44:12.988835+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":73,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214748299264,"available":128833712128,"internally_reserved":0,"allocated":85914587136,"data_stored":85914587136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32208031744,"internally_reserved":0,"allocated":21479043072,"data_stored":21479043072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96624840704,"internally_reserved":0,"allocated":64436383744,"data_stored":64436383744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20975732,"kb_used_data":20975732,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31453052,"statfs":{"total":53687074816,"available":32207925248,"internally_reserved":0,"allocated":21479149568,"data_stored":21479149568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20975224,"kb_used_data":20975224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31453560,"statfs":{"total":53687074816,"available":32208445440,"internally_reserved":0,"allocated":21478629376,"data_stored":21478629376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673269,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20975344,"kb_used_data":20975344,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31453440,"statfs":{"total":53687074816,"available":32208322560,"internally_reserved":0,"allocated":21478752256,"data_stored":21478752256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20974980,"kb_used_data":20974980,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31453804,"statfs":{"total":53687074816,"available":32208695296,"internally_reserved":0,"allocated":21478379520,"data_stored":21478379520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32208257024,"internally_reserved":0,"allocated":21478817792,"data_stored":21478817792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32208551936,"internally_reserved":0,"allocated":21478522880,"data_stored":21478522880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32208031744,"internally_reserved":0,"allocated":21479043072,"data_stored":21479043072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32208031744,"internally_reserved":0,"allocated":21479043072,"data_stored":21479043072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":0,"total":53687074816,"available":32208871424,"internally_reserved":0,"allocated":21478203392,"data_stored":21478203392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":1,"total":53687074816,"available":32208257024,"internally_reserved":0,"allocated":21478817792,"data_stored":21478817792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":2,"total":53687074816,"available":32208551936,"internally_reserved":0,"allocated":21478522880,"data_stored":21478522880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":3,"total":53687074816,"available":32208031744,"internally_reserved":0,"allocated":21479043072,"data_stored":21479043072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T08:44:16.757 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T08:44:16.833 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:16.830+0000 7f933b5e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:16.836 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:16.835+0000 7f933b5e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:16.949 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:44:16.949 INFO:teuthology.orchestra.run.trial009.stderr:dumped all 2026-02-25T08:44:16.959 INFO:teuthology.orchestra.run.trial009.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2026-02-25T08:44:16.054497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83901280,"kb_used_data":83901280,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125813856,"statfs":{"total":214748299264,"available":128833388544,"internally_reserved":0,"allocated":85914910720,"data_stored":85914910720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.126784"},"pg_stats":[{"pgid":"73.f","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.981367+0000","last_change":"2026-02-25T08:44:04.999897+0000","last_active":"2026-02-25T08:44:12.981367+0000","last_peered":"2026-02-25T08:44:12.981367+0000","last_clean":"2026-02-25T08:44:12.981367+0000","last_became_active":"2026-02-25T08:44:04.994536+0000","last_became_peered":"2026-02-25T08:44:04.994536+0000","last_unstale":"2026-02-25T08:44:12.981367+0000","last_undegraded":"2026-02-25T08:44:12.981367+0000","last_fullsized":"2026-02-25T08:44:12.981367+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.e","version":"0'0","reported_seq":23,"reported_epoch":293,"state":"active+clean","last_fresh":"2026-02-25T08:44:11.978140+0000","last_change":"2026-02-25T08:44:04.993806+0000","last_active":"2026-02-25T08:44:11.978140+0000","last_peered":"2026-02-25T08:44:11.978140+0000","last_clean":"2026-02-25T08:44:11.978140+0000","last_became_active":"2026-02-25T08:44:04.989733+0000","last_became_peered":"2026-02-25T08:44:04.989733+0000","last_unstale":"2026-02-25T08:44:11.978140+0000","last_undegraded":"2026-02-25T08:44:11.978140+0000","last_fullsized":"2026-02-25T08:44:11.978140+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.d","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.980657+0000","last_change":"2026-02-25T08:44:05.007912+0000","last_active":"2026-02-25T08:44:12.980657+0000","last_peered":"2026-02-25T08:44:12.980657+0000","last_clean":"2026-02-25T08:44:12.980657+0000","last_became_active":"2026-02-25T08:44:04.989310+0000","last_became_peered":"2026-02-25T08:44:04.989310+0000","last_unstale":"2026-02-25T08:44:12.980657+0000","last_undegraded":"2026-02-25T08:44:12.980657+0000","last_fullsized":"2026-02-25T08:44:12.980657+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.c","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.981951+0000","last_change":"2026-02-25T08:44:05.011182+0000","last_active":"2026-02-25T08:44:12.981951+0000","last_peered":"2026-02-25T08:44:12.981951+0000","last_clean":"2026-02-25T08:44:12.981951+0000","last_became_active":"2026-02-25T08:44:05.007215+0000","last_became_peered":"2026-02-25T08:44:05.007215+0000","last_unstale":"2026-02-25T08:44:12.981951+0000","last_undegraded":"2026-02-25T08:44:12.981951+0000","last_fullsized":"2026-02-25T08:44:12.981951+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.b","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.981978+0000","last_change":"2026-02-25T08:44:04.996601+0000","last_active":"2026-02-25T08:44:12.981978+0000","last_peered":"2026-02-25T08:44:12.981978+0000","last_clean":"2026-02-25T08:44:12.981978+0000","last_became_active":"2026-02-25T08:44:04.992595+0000","last_became_peered":"2026-02-25T08:44:04.992595+0000","last_unstale":"2026-02-25T08:44:12.981978+0000","last_undegraded":"2026-02-25T08:44:12.981978+0000","last_fullsized":"2026-02-25T08:44:12.981978+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.a","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.988479+0000","last_change":"2026-02-25T08:44:04.992304+0000","last_active":"2026-02-25T08:44:12.988479+0000","last_peered":"2026-02-25T08:44:12.988479+0000","last_clean":"2026-02-25T08:44:12.988479+0000","last_became_active":"2026-02-25T08:44:04.986497+0000","last_became_peered":"2026-02-25T08:44:04.986497+0000","last_unstale":"2026-02-25T08:44:12.988479+0000","last_undegraded":"2026-02-25T08:44:12.988479+0000","last_fullsized":"2026-02-25T08:44:12.988479+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.9","version":"0'0","reported_seq":23,"reported_epoch":293,"state":"active+clean","last_fresh":"2026-02-25T08:44:11.978364+0000","last_change":"2026-02-25T08:44:05.005758+0000","last_active":"2026-02-25T08:44:11.978364+0000","last_peered":"2026-02-25T08:44:11.978364+0000","last_clean":"2026-02-25T08:44:11.978364+0000","last_became_active":"2026-02-25T08:44:05.001726+0000","last_became_peered":"2026-02-25T08:44:05.001726+0000","last_unstale":"2026-02-25T08:44:11.978364+0000","last_undegraded":"2026-02-25T08:44:11.978364+0000","last_fullsized":"2026-02-25T08:44:11.978364+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.8","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.982493+0000","last_change":"2026-02-25T08:44:05.039530+0000","last_active":"2026-02-25T08:44:12.982493+0000","last_peered":"2026-02-25T08:44:12.982493+0000","last_clean":"2026-02-25T08:44:12.982493+0000","last_became_active":"2026-02-25T08:44:05.035607+0000","last_became_peered":"2026-02-25T08:44:05.035607+0000","last_unstale":"2026-02-25T08:44:12.982493+0000","last_undegraded":"2026-02-25T08:44:12.982493+0000","last_fullsized":"2026-02-25T08:44:12.982493+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.7","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.988171+0000","last_change":"2026-02-25T08:44:05.021080+0000","last_active":"2026-02-25T08:44:12.988171+0000","last_peered":"2026-02-25T08:44:12.988171+0000","last_clean":"2026-02-25T08:44:12.988171+0000","last_became_active":"2026-02-25T08:44:05.014263+0000","last_became_peered":"2026-02-25T08:44:05.014263+0000","last_unstale":"2026-02-25T08:44:12.988171+0000","last_undegraded":"2026-02-25T08:44:12.988171+0000","last_fullsized":"2026-02-25T08:44:12.988171+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.6","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.982858+0000","last_change":"2026-02-25T08:44:05.005104+0000","last_active":"2026-02-25T08:44:12.982858+0000","last_peered":"2026-02-25T08:44:12.982858+0000","last_clean":"2026-02-25T08:44:12.982858+0000","last_became_active":"2026-02-25T08:44:04.999446+0000","last_became_peered":"2026-02-25T08:44:04.999446+0000","last_unstale":"2026-02-25T08:44:12.982858+0000","last_undegraded":"2026-02-25T08:44:12.982858+0000","last_fullsized":"2026-02-25T08:44:12.982858+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.5","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.980282+0000","last_change":"2026-02-25T08:44:05.029482+0000","last_active":"2026-02-25T08:44:12.980282+0000","last_peered":"2026-02-25T08:44:12.980282+0000","last_clean":"2026-02-25T08:44:12.980282+0000","last_became_active":"2026-02-25T08:44:04.987531+0000","last_became_peered":"2026-02-25T08:44:04.987531+0000","last_unstale":"2026-02-25T08:44:12.980282+0000","last_undegraded":"2026-02-25T08:44:12.980282+0000","last_fullsized":"2026-02-25T08:44:12.980282+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.4","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.980950+0000","last_change":"2026-02-25T08:44:05.011406+0000","last_active":"2026-02-25T08:44:12.980950+0000","last_peered":"2026-02-25T08:44:12.980950+0000","last_clean":"2026-02-25T08:44:12.980950+0000","last_became_active":"2026-02-25T08:44:04.995832+0000","last_became_peered":"2026-02-25T08:44:04.995832+0000","last_unstale":"2026-02-25T08:44:12.980950+0000","last_undegraded":"2026-02-25T08:44:12.980950+0000","last_fullsized":"2026-02-25T08:44:12.980950+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.3","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.982653+0000","last_change":"2026-02-25T08:44:05.014234+0000","last_active":"2026-02-25T08:44:12.982653+0000","last_peered":"2026-02-25T08:44:12.982653+0000","last_clean":"2026-02-25T08:44:12.982653+0000","last_became_active":"2026-02-25T08:44:04.998048+0000","last_became_peered":"2026-02-25T08:44:04.998048+0000","last_unstale":"2026-02-25T08:44:12.982653+0000","last_undegraded":"2026-02-25T08:44:12.982653+0000","last_fullsized":"2026-02-25T08:44:12.982653+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.2","version":"0'0","reported_seq":23,"reported_epoch":293,"state":"active+clean","last_fresh":"2026-02-25T08:44:11.976742+0000","last_change":"2026-02-25T08:44:05.077645+0000","last_active":"2026-02-25T08:44:11.976742+0000","last_peered":"2026-02-25T08:44:11.976742+0000","last_clean":"2026-02-25T08:44:11.976742+0000","last_became_active":"2026-02-25T08:44:05.070640+0000","last_became_peered":"2026-02-25T08:44:05.070640+0000","last_unstale":"2026-02-25T08:44:11.976742+0000","last_undegraded":"2026-02-25T08:44:11.976742+0000","last_fullsized":"2026-02-25T08:44:11.976742+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.1","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.987065+0000","last_change":"2026-02-25T08:44:05.020320+0000","last_active":"2026-02-25T08:44:12.987065+0000","last_peered":"2026-02-25T08:44:12.987065+0000","last_clean":"2026-02-25T08:44:12.987065+0000","last_became_active":"2026-02-25T08:44:05.000080+0000","last_became_peered":"2026-02-25T08:44:05.000080+0000","last_unstale":"2026-02-25T08:44:12.987065+0000","last_undegraded":"2026-02-25T08:44:12.987065+0000","last_fullsized":"2026-02-25T08:44:12.987065+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.0","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.983458+0000","last_change":"2026-02-25T08:44:05.056957+0000","last_active":"2026-02-25T08:44:12.983458+0000","last_peered":"2026-02-25T08:44:12.983458+0000","last_clean":"2026-02-25T08:44:12.983458+0000","last_became_active":"2026-02-25T08:44:05.044355+0000","last_became_peered":"2026-02-25T08:44:05.044355+0000","last_unstale":"2026-02-25T08:44:12.983458+0000","last_undegraded":"2026-02-25T08:44:12.983458+0000","last_fullsized":"2026-02-25T08:44:12.983458+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.987786+0000","last_change":"2026-02-25T08:39:07.045617+0000","last_active":"2026-02-25T08:44:12.987786+0000","last_peered":"2026-02-25T08:44:12.987786+0000","last_clean":"2026-02-25T08:44:12.987786+0000","last_became_active":"2026-02-25T08:39:05.069458+0000","last_became_peered":"2026-02-25T08:39:05.069458+0000","last_unstale":"2026-02-25T08:44:12.987786+0000","last_undegraded":"2026-02-25T08:44:12.987786+0000","last_fullsized":"2026-02-25T08:44:12.987786+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.990181+0000","last_change":"2026-02-25T08:39:07.046493+0000","last_active":"2026-02-25T08:44:12.990181+0000","last_peered":"2026-02-25T08:44:12.990181+0000","last_clean":"2026-02-25T08:44:12.990181+0000","last_became_active":"2026-02-25T08:39:05.065571+0000","last_became_peered":"2026-02-25T08:39:05.065571+0000","last_unstale":"2026-02-25T08:44:12.990181+0000","last_undegraded":"2026-02-25T08:44:12.990181+0000","last_fullsized":"2026-02-25T08:44:12.990181+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":854,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.980973+0000","last_change":"2026-02-25T08:39:07.044809+0000","last_active":"2026-02-25T08:44:12.980973+0000","last_peered":"2026-02-25T08:44:12.980973+0000","last_clean":"2026-02-25T08:44:12.980973+0000","last_became_active":"2026-02-25T08:39:05.060963+0000","last_became_peered":"2026-02-25T08:39:05.060963+0000","last_unstale":"2026-02-25T08:44:12.980973+0000","last_undegraded":"2026-02-25T08:44:12.980973+0000","last_fullsized":"2026-02-25T08:44:12.980973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":850,"reported_epoch":293,"state":"active+clean","last_fresh":"2026-02-25T08:44:11.977172+0000","last_change":"2026-02-25T08:39:07.044303+0000","last_active":"2026-02-25T08:44:11.977172+0000","last_peered":"2026-02-25T08:44:11.977172+0000","last_clean":"2026-02-25T08:44:11.977172+0000","last_became_active":"2026-02-25T08:39:05.066212+0000","last_became_peered":"2026-02-25T08:39:05.066212+0000","last_unstale":"2026-02-25T08:44:11.977172+0000","last_undegraded":"2026-02-25T08:44:11.977172+0000","last_fullsized":"2026-02-25T08:44:11.977172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":918,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.987860+0000","last_change":"2026-02-25T08:39:05.080267+0000","last_active":"2026-02-25T08:44:12.987860+0000","last_peered":"2026-02-25T08:44:12.987860+0000","last_clean":"2026-02-25T08:44:12.987860+0000","last_became_active":"2026-02-25T08:39:05.067451+0000","last_became_peered":"2026-02-25T08:39:05.067451+0000","last_unstale":"2026-02-25T08:44:12.987860+0000","last_undegraded":"2026-02-25T08:44:12.987860+0000","last_fullsized":"2026-02-25T08:44:12.987860+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":849,"reported_epoch":293,"state":"active+clean","last_fresh":"2026-02-25T08:44:11.978611+0000","last_change":"2026-02-25T08:39:07.045912+0000","last_active":"2026-02-25T08:44:11.978611+0000","last_peered":"2026-02-25T08:44:11.978611+0000","last_clean":"2026-02-25T08:44:11.978611+0000","last_became_active":"2026-02-25T08:39:05.062319+0000","last_became_peered":"2026-02-25T08:39:05.062319+0000","last_unstale":"2026-02-25T08:44:11.978611+0000","last_undegraded":"2026-02-25T08:44:11.978611+0000","last_fullsized":"2026-02-25T08:44:11.978611+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.981713+0000","last_change":"2026-02-25T08:39:07.045738+0000","last_active":"2026-02-25T08:44:12.981713+0000","last_peered":"2026-02-25T08:44:12.981713+0000","last_clean":"2026-02-25T08:44:12.981713+0000","last_became_active":"2026-02-25T08:39:05.069478+0000","last_became_peered":"2026-02-25T08:39:05.069478+0000","last_unstale":"2026-02-25T08:44:12.981713+0000","last_undegraded":"2026-02-25T08:44:12.981713+0000","last_fullsized":"2026-02-25T08:44:12.981713+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.988937+0000","last_change":"2026-02-25T08:39:07.045411+0000","last_active":"2026-02-25T08:44:12.988937+0000","last_peered":"2026-02-25T08:44:12.988937+0000","last_clean":"2026-02-25T08:44:12.988937+0000","last_became_active":"2026-02-25T08:39:05.065104+0000","last_became_peered":"2026-02-25T08:39:05.065104+0000","last_unstale":"2026-02-25T08:44:12.988937+0000","last_undegraded":"2026-02-25T08:44:12.988937+0000","last_fullsized":"2026-02-25T08:44:12.988937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.988835+0000","last_change":"2026-02-25T08:39:07.045542+0000","last_active":"2026-02-25T08:44:12.988835+0000","last_peered":"2026-02-25T08:44:12.988835+0000","last_clean":"2026-02-25T08:44:12.988835+0000","last_became_active":"2026-02-25T08:39:05.066794+0000","last_became_peered":"2026-02-25T08:39:05.066794+0000","last_unstale":"2026-02-25T08:44:12.988835+0000","last_undegraded":"2026-02-25T08:44:12.988835+0000","last_fullsized":"2026-02-25T08:44:12.988835+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":73,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214748299264,"available":128833712128,"internally_reserved":0,"allocated":85914587136,"data_stored":85914587136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32208031744,"internally_reserved":0,"allocated":21479043072,"data_stored":21479043072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96624840704,"internally_reserved":0,"allocated":64436383744,"data_stored":64436383744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20975732,"kb_used_data":20975732,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31453052,"statfs":{"total":53687074816,"available":32207925248,"internally_reserved":0,"allocated":21479149568,"data_stored":21479149568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20975224,"kb_used_data":20975224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31453560,"statfs":{"total":53687074816,"available":32208445440,"internally_reserved":0,"allocated":21478629376,"data_stored":21478629376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673269,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20975344,"kb_used_data":20975344,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31453440,"statfs":{"total":53687074816,"available":32208322560,"internally_reserved":0,"allocated":21478752256,"data_stored":21478752256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20974980,"kb_used_data":20974980,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31453804,"statfs":{"total":53687074816,"available":32208695296,"internally_reserved":0,"allocated":21478379520,"data_stored":21478379520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32208257024,"internally_reserved":0,"allocated":21478817792,"data_stored":21478817792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32208551936,"internally_reserved":0,"allocated":21478522880,"data_stored":21478522880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32208031744,"internally_reserved":0,"allocated":21479043072,"data_stored":21479043072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32208031744,"internally_reserved":0,"allocated":21479043072,"data_stored":21479043072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":0,"total":53687074816,"available":32208871424,"internally_reserved":0,"allocated":21478203392,"data_stored":21478203392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":1,"total":53687074816,"available":32208257024,"internally_reserved":0,"allocated":21478817792,"data_stored":21478817792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":2,"total":53687074816,"available":32208551936,"internally_reserved":0,"allocated":21478522880,"data_stored":21478522880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":3,"total":53687074816,"available":32208031744,"internally_reserved":0,"allocated":21479043072,"data_stored":21479043072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T08:44:16.961 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-25T08:44:16.961 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T08:44:17.039 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:17.035+0000 7f6caba5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:17.042 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:17.041+0000 7f6caa7d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:17.154 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:44:17.155 INFO:teuthology.orchestra.run.trial009.stderr:dumped all 2026-02-25T08:44:17.165 INFO:teuthology.orchestra.run.trial009.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2026-02-25T08:44:16.054497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83901280,"kb_used_data":83901280,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125813856,"statfs":{"total":214748299264,"available":128833388544,"internally_reserved":0,"allocated":85914910720,"data_stored":85914910720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.126784"},"pg_stats":[{"pgid":"73.f","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.981367+0000","last_change":"2026-02-25T08:44:04.999897+0000","last_active":"2026-02-25T08:44:12.981367+0000","last_peered":"2026-02-25T08:44:12.981367+0000","last_clean":"2026-02-25T08:44:12.981367+0000","last_became_active":"2026-02-25T08:44:04.994536+0000","last_became_peered":"2026-02-25T08:44:04.994536+0000","last_unstale":"2026-02-25T08:44:12.981367+0000","last_undegraded":"2026-02-25T08:44:12.981367+0000","last_fullsized":"2026-02-25T08:44:12.981367+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.e","version":"0'0","reported_seq":23,"reported_epoch":293,"state":"active+clean","last_fresh":"2026-02-25T08:44:11.978140+0000","last_change":"2026-02-25T08:44:04.993806+0000","last_active":"2026-02-25T08:44:11.978140+0000","last_peered":"2026-02-25T08:44:11.978140+0000","last_clean":"2026-02-25T08:44:11.978140+0000","last_became_active":"2026-02-25T08:44:04.989733+0000","last_became_peered":"2026-02-25T08:44:04.989733+0000","last_unstale":"2026-02-25T08:44:11.978140+0000","last_undegraded":"2026-02-25T08:44:11.978140+0000","last_fullsized":"2026-02-25T08:44:11.978140+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.d","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.980657+0000","last_change":"2026-02-25T08:44:05.007912+0000","last_active":"2026-02-25T08:44:12.980657+0000","last_peered":"2026-02-25T08:44:12.980657+0000","last_clean":"2026-02-25T08:44:12.980657+0000","last_became_active":"2026-02-25T08:44:04.989310+0000","last_became_peered":"2026-02-25T08:44:04.989310+0000","last_unstale":"2026-02-25T08:44:12.980657+0000","last_undegraded":"2026-02-25T08:44:12.980657+0000","last_fullsized":"2026-02-25T08:44:12.980657+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.c","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.981951+0000","last_change":"2026-02-25T08:44:05.011182+0000","last_active":"2026-02-25T08:44:12.981951+0000","last_peered":"2026-02-25T08:44:12.981951+0000","last_clean":"2026-02-25T08:44:12.981951+0000","last_became_active":"2026-02-25T08:44:05.007215+0000","last_became_peered":"2026-02-25T08:44:05.007215+0000","last_unstale":"2026-02-25T08:44:12.981951+0000","last_undegraded":"2026-02-25T08:44:12.981951+0000","last_fullsized":"2026-02-25T08:44:12.981951+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.b","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.981978+0000","last_change":"2026-02-25T08:44:04.996601+0000","last_active":"2026-02-25T08:44:12.981978+0000","last_peered":"2026-02-25T08:44:12.981978+0000","last_clean":"2026-02-25T08:44:12.981978+0000","last_became_active":"2026-02-25T08:44:04.992595+0000","last_became_peered":"2026-02-25T08:44:04.992595+0000","last_unstale":"2026-02-25T08:44:12.981978+0000","last_undegraded":"2026-02-25T08:44:12.981978+0000","last_fullsized":"2026-02-25T08:44:12.981978+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.a","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.988479+0000","last_change":"2026-02-25T08:44:04.992304+0000","last_active":"2026-02-25T08:44:12.988479+0000","last_peered":"2026-02-25T08:44:12.988479+0000","last_clean":"2026-02-25T08:44:12.988479+0000","last_became_active":"2026-02-25T08:44:04.986497+0000","last_became_peered":"2026-02-25T08:44:04.986497+0000","last_unstale":"2026-02-25T08:44:12.988479+0000","last_undegraded":"2026-02-25T08:44:12.988479+0000","last_fullsized":"2026-02-25T08:44:12.988479+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.9","version":"0'0","reported_seq":23,"reported_epoch":293,"state":"active+clean","last_fresh":"2026-02-25T08:44:11.978364+0000","last_change":"2026-02-25T08:44:05.005758+0000","last_active":"2026-02-25T08:44:11.978364+0000","last_peered":"2026-02-25T08:44:11.978364+0000","last_clean":"2026-02-25T08:44:11.978364+0000","last_became_active":"2026-02-25T08:44:05.001726+0000","last_became_peered":"2026-02-25T08:44:05.001726+0000","last_unstale":"2026-02-25T08:44:11.978364+0000","last_undegraded":"2026-02-25T08:44:11.978364+0000","last_fullsized":"2026-02-25T08:44:11.978364+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.8","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.982493+0000","last_change":"2026-02-25T08:44:05.039530+0000","last_active":"2026-02-25T08:44:12.982493+0000","last_peered":"2026-02-25T08:44:12.982493+0000","last_clean":"2026-02-25T08:44:12.982493+0000","last_became_active":"2026-02-25T08:44:05.035607+0000","last_became_peered":"2026-02-25T08:44:05.035607+0000","last_unstale":"2026-02-25T08:44:12.982493+0000","last_undegraded":"2026-02-25T08:44:12.982493+0000","last_fullsized":"2026-02-25T08:44:12.982493+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.7","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.988171+0000","last_change":"2026-02-25T08:44:05.021080+0000","last_active":"2026-02-25T08:44:12.988171+0000","last_peered":"2026-02-25T08:44:12.988171+0000","last_clean":"2026-02-25T08:44:12.988171+0000","last_became_active":"2026-02-25T08:44:05.014263+0000","last_became_peered":"2026-02-25T08:44:05.014263+0000","last_unstale":"2026-02-25T08:44:12.988171+0000","last_undegraded":"2026-02-25T08:44:12.988171+0000","last_fullsized":"2026-02-25T08:44:12.988171+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.6","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.982858+0000","last_change":"2026-02-25T08:44:05.005104+0000","last_active":"2026-02-25T08:44:12.982858+0000","last_peered":"2026-02-25T08:44:12.982858+0000","last_clean":"2026-02-25T08:44:12.982858+0000","last_became_active":"2026-02-25T08:44:04.999446+0000","last_became_peered":"2026-02-25T08:44:04.999446+0000","last_unstale":"2026-02-25T08:44:12.982858+0000","last_undegraded":"2026-02-25T08:44:12.982858+0000","last_fullsized":"2026-02-25T08:44:12.982858+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.5","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.980282+0000","last_change":"2026-02-25T08:44:05.029482+0000","last_active":"2026-02-25T08:44:12.980282+0000","last_peered":"2026-02-25T08:44:12.980282+0000","last_clean":"2026-02-25T08:44:12.980282+0000","last_became_active":"2026-02-25T08:44:04.987531+0000","last_became_peered":"2026-02-25T08:44:04.987531+0000","last_unstale":"2026-02-25T08:44:12.980282+0000","last_undegraded":"2026-02-25T08:44:12.980282+0000","last_fullsized":"2026-02-25T08:44:12.980282+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.4","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.980950+0000","last_change":"2026-02-25T08:44:05.011406+0000","last_active":"2026-02-25T08:44:12.980950+0000","last_peered":"2026-02-25T08:44:12.980950+0000","last_clean":"2026-02-25T08:44:12.980950+0000","last_became_active":"2026-02-25T08:44:04.995832+0000","last_became_peered":"2026-02-25T08:44:04.995832+0000","last_unstale":"2026-02-25T08:44:12.980950+0000","last_undegraded":"2026-02-25T08:44:12.980950+0000","last_fullsized":"2026-02-25T08:44:12.980950+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.3","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.982653+0000","last_change":"2026-02-25T08:44:05.014234+0000","last_active":"2026-02-25T08:44:12.982653+0000","last_peered":"2026-02-25T08:44:12.982653+0000","last_clean":"2026-02-25T08:44:12.982653+0000","last_became_active":"2026-02-25T08:44:04.998048+0000","last_became_peered":"2026-02-25T08:44:04.998048+0000","last_unstale":"2026-02-25T08:44:12.982653+0000","last_undegraded":"2026-02-25T08:44:12.982653+0000","last_fullsized":"2026-02-25T08:44:12.982653+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.2","version":"0'0","reported_seq":23,"reported_epoch":293,"state":"active+clean","last_fresh":"2026-02-25T08:44:11.976742+0000","last_change":"2026-02-25T08:44:05.077645+0000","last_active":"2026-02-25T08:44:11.976742+0000","last_peered":"2026-02-25T08:44:11.976742+0000","last_clean":"2026-02-25T08:44:11.976742+0000","last_became_active":"2026-02-25T08:44:05.070640+0000","last_became_peered":"2026-02-25T08:44:05.070640+0000","last_unstale":"2026-02-25T08:44:11.976742+0000","last_undegraded":"2026-02-25T08:44:11.976742+0000","last_fullsized":"2026-02-25T08:44:11.976742+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.1","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.987065+0000","last_change":"2026-02-25T08:44:05.020320+0000","last_active":"2026-02-25T08:44:12.987065+0000","last_peered":"2026-02-25T08:44:12.987065+0000","last_clean":"2026-02-25T08:44:12.987065+0000","last_became_active":"2026-02-25T08:44:05.000080+0000","last_became_peered":"2026-02-25T08:44:05.000080+0000","last_unstale":"2026-02-25T08:44:12.987065+0000","last_undegraded":"2026-02-25T08:44:12.987065+0000","last_fullsized":"2026-02-25T08:44:12.987065+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.0","version":"0'0","reported_seq":26,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.983458+0000","last_change":"2026-02-25T08:44:05.056957+0000","last_active":"2026-02-25T08:44:12.983458+0000","last_peered":"2026-02-25T08:44:12.983458+0000","last_clean":"2026-02-25T08:44:12.983458+0000","last_became_active":"2026-02-25T08:44:05.044355+0000","last_became_peered":"2026-02-25T08:44:05.044355+0000","last_unstale":"2026-02-25T08:44:12.983458+0000","last_undegraded":"2026-02-25T08:44:12.983458+0000","last_fullsized":"2026-02-25T08:44:12.983458+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.987786+0000","last_change":"2026-02-25T08:39:07.045617+0000","last_active":"2026-02-25T08:44:12.987786+0000","last_peered":"2026-02-25T08:44:12.987786+0000","last_clean":"2026-02-25T08:44:12.987786+0000","last_became_active":"2026-02-25T08:39:05.069458+0000","last_became_peered":"2026-02-25T08:39:05.069458+0000","last_unstale":"2026-02-25T08:44:12.987786+0000","last_undegraded":"2026-02-25T08:44:12.987786+0000","last_fullsized":"2026-02-25T08:44:12.987786+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.990181+0000","last_change":"2026-02-25T08:39:07.046493+0000","last_active":"2026-02-25T08:44:12.990181+0000","last_peered":"2026-02-25T08:44:12.990181+0000","last_clean":"2026-02-25T08:44:12.990181+0000","last_became_active":"2026-02-25T08:39:05.065571+0000","last_became_peered":"2026-02-25T08:39:05.065571+0000","last_unstale":"2026-02-25T08:44:12.990181+0000","last_undegraded":"2026-02-25T08:44:12.990181+0000","last_fullsized":"2026-02-25T08:44:12.990181+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":854,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.980973+0000","last_change":"2026-02-25T08:39:07.044809+0000","last_active":"2026-02-25T08:44:12.980973+0000","last_peered":"2026-02-25T08:44:12.980973+0000","last_clean":"2026-02-25T08:44:12.980973+0000","last_became_active":"2026-02-25T08:39:05.060963+0000","last_became_peered":"2026-02-25T08:39:05.060963+0000","last_unstale":"2026-02-25T08:44:12.980973+0000","last_undegraded":"2026-02-25T08:44:12.980973+0000","last_fullsized":"2026-02-25T08:44:12.980973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":850,"reported_epoch":293,"state":"active+clean","last_fresh":"2026-02-25T08:44:11.977172+0000","last_change":"2026-02-25T08:39:07.044303+0000","last_active":"2026-02-25T08:44:11.977172+0000","last_peered":"2026-02-25T08:44:11.977172+0000","last_clean":"2026-02-25T08:44:11.977172+0000","last_became_active":"2026-02-25T08:39:05.066212+0000","last_became_peered":"2026-02-25T08:39:05.066212+0000","last_unstale":"2026-02-25T08:44:11.977172+0000","last_undegraded":"2026-02-25T08:44:11.977172+0000","last_fullsized":"2026-02-25T08:44:11.977172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":918,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.987860+0000","last_change":"2026-02-25T08:39:05.080267+0000","last_active":"2026-02-25T08:44:12.987860+0000","last_peered":"2026-02-25T08:44:12.987860+0000","last_clean":"2026-02-25T08:44:12.987860+0000","last_became_active":"2026-02-25T08:39:05.067451+0000","last_became_peered":"2026-02-25T08:39:05.067451+0000","last_unstale":"2026-02-25T08:44:12.987860+0000","last_undegraded":"2026-02-25T08:44:12.987860+0000","last_fullsized":"2026-02-25T08:44:12.987860+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":849,"reported_epoch":293,"state":"active+clean","last_fresh":"2026-02-25T08:44:11.978611+0000","last_change":"2026-02-25T08:39:07.045912+0000","last_active":"2026-02-25T08:44:11.978611+0000","last_peered":"2026-02-25T08:44:11.978611+0000","last_clean":"2026-02-25T08:44:11.978611+0000","last_became_active":"2026-02-25T08:39:05.062319+0000","last_became_peered":"2026-02-25T08:39:05.062319+0000","last_unstale":"2026-02-25T08:44:11.978611+0000","last_undegraded":"2026-02-25T08:44:11.978611+0000","last_fullsized":"2026-02-25T08:44:11.978611+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.981713+0000","last_change":"2026-02-25T08:39:07.045738+0000","last_active":"2026-02-25T08:44:12.981713+0000","last_peered":"2026-02-25T08:44:12.981713+0000","last_clean":"2026-02-25T08:44:12.981713+0000","last_became_active":"2026-02-25T08:39:05.069478+0000","last_became_peered":"2026-02-25T08:39:05.069478+0000","last_unstale":"2026-02-25T08:44:12.981713+0000","last_undegraded":"2026-02-25T08:44:12.981713+0000","last_fullsized":"2026-02-25T08:44:12.981713+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.988937+0000","last_change":"2026-02-25T08:39:07.045411+0000","last_active":"2026-02-25T08:44:12.988937+0000","last_peered":"2026-02-25T08:44:12.988937+0000","last_clean":"2026-02-25T08:44:12.988937+0000","last_became_active":"2026-02-25T08:39:05.065104+0000","last_became_peered":"2026-02-25T08:39:05.065104+0000","last_unstale":"2026-02-25T08:44:12.988937+0000","last_undegraded":"2026-02-25T08:44:12.988937+0000","last_fullsized":"2026-02-25T08:44:12.988937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":852,"reported_epoch":294,"state":"active+clean","last_fresh":"2026-02-25T08:44:12.988835+0000","last_change":"2026-02-25T08:39:07.045542+0000","last_active":"2026-02-25T08:44:12.988835+0000","last_peered":"2026-02-25T08:44:12.988835+0000","last_clean":"2026-02-25T08:44:12.988835+0000","last_became_active":"2026-02-25T08:39:05.066794+0000","last_became_peered":"2026-02-25T08:39:05.066794+0000","last_unstale":"2026-02-25T08:44:12.988835+0000","last_undegraded":"2026-02-25T08:44:12.988835+0000","last_fullsized":"2026-02-25T08:44:12.988835+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":73,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214748299264,"available":128833712128,"internally_reserved":0,"allocated":85914587136,"data_stored":85914587136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32208031744,"internally_reserved":0,"allocated":21479043072,"data_stored":21479043072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96624840704,"internally_reserved":0,"allocated":64436383744,"data_stored":64436383744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20975732,"kb_used_data":20975732,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31453052,"statfs":{"total":53687074816,"available":32207925248,"internally_reserved":0,"allocated":21479149568,"data_stored":21479149568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20975224,"kb_used_data":20975224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31453560,"statfs":{"total":53687074816,"available":32208445440,"internally_reserved":0,"allocated":21478629376,"data_stored":21478629376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673269,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20975344,"kb_used_data":20975344,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31453440,"statfs":{"total":53687074816,"available":32208322560,"internally_reserved":0,"allocated":21478752256,"data_stored":21478752256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20974980,"kb_used_data":20974980,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31453804,"statfs":{"total":53687074816,"available":32208695296,"internally_reserved":0,"allocated":21478379520,"data_stored":21478379520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32208257024,"internally_reserved":0,"allocated":21478817792,"data_stored":21478817792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32208551936,"internally_reserved":0,"allocated":21478522880,"data_stored":21478522880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32208031744,"internally_reserved":0,"allocated":21479043072,"data_stored":21479043072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32208031744,"internally_reserved":0,"allocated":21479043072,"data_stored":21479043072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":0,"total":53687074816,"available":32208871424,"internally_reserved":0,"allocated":21478203392,"data_stored":21478203392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":1,"total":53687074816,"available":32208257024,"internally_reserved":0,"allocated":21478817792,"data_stored":21478817792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":2,"total":53687074816,"available":32208551936,"internally_reserved":0,"allocated":21478522880,"data_stored":21478522880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":3,"total":53687074816,"available":32208031744,"internally_reserved":0,"allocated":21479043072,"data_stored":21479043072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T08:44:17.167 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T08:44:17.244 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:17.240+0000 7f75efacb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:17.246 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:17.245+0000 7f75efacb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:17.359 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:44:17.359 INFO:teuthology.orchestra.run.trial009.stdout:{"epoch":295,"fsid":"864c6132-1c9b-4620-b7bf-62f54427687f","created":"2026-02-25T08:38:53.799625+0000","modified":"2026-02-25T08:44:15.940425+0000","last_up_change":"2026-02-25T08:39:03.014409+0000","last_in_change":"2026-02-25T08:38:55.682585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":75,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-25T08:39:03.390813+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-25T08:39:04.022360+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":73,"pool_name":"黅","create_time":"2026-02-25T08:44:02.994832+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"289","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"08eaef4c-a709-4cb0-9bd5-cd7698b3c29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":292,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6803","nonce":2930705883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6804","nonce":2930705883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6806","nonce":2930705883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6807","nonce":2930705883}]},"public_addr":"10.20.193.9:6803/2930705883","cluster_addr":"10.20.193.9:6804/2930705883","heartbeat_back_addr":"10.20.193.9:6806/2930705883","heartbeat_front_addr":"10.20.193.9:6807/2930705883","state":["exists","up"]},{"osd":1,"uuid":"d3c936d9-0068-4832-8e94-706b81084d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":292,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6800","nonce":4153606934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6801","nonce":4153606934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6802","nonce":4153606934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.9:6805","nonce":4153606934}]},"public_addr":"10.20.193.9:6800/4153606934","cluster_addr":"10.20.193.9:6801/4153606934","heartbeat_back_addr":"10.20.193.9:6802/4153606934","heartbeat_front_addr":"10.20.193.9:6805/4153606934","state":["exists","up"]},{"osd":2,"uuid":"ed0c9b25-bffe-4250-9093-a1ef55469878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":292,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6803","nonce":1150076135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6804","nonce":1150076135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6809","nonce":1150076135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6808","nonce":1150076135}]},"public_addr":"10.20.193.59:6803/1150076135","cluster_addr":"10.20.193.59:6804/1150076135","heartbeat_back_addr":"10.20.193.59:6809/1150076135","heartbeat_front_addr":"10.20.193.59:6808/1150076135","state":["exists","up"]},{"osd":3,"uuid":"673cc133-8da7-49dc-9d33-43ef24d8a399","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":292,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6802","nonce":57555495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6805","nonce":57555495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6807","nonce":57555495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.59:6806","nonce":57555495}]},"public_addr":"10.20.193.59:6802/57555495","cluster_addr":"10.20.193.59:6805/57555495","heartbeat_back_addr":"10.20.193.59:6807/57555495","heartbeat_front_addr":"10.20.193.59:6806/57555495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]},{"pool":28,"snaps":[{"begin":1,"length":1}]},{"pool":33,"snaps":[{"begin":1,"length":1}]},{"pool":34,"snaps":[{"begin":1,"length":1}]},{"pool":35,"snaps":[{"begin":1,"length":1}]},{"pool":36,"snaps":[{"begin":1,"length":1}]},{"pool":72,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T08:44:18.370 INFO:tasks.ceph:Scrubbing osd.0 2026-02-25T08:44:18.370 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-25T08:44:18.451 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:18.446+0000 7f82e935b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:18.454 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:18.453+0000 7f82e935b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:18.463 INFO:teuthology.orchestra.run.trial009.stdout:{ 2026-02-25T08:44:18.463 INFO:teuthology.orchestra.run.trial009.stdout: "success": "" 2026-02-25T08:44:18.464 INFO:teuthology.orchestra.run.trial009.stdout:} 2026-02-25T08:44:18.470 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-25T08:44:18.548 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:18.544+0000 7f897ab0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:18.550 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:18.549+0000 7f897ab0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:18.666 INFO:teuthology.orchestra.run.trial009.stderr:instructed osd(s) 0 to deep-scrub 2026-02-25T08:44:18.681 INFO:tasks.ceph:Scrubbing osd.1 2026-02-25T08:44:18.681 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-25T08:44:18.759 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:18.754+0000 7f84e35dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:18.761 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:18.761+0000 7f84e35dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:18.772 INFO:teuthology.orchestra.run.trial009.stdout:{ 2026-02-25T08:44:18.772 INFO:teuthology.orchestra.run.trial009.stdout: "success": "" 2026-02-25T08:44:18.772 INFO:teuthology.orchestra.run.trial009.stdout:} 2026-02-25T08:44:18.781 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-25T08:44:18.859 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:18.856+0000 7f63a123d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:18.862 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:18.861+0000 7f63a123d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:18.974 INFO:teuthology.orchestra.run.trial009.stderr:instructed osd(s) 1 to deep-scrub 2026-02-25T08:44:18.987 INFO:tasks.ceph:Scrubbing osd.2 2026-02-25T08:44:18.987 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-25T08:44:19.067 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:19.061+0000 7f413d2cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:19.069 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:19.068+0000 7f413d2cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:19.078 INFO:teuthology.orchestra.run.trial009.stdout:{ 2026-02-25T08:44:19.078 INFO:teuthology.orchestra.run.trial009.stdout: "success": "" 2026-02-25T08:44:19.078 INFO:teuthology.orchestra.run.trial009.stdout:} 2026-02-25T08:44:19.084 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-25T08:44:19.164 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:19.159+0000 7f30663b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:19.166 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:19.166+0000 7f30663b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:19.278 INFO:teuthology.orchestra.run.trial009.stderr:instructed osd(s) 2 to deep-scrub 2026-02-25T08:44:19.289 INFO:tasks.ceph:Scrubbing osd.3 2026-02-25T08:44:19.289 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-25T08:44:19.368 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:19.363+0000 7f28ccd0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:19.371 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:19.370+0000 7f28ccd0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:19.382 INFO:teuthology.orchestra.run.trial009.stdout:{ 2026-02-25T08:44:19.382 INFO:teuthology.orchestra.run.trial009.stdout: "success": "" 2026-02-25T08:44:19.382 INFO:teuthology.orchestra.run.trial009.stdout:} 2026-02-25T08:44:19.388 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-25T08:44:19.466 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:19.462+0000 7f56e4da4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:19.469 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:19.468+0000 7f56e4da4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:19.581 INFO:teuthology.orchestra.run.trial009.stderr:instructed osd(s) 3 to deep-scrub 2026-02-25T08:44:19.591 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T08:44:19.670 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:19.666+0000 7f2b4345a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:19.672 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:19.671+0000 7f2b421d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:19.784 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:44:19.785 INFO:teuthology.orchestra.run.trial009.stderr:dumped all 2026-02-25T08:44:19.793 INFO:teuthology.orchestra.run.trial009.stdout:{"pg_ready":true,"pg_map":{"version":446,"stamp":"2026-02-25T08:44:18.054813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83898412,"kb_used_data":83898412,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125816724,"statfs":{"total":214748299264,"available":128836325376,"internally_reserved":0,"allocated":85911973888,"data_stored":85911973888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.126143"},"pg_stats":[{"pgid":"73.f","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.996098+0000","last_change":"2026-02-25T08:44:04.999897+0000","last_active":"2026-02-25T08:44:15.996098+0000","last_peered":"2026-02-25T08:44:15.996098+0000","last_clean":"2026-02-25T08:44:15.996098+0000","last_became_active":"2026-02-25T08:44:04.994536+0000","last_became_peered":"2026-02-25T08:44:04.994536+0000","last_unstale":"2026-02-25T08:44:15.996098+0000","last_undegraded":"2026-02-25T08:44:15.996098+0000","last_fullsized":"2026-02-25T08:44:15.996098+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.e","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.993014+0000","last_change":"2026-02-25T08:44:04.993806+0000","last_active":"2026-02-25T08:44:15.993014+0000","last_peered":"2026-02-25T08:44:15.993014+0000","last_clean":"2026-02-25T08:44:15.993014+0000","last_became_active":"2026-02-25T08:44:04.989733+0000","last_became_peered":"2026-02-25T08:44:04.989733+0000","last_unstale":"2026-02-25T08:44:15.993014+0000","last_undegraded":"2026-02-25T08:44:15.993014+0000","last_fullsized":"2026-02-25T08:44:15.993014+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.d","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.991160+0000","last_change":"2026-02-25T08:44:05.007912+0000","last_active":"2026-02-25T08:44:15.991160+0000","last_peered":"2026-02-25T08:44:15.991160+0000","last_clean":"2026-02-25T08:44:15.991160+0000","last_became_active":"2026-02-25T08:44:04.989310+0000","last_became_peered":"2026-02-25T08:44:04.989310+0000","last_unstale":"2026-02-25T08:44:15.991160+0000","last_undegraded":"2026-02-25T08:44:15.991160+0000","last_fullsized":"2026-02-25T08:44:15.991160+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.c","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.998599+0000","last_change":"2026-02-25T08:44:05.011182+0000","last_active":"2026-02-25T08:44:15.998599+0000","last_peered":"2026-02-25T08:44:15.998599+0000","last_clean":"2026-02-25T08:44:15.998599+0000","last_became_active":"2026-02-25T08:44:05.007215+0000","last_became_peered":"2026-02-25T08:44:05.007215+0000","last_unstale":"2026-02-25T08:44:15.998599+0000","last_undegraded":"2026-02-25T08:44:15.998599+0000","last_fullsized":"2026-02-25T08:44:15.998599+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.b","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.994677+0000","last_change":"2026-02-25T08:44:04.996601+0000","last_active":"2026-02-25T08:44:15.994677+0000","last_peered":"2026-02-25T08:44:15.994677+0000","last_clean":"2026-02-25T08:44:15.994677+0000","last_became_active":"2026-02-25T08:44:04.992595+0000","last_became_peered":"2026-02-25T08:44:04.992595+0000","last_unstale":"2026-02-25T08:44:15.994677+0000","last_undegraded":"2026-02-25T08:44:15.994677+0000","last_fullsized":"2026-02-25T08:44:15.994677+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.a","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.995897+0000","last_change":"2026-02-25T08:44:04.992304+0000","last_active":"2026-02-25T08:44:15.995897+0000","last_peered":"2026-02-25T08:44:15.995897+0000","last_clean":"2026-02-25T08:44:15.995897+0000","last_became_active":"2026-02-25T08:44:04.986497+0000","last_became_peered":"2026-02-25T08:44:04.986497+0000","last_unstale":"2026-02-25T08:44:15.995897+0000","last_undegraded":"2026-02-25T08:44:15.995897+0000","last_fullsized":"2026-02-25T08:44:15.995897+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.9","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.992032+0000","last_change":"2026-02-25T08:44:05.005758+0000","last_active":"2026-02-25T08:44:15.992032+0000","last_peered":"2026-02-25T08:44:15.992032+0000","last_clean":"2026-02-25T08:44:15.992032+0000","last_became_active":"2026-02-25T08:44:05.001726+0000","last_became_peered":"2026-02-25T08:44:05.001726+0000","last_unstale":"2026-02-25T08:44:15.992032+0000","last_undegraded":"2026-02-25T08:44:15.992032+0000","last_fullsized":"2026-02-25T08:44:15.992032+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.8","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.999863+0000","last_change":"2026-02-25T08:44:05.039530+0000","last_active":"2026-02-25T08:44:15.999863+0000","last_peered":"2026-02-25T08:44:15.999863+0000","last_clean":"2026-02-25T08:44:15.999863+0000","last_became_active":"2026-02-25T08:44:05.035607+0000","last_became_peered":"2026-02-25T08:44:05.035607+0000","last_unstale":"2026-02-25T08:44:15.999863+0000","last_undegraded":"2026-02-25T08:44:15.999863+0000","last_fullsized":"2026-02-25T08:44:15.999863+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.7","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.995858+0000","last_change":"2026-02-25T08:44:05.021080+0000","last_active":"2026-02-25T08:44:15.995858+0000","last_peered":"2026-02-25T08:44:15.995858+0000","last_clean":"2026-02-25T08:44:15.995858+0000","last_became_active":"2026-02-25T08:44:05.014263+0000","last_became_peered":"2026-02-25T08:44:05.014263+0000","last_unstale":"2026-02-25T08:44:15.995858+0000","last_undegraded":"2026-02-25T08:44:15.995858+0000","last_fullsized":"2026-02-25T08:44:15.995858+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.6","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.996158+0000","last_change":"2026-02-25T08:44:05.005104+0000","last_active":"2026-02-25T08:44:15.996158+0000","last_peered":"2026-02-25T08:44:15.996158+0000","last_clean":"2026-02-25T08:44:15.996158+0000","last_became_active":"2026-02-25T08:44:04.999446+0000","last_became_peered":"2026-02-25T08:44:04.999446+0000","last_unstale":"2026-02-25T08:44:15.996158+0000","last_undegraded":"2026-02-25T08:44:15.996158+0000","last_fullsized":"2026-02-25T08:44:15.996158+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.5","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.990916+0000","last_change":"2026-02-25T08:44:05.029482+0000","last_active":"2026-02-25T08:44:15.990916+0000","last_peered":"2026-02-25T08:44:15.990916+0000","last_clean":"2026-02-25T08:44:15.990916+0000","last_became_active":"2026-02-25T08:44:04.987531+0000","last_became_peered":"2026-02-25T08:44:04.987531+0000","last_unstale":"2026-02-25T08:44:15.990916+0000","last_undegraded":"2026-02-25T08:44:15.990916+0000","last_fullsized":"2026-02-25T08:44:15.990916+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.4","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.991285+0000","last_change":"2026-02-25T08:44:05.011406+0000","last_active":"2026-02-25T08:44:15.991285+0000","last_peered":"2026-02-25T08:44:15.991285+0000","last_clean":"2026-02-25T08:44:15.991285+0000","last_became_active":"2026-02-25T08:44:04.995832+0000","last_became_peered":"2026-02-25T08:44:04.995832+0000","last_unstale":"2026-02-25T08:44:15.991285+0000","last_undegraded":"2026-02-25T08:44:15.991285+0000","last_fullsized":"2026-02-25T08:44:15.991285+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.3","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.992319+0000","last_change":"2026-02-25T08:44:05.014234+0000","last_active":"2026-02-25T08:44:15.992319+0000","last_peered":"2026-02-25T08:44:15.992319+0000","last_clean":"2026-02-25T08:44:15.992319+0000","last_became_active":"2026-02-25T08:44:04.998048+0000","last_became_peered":"2026-02-25T08:44:04.998048+0000","last_unstale":"2026-02-25T08:44:15.992319+0000","last_undegraded":"2026-02-25T08:44:15.992319+0000","last_fullsized":"2026-02-25T08:44:15.992319+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.2","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.992900+0000","last_change":"2026-02-25T08:44:05.077645+0000","last_active":"2026-02-25T08:44:15.992900+0000","last_peered":"2026-02-25T08:44:15.992900+0000","last_clean":"2026-02-25T08:44:15.992900+0000","last_became_active":"2026-02-25T08:44:05.070640+0000","last_became_peered":"2026-02-25T08:44:05.070640+0000","last_unstale":"2026-02-25T08:44:15.992900+0000","last_undegraded":"2026-02-25T08:44:15.992900+0000","last_fullsized":"2026-02-25T08:44:15.992900+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.1","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.993888+0000","last_change":"2026-02-25T08:44:05.020320+0000","last_active":"2026-02-25T08:44:15.993888+0000","last_peered":"2026-02-25T08:44:15.993888+0000","last_clean":"2026-02-25T08:44:15.993888+0000","last_became_active":"2026-02-25T08:44:05.000080+0000","last_became_peered":"2026-02-25T08:44:05.000080+0000","last_unstale":"2026-02-25T08:44:15.993888+0000","last_undegraded":"2026-02-25T08:44:15.993888+0000","last_fullsized":"2026-02-25T08:44:15.993888+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.0","version":"0'0","reported_seq":29,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:16.000822+0000","last_change":"2026-02-25T08:44:05.056957+0000","last_active":"2026-02-25T08:44:16.000822+0000","last_peered":"2026-02-25T08:44:16.000822+0000","last_clean":"2026-02-25T08:44:16.000822+0000","last_became_active":"2026-02-25T08:44:05.044355+0000","last_became_peered":"2026-02-25T08:44:05.044355+0000","last_unstale":"2026-02-25T08:44:16.000822+0000","last_undegraded":"2026-02-25T08:44:16.000822+0000","last_fullsized":"2026-02-25T08:44:16.000822+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:03.903113+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":855,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.988990+0000","last_change":"2026-02-25T08:39:07.045617+0000","last_active":"2026-02-25T08:44:15.988990+0000","last_peered":"2026-02-25T08:44:15.988990+0000","last_clean":"2026-02-25T08:44:15.988990+0000","last_became_active":"2026-02-25T08:39:05.069458+0000","last_became_peered":"2026-02-25T08:39:05.069458+0000","last_unstale":"2026-02-25T08:44:15.988990+0000","last_undegraded":"2026-02-25T08:44:15.988990+0000","last_fullsized":"2026-02-25T08:44:15.988990+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":855,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.995425+0000","last_change":"2026-02-25T08:39:07.046493+0000","last_active":"2026-02-25T08:44:15.995425+0000","last_peered":"2026-02-25T08:44:15.995425+0000","last_clean":"2026-02-25T08:44:15.995425+0000","last_became_active":"2026-02-25T08:39:05.065571+0000","last_became_peered":"2026-02-25T08:39:05.065571+0000","last_unstale":"2026-02-25T08:44:15.995425+0000","last_undegraded":"2026-02-25T08:44:15.995425+0000","last_fullsized":"2026-02-25T08:44:15.995425+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":857,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.992413+0000","last_change":"2026-02-25T08:39:07.044809+0000","last_active":"2026-02-25T08:44:15.992413+0000","last_peered":"2026-02-25T08:44:15.992413+0000","last_clean":"2026-02-25T08:44:15.992413+0000","last_became_active":"2026-02-25T08:39:05.060963+0000","last_became_peered":"2026-02-25T08:39:05.060963+0000","last_unstale":"2026-02-25T08:44:15.992413+0000","last_undegraded":"2026-02-25T08:44:15.992413+0000","last_fullsized":"2026-02-25T08:44:15.992413+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":856,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.992313+0000","last_change":"2026-02-25T08:39:07.044303+0000","last_active":"2026-02-25T08:44:15.992313+0000","last_peered":"2026-02-25T08:44:15.992313+0000","last_clean":"2026-02-25T08:44:15.992313+0000","last_became_active":"2026-02-25T08:39:05.066212+0000","last_became_peered":"2026-02-25T08:39:05.066212+0000","last_unstale":"2026-02-25T08:44:15.992313+0000","last_undegraded":"2026-02-25T08:44:15.992313+0000","last_fullsized":"2026-02-25T08:44:15.992313+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":921,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:16.001184+0000","last_change":"2026-02-25T08:39:05.080267+0000","last_active":"2026-02-25T08:44:16.001184+0000","last_peered":"2026-02-25T08:44:16.001184+0000","last_clean":"2026-02-25T08:44:16.001184+0000","last_became_active":"2026-02-25T08:39:05.067451+0000","last_became_peered":"2026-02-25T08:39:05.067451+0000","last_unstale":"2026-02-25T08:44:16.001184+0000","last_undegraded":"2026-02-25T08:44:16.001184+0000","last_fullsized":"2026-02-25T08:44:16.001184+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":855,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.994084+0000","last_change":"2026-02-25T08:39:07.045912+0000","last_active":"2026-02-25T08:44:15.994084+0000","last_peered":"2026-02-25T08:44:15.994084+0000","last_clean":"2026-02-25T08:44:15.994084+0000","last_became_active":"2026-02-25T08:39:05.062319+0000","last_became_peered":"2026-02-25T08:39:05.062319+0000","last_unstale":"2026-02-25T08:44:15.994084+0000","last_undegraded":"2026-02-25T08:44:15.994084+0000","last_fullsized":"2026-02-25T08:44:15.994084+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":855,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.994894+0000","last_change":"2026-02-25T08:39:07.045738+0000","last_active":"2026-02-25T08:44:15.994894+0000","last_peered":"2026-02-25T08:44:15.994894+0000","last_clean":"2026-02-25T08:44:15.994894+0000","last_became_active":"2026-02-25T08:39:05.069478+0000","last_became_peered":"2026-02-25T08:39:05.069478+0000","last_unstale":"2026-02-25T08:44:15.994894+0000","last_undegraded":"2026-02-25T08:44:15.994894+0000","last_fullsized":"2026-02-25T08:44:15.994894+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":855,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.993432+0000","last_change":"2026-02-25T08:39:07.045411+0000","last_active":"2026-02-25T08:44:15.993432+0000","last_peered":"2026-02-25T08:44:15.993432+0000","last_clean":"2026-02-25T08:44:15.993432+0000","last_became_active":"2026-02-25T08:39:05.065104+0000","last_became_peered":"2026-02-25T08:39:05.065104+0000","last_unstale":"2026-02-25T08:44:15.993432+0000","last_undegraded":"2026-02-25T08:44:15.993432+0000","last_fullsized":"2026-02-25T08:44:15.993432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":855,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:15.996177+0000","last_change":"2026-02-25T08:39:07.045542+0000","last_active":"2026-02-25T08:44:15.996177+0000","last_peered":"2026-02-25T08:44:15.996177+0000","last_clean":"2026-02-25T08:44:15.996177+0000","last_became_active":"2026-02-25T08:39:05.066794+0000","last_became_peered":"2026-02-25T08:39:05.066794+0000","last_unstale":"2026-02-25T08:44:15.996177+0000","last_undegraded":"2026-02-25T08:44:15.996177+0000","last_fullsized":"2026-02-25T08:44:15.996177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:39:04.022925+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":73,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214748299264,"available":128836325376,"internally_reserved":0,"allocated":85911973888,"data_stored":85911973888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32208855040,"internally_reserved":0,"allocated":21478219776,"data_stored":21478219776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96626794496,"internally_reserved":0,"allocated":64434429952,"data_stored":64434429952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20974824,"kb_used_data":20974824,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31453960,"statfs":{"total":53687074816,"available":32208855040,"internally_reserved":0,"allocated":21478219776,"data_stored":21478219776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20974508,"kb_used_data":20974508,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31454276,"statfs":{"total":53687074816,"available":32209178624,"internally_reserved":0,"allocated":21477896192,"data_stored":21477896192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673274,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20974916,"kb_used_data":20974916,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31453868,"statfs":{"total":53687074816,"available":32208760832,"internally_reserved":0,"allocated":21478313984,"data_stored":21478313984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20974164,"kb_used_data":20974164,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31454620,"statfs":{"total":53687074816,"available":32209530880,"internally_reserved":0,"allocated":21477543936,"data_stored":21477543936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32208760832,"internally_reserved":0,"allocated":21478313984,"data_stored":21478313984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32209178624,"internally_reserved":0,"allocated":21477896192,"data_stored":21477896192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32208855040,"internally_reserved":0,"allocated":21478219776,"data_stored":21478219776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32208855040,"internally_reserved":0,"allocated":21478219776,"data_stored":21478219776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":0,"total":53687074816,"available":32209530880,"internally_reserved":0,"allocated":21477543936,"data_stored":21477543936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":1,"total":53687074816,"available":32208760832,"internally_reserved":0,"allocated":21478313984,"data_stored":21478313984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":2,"total":53687074816,"available":32209178624,"internally_reserved":0,"allocated":21477896192,"data_stored":21477896192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":3,"total":53687074816,"available":32208855040,"internally_reserved":0,"allocated":21478219776,"data_stored":21478219776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T08:44:19.800 INFO:tasks.ceph:pgid 73.f last_scrub_stamp 2026-02-25T08:44:03.903113+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=3, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.800 INFO:tasks.ceph:pgid 73.e last_scrub_stamp 2026-02-25T08:44:03.903113+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=3, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.800 INFO:tasks.ceph:pgid 73.d last_scrub_stamp 2026-02-25T08:44:03.903113+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=3, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.800 INFO:tasks.ceph:pgid 73.c last_scrub_stamp 2026-02-25T08:44:03.903113+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=3, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.800 INFO:tasks.ceph:pgid 73.b last_scrub_stamp 2026-02-25T08:44:03.903113+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=3, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.801 INFO:tasks.ceph:pgid 73.a last_scrub_stamp 2026-02-25T08:44:03.903113+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=3, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.801 INFO:tasks.ceph:pgid 73.9 last_scrub_stamp 2026-02-25T08:44:03.903113+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=3, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.801 INFO:tasks.ceph:pgid 73.8 last_scrub_stamp 2026-02-25T08:44:03.903113+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=3, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.801 INFO:tasks.ceph:pgid 73.7 last_scrub_stamp 2026-02-25T08:44:03.903113+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=3, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.801 INFO:tasks.ceph:pgid 73.6 last_scrub_stamp 2026-02-25T08:44:03.903113+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=3, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.801 INFO:tasks.ceph:pgid 73.5 last_scrub_stamp 2026-02-25T08:44:03.903113+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=3, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.802 INFO:tasks.ceph:pgid 73.4 last_scrub_stamp 2026-02-25T08:44:03.903113+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=3, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.802 INFO:tasks.ceph:pgid 73.3 last_scrub_stamp 2026-02-25T08:44:03.903113+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=3, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.802 INFO:tasks.ceph:pgid 73.2 last_scrub_stamp 2026-02-25T08:44:03.903113+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=3, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.802 INFO:tasks.ceph:pgid 73.1 last_scrub_stamp 2026-02-25T08:44:03.903113+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=3, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.802 INFO:tasks.ceph:pgid 73.0 last_scrub_stamp 2026-02-25T08:44:03.903113+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=3, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.802 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-25T08:39:04.022925+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=39, tm_sec=4, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.802 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-25T08:39:04.022925+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=39, tm_sec=4, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.803 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-25T08:39:04.022925+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=39, tm_sec=4, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.803 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-25T08:39:04.022925+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=39, tm_sec=4, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.803 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-25T08:39:04.022925+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=39, tm_sec=4, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.803 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-25T08:39:04.022925+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=39, tm_sec=4, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.803 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-25T08:39:04.022925+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=39, tm_sec=4, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.803 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-25T08:39:04.022925+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=39, tm_sec=4, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.803 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-25T08:39:04.022925+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=39, tm_sec=4, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=8, tm_min=44, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T08:44:19.804 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-25T08:44:39.804 DEBUG:teuthology.orchestra.run.trial009:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T08:44:39.884 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:39.880+0000 7f31884c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:39.886 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:39.884+0000 7f31884c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:40.000 INFO:teuthology.orchestra.run.trial009.stdout: 2026-02-25T08:44:40.000 INFO:teuthology.orchestra.run.trial009.stderr:dumped all 2026-02-25T08:44:40.009 INFO:teuthology.orchestra.run.trial009.stdout:{"pg_ready":true,"pg_map":{"version":456,"stamp":"2026-02-25T08:44:38.058473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83898412,"kb_used_data":83898412,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125816724,"statfs":{"total":214748299264,"available":128836325376,"internally_reserved":0,"allocated":85911973888,"data_stored":85911973888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002177"},"pg_stats":[{"pgid":"73.f","version":"0'0","reported_seq":31,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:19.283341+0000","last_change":"2026-02-25T08:44:19.300622+0000","last_active":"2026-02-25T08:44:19.283341+0000","last_peered":"2026-02-25T08:44:19.283341+0000","last_clean":"2026-02-25T08:44:19.283341+0000","last_became_active":"2026-02-25T08:44:04.994536+0000","last_became_peered":"2026-02-25T08:44:04.994536+0000","last_unstale":"2026-02-25T08:44:19.283341+0000","last_undegraded":"2026-02-25T08:44:19.283341+0000","last_fullsized":"2026-02-25T08:44:19.283341+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:19.300557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:19.300557+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.e","version":"0'0","reported_seq":31,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:18.976757+0000","last_change":"2026-02-25T08:44:18.986034+0000","last_active":"2026-02-25T08:44:18.976757+0000","last_peered":"2026-02-25T08:44:18.976757+0000","last_clean":"2026-02-25T08:44:18.976757+0000","last_became_active":"2026-02-25T08:44:04.989733+0000","last_became_peered":"2026-02-25T08:44:04.989733+0000","last_unstale":"2026-02-25T08:44:18.976757+0000","last_undegraded":"2026-02-25T08:44:18.976757+0000","last_fullsized":"2026-02-25T08:44:18.976757+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:18.985967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:18.985967+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.d","version":"0'0","reported_seq":31,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:19.283331+0000","last_change":"2026-02-25T08:44:19.299118+0000","last_active":"2026-02-25T08:44:19.283331+0000","last_peered":"2026-02-25T08:44:19.283331+0000","last_clean":"2026-02-25T08:44:19.283331+0000","last_became_active":"2026-02-25T08:44:04.989310+0000","last_became_peered":"2026-02-25T08:44:04.989310+0000","last_unstale":"2026-02-25T08:44:19.283331+0000","last_undegraded":"2026-02-25T08:44:19.283331+0000","last_fullsized":"2026-02-25T08:44:19.283331+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:19.299066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:19.299066+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.c","version":"0'0","reported_seq":31,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:19.282563+0000","last_change":"2026-02-25T08:44:19.294445+0000","last_active":"2026-02-25T08:44:19.282563+0000","last_peered":"2026-02-25T08:44:19.282563+0000","last_clean":"2026-02-25T08:44:19.282563+0000","last_became_active":"2026-02-25T08:44:05.007215+0000","last_became_peered":"2026-02-25T08:44:05.007215+0000","last_unstale":"2026-02-25T08:44:19.282563+0000","last_undegraded":"2026-02-25T08:44:19.282563+0000","last_fullsized":"2026-02-25T08:44:19.282563+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:19.294392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:19.294392+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.b","version":"0'0","reported_seq":31,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:19.282537+0000","last_change":"2026-02-25T08:44:19.296263+0000","last_active":"2026-02-25T08:44:19.282537+0000","last_peered":"2026-02-25T08:44:19.282537+0000","last_clean":"2026-02-25T08:44:19.282537+0000","last_became_active":"2026-02-25T08:44:04.992595+0000","last_became_peered":"2026-02-25T08:44:04.992595+0000","last_unstale":"2026-02-25T08:44:19.282537+0000","last_undegraded":"2026-02-25T08:44:19.282537+0000","last_fullsized":"2026-02-25T08:44:19.282537+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:19.296210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:19.296210+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.a","version":"0'0","reported_seq":31,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:19.586275+0000","last_change":"2026-02-25T08:44:19.603672+0000","last_active":"2026-02-25T08:44:19.586275+0000","last_peered":"2026-02-25T08:44:19.586275+0000","last_clean":"2026-02-25T08:44:19.586275+0000","last_became_active":"2026-02-25T08:44:04.986497+0000","last_became_peered":"2026-02-25T08:44:04.986497+0000","last_unstale":"2026-02-25T08:44:19.586275+0000","last_undegraded":"2026-02-25T08:44:19.586275+0000","last_fullsized":"2026-02-25T08:44:19.586275+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:19.603624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:19.603624+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.9","version":"0'0","reported_seq":31,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:18.976109+0000","last_change":"2026-02-25T08:44:18.987699+0000","last_active":"2026-02-25T08:44:18.976109+0000","last_peered":"2026-02-25T08:44:18.976109+0000","last_clean":"2026-02-25T08:44:18.976109+0000","last_became_active":"2026-02-25T08:44:05.001726+0000","last_became_peered":"2026-02-25T08:44:05.001726+0000","last_unstale":"2026-02-25T08:44:18.976109+0000","last_undegraded":"2026-02-25T08:44:18.976109+0000","last_fullsized":"2026-02-25T08:44:18.976109+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:18.987643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:18.987643+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.8","version":"0'0","reported_seq":31,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:19.283340+0000","last_change":"2026-02-25T08:44:19.297085+0000","last_active":"2026-02-25T08:44:19.283340+0000","last_peered":"2026-02-25T08:44:19.283340+0000","last_clean":"2026-02-25T08:44:19.283340+0000","last_became_active":"2026-02-25T08:44:05.035607+0000","last_became_peered":"2026-02-25T08:44:05.035607+0000","last_unstale":"2026-02-25T08:44:19.283340+0000","last_undegraded":"2026-02-25T08:44:19.283340+0000","last_fullsized":"2026-02-25T08:44:19.283340+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:19.297017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:19.297017+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.7","version":"0'0","reported_seq":31,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:19.586551+0000","last_change":"2026-02-25T08:44:19.600114+0000","last_active":"2026-02-25T08:44:19.586551+0000","last_peered":"2026-02-25T08:44:19.586551+0000","last_clean":"2026-02-25T08:44:19.586551+0000","last_became_active":"2026-02-25T08:44:05.014263+0000","last_became_peered":"2026-02-25T08:44:05.014263+0000","last_unstale":"2026-02-25T08:44:19.586551+0000","last_undegraded":"2026-02-25T08:44:19.586551+0000","last_fullsized":"2026-02-25T08:44:19.586551+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:19.600052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:19.600052+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.6","version":"0'0","reported_seq":31,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:19.281013+0000","last_change":"2026-02-25T08:44:19.294091+0000","last_active":"2026-02-25T08:44:19.281013+0000","last_peered":"2026-02-25T08:44:19.281013+0000","last_clean":"2026-02-25T08:44:19.281013+0000","last_became_active":"2026-02-25T08:44:04.999446+0000","last_became_peered":"2026-02-25T08:44:04.999446+0000","last_unstale":"2026-02-25T08:44:19.281013+0000","last_undegraded":"2026-02-25T08:44:19.281013+0000","last_fullsized":"2026-02-25T08:44:19.281013+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:19.294008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:19.294008+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.5","version":"0'0","reported_seq":31,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:19.280401+0000","last_change":"2026-02-25T08:44:19.299354+0000","last_active":"2026-02-25T08:44:19.280401+0000","last_peered":"2026-02-25T08:44:19.280401+0000","last_clean":"2026-02-25T08:44:19.280401+0000","last_became_active":"2026-02-25T08:44:04.987531+0000","last_became_peered":"2026-02-25T08:44:04.987531+0000","last_unstale":"2026-02-25T08:44:19.280401+0000","last_undegraded":"2026-02-25T08:44:19.280401+0000","last_fullsized":"2026-02-25T08:44:19.280401+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:19.299306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:19.299306+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.4","version":"0'0","reported_seq":31,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:18.667634+0000","last_change":"2026-02-25T08:44:18.676717+0000","last_active":"2026-02-25T08:44:18.667634+0000","last_peered":"2026-02-25T08:44:18.667634+0000","last_clean":"2026-02-25T08:44:18.667634+0000","last_became_active":"2026-02-25T08:44:04.995832+0000","last_became_peered":"2026-02-25T08:44:04.995832+0000","last_unstale":"2026-02-25T08:44:18.667634+0000","last_undegraded":"2026-02-25T08:44:18.667634+0000","last_fullsized":"2026-02-25T08:44:18.667634+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:18.676666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:18.676666+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.3","version":"0'0","reported_seq":31,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:18.666863+0000","last_change":"2026-02-25T08:44:18.676396+0000","last_active":"2026-02-25T08:44:18.666863+0000","last_peered":"2026-02-25T08:44:18.666863+0000","last_clean":"2026-02-25T08:44:18.666863+0000","last_became_active":"2026-02-25T08:44:04.998048+0000","last_became_peered":"2026-02-25T08:44:04.998048+0000","last_unstale":"2026-02-25T08:44:18.666863+0000","last_undegraded":"2026-02-25T08:44:18.666863+0000","last_fullsized":"2026-02-25T08:44:18.666863+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:18.676339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:18.676339+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.2","version":"0'0","reported_seq":31,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:18.975564+0000","last_change":"2026-02-25T08:44:18.988151+0000","last_active":"2026-02-25T08:44:18.975564+0000","last_peered":"2026-02-25T08:44:18.975564+0000","last_clean":"2026-02-25T08:44:18.975564+0000","last_became_active":"2026-02-25T08:44:05.070640+0000","last_became_peered":"2026-02-25T08:44:05.070640+0000","last_unstale":"2026-02-25T08:44:18.975564+0000","last_undegraded":"2026-02-25T08:44:18.975564+0000","last_fullsized":"2026-02-25T08:44:18.975564+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:18.988099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:18.988099+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.1","version":"0'0","reported_seq":31,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:19.584902+0000","last_change":"2026-02-25T08:44:19.604031+0000","last_active":"2026-02-25T08:44:19.584902+0000","last_peered":"2026-02-25T08:44:19.584902+0000","last_clean":"2026-02-25T08:44:19.584902+0000","last_became_active":"2026-02-25T08:44:05.000080+0000","last_became_peered":"2026-02-25T08:44:05.000080+0000","last_unstale":"2026-02-25T08:44:19.584902+0000","last_undegraded":"2026-02-25T08:44:19.584902+0000","last_fullsized":"2026-02-25T08:44:19.584902+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:19.603983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:19.603983+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.0","version":"0'0","reported_seq":31,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:18.666943+0000","last_change":"2026-02-25T08:44:18.676637+0000","last_active":"2026-02-25T08:44:18.666943+0000","last_peered":"2026-02-25T08:44:18.666943+0000","last_clean":"2026-02-25T08:44:18.666943+0000","last_became_active":"2026-02-25T08:44:05.044355+0000","last_became_peered":"2026-02-25T08:44:05.044355+0000","last_unstale":"2026-02-25T08:44:18.666943+0000","last_undegraded":"2026-02-25T08:44:18.666943+0000","last_fullsized":"2026-02-25T08:44:18.666943+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:18.676557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:18.676557+0000","last_clean_scrub_stamp":"2026-02-25T08:44:03.903113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":857,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:19.582352+0000","last_change":"2026-02-25T08:44:19.600755+0000","last_active":"2026-02-25T08:44:19.582352+0000","last_peered":"2026-02-25T08:44:19.582352+0000","last_clean":"2026-02-25T08:44:19.582352+0000","last_became_active":"2026-02-25T08:39:05.069458+0000","last_became_peered":"2026-02-25T08:39:05.069458+0000","last_unstale":"2026-02-25T08:44:19.582352+0000","last_undegraded":"2026-02-25T08:44:19.582352+0000","last_fullsized":"2026-02-25T08:44:19.582352+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:19.600705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:19.600705+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":857,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:19.582389+0000","last_change":"2026-02-25T08:44:19.595787+0000","last_active":"2026-02-25T08:44:19.582389+0000","last_peered":"2026-02-25T08:44:19.582389+0000","last_clean":"2026-02-25T08:44:19.582389+0000","last_became_active":"2026-02-25T08:39:05.065571+0000","last_became_peered":"2026-02-25T08:39:05.065571+0000","last_unstale":"2026-02-25T08:44:19.582389+0000","last_undegraded":"2026-02-25T08:44:19.582389+0000","last_fullsized":"2026-02-25T08:44:19.582389+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:19.595737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:19.595737+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":859,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:19.278964+0000","last_change":"2026-02-25T08:44:19.304175+0000","last_active":"2026-02-25T08:44:19.278964+0000","last_peered":"2026-02-25T08:44:19.278964+0000","last_clean":"2026-02-25T08:44:19.278964+0000","last_became_active":"2026-02-25T08:39:05.060963+0000","last_became_peered":"2026-02-25T08:39:05.060963+0000","last_unstale":"2026-02-25T08:44:19.278964+0000","last_undegraded":"2026-02-25T08:44:19.278964+0000","last_fullsized":"2026-02-25T08:44:19.278964+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2026-02-25T08:44:19.304119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:19.304119+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":858,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:18.974468+0000","last_change":"2026-02-25T08:44:18.991163+0000","last_active":"2026-02-25T08:44:18.974468+0000","last_peered":"2026-02-25T08:44:18.974468+0000","last_clean":"2026-02-25T08:44:18.974468+0000","last_became_active":"2026-02-25T08:39:05.066212+0000","last_became_peered":"2026-02-25T08:39:05.066212+0000","last_unstale":"2026-02-25T08:44:18.974468+0000","last_undegraded":"2026-02-25T08:44:18.974468+0000","last_fullsized":"2026-02-25T08:44:18.974468+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2026-02-25T08:44:18.991107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:18.991107+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":923,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:19.584736+0000","last_change":"2026-02-25T08:44:19.604673+0000","last_active":"2026-02-25T08:44:19.584736+0000","last_peered":"2026-02-25T08:44:19.584736+0000","last_clean":"2026-02-25T08:44:19.584736+0000","last_became_active":"2026-02-25T08:39:05.067451+0000","last_became_peered":"2026-02-25T08:39:05.067451+0000","last_unstale":"2026-02-25T08:44:19.584736+0000","last_undegraded":"2026-02-25T08:44:19.584736+0000","last_fullsized":"2026-02-25T08:44:19.584736+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'52","last_scrub_stamp":"2026-02-25T08:44:19.604597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:19.604597+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":857,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:18.974867+0000","last_change":"2026-02-25T08:44:18.983339+0000","last_active":"2026-02-25T08:44:18.974867+0000","last_peered":"2026-02-25T08:44:18.974867+0000","last_clean":"2026-02-25T08:44:18.974867+0000","last_became_active":"2026-02-25T08:39:05.062319+0000","last_became_peered":"2026-02-25T08:39:05.062319+0000","last_unstale":"2026-02-25T08:44:18.974867+0000","last_undegraded":"2026-02-25T08:44:18.974867+0000","last_fullsized":"2026-02-25T08:44:18.974867+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:18.983254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:18.983254+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":857,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:19.278964+0000","last_change":"2026-02-25T08:44:19.290293+0000","last_active":"2026-02-25T08:44:19.278964+0000","last_peered":"2026-02-25T08:44:19.278964+0000","last_clean":"2026-02-25T08:44:19.278964+0000","last_became_active":"2026-02-25T08:39:05.069478+0000","last_became_peered":"2026-02-25T08:39:05.069478+0000","last_unstale":"2026-02-25T08:44:19.278964+0000","last_undegraded":"2026-02-25T08:44:19.278964+0000","last_fullsized":"2026-02-25T08:44:19.278964+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:19.290224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:19.290224+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":857,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:19.583341+0000","last_change":"2026-02-25T08:44:19.594347+0000","last_active":"2026-02-25T08:44:19.583341+0000","last_peered":"2026-02-25T08:44:19.583341+0000","last_clean":"2026-02-25T08:44:19.583341+0000","last_became_active":"2026-02-25T08:39:05.065104+0000","last_became_peered":"2026-02-25T08:39:05.065104+0000","last_unstale":"2026-02-25T08:44:19.583341+0000","last_undegraded":"2026-02-25T08:44:19.583341+0000","last_fullsized":"2026-02-25T08:44:19.583341+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:19.594274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:19.594274+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":857,"reported_epoch":295,"state":"active+clean","last_fresh":"2026-02-25T08:44:19.583640+0000","last_change":"2026-02-25T08:44:19.602729+0000","last_active":"2026-02-25T08:44:19.583640+0000","last_peered":"2026-02-25T08:44:19.583640+0000","last_clean":"2026-02-25T08:44:19.583640+0000","last_became_active":"2026-02-25T08:39:05.066794+0000","last_became_peered":"2026-02-25T08:39:05.066794+0000","last_unstale":"2026-02-25T08:44:19.583640+0000","last_undegraded":"2026-02-25T08:44:19.583640+0000","last_fullsized":"2026-02-25T08:44:19.583640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T08:44:19.602681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T08:44:19.602681+0000","last_clean_scrub_stamp":"2026-02-25T08:39:04.022925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":73,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214748299264,"available":128836325376,"internally_reserved":0,"allocated":85911973888,"data_stored":85911973888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32208855040,"internally_reserved":0,"allocated":21478219776,"data_stored":21478219776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96626794496,"internally_reserved":0,"allocated":64434429952,"data_stored":64434429952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640590,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20974824,"kb_used_data":20974824,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31453960,"statfs":{"total":53687074816,"available":32208855040,"internally_reserved":0,"allocated":21478219776,"data_stored":21478219776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640590,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20974508,"kb_used_data":20974508,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31454276,"statfs":{"total":53687074816,"available":32209178624,"internally_reserved":0,"allocated":21477896192,"data_stored":21477896192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20974916,"kb_used_data":20974916,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31453868,"statfs":{"total":53687074816,"available":32208760832,"internally_reserved":0,"allocated":21478313984,"data_stored":21478313984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640590,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20974164,"kb_used_data":20974164,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31454620,"statfs":{"total":53687074816,"available":32209530880,"internally_reserved":0,"allocated":21477543936,"data_stored":21477543936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32208760832,"internally_reserved":0,"allocated":21478313984,"data_stored":21478313984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32209178624,"internally_reserved":0,"allocated":21477896192,"data_stored":21477896192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32208855040,"internally_reserved":0,"allocated":21478219776,"data_stored":21478219776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32208855040,"internally_reserved":0,"allocated":21478219776,"data_stored":21478219776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":0,"total":53687074816,"available":32209530880,"internally_reserved":0,"allocated":21477543936,"data_stored":21477543936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":1,"total":53687074816,"available":32208760832,"internally_reserved":0,"allocated":21478313984,"data_stored":21478313984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":2,"total":53687074816,"available":32209178624,"internally_reserved":0,"allocated":21477896192,"data_stored":21477896192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":3,"total":53687074816,"available":32208855040,"internally_reserved":0,"allocated":21478219776,"data_stored":21478219776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T08:44:40.013 DEBUG:teuthology.orchestra.run.trial009:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-25T08:44:40.089 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:40.083+0000 7febe1d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:40.091 INFO:teuthology.orchestra.run.trial009.stderr:2026-02-25T08:44:40.090+0000 7febe1d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-25T08:44:40.222 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-25T08:44:40.222 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-25T08:44:40.222 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-25T08:44:40.223 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T08:44:40.287 INFO:tasks.ceph.osd.0:Stopped 2026-02-25T08:44:40.287 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-25T08:44:40.287 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T08:44:40.363 INFO:tasks.ceph.osd.1:Stopped 2026-02-25T08:44:40.363 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-25T08:44:40.363 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T08:44:40.426 INFO:tasks.ceph.osd.2:Stopped 2026-02-25T08:44:40.427 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-25T08:44:40.427 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T08:44:40.493 INFO:tasks.ceph.osd.3:Stopped 2026-02-25T08:44:40.493 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-25T08:44:40.493 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-25T08:44:40.493 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T08:44:40.525 INFO:tasks.ceph.mgr.x:Stopped 2026-02-25T08:44:40.526 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-25T08:44:40.526 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-25T08:44:40.526 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T08:44:40.538 INFO:tasks.ceph.mon.a:Stopped 2026-02-25T08:44:40.539 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-25T08:44:40.539 DEBUG:teuthology.orchestra.run.trial009:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v 'but it is still running' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(PG_' | grep -E -v '\(OSD_' | grep -E -v '\(OBJECT_' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | head -n 1 2026-02-25T08:44:40.605 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial009.front.sepia.ceph.com 2026-02-25T08:44:40.605 DEBUG:teuthology.orchestra.run.trial009:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-25T08:44:40.680 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial009.front.sepia.ceph.com 2026-02-25T08:44:40.680 DEBUG:teuthology.orchestra.run.trial009:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-25T08:44:40.755 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial059.front.sepia.ceph.com 2026-02-25T08:44:40.755 DEBUG:teuthology.orchestra.run.trial059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-25T08:44:40.787 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial059.front.sepia.ceph.com 2026-02-25T08:44:40.787 DEBUG:teuthology.orchestra.run.trial059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-25T08:44:40.852 INFO:tasks.ceph:Archiving mon data... 2026-02-25T08:44:40.854 DEBUG:teuthology.misc:Transferring archived files from trial009:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/matan-2026-02-25_07:55:35-crimson-rados-wip-logstoremanager-distro-debug-trial/69099/data/mon.a.tgz 2026-02-25T08:44:40.854 DEBUG:teuthology.orchestra.run.trial009:> mktemp 2026-02-25T08:44:40.872 INFO:teuthology.orchestra.run.trial009.stdout:/tmp/tmp.Ldv9BmXjBi 2026-02-25T08:44:40.873 DEBUG:teuthology.orchestra.run.trial009:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Ldv9BmXjBi 2026-02-25T08:44:40.984 DEBUG:teuthology.orchestra.run.trial009:> sudo chmod 0666 /tmp/tmp.Ldv9BmXjBi 2026-02-25T08:44:41.066 DEBUG:teuthology.orchestra.remote:trial009:/tmp/tmp.Ldv9BmXjBi is 383KB 2026-02-25T08:44:41.161 DEBUG:teuthology.orchestra.run.trial009:> rm -fr /tmp/tmp.Ldv9BmXjBi 2026-02-25T08:44:41.177 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-25T08:44:41.177 DEBUG:teuthology.orchestra.run.trial009:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-25T08:44:41.219 DEBUG:teuthology.orchestra.run.trial059:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-25T08:44:41.298 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-25T08:44:41.315 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-25T08:44:41.315 INFO:tasks.ceph:Archiving crash dumps... 2026-02-25T08:44:41.318 DEBUG:teuthology.misc:Transferring archived files from trial009:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/matan-2026-02-25_07:55:35-crimson-rados-wip-logstoremanager-distro-debug-trial/69099/remote/trial009/crash 2026-02-25T08:44:41.319 DEBUG:teuthology.orchestra.run.trial009:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-25T08:44:41.364 DEBUG:teuthology.misc:Transferring archived files from trial059:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/matan-2026-02-25_07:55:35-crimson-rados-wip-logstoremanager-distro-debug-trial/69099/remote/trial059/crash 2026-02-25T08:44:41.366 DEBUG:teuthology.orchestra.run.trial059:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-25T08:44:41.391 INFO:tasks.ceph:Compressing logs... 2026-02-25T08:44:41.391 DEBUG:teuthology.orchestra.run.trial009:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T08:44:41.409 DEBUG:teuthology.orchestra.run.trial059:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T08:44:41.430 INFO:teuthology.orchestra.run.trial009.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38970.log 2026-02-25T08:44:41.433 INFO:teuthology.orchestra.run.trial009.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.36309.log 2026-02-25T08:44:41.434 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.38970.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-25T08:44:41.434 INFO:teuthology.orchestra.run.trial009.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.38970.log.gz 2026-02-25T08:44:41.434 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph.tmp-client.admin.36309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41261.log 2026-02-25T08:44:41.434 INFO:teuthology.orchestra.run.trial009.stderr: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.36309.log.gz 2026-02-25T08:44:41.434 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-25T08:44:41.434 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.41261.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41261.log.gz 2026-02-25T08:44:41.434 INFO:teuthology.orchestra.run.trial009.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38248.log 2026-02-25T08:44:41.434 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40721.log 2026-02-25T08:44:41.434 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.38248.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38248.log.gz 2026-02-25T08:44:41.434 INFO:teuthology.orchestra.run.trial009.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41113.log 2026-02-25T08:44:41.435 INFO:teuthology.orchestra.run.trial009.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40672.log 2026-02-25T08:44:41.435 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.40721.log: /var/log/ceph/ceph-client.admin.41113.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.40721.log.gz 2026-02-25T08:44:41.435 INFO:teuthology.orchestra.run.trial009.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41113.log.gz 2026-02-25T08:44:41.435 INFO:teuthology.orchestra.run.trial009.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41211.log 2026-02-25T08:44:41.435 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.40672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40917.log 2026-02-25T08:44:41.435 INFO:teuthology.orchestra.run.trial009.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40672.log.gz 2026-02-25T08:44:41.435 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.41211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38444.log 2026-02-25T08:44:41.435 INFO:teuthology.orchestra.run.trial009.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.41211.log.gz 2026-02-25T08:44:41.435 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.40917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38658.log 2026-02-25T08:44:41.435 INFO:teuthology.orchestra.run.trial009.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40917.log.gz 2026-02-25T08:44:41.435 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.38444.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38444.log.gzgzip 2026-02-25T08:44:41.435 INFO:teuthology.orchestra.run.trial009.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38560.log 2026-02-25T08:44:41.436 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.38658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37742.log 2026-02-25T08:44:41.436 INFO:teuthology.orchestra.run.trial009.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38658.log.gz 2026-02-25T08:44:41.447 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.38560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38445.log 2026-02-25T08:44:41.447 INFO:teuthology.orchestra.run.trial009.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38560.log.gz 2026-02-25T08:44:41.447 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.37742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40819.log 2026-02-25T08:44:41.447 INFO:teuthology.orchestra.run.trial009.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37742.log.gz 2026-02-25T08:44:41.447 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.38445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40966.log 2026-02-25T08:44:41.447 INFO:teuthology.orchestra.run.trial009.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38445.log.gz 2026-02-25T08:44:41.447 INFO:teuthology.orchestra.run.trial009.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41308.log 2026-02-25T08:44:41.447 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.40819.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40819.log.gz 2026-02-25T08:44:41.447 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.40966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40770.log 2026-02-25T08:44:41.448 INFO:teuthology.orchestra.run.trial009.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40966.log.gz 2026-02-25T08:44:41.448 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.41308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38249.log 2026-02-25T08:44:41.448 INFO:teuthology.orchestra.run.trial009.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41308.log.gz 2026-02-25T08:44:41.448 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.40770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38246.log 2026-02-25T08:44:41.448 INFO:teuthology.orchestra.run.trial009.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40770.log.gz 2026-02-25T08:44:41.448 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.38249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37899.log 2026-02-25T08:44:41.448 INFO:teuthology.orchestra.run.trial009.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38249.log.gz 2026-02-25T08:44:41.448 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.38246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41015.log 2026-02-25T08:44:41.448 INFO:teuthology.orchestra.run.trial009.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38246.log.gz 2026-02-25T08:44:41.448 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.37899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38119.log 2026-02-25T08:44:41.448 INFO:teuthology.orchestra.run.trial009.stderr: 66.9% -- replaced with /var/log/ceph/ceph-client.admin.37899.log.gz 2026-02-25T08:44:41.448 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.41015.log: gzip 50.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.41015.log.gz -- 2026-02-25T08:44:41.449 INFO:teuthology.orchestra.run.trial009.stderr: /var/log/ceph/ceph-client.admin.37972.log 2026-02-25T08:44:41.449 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.38119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37508.log 2026-02-25T08:44:41.449 INFO:teuthology.orchestra.run.trial009.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38119.log.gz 2026-02-25T08:44:41.449 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.37972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37461.log 2026-02-25T08:44:41.449 INFO:teuthology.orchestra.run.trial009.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37972.log.gz 2026-02-25T08:44:41.449 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.37508.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37508.log.gz 2026-02-25T08:44:41.449 INFO:teuthology.orchestra.run.trial009.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37716.log 2026-02-25T08:44:41.449 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.37461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41064.log 2026-02-25T08:44:41.449 INFO:teuthology.orchestra.run.trial009.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37461.log.gz 2026-02-25T08:44:41.449 INFO:teuthology.orchestra.run.trial009.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38440.log 2026-02-25T08:44:41.449 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.37716.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37716.log.gz 2026-02-25T08:44:41.449 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.41064.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41064.log.gz 2026-02-25T08:44:41.449 INFO:teuthology.orchestra.run.trial009.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37802.log 2026-02-25T08:44:41.450 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.38440.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-25T08:44:41.450 INFO:teuthology.orchestra.run.trial009.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38440.log.gz 2026-02-25T08:44:41.450 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.37802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37872.log 2026-02-25T08:44:41.450 INFO:teuthology.orchestra.run.trial009.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37802.log.gz 2026-02-25T08:44:41.450 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-25T08:44:41.450 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.37872.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37872.log.gz 2026-02-25T08:44:41.450 INFO:teuthology.orchestra.run.trial009.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38443.log 2026-02-25T08:44:41.450 INFO:teuthology.orchestra.run.trial009.stderr: 88.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-25T08:44:41.450 INFO:teuthology.orchestra.run.trial009.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40623.log 2026-02-25T08:44:41.450 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.38443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38021.log 2026-02-25T08:44:41.450 INFO:teuthology.orchestra.run.trial009.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38443.log.gz 2026-02-25T08:44:41.450 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.40623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41162.log 2026-02-25T08:44:41.451 INFO:teuthology.orchestra.run.trial009.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40623.log.gz 2026-02-25T08:44:41.451 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.38021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40868.log 2026-02-25T08:44:41.451 INFO:teuthology.orchestra.run.trial009.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.38021.log.gz 2026-02-25T08:44:41.451 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.41162.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41162.log.gz 2026-02-25T08:44:41.451 INFO:teuthology.orchestra.run.trial009.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37375.log 2026-02-25T08:44:41.451 INFO:teuthology.orchestra.run.trial009.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38945.log 2026-02-25T08:44:41.451 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.40868.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40868.log.gz 2026-02-25T08:44:41.451 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.37375.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37375.log.gzgzip 2026-02-25T08:44:41.451 INFO:teuthology.orchestra.run.trial009.stderr: -5 --verbose -- /var/log/ceph/ceph.log 2026-02-25T08:44:41.451 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.38945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38247.log 2026-02-25T08:44:41.451 INFO:teuthology.orchestra.run.trial009.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38945.log.gz 2026-02-25T08:44:41.451 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38609.log 2026-02-25T08:44:41.451 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.38247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38070.log 2026-02-25T08:44:41.452 INFO:teuthology.orchestra.run.trial009.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38247.log.gz 2026-02-25T08:44:41.452 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.38609.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38609.log.gz 2026-02-25T08:44:41.452 INFO:teuthology.orchestra.run.trial009.stderr: 87.0% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-25T08:44:41.452 INFO:teuthology.orchestra.run.trial009.stderr:/var/log/ceph/ceph-client.admin.38070.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38070.log.gz 2026-02-25T08:44:41.458 INFO:teuthology.orchestra.run.trial059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-25T08:44:41.460 INFO:teuthology.orchestra.run.trial059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-25T08:44:41.460 INFO:teuthology.orchestra.run.trial059.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37331.log 2026-02-25T08:44:41.460 INFO:teuthology.orchestra.run.trial059.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37179.log 2026-02-25T08:44:41.460 INFO:teuthology.orchestra.run.trial059.stderr:/var/log/ceph/ceph-client.admin.37331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37226.log 2026-02-25T08:44:41.461 INFO:teuthology.orchestra.run.trial059.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37331.log.gz 2026-02-25T08:44:41.461 INFO:teuthology.orchestra.run.trial059.stderr:/var/log/ceph/ceph-client.admin.37179.log: gzip 50.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.37179.log.gz -- 2026-02-25T08:44:41.461 INFO:teuthology.orchestra.run.trial059.stderr: /var/log/ceph/ceph-client.admin.37278.log 2026-02-25T08:44:41.461 INFO:teuthology.orchestra.run.trial059.stderr:/var/log/ceph/ceph-client.admin.37226.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-25T08:44:41.461 INFO:teuthology.orchestra.run.trial059.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37226.log.gz 2026-02-25T08:44:41.461 INFO:teuthology.orchestra.run.trial059.stderr:/var/log/ceph/ceph-client.admin.37278.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37278.log.gz 2026-02-25T08:44:41.484 INFO:teuthology.orchestra.run.trial059.stderr:/var/log/ceph/ceph-mgr.x.log: 90.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-25T08:44:41.607 INFO:teuthology.orchestra.run.trial009.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-25T08:44:43.676 INFO:teuthology.orchestra.run.trial009.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-25T08:44:43.713 INFO:teuthology.orchestra.run.trial059.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-25T08:44:43.735 INFO:teuthology.orchestra.run.trial009.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-25T08:44:43.737 INFO:teuthology.orchestra.run.trial009.stderr: 2026-02-25T08:44:43.737 INFO:teuthology.orchestra.run.trial009.stderr:real 0m2.316s 2026-02-25T08:44:43.737 INFO:teuthology.orchestra.run.trial009.stderr:user 0m4.483s 2026-02-25T08:44:43.737 INFO:teuthology.orchestra.run.trial009.stderr:sys 0m0.273s 2026-02-25T08:44:43.781 INFO:teuthology.orchestra.run.trial059.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-25T08:44:43.784 INFO:teuthology.orchestra.run.trial059.stderr: 2026-02-25T08:44:43.784 INFO:teuthology.orchestra.run.trial059.stderr:real 0m2.332s 2026-02-25T08:44:43.784 INFO:teuthology.orchestra.run.trial059.stderr:user 0m4.397s 2026-02-25T08:44:43.784 INFO:teuthology.orchestra.run.trial059.stderr:sys 0m0.215s 2026-02-25T08:44:43.785 INFO:tasks.ceph:Archiving logs... 2026-02-25T08:44:43.785 DEBUG:teuthology.misc:Transferring archived files from trial009:/var/log/ceph to /home/teuthworker/mnt/teuthology/matan-2026-02-25_07:55:35-crimson-rados-wip-logstoremanager-distro-debug-trial/69099/remote/trial009/log 2026-02-25T08:44:43.786 DEBUG:teuthology.orchestra.run.trial009:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-25T08:44:44.281 DEBUG:teuthology.misc:Transferring archived files from trial059:/var/log/ceph to /home/teuthworker/mnt/teuthology/matan-2026-02-25_07:55:35-crimson-rados-wip-logstoremanager-distro-debug-trial/69099/remote/trial059/log 2026-02-25T08:44:44.282 DEBUG:teuthology.orchestra.run.trial059:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-25T08:44:44.680 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-25T08:44:44.802 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-25T08:44:44.813 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-25T08:44:44.813 DEBUG:teuthology.orchestra.run.trial009:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-25T08:44:44.815 DEBUG:teuthology.orchestra.run.trial059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-25T08:44:44.841 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-25T08:44:44.852 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-25T08:44:44.852 DEBUG:teuthology.orchestra.run.trial009:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T08:44:44.880 DEBUG:teuthology.orchestra.run.trial059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T08:44:44.894 INFO:teuthology.orchestra.run.trial009.stderr:bash: line 1: ntpq: command not found 2026-02-25T08:44:44.896 INFO:teuthology.orchestra.run.trial059.stderr:bash: line 1: ntpq: command not found 2026-02-25T08:44:44.922 INFO:teuthology.orchestra.run.trial059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T08:44:44.922 INFO:teuthology.orchestra.run.trial059.stdout:=============================================================================== 2026-02-25T08:44:44.922 INFO:teuthology.orchestra.run.trial059.stdout:^- ntp11.kernfusion.at 2 8 377 63 +273us[ +273us] +/- 72ms 2026-02-25T08:44:44.922 INFO:teuthology.orchestra.run.trial059.stdout:^* nyc3.us.ntp.li 2 8 377 64 -69us[ -91us] +/- 2569us 2026-02-25T08:44:44.922 INFO:teuthology.orchestra.run.trial059.stdout:^- time.gslb.gravinoc.com 2 8 377 67 +1375us[+1353us] +/- 39ms 2026-02-25T08:44:44.922 INFO:teuthology.orchestra.run.trial059.stdout:^- ip74-208-14-149.pbiaas.c> 2 8 377 66 -278us[ -301us] +/- 25ms 2026-02-25T08:44:44.929 INFO:teuthology.orchestra.run.trial009.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T08:44:44.929 INFO:teuthology.orchestra.run.trial009.stdout:=============================================================================== 2026-02-25T08:44:44.929 INFO:teuthology.orchestra.run.trial009.stdout:^* chi2.us.ntp.li 2 7 377 65 -4395ns[ -32us] +/- 12ms 2026-02-25T08:44:44.929 INFO:teuthology.orchestra.run.trial009.stdout:^- wsip-24-249-17-250.dc.dc> 2 7 377 3 +2210us[+2210us] +/- 11ms 2026-02-25T08:44:44.929 INFO:teuthology.orchestra.run.trial009.stdout:^+ blotch.image1tech.net 2 8 377 192 -39us[ -59us] +/- 22ms 2026-02-25T08:44:44.929 INFO:teuthology.orchestra.run.trial009.stdout:^- ntp.maxhost.io 2 8 357 57 +573us[ +573us] +/- 56ms 2026-02-25T08:44:44.930 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-25T08:44:44.943 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-25T08:44:44.944 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-25T08:44:44.957 DEBUG:teuthology.orchestra.run.trial009:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-25T08:44:45.024 DEBUG:teuthology.orchestra.run.trial059:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-25T08:44:45.077 DEBUG:teuthology.orchestra.run.trial009:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T08:44:45.103 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T08:44:45.104 DEBUG:teuthology.orchestra.run.trial059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T08:44:45.129 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T08:44:45.129 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-25T08:44:45.146 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-25T08:44:45.161 INFO:teuthology.task.internal:Duration was 2363.842760 seconds 2026-02-25T08:44:45.161 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-25T08:44:45.177 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-25T08:44:45.177 DEBUG:teuthology.orchestra.run.trial009:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-25T08:44:45.180 DEBUG:teuthology.orchestra.run.trial059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-25T08:44:45.215 INFO:teuthology.orchestra.run.trial009.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T08:44:45.217 INFO:teuthology.orchestra.run.trial059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T08:44:45.534 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-25T08:44:45.534 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial009.front.sepia.ceph.com 2026-02-25T08:44:45.535 DEBUG:teuthology.orchestra.run.trial009:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-25T08:44:45.553 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial059.front.sepia.ceph.com 2026-02-25T08:44:45.554 DEBUG:teuthology.orchestra.run.trial059:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-25T08:44:45.593 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-25T08:44:45.593 DEBUG:teuthology.orchestra.run.trial009:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T08:44:45.596 DEBUG:teuthology.orchestra.run.trial059:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T08:44:45.693 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-25T08:44:45.694 DEBUG:teuthology.orchestra.run.trial009:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T08:44:45.696 DEBUG:teuthology.orchestra.run.trial059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T08:44:45.717 INFO:teuthology.orchestra.run.trial009.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T08:44:45.718 INFO:teuthology.orchestra.run.trial009.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T08:44:45.718 INFO:teuthology.orchestra.run.trial009.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-25T08:44:45.718 INFO:teuthology.orchestra.run.trial009.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T08:44:45.719 INFO:teuthology.orchestra.run.trial009.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-25T08:44:45.719 INFO:teuthology.orchestra.run.trial059.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T08:44:45.720 INFO:teuthology.orchestra.run.trial059.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T08:44:45.721 INFO:teuthology.orchestra.run.trial059.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-25T08:44:45.721 INFO:teuthology.orchestra.run.trial059.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T08:44:45.721 INFO:teuthology.orchestra.run.trial059.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-25T08:44:45.727 INFO:teuthology.orchestra.run.trial009.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-25T08:44:45.730 INFO:teuthology.orchestra.run.trial059.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-25T08:44:45.732 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-25T08:44:45.752 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-25T08:44:45.752 DEBUG:teuthology.orchestra.run.trial009:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-25T08:44:45.794 DEBUG:teuthology.orchestra.run.trial059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-25T08:44:45.820 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-25T08:44:45.837 DEBUG:teuthology.orchestra.run.trial009:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-25T08:44:45.840 DEBUG:teuthology.orchestra.run.trial059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-25T08:44:45.861 INFO:teuthology.orchestra.run.trial009.stdout:kernel.core_pattern = core 2026-02-25T08:44:45.882 INFO:teuthology.orchestra.run.trial059.stdout:kernel.core_pattern = core 2026-02-25T08:44:45.893 DEBUG:teuthology.orchestra.run.trial009:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-25T08:44:45.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T08:44:45.949 DEBUG:teuthology.orchestra.run.trial059:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-25T08:44:45.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T08:44:45.964 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-25T08:44:45.982 INFO:teuthology.task.internal:Transferring archived files... 2026-02-25T08:44:45.983 DEBUG:teuthology.misc:Transferring archived files from trial009:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/matan-2026-02-25_07:55:35-crimson-rados-wip-logstoremanager-distro-debug-trial/69099/remote/trial009 2026-02-25T08:44:45.984 DEBUG:teuthology.orchestra.run.trial009:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-25T08:44:46.025 DEBUG:teuthology.misc:Transferring archived files from trial059:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/matan-2026-02-25_07:55:35-crimson-rados-wip-logstoremanager-distro-debug-trial/69099/remote/trial059 2026-02-25T08:44:46.025 DEBUG:teuthology.orchestra.run.trial059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-25T08:44:46.062 INFO:teuthology.task.internal:Removing archive directory... 2026-02-25T08:44:46.063 DEBUG:teuthology.orchestra.run.trial009:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-25T08:44:46.065 DEBUG:teuthology.orchestra.run.trial059:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-25T08:44:46.109 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-25T08:44:46.127 INFO:teuthology.task.internal:Not uploading archives. 2026-02-25T08:44:46.127 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-25T08:44:46.145 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-25T08:44:46.145 DEBUG:teuthology.orchestra.run.trial009:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-25T08:44:46.148 DEBUG:teuthology.orchestra.run.trial059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-25T08:44:46.163 INFO:teuthology.orchestra.run.trial009.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 25 08:44 /home/ubuntu/cephtest 2026-02-25T08:44:46.164 INFO:teuthology.orchestra.run.trial059.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 25 08:44 /home/ubuntu/cephtest 2026-02-25T08:44:46.165 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-25T08:44:46.186 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-25T08:44:46.227 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/rados_python} duration: 2363.842759847641 flavor: debug owner: scheduled_matan@soko04.front.sepia.ceph.com success: true 2026-02-25T08:44:46.227 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T08:44:46.352 INFO:teuthology.run:pass