2026-02-12T08:31:07.310 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062 2026-02-12T08:31:07.325 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T08:31:07.402 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41539 branch: main description: crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} tasks/rados_python} email: null first_in_suite: false flavor: debug job_id: '41539' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd pool default crimson: true osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug ms: 20 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd objectstore: seastore osd shutdown pgref assert: true seastore cachepin size pershard: 64M seastore cachepin type: 2Q seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(PG_ - \(OSD_ - \(OBJECT_ - \(POOL_APP_NOT_ENABLED\) sha1: 2401a109e2ac85dfa20fc57328da663aa754c875 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: extra_system_packages: - python3-pytest flavor: debug sha1: 2401a109e2ac85dfa20fc57328da663aa754c875 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c owner: scheduled_matan@soko04.front.sepia.ceph.com priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 9353 sha1: 2401a109e2ac85dfa20fc57328da663aa754c875 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c targets: trial160.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAAKUX27+dsBDoFcBgYTki9D0KRk3E5JFCsed6IinBk4NStVlfF1PZ1W3PHDvsz4h05WcCvXWmymhxaRZBC0Gfo= trial181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAPHVmezqIhAtfcKlMVEXUgOpd2yum3GJdle0P0re9fB7JpAPhiGtvmcw9XA8qTDnSDmayz1ObsfF1oBoPI1pWA= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 - workunit: clients: client.0: - rados/test_python.sh -m 'not (wait or tier or ec)' timeout: 1h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: c433f1062990a0488dc29a553589bc609a460691 timestamp: 2026-02-09_15:50:17 tube: trial user: matan verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.2161924 2026-02-12T08:31:07.402 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c/qa; will attempt to use it 2026-02-12T08:31:07.402 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c/qa/tasks 2026-02-12T08:31:07.403 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T08:31:07.404 INFO:teuthology.task.internal:Checking packages... 2026-02-12T08:31:07.404 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash '2401a109e2ac85dfa20fc57328da663aa754c875' 2026-02-12T08:31:07.404 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T08:31:07.404 INFO:teuthology.packaging:ref: None 2026-02-12T08:31:07.404 INFO:teuthology.packaging:tag: None 2026-02-12T08:31:07.404 INFO:teuthology.packaging:branch: main 2026-02-12T08:31:07.404 INFO:teuthology.packaging:sha1: 2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:31:07.404 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=main 2026-02-12T08:31:07.548 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5271.gdbd7cb72 2026-02-12T08:31:07.549 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T08:31:07.561 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T08:31:07.561 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T08:31:07.575 INFO:teuthology.task.internal:Saving configuration 2026-02-12T08:31:07.589 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T08:31:07.601 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T08:31:07.685 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial160.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41539', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 08:27:53.152136', 'locked_by': 'scheduled_matan@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAAKUX27+dsBDoFcBgYTki9D0KRk3E5JFCsed6IinBk4NStVlfF1PZ1W3PHDvsz4h05WcCvXWmymhxaRZBC0Gfo='} 2026-02-12T08:31:07.741 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial181.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41539', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 08:27:53.152725', 'locked_by': 'scheduled_matan@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAPHVmezqIhAtfcKlMVEXUgOpd2yum3GJdle0P0re9fB7JpAPhiGtvmcw9XA8qTDnSDmayz1ObsfF1oBoPI1pWA='} 2026-02-12T08:31:07.741 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T08:31:07.752 INFO:teuthology.task.internal:roles: ubuntu@trial160.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2026-02-12T08:31:07.752 INFO:teuthology.task.internal:roles: ubuntu@trial181.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2026-02-12T08:31:07.752 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T08:31:07.886 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x75da92410a40>, signals=[15]) 2026-02-12T08:31:07.886 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T08:31:07.897 INFO:teuthology.task.internal:Opening connections... 2026-02-12T08:31:07.897 DEBUG:teuthology.task.internal:connecting to ubuntu@trial160.front.sepia.ceph.com 2026-02-12T08:31:07.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:31:07.960 DEBUG:teuthology.task.internal:connecting to ubuntu@trial181.front.sepia.ceph.com 2026-02-12T08:31:07.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:31:08.019 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T08:31:08.031 DEBUG:teuthology.orchestra.run.trial160:> uname -m 2026-02-12T08:31:08.047 INFO:teuthology.orchestra.run.trial160.stdout:x86_64 2026-02-12T08:31:08.047 DEBUG:teuthology.orchestra.run.trial160:> cat /etc/os-release 2026-02-12T08:31:08.103 INFO:teuthology.orchestra.run.trial160.stdout:NAME="CentOS Stream" 2026-02-12T08:31:08.103 INFO:teuthology.orchestra.run.trial160.stdout:VERSION="9" 2026-02-12T08:31:08.103 INFO:teuthology.orchestra.run.trial160.stdout:ID="centos" 2026-02-12T08:31:08.103 INFO:teuthology.orchestra.run.trial160.stdout:ID_LIKE="rhel fedora" 2026-02-12T08:31:08.103 INFO:teuthology.orchestra.run.trial160.stdout:VERSION_ID="9" 2026-02-12T08:31:08.103 INFO:teuthology.orchestra.run.trial160.stdout:PLATFORM_ID="platform:el9" 2026-02-12T08:31:08.103 INFO:teuthology.orchestra.run.trial160.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T08:31:08.103 INFO:teuthology.orchestra.run.trial160.stdout:ANSI_COLOR="0;31" 2026-02-12T08:31:08.103 INFO:teuthology.orchestra.run.trial160.stdout:LOGO="fedora-logo-icon" 2026-02-12T08:31:08.103 INFO:teuthology.orchestra.run.trial160.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T08:31:08.103 INFO:teuthology.orchestra.run.trial160.stdout:HOME_URL="https://centos.org/" 2026-02-12T08:31:08.103 INFO:teuthology.orchestra.run.trial160.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T08:31:08.103 INFO:teuthology.orchestra.run.trial160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T08:31:08.103 INFO:teuthology.orchestra.run.trial160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T08:31:08.104 INFO:teuthology.lock.ops:Updating trial160.front.sepia.ceph.com on lock server 2026-02-12T08:31:08.177 DEBUG:teuthology.orchestra.run.trial181:> uname -m 2026-02-12T08:31:08.193 INFO:teuthology.orchestra.run.trial181.stdout:x86_64 2026-02-12T08:31:08.193 DEBUG:teuthology.orchestra.run.trial181:> cat /etc/os-release 2026-02-12T08:31:08.248 INFO:teuthology.orchestra.run.trial181.stdout:NAME="CentOS Stream" 2026-02-12T08:31:08.248 INFO:teuthology.orchestra.run.trial181.stdout:VERSION="9" 2026-02-12T08:31:08.248 INFO:teuthology.orchestra.run.trial181.stdout:ID="centos" 2026-02-12T08:31:08.248 INFO:teuthology.orchestra.run.trial181.stdout:ID_LIKE="rhel fedora" 2026-02-12T08:31:08.248 INFO:teuthology.orchestra.run.trial181.stdout:VERSION_ID="9" 2026-02-12T08:31:08.248 INFO:teuthology.orchestra.run.trial181.stdout:PLATFORM_ID="platform:el9" 2026-02-12T08:31:08.248 INFO:teuthology.orchestra.run.trial181.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T08:31:08.248 INFO:teuthology.orchestra.run.trial181.stdout:ANSI_COLOR="0;31" 2026-02-12T08:31:08.248 INFO:teuthology.orchestra.run.trial181.stdout:LOGO="fedora-logo-icon" 2026-02-12T08:31:08.248 INFO:teuthology.orchestra.run.trial181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T08:31:08.249 INFO:teuthology.orchestra.run.trial181.stdout:HOME_URL="https://centos.org/" 2026-02-12T08:31:08.249 INFO:teuthology.orchestra.run.trial181.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T08:31:08.249 INFO:teuthology.orchestra.run.trial181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T08:31:08.249 INFO:teuthology.orchestra.run.trial181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T08:31:08.249 INFO:teuthology.lock.ops:Updating trial181.front.sepia.ceph.com on lock server 2026-02-12T08:31:08.325 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T08:31:08.338 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T08:31:08.349 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T08:31:08.349 DEBUG:teuthology.orchestra.run.trial160:> test '!' -e /home/ubuntu/cephtest 2026-02-12T08:31:08.351 DEBUG:teuthology.orchestra.run.trial181:> test '!' -e /home/ubuntu/cephtest 2026-02-12T08:31:08.366 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T08:31:08.377 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T08:31:08.377 DEBUG:teuthology.orchestra.run.trial160:> test -z $(ls -A /var/lib/ceph) 2026-02-12T08:31:08.407 DEBUG:teuthology.orchestra.run.trial181:> test -z $(ls -A /var/lib/ceph) 2026-02-12T08:31:08.424 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T08:31:08.580 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T08:31:08.599 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-12T08:31:08.599 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-12T08:31:08.600 DEBUG:teuthology.orchestra.run.trial160:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T08:31:08.600 DEBUG:teuthology.orchestra.run.trial181:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T08:31:08.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:31:08.614 DEBUG:teuthology.orchestra.run.trial181:> uname -r 2026-02-12T08:31:08.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:31:08.615 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T08:31:08.670 INFO:teuthology.orchestra.run.trial181.stdout:5.14.0-645.el9.x86_64 2026-02-12T08:31:08.670 INFO:teuthology.task.kernel:Running kernel on trial181: 5.14.0-645.el9.x86_64 2026-02-12T08:31:08.670 DEBUG:teuthology.orchestra.run.trial181:> sudo yum install -y kernel 2026-02-12T08:31:08.670 INFO:teuthology.orchestra.run.trial160.stdout:5.14.0-645.el9.x86_64 2026-02-12T08:31:08.671 INFO:teuthology.task.kernel:Running kernel on trial160: 5.14.0-645.el9.x86_64 2026-02-12T08:31:08.671 DEBUG:teuthology.orchestra.run.trial160:> sudo yum install -y kernel 2026-02-12T08:31:09.892 INFO:teuthology.orchestra.run.trial181.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-12T08:31:10.324 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - BaseOS 6.9 MB/s | 8.9 MB 00:01 2026-02-12T08:31:14.497 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - AppStream 7.4 MB/s | 27 MB 00:03 2026-02-12T08:31:18.427 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 7.8 MB 00:01 2026-02-12T08:31:20.008 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-12T08:31:21.030 INFO:teuthology.orchestra.run.trial160.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2026-02-12T08:31:21.284 INFO:teuthology.orchestra.run.trial181.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 27 MB 00:10 2026-02-12T08:31:24.265 INFO:teuthology.orchestra.run.trial160.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-12T08:31:25.243 INFO:teuthology.orchestra.run.trial181.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 7.8 MB 00:01 2026-02-12T08:31:25.333 INFO:teuthology.orchestra.run.trial160.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T08:31:25.353 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-12T08:31:25.354 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-12T08:31:25.354 INFO:teuthology.orchestra.run.trial160.stdout: Package Architecture Version Repository Size 2026-02-12T08:31:25.354 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-12T08:31:25.354 INFO:teuthology.orchestra.run.trial160.stdout:Installing: 2026-02-12T08:31:25.355 INFO:teuthology.orchestra.run.trial160.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T08:31:25.355 INFO:teuthology.orchestra.run.trial160.stdout:Installing dependencies: 2026-02-12T08:31:25.355 INFO:teuthology.orchestra.run.trial160.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T08:31:25.355 INFO:teuthology.orchestra.run.trial160.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T08:31:25.355 INFO:teuthology.orchestra.run.trial160.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T08:31:25.355 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:31:25.355 INFO:teuthology.orchestra.run.trial160.stdout:Transaction Summary 2026-02-12T08:31:25.355 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-12T08:31:25.355 INFO:teuthology.orchestra.run.trial160.stdout:Install 4 Packages 2026-02-12T08:31:25.355 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:31:25.355 INFO:teuthology.orchestra.run.trial160.stdout:Total download size: 88 M 2026-02-12T08:31:25.356 INFO:teuthology.orchestra.run.trial160.stdout:Installed size: 135 M 2026-02-12T08:31:25.356 INFO:teuthology.orchestra.run.trial160.stdout:Downloading Packages: 2026-02-12T08:31:25.773 INFO:teuthology.orchestra.run.trial160.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 10 MB/s | 768 kB 00:00 2026-02-12T08:31:26.073 INFO:teuthology.orchestra.run.trial160.stdout:(2/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 106 MB/s | 40 MB 00:00 2026-02-12T08:31:26.308 INFO:teuthology.orchestra.run.trial160.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 58 MB/s | 31 MB 00:00 2026-02-12T08:31:26.382 INFO:teuthology.orchestra.run.trial181.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 20 kB 00:00 2026-02-12T08:31:26.595 INFO:teuthology.orchestra.run.trial160.stdout:(4/4): kernel-core-5.14.0-677.el9.x86_64.rpm 19 MB/s | 17 MB 00:00 2026-02-12T08:31:26.595 INFO:teuthology.orchestra.run.trial160.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:31:26.595 INFO:teuthology.orchestra.run.trial160.stdout:Total 71 MB/s | 88 MB 00:01 2026-02-12T08:31:26.785 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction check 2026-02-12T08:31:26.997 INFO:teuthology.orchestra.run.trial160.stdout:Transaction check succeeded. 2026-02-12T08:31:26.997 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction test 2026-02-12T08:31:27.344 INFO:teuthology.orchestra.run.trial160.stdout:Transaction test succeeded. 2026-02-12T08:31:27.344 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction 2026-02-12T08:31:28.438 INFO:teuthology.orchestra.run.trial160.stdout: Preparing : 1/1 2026-02-12T08:31:28.723 INFO:teuthology.orchestra.run.trial160.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T08:31:28.743 INFO:teuthology.orchestra.run.trial160.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T08:31:30.516 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T08:31:30.545 INFO:teuthology.orchestra.run.trial160.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T08:31:31.008 INFO:teuthology.orchestra.run.trial181.stdout:Extra Packages for Enterprise Linux 4.5 MB/s | 20 MB 00:04 2026-02-12T08:31:33.564 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T08:31:33.571 INFO:teuthology.orchestra.run.trial160.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:31:34.257 INFO:teuthology.orchestra.run.trial181.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-12T08:31:35.335 INFO:teuthology.orchestra.run.trial181.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T08:31:35.356 INFO:teuthology.orchestra.run.trial181.stdout:Dependencies resolved. 2026-02-12T08:31:35.357 INFO:teuthology.orchestra.run.trial181.stdout:================================================================================ 2026-02-12T08:31:35.357 INFO:teuthology.orchestra.run.trial181.stdout: Package Architecture Version Repository Size 2026-02-12T08:31:35.357 INFO:teuthology.orchestra.run.trial181.stdout:================================================================================ 2026-02-12T08:31:35.357 INFO:teuthology.orchestra.run.trial181.stdout:Installing: 2026-02-12T08:31:35.357 INFO:teuthology.orchestra.run.trial181.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T08:31:35.358 INFO:teuthology.orchestra.run.trial181.stdout:Installing dependencies: 2026-02-12T08:31:35.358 INFO:teuthology.orchestra.run.trial181.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T08:31:35.358 INFO:teuthology.orchestra.run.trial181.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T08:31:35.358 INFO:teuthology.orchestra.run.trial181.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T08:31:35.358 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:31:35.358 INFO:teuthology.orchestra.run.trial181.stdout:Transaction Summary 2026-02-12T08:31:35.358 INFO:teuthology.orchestra.run.trial181.stdout:================================================================================ 2026-02-12T08:31:35.358 INFO:teuthology.orchestra.run.trial181.stdout:Install 4 Packages 2026-02-12T08:31:35.358 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:31:35.359 INFO:teuthology.orchestra.run.trial181.stdout:Total download size: 88 M 2026-02-12T08:31:35.359 INFO:teuthology.orchestra.run.trial181.stdout:Installed size: 135 M 2026-02-12T08:31:35.359 INFO:teuthology.orchestra.run.trial181.stdout:Downloading Packages: 2026-02-12T08:31:36.605 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:31:37.847 INFO:teuthology.orchestra.run.trial181.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 351 kB/s | 768 kB 00:02 2026-02-12T08:31:37.927 INFO:teuthology.orchestra.run.trial181.stdout:[MIRROR] kernel-modules-core-5.14.0-677.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-677.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T08:31:45.083 INFO:teuthology.orchestra.run.trial181.stdout:(2/4): kernel-modules-core-5.14.0-677.el9.x86_6 4.3 MB/s | 31 MB 00:07 2026-02-12T08:31:55.463 INFO:teuthology.orchestra.run.trial181.stdout:(3/4): kernel-core-5.14.0-677.el9.x86_64.rpm 881 kB/s | 17 MB 00:19 2026-02-12T08:32:07.021 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:32:07.043 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:32:07.108 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:32:07.108 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T08:32:07.108 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T08:32:07.109 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T08:32:07.162 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:32:07.162 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:32:07.162 INFO:teuthology.orchestra.run.trial160.stdout:Installed: 2026-02-12T08:32:07.162 INFO:teuthology.orchestra.run.trial160.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T08:32:07.162 INFO:teuthology.orchestra.run.trial160.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T08:32:07.162 INFO:teuthology.orchestra.run.trial160.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T08:32:07.162 INFO:teuthology.orchestra.run.trial160.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T08:32:07.162 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:32:07.162 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-12T08:32:07.164 INFO:teuthology.orchestra.run.trial181.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 1.3 MB/s | 40 MB 00:31 2026-02-12T08:32:07.166 INFO:teuthology.orchestra.run.trial181.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:32:07.166 INFO:teuthology.orchestra.run.trial181.stdout:Total 2.8 MB/s | 88 MB 00:31 2026-02-12T08:32:07.221 DEBUG:teuthology.orchestra.run.trial160:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T08:32:07.247 INFO:teuthology.orchestra.run.trial160.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T08:32:07.248 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T08:32:07.248 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T08:32:07.248 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T08:32:07.248 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T08:32:07.248 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T08:32:07.249 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial160.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T08:32:07.249 DEBUG:teuthology.orchestra.run.trial160:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T08:32:07.313 INFO:teuthology.orchestra.run.trial160.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T08:32:07.314 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T08:32:07.314 DEBUG:teuthology.orchestra.run.trial160:> sudo rpm -qi grub2-tools 2026-02-12T08:32:07.353 INFO:teuthology.orchestra.run.trial181.stdout:Running transaction check 2026-02-12T08:32:07.382 INFO:teuthology.orchestra.run.trial160.stdout:Name : grub2-tools 2026-02-12T08:32:07.383 INFO:teuthology.orchestra.run.trial160.stdout:Epoch : 1 2026-02-12T08:32:07.383 INFO:teuthology.orchestra.run.trial160.stdout:Version : 2.06 2026-02-12T08:32:07.383 INFO:teuthology.orchestra.run.trial160.stdout:Release : 118.el9 2026-02-12T08:32:07.383 INFO:teuthology.orchestra.run.trial160.stdout:Architecture: x86_64 2026-02-12T08:32:07.383 INFO:teuthology.orchestra.run.trial160.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T08:32:07.383 INFO:teuthology.orchestra.run.trial160.stdout:Group : Unspecified 2026-02-12T08:32:07.383 INFO:teuthology.orchestra.run.trial160.stdout:Size : 8393909 2026-02-12T08:32:07.383 INFO:teuthology.orchestra.run.trial160.stdout:License : GPLv3+ 2026-02-12T08:32:07.383 INFO:teuthology.orchestra.run.trial160.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T08:32:07.383 INFO:teuthology.orchestra.run.trial160.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T08:32:07.384 INFO:teuthology.orchestra.run.trial160.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T08:32:07.384 INFO:teuthology.orchestra.run.trial160.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T08:32:07.384 INFO:teuthology.orchestra.run.trial160.stdout:Packager : builder@centos.org 2026-02-12T08:32:07.384 INFO:teuthology.orchestra.run.trial160.stdout:Vendor : CentOS 2026-02-12T08:32:07.384 INFO:teuthology.orchestra.run.trial160.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T08:32:07.384 INFO:teuthology.orchestra.run.trial160.stdout:Summary : Support tools for GRUB. 2026-02-12T08:32:07.384 INFO:teuthology.orchestra.run.trial160.stdout:Description : 2026-02-12T08:32:07.384 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:32:07.384 INFO:teuthology.orchestra.run.trial160.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T08:32:07.384 INFO:teuthology.orchestra.run.trial160.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T08:32:07.384 INFO:teuthology.orchestra.run.trial160.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T08:32:07.384 INFO:teuthology.orchestra.run.trial160.stdout:hardware devices. 2026-02-12T08:32:07.385 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:32:07.385 INFO:teuthology.orchestra.run.trial160.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T08:32:07.386 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T08:32:07.386 INFO:teuthology.task.kernel:Updating grub on trial160 to boot 5.14.0-677.el9.x86_64 2026-02-12T08:32:07.386 DEBUG:teuthology.orchestra.run.trial160:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T08:32:07.451 INFO:teuthology.orchestra.run.trial160.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T08:32:07.453 DEBUG:teuthology.orchestra.run.trial160:> sudo command -v grubby && echo yes || echo no 2026-02-12T08:32:07.516 INFO:teuthology.orchestra.run.trial160.stdout:/sbin/grubby 2026-02-12T08:32:07.517 INFO:teuthology.orchestra.run.trial160.stdout:yes 2026-02-12T08:32:07.517 DEBUG:teuthology.orchestra.run.trial160:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T08:32:07.555 INFO:teuthology.orchestra.run.trial181.stdout:Transaction check succeeded. 2026-02-12T08:32:07.555 INFO:teuthology.orchestra.run.trial181.stdout:Running transaction test 2026-02-12T08:32:07.583 INFO:teuthology.orchestra.run.trial160.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T08:32:07.583 DEBUG:teuthology.orchestra.run.trial160:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T08:32:07.655 DEBUG:teuthology.orchestra.run.trial160:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T08:32:07.858 INFO:teuthology.orchestra.run.trial160.stderr:Generating grub configuration file ... 2026-02-12T08:32:07.901 INFO:teuthology.orchestra.run.trial181.stdout:Transaction test succeeded. 2026-02-12T08:32:07.901 INFO:teuthology.orchestra.run.trial181.stdout:Running transaction 2026-02-12T08:32:07.919 INFO:teuthology.orchestra.run.trial160.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T08:32:07.926 INFO:teuthology.orchestra.run.trial160.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T08:32:08.179 INFO:teuthology.orchestra.run.trial160.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T08:32:08.185 INFO:teuthology.orchestra.run.trial160.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T08:32:08.218 INFO:teuthology.orchestra.run.trial160.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T08:32:08.224 INFO:teuthology.orchestra.run.trial160.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T08:32:08.248 INFO:teuthology.orchestra.run.trial160.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T08:32:08.255 INFO:teuthology.orchestra.run.trial160.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T08:32:08.335 INFO:teuthology.orchestra.run.trial160.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T08:32:08.343 INFO:teuthology.orchestra.run.trial160.stderr:done 2026-02-12T08:32:08.345 DEBUG:teuthology.orchestra.run.trial160:> test -d /sys/firmware/efi 2026-02-12T08:32:08.360 DEBUG:teuthology.orchestra.run.trial160:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T08:32:08.424 INFO:teuthology.orchestra.run.trial160.stdout:/boot/efi/EFI/BOOT 2026-02-12T08:32:08.424 INFO:teuthology.orchestra.run.trial160.stdout:/boot/efi/EFI/centos 2026-02-12T08:32:08.425 DEBUG:teuthology.orchestra.run.trial160:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T08:32:08.490 INFO:teuthology.orchestra.run.trial160.stdout:no 2026-02-12T08:32:08.490 DEBUG:teuthology.orchestra.run.trial160:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T08:32:08.554 INFO:teuthology.orchestra.run.trial160.stdout:yes 2026-02-12T08:32:08.555 DEBUG:teuthology.orchestra.run.trial160:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T08:32:08.618 DEBUG:teuthology.orchestra.run.trial160:> sudo shutdown -r now 2026-02-12T08:32:08.989 INFO:teuthology.orchestra.run.trial181.stdout: Preparing : 1/1 2026-02-12T08:32:09.272 INFO:teuthology.orchestra.run.trial181.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T08:32:09.292 INFO:teuthology.orchestra.run.trial181.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T08:32:11.069 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T08:32:11.097 INFO:teuthology.orchestra.run.trial181.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T08:32:14.188 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T08:32:14.194 INFO:teuthology.orchestra.run.trial181.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:32:17.296 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:32:38.659 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T08:32:38.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T08:32:38.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:32:47.836 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:32:47.857 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:32:47.921 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:32:47.921 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T08:32:47.921 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T08:32:47.921 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T08:32:47.973 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:32:47.973 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:32:47.973 INFO:teuthology.orchestra.run.trial181.stdout:Installed: 2026-02-12T08:32:47.974 INFO:teuthology.orchestra.run.trial181.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T08:32:47.974 INFO:teuthology.orchestra.run.trial181.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T08:32:47.974 INFO:teuthology.orchestra.run.trial181.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T08:32:47.974 INFO:teuthology.orchestra.run.trial181.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T08:32:47.974 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:32:47.974 INFO:teuthology.orchestra.run.trial181.stdout:Complete! 2026-02-12T08:32:48.029 DEBUG:teuthology.orchestra.run.trial181:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T08:32:48.054 INFO:teuthology.orchestra.run.trial181.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T08:32:48.054 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T08:32:48.054 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T08:32:48.054 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T08:32:48.054 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T08:32:48.054 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2026-02-12T08:32:48.054 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial181.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T08:32:48.055 DEBUG:teuthology.orchestra.run.trial181:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T08:32:48.117 INFO:teuthology.orchestra.run.trial181.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T08:32:48.117 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T08:32:48.117 DEBUG:teuthology.orchestra.run.trial181:> sudo rpm -qi grub2-tools 2026-02-12T08:32:48.184 INFO:teuthology.orchestra.run.trial181.stdout:Name : grub2-tools 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:Epoch : 1 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:Version : 2.06 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:Release : 118.el9 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:Architecture: x86_64 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:Group : Unspecified 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:Size : 8393909 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:License : GPLv3+ 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:Packager : builder@centos.org 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:Vendor : CentOS 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:Summary : Support tools for GRUB. 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:Description : 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:hardware devices. 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:32:48.185 INFO:teuthology.orchestra.run.trial181.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T08:32:48.186 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T08:32:48.186 INFO:teuthology.task.kernel:Updating grub on trial181 to boot 5.14.0-677.el9.x86_64 2026-02-12T08:32:48.186 DEBUG:teuthology.orchestra.run.trial181:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T08:32:48.249 INFO:teuthology.orchestra.run.trial181.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T08:32:48.250 DEBUG:teuthology.orchestra.run.trial181:> sudo command -v grubby && echo yes || echo no 2026-02-12T08:32:48.312 INFO:teuthology.orchestra.run.trial181.stdout:/sbin/grubby 2026-02-12T08:32:48.313 INFO:teuthology.orchestra.run.trial181.stdout:yes 2026-02-12T08:32:48.314 DEBUG:teuthology.orchestra.run.trial181:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T08:32:48.377 INFO:teuthology.orchestra.run.trial181.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T08:32:48.378 DEBUG:teuthology.orchestra.run.trial181:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T08:32:48.453 DEBUG:teuthology.orchestra.run.trial181:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T08:32:48.664 INFO:teuthology.orchestra.run.trial181.stderr:Generating grub configuration file ... 2026-02-12T08:32:48.727 INFO:teuthology.orchestra.run.trial181.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T08:32:48.733 INFO:teuthology.orchestra.run.trial181.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T08:32:48.987 INFO:teuthology.orchestra.run.trial181.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T08:32:48.993 INFO:teuthology.orchestra.run.trial181.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T08:32:49.025 INFO:teuthology.orchestra.run.trial181.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T08:32:49.031 INFO:teuthology.orchestra.run.trial181.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T08:32:49.054 INFO:teuthology.orchestra.run.trial181.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T08:32:49.061 INFO:teuthology.orchestra.run.trial181.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T08:32:49.142 INFO:teuthology.orchestra.run.trial181.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T08:32:49.150 INFO:teuthology.orchestra.run.trial181.stderr:done 2026-02-12T08:32:49.152 DEBUG:teuthology.orchestra.run.trial181:> test -d /sys/firmware/efi 2026-02-12T08:32:49.169 DEBUG:teuthology.orchestra.run.trial181:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T08:32:49.233 INFO:teuthology.orchestra.run.trial181.stdout:/boot/efi/EFI/BOOT 2026-02-12T08:32:49.234 INFO:teuthology.orchestra.run.trial181.stdout:/boot/efi/EFI/centos 2026-02-12T08:32:49.235 DEBUG:teuthology.orchestra.run.trial181:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T08:32:49.303 INFO:teuthology.orchestra.run.trial181.stdout:no 2026-02-12T08:32:49.304 DEBUG:teuthology.orchestra.run.trial181:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T08:32:49.368 INFO:teuthology.orchestra.run.trial181.stdout:yes 2026-02-12T08:32:49.368 DEBUG:teuthology.orchestra.run.trial181:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T08:32:49.433 DEBUG:teuthology.orchestra.run.trial181:> sudo shutdown -r now 2026-02-12T08:33:19.504 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2026-02-12T08:33:19.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial181.front.sepia.ceph.com' 2026-02-12T08:33:19.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:33:38.681 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T08:33:47.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T08:33:47.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:33:47.776 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T08:33:47.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T08:33:47.932 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T08:33:47.932 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T08:33:47.989 INFO:teuthology.orchestra.run.trial160.stdout:5.14.0-677.el9.x86_64 2026-02-12T08:33:47.989 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T08:33:47.989 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T08:33:47.989 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T08:33:48.990 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-12T08:33:48.990 DEBUG:teuthology.orchestra.run.trial160:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T08:33:49.018 INFO:teuthology.orchestra.run.trial160.stdout:ttyS1 2026-02-12T08:33:49.038 DEBUG:teuthology.parallel:result is None 2026-02-12T08:34:19.507 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T08:34:28.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial181.front.sepia.ceph.com' 2026-02-12T08:34:28.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:34:28.582 DEBUG:teuthology.orchestra.run.trial181:> true 2026-02-12T08:34:28.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial181.front.sepia.ceph.com' 2026-02-12T08:34:28.737 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-677.el9.x86_64"... 2026-02-12T08:34:28.737 DEBUG:teuthology.orchestra.run.trial181:> uname -r 2026-02-12T08:34:28.794 INFO:teuthology.orchestra.run.trial181.stdout:5.14.0-677.el9.x86_64 2026-02-12T08:34:28.794 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T08:34:28.794 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T08:34:28.794 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T08:34:29.796 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-12T08:34:29.796 DEBUG:teuthology.orchestra.run.trial181:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T08:34:29.825 INFO:teuthology.orchestra.run.trial181.stdout:ttyS1 2026-02-12T08:34:29.849 DEBUG:teuthology.parallel:result is None 2026-02-12T08:34:29.850 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-12T08:34:29.862 INFO:teuthology.task.internal:Creating test directory... 2026-02-12T08:34:29.862 DEBUG:teuthology.orchestra.run.trial160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T08:34:29.864 DEBUG:teuthology.orchestra.run.trial181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T08:34:29.906 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-12T08:34:29.919 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-12T08:34:29.932 INFO:teuthology.task.internal:Creating archive directory... 2026-02-12T08:34:29.932 DEBUG:teuthology.orchestra.run.trial160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T08:34:29.934 DEBUG:teuthology.orchestra.run.trial181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T08:34:29.965 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-12T08:34:29.976 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-12T08:34:29.976 DEBUG:teuthology.orchestra.run.trial160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T08:34:29.992 DEBUG:teuthology.orchestra.run.trial181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T08:34:30.015 INFO:teuthology.orchestra.run.trial160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T08:34:30.024 INFO:teuthology.orchestra.run.trial160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T08:34:30.025 INFO:teuthology.orchestra.run.trial181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T08:34:30.034 INFO:teuthology.orchestra.run.trial181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T08:34:30.035 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-12T08:34:30.048 INFO:teuthology.task.internal:Configuring sudo... 2026-02-12T08:34:30.049 DEBUG:teuthology.orchestra.run.trial160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T08:34:30.068 DEBUG:teuthology.orchestra.run.trial181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T08:34:30.099 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-12T08:34:30.116 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-12T08:34:30.117 DEBUG:teuthology.orchestra.run.trial160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T08:34:30.133 DEBUG:teuthology.orchestra.run.trial181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T08:34:30.156 DEBUG:teuthology.orchestra.run.trial160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T08:34:30.288 DEBUG:teuthology.orchestra.run.trial160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T08:34:30.314 DEBUG:teuthology.orchestra.run.trial160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T08:34:30.434 DEBUG:teuthology.orchestra.run.trial160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T08:34:30.458 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:34:30.458 DEBUG:teuthology.orchestra.run.trial160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T08:34:30.522 DEBUG:teuthology.orchestra.run.trial181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T08:34:30.630 DEBUG:teuthology.orchestra.run.trial181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T08:34:30.655 DEBUG:teuthology.orchestra.run.trial181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T08:34:30.796 DEBUG:teuthology.orchestra.run.trial181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T08:34:30.821 DEBUG:teuthology.orchestra.run.trial181:> set -ex 2026-02-12T08:34:30.822 DEBUG:teuthology.orchestra.run.trial181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T08:34:30.885 DEBUG:teuthology.orchestra.run.trial160:> sudo service rsyslog restart 2026-02-12T08:34:30.888 DEBUG:teuthology.orchestra.run.trial181:> sudo service rsyslog restart 2026-02-12T08:34:30.914 INFO:teuthology.orchestra.run.trial160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T08:34:30.954 INFO:teuthology.orchestra.run.trial181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T08:34:31.439 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-12T08:34:31.455 INFO:teuthology.task.internal:Starting timer... 2026-02-12T08:34:31.455 INFO:teuthology.run_tasks:Running task pcp... 2026-02-12T08:34:31.478 INFO:teuthology.run_tasks:Running task selinux... 2026-02-12T08:34:31.496 DEBUG:teuthology.orchestra.run.trial160:> sudo service auditd rotate 2026-02-12T08:34:31.526 INFO:teuthology.orchestra.run.trial160.stdout:Rotating logs: 2026-02-12T08:34:31.528 DEBUG:teuthology.orchestra.run.trial181:> sudo service auditd rotate 2026-02-12T08:34:31.558 INFO:teuthology.orchestra.run.trial181.stdout:Rotating logs: 2026-02-12T08:34:31.560 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-12T08:34:31.560 DEBUG:teuthology.orchestra.run.trial160:> /usr/sbin/getenforce 2026-02-12T08:34:31.585 INFO:teuthology.orchestra.run.trial160.stdout:Permissive 2026-02-12T08:34:31.585 DEBUG:teuthology.orchestra.run.trial181:> /usr/sbin/getenforce 2026-02-12T08:34:31.617 INFO:teuthology.orchestra.run.trial181.stdout:Permissive 2026-02-12T08:34:31.617 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial160.front.sepia.ceph.com': 'permissive', 'ubuntu@trial181.front.sepia.ceph.com': 'permissive'} 2026-02-12T08:34:31.617 DEBUG:teuthology.orchestra.run.trial160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T08:34:31.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:34:31.650 DEBUG:teuthology.orchestra.run.trial181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T08:34:31.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:34:31.681 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-12T08:34:31.681 DEBUG:teuthology.orchestra.run.trial160:> sudo /usr/sbin/setenforce permissive 2026-02-12T08:34:31.714 DEBUG:teuthology.orchestra.run.trial181:> sudo /usr/sbin/setenforce permissive 2026-02-12T08:34:31.744 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-12T08:34:31.756 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-12T08:34:31.763 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-12T08:34:31.763 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial160.front.sepia.ceph.com,trial181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-12T08:35:40.999 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial160.front.sepia.ceph.com'), Remote(name='ubuntu@trial181.front.sepia.ceph.com')] 2026-02-12T08:35:41.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T08:35:41.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:35:41.110 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T08:35:41.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T08:35:41.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial181.front.sepia.ceph.com' 2026-02-12T08:35:41.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:35:41.276 DEBUG:teuthology.orchestra.run.trial181:> true 2026-02-12T08:35:41.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial181.front.sepia.ceph.com' 2026-02-12T08:35:41.346 INFO:teuthology.run_tasks:Running task clock... 2026-02-12T08:35:41.367 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-12T08:35:41.367 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T08:35:41.367 DEBUG:teuthology.orchestra.run.trial160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T08:35:41.369 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T08:35:41.369 DEBUG:teuthology.orchestra.run.trial181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T08:35:41.395 INFO:teuthology.orchestra.run.trial160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T08:35:41.408 INFO:teuthology.orchestra.run.trial160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T08:35:41.413 INFO:teuthology.orchestra.run.trial181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T08:35:41.425 INFO:teuthology.orchestra.run.trial181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T08:35:41.430 INFO:teuthology.orchestra.run.trial160.stderr:sudo: ntpd: command not found 2026-02-12T08:35:41.440 INFO:teuthology.orchestra.run.trial160.stdout:506 Cannot talk to daemon 2026-02-12T08:35:41.446 INFO:teuthology.orchestra.run.trial181.stderr:sudo: ntpd: command not found 2026-02-12T08:35:41.452 INFO:teuthology.orchestra.run.trial160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T08:35:41.455 INFO:teuthology.orchestra.run.trial181.stdout:506 Cannot talk to daemon 2026-02-12T08:35:41.464 INFO:teuthology.orchestra.run.trial160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T08:35:41.467 INFO:teuthology.orchestra.run.trial181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T08:35:41.479 INFO:teuthology.orchestra.run.trial181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T08:35:41.512 INFO:teuthology.orchestra.run.trial160.stderr:bash: line 1: ntpq: command not found 2026-02-12T08:35:41.514 INFO:teuthology.orchestra.run.trial160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T08:35:41.514 INFO:teuthology.orchestra.run.trial160.stdout:=============================================================================== 2026-02-12T08:35:41.523 INFO:teuthology.orchestra.run.trial181.stderr:bash: line 1: ntpq: command not found 2026-02-12T08:35:41.529 INFO:teuthology.orchestra.run.trial181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T08:35:41.529 INFO:teuthology.orchestra.run.trial181.stdout:=============================================================================== 2026-02-12T08:35:41.529 INFO:teuthology.orchestra.run.trial181.stdout:^? 144.202.41.38.vultruserc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T08:35:41.530 INFO:teuthology.run_tasks:Running task install... 2026-02-12T08:35:41.541 DEBUG:teuthology.task.install:project ceph 2026-02-12T08:35:41.541 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'}} 2026-02-12T08:35:41.541 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'} 2026-02-12T08:35:41.541 INFO:teuthology.task.install:Using flavor: debug 2026-02-12T08:35:41.545 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-12T08:35:41.545 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-12T08:35:41.545 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875', 'tag': None, 'wait_for_package': False} 2026-02-12T08:35:41.546 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:35:41.547 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875', 'tag': None, 'wait_for_package': False} 2026-02-12T08:35:41.547 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:35:41.725 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/ 2026-02-12T08:35:41.725 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5161.g2401a109 2026-02-12T08:35:41.734 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/ 2026-02-12T08:35:41.734 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5161.g2401a109 2026-02-12T08:35:42.085 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T08:35:42.085 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:35:42.086 DEBUG:teuthology.orchestra.run.trial160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T08:35:42.112 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo, python3-pytest on remote rpm x86_64 2026-02-12T08:35:42.112 DEBUG:teuthology.orchestra.run.trial160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2401a109e2ac85dfa20fc57328da663aa754c875/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T08:35:42.124 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T08:35:42.124 DEBUG:teuthology.orchestra.run.trial181:> set -ex 2026-02-12T08:35:42.124 DEBUG:teuthology.orchestra.run.trial181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T08:35:42.150 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo, python3-pytest on remote rpm x86_64 2026-02-12T08:35:42.151 DEBUG:teuthology.orchestra.run.trial181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2401a109e2ac85dfa20fc57328da663aa754c875/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T08:35:42.176 DEBUG:teuthology.orchestra.run.trial160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T08:35:42.213 DEBUG:teuthology.orchestra.run.trial181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T08:35:42.250 DEBUG:teuthology.orchestra.run.trial160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T08:35:42.285 DEBUG:teuthology.orchestra.run.trial181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T08:35:42.313 INFO:teuthology.orchestra.run.trial160.stdout:check_obsoletes = 1 2026-02-12T08:35:42.315 DEBUG:teuthology.orchestra.run.trial160:> sudo yum clean all 2026-02-12T08:35:42.348 INFO:teuthology.orchestra.run.trial181.stdout:check_obsoletes = 1 2026-02-12T08:35:42.349 DEBUG:teuthology.orchestra.run.trial181:> sudo yum clean all 2026-02-12T08:35:42.464 INFO:teuthology.orchestra.run.trial160.stdout:41 files removed 2026-02-12T08:35:42.478 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-osd-crimson ceph-osd-crimson-debuginfo python3-pytest 2026-02-12T08:35:42.497 INFO:teuthology.orchestra.run.trial181.stdout:41 files removed 2026-02-12T08:35:42.511 DEBUG:teuthology.orchestra.run.trial181:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-osd-crimson ceph-osd-crimson-debuginfo python3-pytest 2026-02-12T08:35:43.215 INFO:teuthology.orchestra.run.trial160.stdout:ceph packages for x86_64 159 kB/s | 94 kB 00:00 2026-02-12T08:35:43.261 INFO:teuthology.orchestra.run.trial181.stdout:ceph packages for x86_64 155 kB/s | 94 kB 00:00 2026-02-12T08:35:43.749 INFO:teuthology.orchestra.run.trial160.stdout:ceph noarch packages 48 kB/s | 24 kB 00:00 2026-02-12T08:35:43.795 INFO:teuthology.orchestra.run.trial181.stdout:ceph noarch packages 48 kB/s | 24 kB 00:00 2026-02-12T08:35:44.264 INFO:teuthology.orchestra.run.trial181.stdout:ceph source packages 4.6 kB/s | 2.1 kB 00:00 2026-02-12T08:35:44.418 INFO:teuthology.orchestra.run.trial160.stdout:ceph source packages 3.2 kB/s | 2.1 kB 00:00 2026-02-12T08:35:45.097 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-12T08:35:45.464 INFO:teuthology.orchestra.run.trial181.stdout:CentOS Stream 9 - BaseOS 7.5 MB/s | 8.9 MB 00:01 2026-02-12T08:35:48.475 INFO:teuthology.orchestra.run.trial181.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-12T08:35:52.381 INFO:teuthology.orchestra.run.trial181.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 7.8 MB 00:01 2026-02-12T08:35:54.249 INFO:teuthology.orchestra.run.trial181.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 20 kB 00:01 2026-02-12T08:35:54.736 INFO:teuthology.orchestra.run.trial181.stdout:Extra Packages for Enterprise Linux 49 MB/s | 20 MB 00:00 2026-02-12T08:35:58.025 INFO:teuthology.orchestra.run.trial181.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-12T08:35:59.322 INFO:teuthology.orchestra.run.trial181.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-12T08:35:59.322 INFO:teuthology.orchestra.run.trial181.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-12T08:35:59.350 INFO:teuthology.orchestra.run.trial181.stdout:Dependencies resolved. 2026-02-12T08:35:59.355 INFO:teuthology.orchestra.run.trial181.stdout:======================================================================================= 2026-02-12T08:35:59.355 INFO:teuthology.orchestra.run.trial181.stdout: Package Arch Version Repository Size 2026-02-12T08:35:59.355 INFO:teuthology.orchestra.run.trial181.stdout:======================================================================================= 2026-02-12T08:35:59.356 INFO:teuthology.orchestra.run.trial181.stdout:Installing: 2026-02-12T08:35:59.356 INFO:teuthology.orchestra.run.trial181.stdout: ceph x86_64 2:20.3.0-5161.g2401a109.el9 ceph 6.5 k 2026-02-12T08:35:59.356 INFO:teuthology.orchestra.run.trial181.stdout: ceph-base x86_64 2:20.3.0-5161.g2401a109.el9 ceph 5.1 M 2026-02-12T08:35:59.356 INFO:teuthology.orchestra.run.trial181.stdout: ceph-fuse x86_64 2:20.3.0-5161.g2401a109.el9 ceph 914 k 2026-02-12T08:35:59.356 INFO:teuthology.orchestra.run.trial181.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5161.g2401a109.el9 ceph 149 k 2026-02-12T08:35:59.356 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mgr x86_64 2:20.3.0-5161.g2401a109.el9 ceph 937 k 2026-02-12T08:35:59.356 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 183 k 2026-02-12T08:35:59.356 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 15 M 2026-02-12T08:35:59.356 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 7.4 M 2026-02-12T08:35:59.356 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mgr-rook noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 50 k 2026-02-12T08:35:59.356 INFO:teuthology.orchestra.run.trial181.stdout: ceph-osd x86_64 2:20.3.0-5161.g2401a109.el9 ceph 163 k 2026-02-12T08:35:59.356 INFO:teuthology.orchestra.run.trial181.stdout: ceph-osd-classic x86_64 2:20.3.0-5161.g2401a109.el9 ceph 15 M 2026-02-12T08:35:59.357 INFO:teuthology.orchestra.run.trial181.stdout: ceph-osd-crimson x86_64 2:20.3.0-5161.g2401a109.el9 ceph 87 M 2026-02-12T08:35:59.357 INFO:teuthology.orchestra.run.trial181.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5161.g2401a109.el9 ceph 429 M 2026-02-12T08:35:59.357 INFO:teuthology.orchestra.run.trial181.stdout: ceph-radosgw x86_64 2:20.3.0-5161.g2401a109.el9 ceph 11 M 2026-02-12T08:35:59.357 INFO:teuthology.orchestra.run.trial181.stdout: ceph-test x86_64 2:20.3.0-5161.g2401a109.el9 ceph 126 M 2026-02-12T08:35:59.357 INFO:teuthology.orchestra.run.trial181.stdout: ceph-volume noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 299 k 2026-02-12T08:35:59.357 INFO:teuthology.orchestra.run.trial181.stdout: cephadm noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 1.0 M 2026-02-12T08:35:59.357 INFO:teuthology.orchestra.run.trial181.stdout: libcephfs-devel x86_64 2:20.3.0-5161.g2401a109.el9 ceph 37 k 2026-02-12T08:35:59.357 INFO:teuthology.orchestra.run.trial181.stdout: libcephfs2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 860 k 2026-02-12T08:35:59.357 INFO:teuthology.orchestra.run.trial181.stdout: librados-devel x86_64 2:20.3.0-5161.g2401a109.el9 ceph 124 k 2026-02-12T08:35:59.357 INFO:teuthology.orchestra.run.trial181.stdout: python3-cephfs x86_64 2:20.3.0-5161.g2401a109.el9 ceph 204 k 2026-02-12T08:35:59.357 INFO:teuthology.orchestra.run.trial181.stdout: python3-pytest noarch 6.2.2-7.el9 appstream 519 k 2026-02-12T08:35:59.357 INFO:teuthology.orchestra.run.trial181.stdout: python3-rados x86_64 2:20.3.0-5161.g2401a109.el9 ceph 323 k 2026-02-12T08:35:59.358 INFO:teuthology.orchestra.run.trial181.stdout: python3-rbd x86_64 2:20.3.0-5161.g2401a109.el9 ceph 305 k 2026-02-12T08:35:59.358 INFO:teuthology.orchestra.run.trial181.stdout: python3-rgw x86_64 2:20.3.0-5161.g2401a109.el9 ceph 100 k 2026-02-12T08:35:59.358 INFO:teuthology.orchestra.run.trial181.stdout: rbd-fuse x86_64 2:20.3.0-5161.g2401a109.el9 ceph 87 k 2026-02-12T08:35:59.358 INFO:teuthology.orchestra.run.trial181.stdout: rbd-mirror x86_64 2:20.3.0-5161.g2401a109.el9 ceph 2.6 M 2026-02-12T08:35:59.358 INFO:teuthology.orchestra.run.trial181.stdout: rbd-nbd x86_64 2:20.3.0-5161.g2401a109.el9 ceph 166 k 2026-02-12T08:35:59.358 INFO:teuthology.orchestra.run.trial181.stdout:Upgrading: 2026-02-12T08:35:59.358 INFO:teuthology.orchestra.run.trial181.stdout: librados2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 3.3 M 2026-02-12T08:35:59.358 INFO:teuthology.orchestra.run.trial181.stdout: librbd1 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 2.7 M 2026-02-12T08:35:59.358 INFO:teuthology.orchestra.run.trial181.stdout:Installing dependencies: 2026-02-12T08:35:59.358 INFO:teuthology.orchestra.run.trial181.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T08:35:59.358 INFO:teuthology.orchestra.run.trial181.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T08:35:59.358 INFO:teuthology.orchestra.run.trial181.stdout: ceph-common x86_64 2:20.3.0-5161.g2401a109.el9 ceph 21 M 2026-02-12T08:35:59.358 INFO:teuthology.orchestra.run.trial181.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 57 k 2026-02-12T08:35:59.359 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mds x86_64 2:20.3.0-5161.g2401a109.el9 ceph 2.0 M 2026-02-12T08:35:59.359 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 297 k 2026-02-12T08:35:59.359 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mon x86_64 2:20.3.0-5161.g2401a109.el9 ceph 4.8 M 2026-02-12T08:35:59.359 INFO:teuthology.orchestra.run.trial181.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 17 k 2026-02-12T08:35:59.359 INFO:teuthology.orchestra.run.trial181.stdout: ceph-selinux x86_64 2:20.3.0-5161.g2401a109.el9 ceph 25 k 2026-02-12T08:35:59.359 INFO:teuthology.orchestra.run.trial181.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T08:35:59.359 INFO:teuthology.orchestra.run.trial181.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T08:35:59.359 INFO:teuthology.orchestra.run.trial181.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T08:35:59.359 INFO:teuthology.orchestra.run.trial181.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T08:35:59.359 INFO:teuthology.orchestra.run.trial181.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T08:35:59.359 INFO:teuthology.orchestra.run.trial181.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T08:35:59.359 INFO:teuthology.orchestra.run.trial181.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-12T08:35:59.360 INFO:teuthology.orchestra.run.trial181.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T08:35:59.360 INFO:teuthology.orchestra.run.trial181.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T08:35:59.360 INFO:teuthology.orchestra.run.trial181.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T08:35:59.360 INFO:teuthology.orchestra.run.trial181.stdout: libasan8 x86_64 15.1.1-2.5.el9 appstream 523 k 2026-02-12T08:35:59.360 INFO:teuthology.orchestra.run.trial181.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-12T08:35:59.360 INFO:teuthology.orchestra.run.trial181.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 24 k 2026-02-12T08:35:59.360 INFO:teuthology.orchestra.run.trial181.stdout: libcephsqlite x86_64 2:20.3.0-5161.g2401a109.el9 ceph 153 k 2026-02-12T08:35:59.360 INFO:teuthology.orchestra.run.trial181.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T08:35:59.360 INFO:teuthology.orchestra.run.trial181.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T08:35:59.360 INFO:teuthology.orchestra.run.trial181.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T08:35:59.360 INFO:teuthology.orchestra.run.trial181.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T08:35:59.360 INFO:teuthology.orchestra.run.trial181.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T08:35:59.360 INFO:teuthology.orchestra.run.trial181.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T08:35:59.361 INFO:teuthology.orchestra.run.trial181.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T08:35:59.361 INFO:teuthology.orchestra.run.trial181.stdout: libradosstriper1 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 263 k 2026-02-12T08:35:59.361 INFO:teuthology.orchestra.run.trial181.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T08:35:59.361 INFO:teuthology.orchestra.run.trial181.stdout: librgw2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 5.6 M 2026-02-12T08:35:59.361 INFO:teuthology.orchestra.run.trial181.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T08:35:59.361 INFO:teuthology.orchestra.run.trial181.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-12T08:35:59.361 INFO:teuthology.orchestra.run.trial181.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T08:35:59.361 INFO:teuthology.orchestra.run.trial181.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T08:35:59.361 INFO:teuthology.orchestra.run.trial181.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-12T08:35:59.361 INFO:teuthology.orchestra.run.trial181.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T08:35:59.361 INFO:teuthology.orchestra.run.trial181.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T08:35:59.361 INFO:teuthology.orchestra.run.trial181.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T08:35:59.361 INFO:teuthology.orchestra.run.trial181.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T08:35:59.362 INFO:teuthology.orchestra.run.trial181.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T08:35:59.362 INFO:teuthology.orchestra.run.trial181.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T08:35:59.362 INFO:teuthology.orchestra.run.trial181.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T08:35:59.362 INFO:teuthology.orchestra.run.trial181.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T08:35:59.362 INFO:teuthology.orchestra.run.trial181.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T08:35:59.362 INFO:teuthology.orchestra.run.trial181.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T08:35:59.362 INFO:teuthology.orchestra.run.trial181.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T08:35:59.362 INFO:teuthology.orchestra.run.trial181.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T08:35:59.362 INFO:teuthology.orchestra.run.trial181.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T08:35:59.362 INFO:teuthology.orchestra.run.trial181.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T08:35:59.362 INFO:teuthology.orchestra.run.trial181.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T08:35:59.362 INFO:teuthology.orchestra.run.trial181.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T08:35:59.362 INFO:teuthology.orchestra.run.trial181.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T08:35:59.363 INFO:teuthology.orchestra.run.trial181.stdout: python3-ceph-argparse x86_64 2:20.3.0-5161.g2401a109.el9 ceph 45 k 2026-02-12T08:35:59.363 INFO:teuthology.orchestra.run.trial181.stdout: python3-ceph-common x86_64 2:20.3.0-5161.g2401a109.el9 ceph 184 k 2026-02-12T08:35:59.363 INFO:teuthology.orchestra.run.trial181.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T08:35:59.363 INFO:teuthology.orchestra.run.trial181.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T08:35:59.363 INFO:teuthology.orchestra.run.trial181.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T08:35:59.363 INFO:teuthology.orchestra.run.trial181.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T08:35:59.363 INFO:teuthology.orchestra.run.trial181.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T08:35:59.363 INFO:teuthology.orchestra.run.trial181.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T08:35:59.363 INFO:teuthology.orchestra.run.trial181.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T08:35:59.363 INFO:teuthology.orchestra.run.trial181.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T08:35:59.363 INFO:teuthology.orchestra.run.trial181.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T08:35:59.363 INFO:teuthology.orchestra.run.trial181.stdout: python3-iniconfig noarch 1.1.1-7.el9 appstream 17 k 2026-02-12T08:35:59.363 INFO:teuthology.orchestra.run.trial181.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-12T08:35:59.364 INFO:teuthology.orchestra.run.trial181.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T08:35:59.364 INFO:teuthology.orchestra.run.trial181.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T08:35:59.364 INFO:teuthology.orchestra.run.trial181.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-12T08:35:59.364 INFO:teuthology.orchestra.run.trial181.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T08:35:59.364 INFO:teuthology.orchestra.run.trial181.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T08:35:59.364 INFO:teuthology.orchestra.run.trial181.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T08:35:59.364 INFO:teuthology.orchestra.run.trial181.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T08:35:59.364 INFO:teuthology.orchestra.run.trial181.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T08:35:59.364 INFO:teuthology.orchestra.run.trial181.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T08:35:59.364 INFO:teuthology.orchestra.run.trial181.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T08:35:59.364 INFO:teuthology.orchestra.run.trial181.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-12T08:35:59.364 INFO:teuthology.orchestra.run.trial181.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T08:35:59.364 INFO:teuthology.orchestra.run.trial181.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T08:35:59.365 INFO:teuthology.orchestra.run.trial181.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-12T08:35:59.365 INFO:teuthology.orchestra.run.trial181.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T08:35:59.365 INFO:teuthology.orchestra.run.trial181.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T08:35:59.365 INFO:teuthology.orchestra.run.trial181.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T08:35:59.365 INFO:teuthology.orchestra.run.trial181.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T08:35:59.365 INFO:teuthology.orchestra.run.trial181.stdout: python3-pluggy noarch 0.13.1-7.el9 appstream 41 k 2026-02-12T08:35:59.365 INFO:teuthology.orchestra.run.trial181.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T08:35:59.365 INFO:teuthology.orchestra.run.trial181.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T08:35:59.365 INFO:teuthology.orchestra.run.trial181.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T08:35:59.365 INFO:teuthology.orchestra.run.trial181.stdout: python3-py noarch 1.10.0-6.el9 appstream 477 k 2026-02-12T08:35:59.365 INFO:teuthology.orchestra.run.trial181.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T08:35:59.365 INFO:teuthology.orchestra.run.trial181.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T08:35:59.366 INFO:teuthology.orchestra.run.trial181.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T08:35:59.366 INFO:teuthology.orchestra.run.trial181.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T08:35:59.366 INFO:teuthology.orchestra.run.trial181.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T08:35:59.366 INFO:teuthology.orchestra.run.trial181.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T08:35:59.366 INFO:teuthology.orchestra.run.trial181.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T08:35:59.366 INFO:teuthology.orchestra.run.trial181.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T08:35:59.366 INFO:teuthology.orchestra.run.trial181.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T08:35:59.366 INFO:teuthology.orchestra.run.trial181.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T08:35:59.366 INFO:teuthology.orchestra.run.trial181.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T08:35:59.366 INFO:teuthology.orchestra.run.trial181.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T08:35:59.366 INFO:teuthology.orchestra.run.trial181.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T08:35:59.366 INFO:teuthology.orchestra.run.trial181.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T08:35:59.366 INFO:teuthology.orchestra.run.trial181.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T08:35:59.367 INFO:teuthology.orchestra.run.trial181.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T08:35:59.367 INFO:teuthology.orchestra.run.trial181.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-12T08:35:59.367 INFO:teuthology.orchestra.run.trial181.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T08:35:59.367 INFO:teuthology.orchestra.run.trial181.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T08:35:59.367 INFO:teuthology.orchestra.run.trial181.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T08:35:59.367 INFO:teuthology.orchestra.run.trial181.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T08:35:59.367 INFO:teuthology.orchestra.run.trial181.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T08:35:59.367 INFO:teuthology.orchestra.run.trial181.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T08:35:59.367 INFO:teuthology.orchestra.run.trial181.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T08:35:59.367 INFO:teuthology.orchestra.run.trial181.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T08:35:59.367 INFO:teuthology.orchestra.run.trial181.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-12T08:35:59.367 INFO:teuthology.orchestra.run.trial181.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-12T08:35:59.367 INFO:teuthology.orchestra.run.trial181.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T08:35:59.368 INFO:teuthology.orchestra.run.trial181.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-12T08:35:59.368 INFO:teuthology.orchestra.run.trial181.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T08:35:59.368 INFO:teuthology.orchestra.run.trial181.stdout:Installing weak dependencies: 2026-02-12T08:35:59.368 INFO:teuthology.orchestra.run.trial181.stdout: ceph-debugsource x86_64 2:20.3.0-5161.g2401a109.el9 ceph 12 M 2026-02-12T08:35:59.368 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 22 k 2026-02-12T08:35:59.368 INFO:teuthology.orchestra.run.trial181.stdout: libcephfs-daemon x86_64 2:20.3.0-5161.g2401a109.el9 ceph 35 k 2026-02-12T08:35:59.368 INFO:teuthology.orchestra.run.trial181.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-12T08:35:59.368 INFO:teuthology.orchestra.run.trial181.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-12T08:35:59.368 INFO:teuthology.orchestra.run.trial181.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-12T08:35:59.368 INFO:teuthology.orchestra.run.trial181.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T08:35:59.368 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:35:59.368 INFO:teuthology.orchestra.run.trial181.stdout:Transaction Summary 2026-02-12T08:35:59.368 INFO:teuthology.orchestra.run.trial181.stdout:======================================================================================= 2026-02-12T08:35:59.369 INFO:teuthology.orchestra.run.trial181.stdout:Install 156 Packages 2026-02-12T08:35:59.369 INFO:teuthology.orchestra.run.trial181.stdout:Upgrade 2 Packages 2026-02-12T08:35:59.369 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:35:59.369 INFO:teuthology.orchestra.run.trial181.stdout:Total download size: 826 M 2026-02-12T08:35:59.370 INFO:teuthology.orchestra.run.trial181.stdout:Downloading Packages: 2026-02-12T08:36:00.585 INFO:teuthology.orchestra.run.trial181.stdout:(1/158): ceph-20.3.0-5161.g2401a109.el9.x86_64. 24 kB/s | 6.5 kB 00:00 2026-02-12T08:36:05.065 INFO:teuthology.orchestra.run.trial181.stdout:(2/158): ceph-base-20.3.0-5161.g2401a109.el9.x8 1.1 MB/s | 5.1 MB 00:04 2026-02-12T08:36:05.874 INFO:teuthology.orchestra.run.trial181.stdout:(3/158): ceph-debugsource-20.3.0-5161.g2401a109 2.3 MB/s | 12 MB 00:05 2026-02-12T08:36:06.001 INFO:teuthology.orchestra.run.trial181.stdout:(4/158): ceph-fuse-20.3.0-5161.g2401a109.el9.x8 976 kB/s | 914 kB 00:00 2026-02-12T08:36:06.002 INFO:teuthology.orchestra.run.trial181.stdout:(5/158): ceph-immutable-object-cache-20.3.0-516 1.1 MB/s | 149 kB 00:00 2026-02-12T08:36:06.470 INFO:teuthology.orchestra.run.trial181.stdout:(6/158): ceph-mgr-20.3.0-5161.g2401a109.el9.x86 2.0 MB/s | 937 kB 00:00 2026-02-12T08:36:07.783 INFO:teuthology.orchestra.run.trial181.stdout:(7/158): ceph-mds-20.3.0-5161.g2401a109.el9.x86 1.1 MB/s | 2.0 MB 00:01 2026-02-12T08:36:07.986 INFO:teuthology.orchestra.run.trial181.stdout:(8/158): ceph-osd-20.3.0-5161.g2401a109.el9.x86 807 kB/s | 163 kB 00:00 2026-02-12T08:36:09.676 INFO:teuthology.orchestra.run.trial181.stdout:(9/158): ceph-mon-20.3.0-5161.g2401a109.el9.x86 1.5 MB/s | 4.8 MB 00:03 2026-02-12T08:36:12.068 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 27 MB 00:26 2026-02-12T08:36:15.716 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 7.8 MB 00:01 2026-02-12T08:36:16.618 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - Extras packages 116 kB/s | 20 kB 00:00 2026-02-12T08:36:17.084 INFO:teuthology.orchestra.run.trial160.stdout:Extra Packages for Enterprise Linux 52 MB/s | 20 MB 00:00 2026-02-12T08:36:18.076 INFO:teuthology.orchestra.run.trial181.stdout:(10/158): ceph-osd-classic-20.3.0-5161.g2401a10 1.5 MB/s | 15 MB 00:10 2026-02-12T08:36:20.278 INFO:teuthology.orchestra.run.trial160.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-12T08:36:20.502 INFO:teuthology.orchestra.run.trial181.stdout:(11/158): ceph-common-20.3.0-5161.g2401a109.el9 1.0 MB/s | 21 MB 00:20 2026-02-12T08:36:21.562 INFO:teuthology.orchestra.run.trial160.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-12T08:36:21.562 INFO:teuthology.orchestra.run.trial160.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-12T08:36:21.590 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-12T08:36:21.595 INFO:teuthology.orchestra.run.trial160.stdout:======================================================================================= 2026-02-12T08:36:21.595 INFO:teuthology.orchestra.run.trial160.stdout: Package Arch Version Repository Size 2026-02-12T08:36:21.595 INFO:teuthology.orchestra.run.trial160.stdout:======================================================================================= 2026-02-12T08:36:21.595 INFO:teuthology.orchestra.run.trial160.stdout:Installing: 2026-02-12T08:36:21.595 INFO:teuthology.orchestra.run.trial160.stdout: ceph x86_64 2:20.3.0-5161.g2401a109.el9 ceph 6.5 k 2026-02-12T08:36:21.595 INFO:teuthology.orchestra.run.trial160.stdout: ceph-base x86_64 2:20.3.0-5161.g2401a109.el9 ceph 5.1 M 2026-02-12T08:36:21.595 INFO:teuthology.orchestra.run.trial160.stdout: ceph-fuse x86_64 2:20.3.0-5161.g2401a109.el9 ceph 914 k 2026-02-12T08:36:21.595 INFO:teuthology.orchestra.run.trial160.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5161.g2401a109.el9 ceph 149 k 2026-02-12T08:36:21.595 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr x86_64 2:20.3.0-5161.g2401a109.el9 ceph 937 k 2026-02-12T08:36:21.596 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 183 k 2026-02-12T08:36:21.596 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 15 M 2026-02-12T08:36:21.596 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 7.4 M 2026-02-12T08:36:21.596 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-rook noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 50 k 2026-02-12T08:36:21.596 INFO:teuthology.orchestra.run.trial160.stdout: ceph-osd x86_64 2:20.3.0-5161.g2401a109.el9 ceph 163 k 2026-02-12T08:36:21.596 INFO:teuthology.orchestra.run.trial160.stdout: ceph-osd-classic x86_64 2:20.3.0-5161.g2401a109.el9 ceph 15 M 2026-02-12T08:36:21.596 INFO:teuthology.orchestra.run.trial160.stdout: ceph-osd-crimson x86_64 2:20.3.0-5161.g2401a109.el9 ceph 87 M 2026-02-12T08:36:21.596 INFO:teuthology.orchestra.run.trial160.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5161.g2401a109.el9 ceph 429 M 2026-02-12T08:36:21.596 INFO:teuthology.orchestra.run.trial160.stdout: ceph-radosgw x86_64 2:20.3.0-5161.g2401a109.el9 ceph 11 M 2026-02-12T08:36:21.596 INFO:teuthology.orchestra.run.trial160.stdout: ceph-test x86_64 2:20.3.0-5161.g2401a109.el9 ceph 126 M 2026-02-12T08:36:21.596 INFO:teuthology.orchestra.run.trial160.stdout: ceph-volume noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 299 k 2026-02-12T08:36:21.596 INFO:teuthology.orchestra.run.trial160.stdout: cephadm noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 1.0 M 2026-02-12T08:36:21.597 INFO:teuthology.orchestra.run.trial160.stdout: libcephfs-devel x86_64 2:20.3.0-5161.g2401a109.el9 ceph 37 k 2026-02-12T08:36:21.597 INFO:teuthology.orchestra.run.trial160.stdout: libcephfs2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 860 k 2026-02-12T08:36:21.597 INFO:teuthology.orchestra.run.trial160.stdout: librados-devel x86_64 2:20.3.0-5161.g2401a109.el9 ceph 124 k 2026-02-12T08:36:21.597 INFO:teuthology.orchestra.run.trial160.stdout: python3-cephfs x86_64 2:20.3.0-5161.g2401a109.el9 ceph 204 k 2026-02-12T08:36:21.597 INFO:teuthology.orchestra.run.trial160.stdout: python3-pytest noarch 6.2.2-7.el9 appstream 519 k 2026-02-12T08:36:21.597 INFO:teuthology.orchestra.run.trial160.stdout: python3-rados x86_64 2:20.3.0-5161.g2401a109.el9 ceph 323 k 2026-02-12T08:36:21.597 INFO:teuthology.orchestra.run.trial160.stdout: python3-rbd x86_64 2:20.3.0-5161.g2401a109.el9 ceph 305 k 2026-02-12T08:36:21.597 INFO:teuthology.orchestra.run.trial160.stdout: python3-rgw x86_64 2:20.3.0-5161.g2401a109.el9 ceph 100 k 2026-02-12T08:36:21.597 INFO:teuthology.orchestra.run.trial160.stdout: rbd-fuse x86_64 2:20.3.0-5161.g2401a109.el9 ceph 87 k 2026-02-12T08:36:21.597 INFO:teuthology.orchestra.run.trial160.stdout: rbd-mirror x86_64 2:20.3.0-5161.g2401a109.el9 ceph 2.6 M 2026-02-12T08:36:21.597 INFO:teuthology.orchestra.run.trial160.stdout: rbd-nbd x86_64 2:20.3.0-5161.g2401a109.el9 ceph 166 k 2026-02-12T08:36:21.597 INFO:teuthology.orchestra.run.trial160.stdout:Upgrading: 2026-02-12T08:36:21.597 INFO:teuthology.orchestra.run.trial160.stdout: librados2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 3.3 M 2026-02-12T08:36:21.598 INFO:teuthology.orchestra.run.trial160.stdout: librbd1 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 2.7 M 2026-02-12T08:36:21.598 INFO:teuthology.orchestra.run.trial160.stdout:Installing dependencies: 2026-02-12T08:36:21.598 INFO:teuthology.orchestra.run.trial160.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T08:36:21.598 INFO:teuthology.orchestra.run.trial160.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T08:36:21.598 INFO:teuthology.orchestra.run.trial160.stdout: ceph-common x86_64 2:20.3.0-5161.g2401a109.el9 ceph 21 M 2026-02-12T08:36:21.598 INFO:teuthology.orchestra.run.trial160.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 57 k 2026-02-12T08:36:21.598 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mds x86_64 2:20.3.0-5161.g2401a109.el9 ceph 2.0 M 2026-02-12T08:36:21.598 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 297 k 2026-02-12T08:36:21.598 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mon x86_64 2:20.3.0-5161.g2401a109.el9 ceph 4.8 M 2026-02-12T08:36:21.598 INFO:teuthology.orchestra.run.trial160.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 17 k 2026-02-12T08:36:21.598 INFO:teuthology.orchestra.run.trial160.stdout: ceph-selinux x86_64 2:20.3.0-5161.g2401a109.el9 ceph 25 k 2026-02-12T08:36:21.598 INFO:teuthology.orchestra.run.trial160.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T08:36:21.599 INFO:teuthology.orchestra.run.trial160.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T08:36:21.599 INFO:teuthology.orchestra.run.trial160.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T08:36:21.599 INFO:teuthology.orchestra.run.trial160.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T08:36:21.599 INFO:teuthology.orchestra.run.trial160.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T08:36:21.599 INFO:teuthology.orchestra.run.trial160.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T08:36:21.599 INFO:teuthology.orchestra.run.trial160.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-12T08:36:21.599 INFO:teuthology.orchestra.run.trial160.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T08:36:21.599 INFO:teuthology.orchestra.run.trial160.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T08:36:21.599 INFO:teuthology.orchestra.run.trial160.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T08:36:21.599 INFO:teuthology.orchestra.run.trial160.stdout: libasan8 x86_64 15.1.1-2.5.el9 appstream 523 k 2026-02-12T08:36:21.599 INFO:teuthology.orchestra.run.trial160.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-12T08:36:21.599 INFO:teuthology.orchestra.run.trial160.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 24 k 2026-02-12T08:36:21.599 INFO:teuthology.orchestra.run.trial160.stdout: libcephsqlite x86_64 2:20.3.0-5161.g2401a109.el9 ceph 153 k 2026-02-12T08:36:21.600 INFO:teuthology.orchestra.run.trial160.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T08:36:21.600 INFO:teuthology.orchestra.run.trial160.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T08:36:21.600 INFO:teuthology.orchestra.run.trial160.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T08:36:21.600 INFO:teuthology.orchestra.run.trial160.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T08:36:21.600 INFO:teuthology.orchestra.run.trial160.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T08:36:21.600 INFO:teuthology.orchestra.run.trial160.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T08:36:21.600 INFO:teuthology.orchestra.run.trial160.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T08:36:21.600 INFO:teuthology.orchestra.run.trial160.stdout: libradosstriper1 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 263 k 2026-02-12T08:36:21.600 INFO:teuthology.orchestra.run.trial160.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T08:36:21.600 INFO:teuthology.orchestra.run.trial160.stdout: librgw2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 5.6 M 2026-02-12T08:36:21.600 INFO:teuthology.orchestra.run.trial160.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T08:36:21.600 INFO:teuthology.orchestra.run.trial160.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-12T08:36:21.601 INFO:teuthology.orchestra.run.trial160.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T08:36:21.601 INFO:teuthology.orchestra.run.trial160.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T08:36:21.601 INFO:teuthology.orchestra.run.trial160.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-12T08:36:21.601 INFO:teuthology.orchestra.run.trial160.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T08:36:21.601 INFO:teuthology.orchestra.run.trial160.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T08:36:21.601 INFO:teuthology.orchestra.run.trial160.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T08:36:21.601 INFO:teuthology.orchestra.run.trial160.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T08:36:21.601 INFO:teuthology.orchestra.run.trial160.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T08:36:21.601 INFO:teuthology.orchestra.run.trial160.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T08:36:21.601 INFO:teuthology.orchestra.run.trial160.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T08:36:21.601 INFO:teuthology.orchestra.run.trial160.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T08:36:21.601 INFO:teuthology.orchestra.run.trial160.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T08:36:21.601 INFO:teuthology.orchestra.run.trial160.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T08:36:21.602 INFO:teuthology.orchestra.run.trial160.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T08:36:21.602 INFO:teuthology.orchestra.run.trial160.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T08:36:21.602 INFO:teuthology.orchestra.run.trial160.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T08:36:21.602 INFO:teuthology.orchestra.run.trial160.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T08:36:21.602 INFO:teuthology.orchestra.run.trial160.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T08:36:21.602 INFO:teuthology.orchestra.run.trial160.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T08:36:21.602 INFO:teuthology.orchestra.run.trial160.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T08:36:21.602 INFO:teuthology.orchestra.run.trial160.stdout: python3-ceph-argparse x86_64 2:20.3.0-5161.g2401a109.el9 ceph 45 k 2026-02-12T08:36:21.602 INFO:teuthology.orchestra.run.trial160.stdout: python3-ceph-common x86_64 2:20.3.0-5161.g2401a109.el9 ceph 184 k 2026-02-12T08:36:21.602 INFO:teuthology.orchestra.run.trial160.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T08:36:21.602 INFO:teuthology.orchestra.run.trial160.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T08:36:21.602 INFO:teuthology.orchestra.run.trial160.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T08:36:21.602 INFO:teuthology.orchestra.run.trial160.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T08:36:21.603 INFO:teuthology.orchestra.run.trial160.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T08:36:21.603 INFO:teuthology.orchestra.run.trial160.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T08:36:21.603 INFO:teuthology.orchestra.run.trial160.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T08:36:21.603 INFO:teuthology.orchestra.run.trial160.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T08:36:21.603 INFO:teuthology.orchestra.run.trial160.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T08:36:21.603 INFO:teuthology.orchestra.run.trial160.stdout: python3-iniconfig noarch 1.1.1-7.el9 appstream 17 k 2026-02-12T08:36:21.603 INFO:teuthology.orchestra.run.trial160.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-12T08:36:21.603 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T08:36:21.603 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T08:36:21.603 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-12T08:36:21.603 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T08:36:21.603 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T08:36:21.604 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T08:36:21.604 INFO:teuthology.orchestra.run.trial160.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T08:36:21.604 INFO:teuthology.orchestra.run.trial160.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T08:36:21.604 INFO:teuthology.orchestra.run.trial160.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T08:36:21.604 INFO:teuthology.orchestra.run.trial160.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T08:36:21.604 INFO:teuthology.orchestra.run.trial160.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-12T08:36:21.604 INFO:teuthology.orchestra.run.trial160.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T08:36:21.604 INFO:teuthology.orchestra.run.trial160.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T08:36:21.604 INFO:teuthology.orchestra.run.trial160.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-12T08:36:21.604 INFO:teuthology.orchestra.run.trial160.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T08:36:21.604 INFO:teuthology.orchestra.run.trial160.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T08:36:21.604 INFO:teuthology.orchestra.run.trial160.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T08:36:21.604 INFO:teuthology.orchestra.run.trial160.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T08:36:21.605 INFO:teuthology.orchestra.run.trial160.stdout: python3-pluggy noarch 0.13.1-7.el9 appstream 41 k 2026-02-12T08:36:21.605 INFO:teuthology.orchestra.run.trial160.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T08:36:21.605 INFO:teuthology.orchestra.run.trial160.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T08:36:21.605 INFO:teuthology.orchestra.run.trial160.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T08:36:21.605 INFO:teuthology.orchestra.run.trial160.stdout: python3-py noarch 1.10.0-6.el9 appstream 477 k 2026-02-12T08:36:21.605 INFO:teuthology.orchestra.run.trial160.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T08:36:21.605 INFO:teuthology.orchestra.run.trial160.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T08:36:21.605 INFO:teuthology.orchestra.run.trial160.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T08:36:21.605 INFO:teuthology.orchestra.run.trial160.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T08:36:21.605 INFO:teuthology.orchestra.run.trial160.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T08:36:21.605 INFO:teuthology.orchestra.run.trial160.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T08:36:21.605 INFO:teuthology.orchestra.run.trial160.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T08:36:21.605 INFO:teuthology.orchestra.run.trial160.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T08:36:21.605 INFO:teuthology.orchestra.run.trial160.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T08:36:21.606 INFO:teuthology.orchestra.run.trial160.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T08:36:21.606 INFO:teuthology.orchestra.run.trial160.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T08:36:21.606 INFO:teuthology.orchestra.run.trial160.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T08:36:21.606 INFO:teuthology.orchestra.run.trial160.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T08:36:21.606 INFO:teuthology.orchestra.run.trial160.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T08:36:21.606 INFO:teuthology.orchestra.run.trial160.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T08:36:21.606 INFO:teuthology.orchestra.run.trial160.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T08:36:21.606 INFO:teuthology.orchestra.run.trial160.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-12T08:36:21.606 INFO:teuthology.orchestra.run.trial160.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T08:36:21.606 INFO:teuthology.orchestra.run.trial160.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T08:36:21.606 INFO:teuthology.orchestra.run.trial160.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T08:36:21.606 INFO:teuthology.orchestra.run.trial160.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T08:36:21.606 INFO:teuthology.orchestra.run.trial160.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T08:36:21.607 INFO:teuthology.orchestra.run.trial160.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T08:36:21.607 INFO:teuthology.orchestra.run.trial160.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T08:36:21.607 INFO:teuthology.orchestra.run.trial160.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T08:36:21.607 INFO:teuthology.orchestra.run.trial160.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-12T08:36:21.607 INFO:teuthology.orchestra.run.trial160.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-12T08:36:21.607 INFO:teuthology.orchestra.run.trial160.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T08:36:21.607 INFO:teuthology.orchestra.run.trial160.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-12T08:36:21.607 INFO:teuthology.orchestra.run.trial160.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T08:36:21.607 INFO:teuthology.orchestra.run.trial160.stdout:Installing weak dependencies: 2026-02-12T08:36:21.607 INFO:teuthology.orchestra.run.trial160.stdout: ceph-debugsource x86_64 2:20.3.0-5161.g2401a109.el9 ceph 12 M 2026-02-12T08:36:21.607 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 22 k 2026-02-12T08:36:21.607 INFO:teuthology.orchestra.run.trial160.stdout: libcephfs-daemon x86_64 2:20.3.0-5161.g2401a109.el9 ceph 35 k 2026-02-12T08:36:21.607 INFO:teuthology.orchestra.run.trial160.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-12T08:36:21.608 INFO:teuthology.orchestra.run.trial160.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-12T08:36:21.608 INFO:teuthology.orchestra.run.trial160.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-12T08:36:21.608 INFO:teuthology.orchestra.run.trial160.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T08:36:21.608 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:36:21.608 INFO:teuthology.orchestra.run.trial160.stdout:Transaction Summary 2026-02-12T08:36:21.608 INFO:teuthology.orchestra.run.trial160.stdout:======================================================================================= 2026-02-12T08:36:21.608 INFO:teuthology.orchestra.run.trial160.stdout:Install 156 Packages 2026-02-12T08:36:21.608 INFO:teuthology.orchestra.run.trial160.stdout:Upgrade 2 Packages 2026-02-12T08:36:21.608 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:36:21.609 INFO:teuthology.orchestra.run.trial160.stdout:Total download size: 826 M 2026-02-12T08:36:21.609 INFO:teuthology.orchestra.run.trial160.stdout:Downloading Packages: 2026-02-12T08:36:22.436 INFO:teuthology.orchestra.run.trial160.stdout:(1/158): ceph-20.3.0-5161.g2401a109.el9.x86_64. 22 kB/s | 6.5 kB 00:00 2026-02-12T08:36:24.363 INFO:teuthology.orchestra.run.trial160.stdout:(2/158): ceph-debugsource-20.3.0-5161.g2401a109 6.2 MB/s | 12 MB 00:01 2026-02-12T08:36:24.495 INFO:teuthology.orchestra.run.trial160.stdout:(3/158): ceph-fuse-20.3.0-5161.g2401a109.el9.x8 6.8 MB/s | 914 kB 00:00 2026-02-12T08:36:24.556 INFO:teuthology.orchestra.run.trial160.stdout:(4/158): ceph-immutable-object-cache-20.3.0-516 2.4 MB/s | 149 kB 00:00 2026-02-12T08:36:24.830 INFO:teuthology.orchestra.run.trial160.stdout:(5/158): ceph-mds-20.3.0-5161.g2401a109.el9.x86 7.4 MB/s | 2.0 MB 00:00 2026-02-12T08:36:24.968 INFO:teuthology.orchestra.run.trial160.stdout:(6/158): ceph-mgr-20.3.0-5161.g2401a109.el9.x86 6.6 MB/s | 937 kB 00:00 2026-02-12T08:36:25.517 INFO:teuthology.orchestra.run.trial160.stdout:(7/158): ceph-mon-20.3.0-5161.g2401a109.el9.x86 8.8 MB/s | 4.8 MB 00:00 2026-02-12T08:36:25.582 INFO:teuthology.orchestra.run.trial160.stdout:(8/158): ceph-osd-20.3.0-5161.g2401a109.el9.x86 2.5 MB/s | 163 kB 00:00 2026-02-12T08:36:28.221 INFO:teuthology.orchestra.run.trial160.stdout:(9/158): ceph-osd-classic-20.3.0-5161.g2401a109 5.6 MB/s | 15 MB 00:02 2026-02-12T08:36:30.743 INFO:teuthology.orchestra.run.trial160.stdout:(10/158): ceph-base-20.3.0-5161.g2401a109.el9.x 608 kB/s | 5.1 MB 00:08 2026-02-12T08:36:32.765 INFO:teuthology.orchestra.run.trial181.stdout:(12/158): ceph-radosgw-20.3.0-5161.g2401a109.el 933 kB/s | 11 MB 00:12 2026-02-12T08:36:33.250 INFO:teuthology.orchestra.run.trial181.stdout:(13/158): ceph-selinux-20.3.0-5161.g2401a109.el 52 kB/s | 25 kB 00:00 2026-02-12T08:36:45.205 INFO:teuthology.orchestra.run.trial160.stdout:(11/158): ceph-common-20.3.0-5161.g2401a109.el9 924 kB/s | 21 MB 00:23 2026-02-12T08:36:55.578 INFO:teuthology.orchestra.run.trial160.stdout:(12/158): ceph-radosgw-20.3.0-5161.g2401a109.el 1.1 MB/s | 11 MB 00:10 2026-02-12T08:36:55.646 INFO:teuthology.orchestra.run.trial160.stdout:(13/158): ceph-selinux-20.3.0-5161.g2401a109.el 368 kB/s | 25 kB 00:00 2026-02-12T08:37:24.884 INFO:teuthology.orchestra.run.trial160.stdout:(14/158): ceph-osd-crimson-20.3.0-5161.g2401a10 1.5 MB/s | 87 MB 00:56 2026-02-12T08:37:24.946 INFO:teuthology.orchestra.run.trial160.stdout:(15/158): libcephfs-daemon-20.3.0-5161.g2401a10 567 kB/s | 35 kB 00:00 2026-02-12T08:37:25.007 INFO:teuthology.orchestra.run.trial160.stdout:(16/158): libcephfs-devel-20.3.0-5161.g2401a109 604 kB/s | 37 kB 00:00 2026-02-12T08:37:25.073 INFO:teuthology.orchestra.run.trial160.stdout:(17/158): libcephfs-proxy2-20.3.0-5161.g2401a10 370 kB/s | 24 kB 00:00 2026-02-12T08:37:25.825 INFO:teuthology.orchestra.run.trial160.stdout:(18/158): libcephfs2-20.3.0-5161.g2401a109.el9. 1.1 MB/s | 860 kB 00:00 2026-02-12T08:37:25.958 INFO:teuthology.orchestra.run.trial160.stdout:(19/158): libcephsqlite-20.3.0-5161.g2401a109.e 1.1 MB/s | 153 kB 00:00 2026-02-12T08:37:26.098 INFO:teuthology.orchestra.run.trial160.stdout:(20/158): librados-devel-20.3.0-5161.g2401a109. 886 kB/s | 124 kB 00:00 2026-02-12T08:37:26.293 INFO:teuthology.orchestra.run.trial160.stdout:(21/158): libradosstriper1-20.3.0-5161.g2401a10 1.3 MB/s | 263 kB 00:00 2026-02-12T08:37:29.877 INFO:teuthology.orchestra.run.trial160.stdout:(22/158): librgw2-20.3.0-5161.g2401a109.el9.x86 1.6 MB/s | 5.6 MB 00:03 2026-02-12T08:37:29.939 INFO:teuthology.orchestra.run.trial160.stdout:(23/158): python3-ceph-argparse-20.3.0-5161.g24 724 kB/s | 45 kB 00:00 2026-02-12T08:37:30.068 INFO:teuthology.orchestra.run.trial160.stdout:(24/158): python3-ceph-common-20.3.0-5161.g2401 1.4 MB/s | 184 kB 00:00 2026-02-12T08:37:30.196 INFO:teuthology.orchestra.run.trial160.stdout:(25/158): python3-cephfs-20.3.0-5161.g2401a109. 1.5 MB/s | 204 kB 00:00 2026-02-12T08:37:30.399 INFO:teuthology.orchestra.run.trial160.stdout:(26/158): python3-rados-20.3.0-5161.g2401a109.e 1.6 MB/s | 323 kB 00:00 2026-02-12T08:37:30.670 INFO:teuthology.orchestra.run.trial160.stdout:(27/158): python3-rbd-20.3.0-5161.g2401a109.el9 1.1 MB/s | 305 kB 00:00 2026-02-12T08:37:30.805 INFO:teuthology.orchestra.run.trial160.stdout:(28/158): python3-rgw-20.3.0-5161.g2401a109.el9 740 kB/s | 100 kB 00:00 2026-02-12T08:37:30.876 INFO:teuthology.orchestra.run.trial160.stdout:(29/158): rbd-fuse-20.3.0-5161.g2401a109.el9.x8 1.2 MB/s | 87 kB 00:00 2026-02-12T08:37:32.771 INFO:teuthology.orchestra.run.trial160.stdout:(30/158): rbd-mirror-20.3.0-5161.g2401a109.el9. 1.4 MB/s | 2.6 MB 00:01 2026-02-12T08:37:32.905 INFO:teuthology.orchestra.run.trial160.stdout:(31/158): rbd-nbd-20.3.0-5161.g2401a109.el9.x86 1.2 MB/s | 166 kB 00:00 2026-02-12T08:37:32.973 INFO:teuthology.orchestra.run.trial160.stdout:(32/158): ceph-grafana-dashboards-20.3.0-5161.g 839 kB/s | 57 kB 00:00 2026-02-12T08:37:33.112 INFO:teuthology.orchestra.run.trial160.stdout:(33/158): ceph-mgr-cephadm-20.3.0-5161.g2401a10 1.3 MB/s | 183 kB 00:00 2026-02-12T08:37:44.319 INFO:teuthology.orchestra.run.trial181.stdout:(14/158): ceph-osd-crimson-20.3.0-5161.g2401a10 937 kB/s | 87 MB 01:34 2026-02-12T08:37:44.386 INFO:teuthology.orchestra.run.trial181.stdout:(15/158): libcephfs-daemon-20.3.0-5161.g2401a10 525 kB/s | 35 kB 00:00 2026-02-12T08:37:44.454 INFO:teuthology.orchestra.run.trial181.stdout:(16/158): libcephfs-devel-20.3.0-5161.g2401a109 549 kB/s | 37 kB 00:00 2026-02-12T08:37:44.522 INFO:teuthology.orchestra.run.trial181.stdout:(17/158): libcephfs-proxy2-20.3.0-5161.g2401a10 356 kB/s | 24 kB 00:00 2026-02-12T08:37:45.932 INFO:teuthology.orchestra.run.trial181.stdout:(18/158): libcephfs2-20.3.0-5161.g2401a109.el9. 609 kB/s | 860 kB 00:01 2026-02-12T08:37:46.340 INFO:teuthology.orchestra.run.trial181.stdout:(19/158): libcephsqlite-20.3.0-5161.g2401a109.e 376 kB/s | 153 kB 00:00 2026-02-12T08:37:46.618 INFO:teuthology.orchestra.run.trial181.stdout:(20/158): librados-devel-20.3.0-5161.g2401a109. 445 kB/s | 124 kB 00:00 2026-02-12T08:37:47.081 INFO:teuthology.orchestra.run.trial181.stdout:(21/158): libradosstriper1-20.3.0-5161.g2401a10 568 kB/s | 263 kB 00:00 2026-02-12T08:37:48.573 INFO:teuthology.orchestra.run.trial160.stdout:(34/158): ceph-mgr-dashboard-20.3.0-5161.g2401a 990 kB/s | 15 MB 00:15 2026-02-12T08:37:55.615 INFO:teuthology.orchestra.run.trial160.stdout:(35/158): ceph-mgr-diskprediction-local-20.3.0- 1.0 MB/s | 7.4 MB 00:07 2026-02-12T08:37:55.685 INFO:teuthology.orchestra.run.trial160.stdout:(36/158): ceph-mgr-k8sevents-20.3.0-5161.g2401a 316 kB/s | 22 kB 00:00 2026-02-12T08:37:56.002 INFO:teuthology.orchestra.run.trial181.stdout:(22/158): librgw2-20.3.0-5161.g2401a109.el9.x86 646 kB/s | 5.6 MB 00:08 2026-02-12T08:37:56.017 INFO:teuthology.orchestra.run.trial160.stdout:(37/158): ceph-mgr-modules-core-20.3.0-5161.g24 894 kB/s | 297 kB 00:00 2026-02-12T08:37:56.065 INFO:teuthology.orchestra.run.trial181.stdout:(23/158): python3-ceph-argparse-20.3.0-5161.g24 722 kB/s | 45 kB 00:00 2026-02-12T08:37:56.081 INFO:teuthology.orchestra.run.trial160.stdout:(38/158): ceph-mgr-rook-20.3.0-5161.g2401a109.e 791 kB/s | 50 kB 00:00 2026-02-12T08:37:56.145 INFO:teuthology.orchestra.run.trial160.stdout:(39/158): ceph-prometheus-alerts-20.3.0-5161.g2 272 kB/s | 17 kB 00:00 2026-02-12T08:37:56.322 INFO:teuthology.orchestra.run.trial181.stdout:(24/158): python3-ceph-common-20.3.0-5161.g2401 716 kB/s | 184 kB 00:00 2026-02-12T08:37:56.473 INFO:teuthology.orchestra.run.trial160.stdout:(40/158): ceph-volume-20.3.0-5161.g2401a109.el9 911 kB/s | 299 kB 00:00 2026-02-12T08:37:56.592 INFO:teuthology.orchestra.run.trial181.stdout:(25/158): python3-cephfs-20.3.0-5161.g2401a109. 756 kB/s | 204 kB 00:00 2026-02-12T08:37:57.003 INFO:teuthology.orchestra.run.trial181.stdout:(26/158): python3-rados-20.3.0-5161.g2401a109.e 786 kB/s | 323 kB 00:00 2026-02-12T08:37:57.387 INFO:teuthology.orchestra.run.trial160.stdout:(41/158): cephadm-20.3.0-5161.g2401a109.el9.noa 1.1 MB/s | 1.0 MB 00:00 2026-02-12T08:37:57.443 INFO:teuthology.orchestra.run.trial160.stdout:(42/158): cryptsetup-2.8.1-2.el9.x86_64.rpm 6.1 MB/s | 350 kB 00:00 2026-02-12T08:37:57.463 INFO:teuthology.orchestra.run.trial181.stdout:(27/158): python3-rbd-20.3.0-5161.g2401a109.el9 663 kB/s | 305 kB 00:00 2026-02-12T08:37:57.481 INFO:teuthology.orchestra.run.trial160.stdout:(43/158): hwloc-libs-2.4.1-6.el9.x86_64.rpm 56 MB/s | 2.1 MB 00:00 2026-02-12T08:37:57.490 INFO:teuthology.orchestra.run.trial160.stdout:(44/158): ledmon-libs-1.1.0-3.el9.x86_64.rpm 4.3 MB/s | 40 kB 00:00 2026-02-12T08:37:57.499 INFO:teuthology.orchestra.run.trial160.stdout:(45/158): libatomic-11.5.0-14.el9.x86_64.rpm 2.5 MB/s | 23 kB 00:00 2026-02-12T08:37:57.509 INFO:teuthology.orchestra.run.trial160.stdout:(46/158): libconfig-1.7.2-9.el9.x86_64.rpm 7.3 MB/s | 72 kB 00:00 2026-02-12T08:37:57.521 INFO:teuthology.orchestra.run.trial160.stdout:(47/158): libgfortran-11.5.0-14.el9.x86_64.rpm 63 MB/s | 794 kB 00:00 2026-02-12T08:37:57.532 INFO:teuthology.orchestra.run.trial160.stdout:(48/158): libquadmath-11.5.0-14.el9.x86_64.rpm 17 MB/s | 184 kB 00:00 2026-02-12T08:37:57.542 INFO:teuthology.orchestra.run.trial160.stdout:(49/158): lksctp-tools-1.0.19-2.el9.x86_64.rpm 9.3 MB/s | 94 kB 00:00 2026-02-12T08:37:57.551 INFO:teuthology.orchestra.run.trial160.stdout:(50/158): mailcap-2.1.49-5.el9.noarch.rpm 3.7 MB/s | 33 kB 00:00 2026-02-12T08:37:57.563 INFO:teuthology.orchestra.run.trial160.stdout:(51/158): nvme-cli-2.13-1.el9.x86_64.rpm 87 MB/s | 1.1 MB 00:00 2026-02-12T08:37:57.574 INFO:teuthology.orchestra.run.trial160.stdout:(52/158): pciutils-3.7.0-7.el9.x86_64.rpm 9.2 MB/s | 93 kB 00:00 2026-02-12T08:37:57.584 INFO:teuthology.orchestra.run.trial160.stdout:(53/158): python3-cffi-1.14.5-5.el9.x86_64.rpm 24 MB/s | 253 kB 00:00 2026-02-12T08:37:57.598 INFO:teuthology.orchestra.run.trial181.stdout:(28/158): python3-rgw-20.3.0-5161.g2401a109.el9 740 kB/s | 100 kB 00:00 2026-02-12T08:37:57.599 INFO:teuthology.orchestra.run.trial160.stdout:(54/158): python3-cryptography-36.0.1-5.el9.x86 87 MB/s | 1.2 MB 00:00 2026-02-12T08:37:57.609 INFO:teuthology.orchestra.run.trial160.stdout:(55/158): python3-ply-3.11-14.el9.noarch.rpm 9.7 MB/s | 106 kB 00:00 2026-02-12T08:37:57.620 INFO:teuthology.orchestra.run.trial160.stdout:(56/158): python3-pycparser-2.20-6.el9.noarch.r 12 MB/s | 135 kB 00:00 2026-02-12T08:37:57.632 INFO:teuthology.orchestra.run.trial160.stdout:(57/158): python3-pyparsing-2.4.7-9.el9.noarch. 13 MB/s | 150 kB 00:00 2026-02-12T08:37:57.643 INFO:teuthology.orchestra.run.trial160.stdout:(58/158): python3-requests-2.25.1-10.el9.noarch 11 MB/s | 126 kB 00:00 2026-02-12T08:37:57.654 INFO:teuthology.orchestra.run.trial160.stdout:(59/158): python3-urllib3-1.26.5-7.el9.noarch.r 19 MB/s | 218 kB 00:00 2026-02-12T08:37:57.666 INFO:teuthology.orchestra.run.trial160.stdout:(60/158): unzip-6.0-59.el9.x86_64.rpm 15 MB/s | 182 kB 00:00 2026-02-12T08:37:57.677 INFO:teuthology.orchestra.run.trial160.stdout:(61/158): zip-3.0-35.el9.x86_64.rpm 24 MB/s | 266 kB 00:00 2026-02-12T08:37:57.735 INFO:teuthology.orchestra.run.trial181.stdout:(29/158): rbd-fuse-20.3.0-5161.g2401a109.el9.x8 629 kB/s | 87 kB 00:00 2026-02-12T08:37:58.220 INFO:teuthology.orchestra.run.trial160.stdout:(62/158): boost-program-options-1.75.0-13.el9.x 192 kB/s | 104 kB 00:00 2026-02-12T08:37:58.299 INFO:teuthology.orchestra.run.trial160.stdout:(63/158): flexiblas-3.0.4-8.el9.x86_64.rpm 412 kB/s | 33 kB 00:00 2026-02-12T08:38:01.600 INFO:teuthology.orchestra.run.trial160.stdout:(64/158): flexiblas-netlib-3.0.4-8.el9.x86_64.r 927 kB/s | 3.0 MB 00:03 2026-02-12T08:38:01.680 INFO:teuthology.orchestra.run.trial160.stdout:(65/158): flexiblas-openblas-openmp-3.0.4-8.el9 228 kB/s | 18 kB 00:00 2026-02-12T08:38:02.284 INFO:teuthology.orchestra.run.trial160.stdout:(66/158): libasan8-15.1.1-2.5.el9.x86_64.rpm 867 kB/s | 523 kB 00:00 2026-02-12T08:38:02.333 INFO:teuthology.orchestra.run.trial181.stdout:(30/158): rbd-mirror-20.3.0-5161.g2401a109.el9. 577 kB/s | 2.6 MB 00:04 2026-02-12T08:38:02.513 INFO:teuthology.orchestra.run.trial160.stdout:(67/158): libnbd-1.20.3-4.el9.x86_64.rpm 714 kB/s | 164 kB 00:00 2026-02-12T08:38:02.584 INFO:teuthology.orchestra.run.trial181.stdout:(31/158): rbd-nbd-20.3.0-5161.g2401a109.el9.x86 662 kB/s | 166 kB 00:00 2026-02-12T08:38:02.743 INFO:teuthology.orchestra.run.trial160.stdout:(68/158): libpmemobj-1.12.1-1.el9.x86_64.rpm 699 kB/s | 160 kB 00:00 2026-02-12T08:38:02.823 INFO:teuthology.orchestra.run.trial160.stdout:(69/158): librabbitmq-0.11.0-7.el9.x86_64.rpm 566 kB/s | 45 kB 00:00 2026-02-12T08:38:02.871 INFO:teuthology.orchestra.run.trial181.stdout:(32/158): ceph-grafana-dashboards-20.3.0-5161.g 199 kB/s | 57 kB 00:00 2026-02-12T08:38:03.213 INFO:teuthology.orchestra.run.trial181.stdout:(33/158): ceph-mgr-cephadm-20.3.0-5161.g2401a10 537 kB/s | 183 kB 00:00 2026-02-12T08:38:03.577 INFO:teuthology.orchestra.run.trial160.stdout:(70/158): librdkafka-1.6.1-102.el9.x86_64.rpm 878 kB/s | 662 kB 00:00 2026-02-12T08:38:03.881 INFO:teuthology.orchestra.run.trial160.stdout:(71/158): libstoragemgmt-1.10.1-1.el9.x86_64.rp 811 kB/s | 246 kB 00:00 2026-02-12T08:38:04.110 INFO:teuthology.orchestra.run.trial160.stdout:(72/158): libubsan-11.5.0-14.el9.x86_64.rpm 768 kB/s | 176 kB 00:00 2026-02-12T08:38:04.415 INFO:teuthology.orchestra.run.trial160.stdout:(73/158): libxslt-1.1.34-12.el9.x86_64.rpm 766 kB/s | 233 kB 00:00 2026-02-12T08:38:04.794 INFO:teuthology.orchestra.run.trial160.stdout:(74/158): lttng-ust-2.12.0-6.el9.x86_64.rpm 771 kB/s | 292 kB 00:00 2026-02-12T08:38:05.024 INFO:teuthology.orchestra.run.trial160.stdout:(75/158): lua-5.4.4-4.el9.x86_64.rpm 821 kB/s | 188 kB 00:00 2026-02-12T08:38:05.103 INFO:teuthology.orchestra.run.trial160.stdout:(76/158): openblas-0.3.29-1.el9.x86_64.rpm 529 kB/s | 42 kB 00:00 2026-02-12T08:38:10.909 INFO:teuthology.orchestra.run.trial160.stdout:(77/158): openblas-openmp-0.3.29-1.el9.x86_64.r 933 kB/s | 5.3 MB 00:05 2026-02-12T08:38:12.075 INFO:teuthology.orchestra.run.trial160.stdout:(78/158): protobuf-3.14.0-17.el9.x86_64.rpm 880 kB/s | 1.0 MB 00:01 2026-02-12T08:38:18.629 INFO:teuthology.orchestra.run.trial160.stdout:(79/158): python3-babel-2.9.1-2.el9.noarch.rpm 932 kB/s | 6.0 MB 00:06 2026-02-12T08:38:18.937 INFO:teuthology.orchestra.run.trial160.stdout:(80/158): python3-devel-3.9.25-2.el9.x86_64.rpm 794 kB/s | 244 kB 00:00 2026-02-12T08:38:18.964 INFO:teuthology.orchestra.run.trial181.stdout:(34/158): ceph-mgr-dashboard-20.3.0-5161.g2401a 972 kB/s | 15 MB 00:15 2026-02-12T08:38:19.027 INFO:teuthology.orchestra.run.trial160.stdout:(81/158): python3-iniconfig-1.1.1-7.el9.noarch. 194 kB/s | 17 kB 00:00 2026-02-12T08:38:19.332 INFO:teuthology.orchestra.run.trial160.stdout:(82/158): python3-jinja2-2.11.3-8.el9.noarch.rp 816 kB/s | 249 kB 00:00 2026-02-12T08:38:19.692 INFO:teuthology.orchestra.run.trial160.stdout:(83/158): python3-jmespath-1.0.1-1.el9.noarch.r 132 kB/s | 48 kB 00:00 2026-02-12T08:38:19.923 INFO:teuthology.orchestra.run.trial160.stdout:(84/158): python3-libstoragemgmt-1.10.1-1.el9.x 765 kB/s | 177 kB 00:00 2026-02-12T08:38:21.281 INFO:teuthology.orchestra.run.trial160.stdout:(85/158): python3-lxml-4.6.5-3.el9.x86_64.rpm 922 kB/s | 1.2 MB 00:01 2026-02-12T08:38:21.366 INFO:teuthology.orchestra.run.trial160.stdout:[MIRROR] python3-markupsafe-1.1.1-12.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-markupsafe-1.1.1-12.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T08:38:21.697 INFO:teuthology.orchestra.run.trial160.stdout:[MIRROR] python3-markupsafe-1.1.1-12.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-markupsafe-1.1.1-12.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T08:38:21.777 INFO:teuthology.orchestra.run.trial160.stdout:(86/158): python3-markupsafe-1.1.1-12.el9.x86_6 70 kB/s | 35 kB 00:00 2026-02-12T08:38:22.093 INFO:teuthology.orchestra.run.trial160.stdout:[MIRROR] python3-numpy-1.23.5-2.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-numpy-1.23.5-2.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T08:38:27.056 INFO:teuthology.orchestra.run.trial181.stdout:(35/158): ceph-mgr-diskprediction-local-20.3.0- 933 kB/s | 7.4 MB 00:08 2026-02-12T08:38:27.123 INFO:teuthology.orchestra.run.trial181.stdout:(36/158): ceph-mgr-k8sevents-20.3.0-5161.g2401a 332 kB/s | 22 kB 00:00 2026-02-12T08:38:27.469 INFO:teuthology.orchestra.run.trial181.stdout:(37/158): ceph-mgr-modules-core-20.3.0-5161.g24 857 kB/s | 297 kB 00:00 2026-02-12T08:38:27.541 INFO:teuthology.orchestra.run.trial181.stdout:(38/158): ceph-mgr-rook-20.3.0-5161.g2401a109.e 705 kB/s | 50 kB 00:00 2026-02-12T08:38:27.611 INFO:teuthology.orchestra.run.trial181.stdout:(39/158): ceph-prometheus-alerts-20.3.0-5161.g2 248 kB/s | 17 kB 00:00 2026-02-12T08:38:27.960 INFO:teuthology.orchestra.run.trial181.stdout:(40/158): ceph-volume-20.3.0-5161.g2401a109.el9 857 kB/s | 299 kB 00:00 2026-02-12T08:38:29.057 INFO:teuthology.orchestra.run.trial181.stdout:(41/158): cephadm-20.3.0-5161.g2401a109.el9.noa 948 kB/s | 1.0 MB 00:01 2026-02-12T08:38:29.224 INFO:teuthology.orchestra.run.trial181.stdout:(42/158): cryptsetup-2.8.1-2.el9.x86_64.rpm 2.0 MB/s | 350 kB 00:00 2026-02-12T08:38:29.324 INFO:teuthology.orchestra.run.trial181.stdout:(43/158): hwloc-libs-2.4.1-6.el9.x86_64.rpm 21 MB/s | 2.1 MB 00:00 2026-02-12T08:38:29.349 INFO:teuthology.orchestra.run.trial181.stdout:(44/158): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.6 MB/s | 40 kB 00:00 2026-02-12T08:38:29.374 INFO:teuthology.orchestra.run.trial181.stdout:(45/158): libatomic-11.5.0-14.el9.x86_64.rpm 928 kB/s | 23 kB 00:00 2026-02-12T08:38:29.375 INFO:teuthology.orchestra.run.trial160.stdout:(87/158): python3-numpy-1.23.5-2.el9.x86_64.rpm 826 kB/s | 6.1 MB 00:07 2026-02-12T08:38:29.399 INFO:teuthology.orchestra.run.trial181.stdout:(46/158): libconfig-1.7.2-9.el9.x86_64.rpm 2.8 MB/s | 72 kB 00:00 2026-02-12T08:38:29.430 INFO:teuthology.orchestra.run.trial181.stdout:(47/158): libgfortran-11.5.0-14.el9.x86_64.rpm 25 MB/s | 794 kB 00:00 2026-02-12T08:38:29.457 INFO:teuthology.orchestra.run.trial181.stdout:(48/158): libquadmath-11.5.0-14.el9.x86_64.rpm 6.8 MB/s | 184 kB 00:00 2026-02-12T08:38:29.483 INFO:teuthology.orchestra.run.trial181.stdout:(49/158): lksctp-tools-1.0.19-2.el9.x86_64.rpm 3.5 MB/s | 94 kB 00:00 2026-02-12T08:38:29.508 INFO:teuthology.orchestra.run.trial181.stdout:(50/158): mailcap-2.1.49-5.el9.noarch.rpm 1.3 MB/s | 33 kB 00:00 2026-02-12T08:38:29.541 INFO:teuthology.orchestra.run.trial181.stdout:(51/158): nvme-cli-2.13-1.el9.x86_64.rpm 33 MB/s | 1.1 MB 00:00 2026-02-12T08:38:29.567 INFO:teuthology.orchestra.run.trial181.stdout:(52/158): pciutils-3.7.0-7.el9.x86_64.rpm 3.5 MB/s | 93 kB 00:00 2026-02-12T08:38:29.593 INFO:teuthology.orchestra.run.trial181.stdout:(53/158): python3-cffi-1.14.5-5.el9.x86_64.rpm 9.4 MB/s | 253 kB 00:00 2026-02-12T08:38:29.615 INFO:teuthology.orchestra.run.trial160.stdout:(88/158): python3-numpy-f2py-1.23.5-2.el9.x86_6 1.8 MB/s | 442 kB 00:00 2026-02-12T08:38:29.629 INFO:teuthology.orchestra.run.trial181.stdout:(54/158): python3-cryptography-36.0.1-5.el9.x86 35 MB/s | 1.2 MB 00:00 2026-02-12T08:38:29.656 INFO:teuthology.orchestra.run.trial181.stdout:(55/158): python3-ply-3.11-14.el9.noarch.rpm 3.9 MB/s | 106 kB 00:00 2026-02-12T08:38:29.683 INFO:teuthology.orchestra.run.trial181.stdout:(56/158): python3-pycparser-2.20-6.el9.noarch.r 4.9 MB/s | 135 kB 00:00 2026-02-12T08:38:29.697 INFO:teuthology.orchestra.run.trial160.stdout:(89/158): python3-packaging-20.9-5.el9.noarch.r 936 kB/s | 77 kB 00:00 2026-02-12T08:38:29.710 INFO:teuthology.orchestra.run.trial181.stdout:(57/158): python3-pyparsing-2.4.7-9.el9.noarch. 5.5 MB/s | 150 kB 00:00 2026-02-12T08:38:29.737 INFO:teuthology.orchestra.run.trial181.stdout:(58/158): python3-requests-2.25.1-10.el9.noarch 4.5 MB/s | 126 kB 00:00 2026-02-12T08:38:29.764 INFO:teuthology.orchestra.run.trial181.stdout:(59/158): python3-urllib3-1.26.5-7.el9.noarch.r 7.8 MB/s | 218 kB 00:00 2026-02-12T08:38:29.792 INFO:teuthology.orchestra.run.trial181.stdout:(60/158): unzip-6.0-59.el9.x86_64.rpm 6.4 MB/s | 182 kB 00:00 2026-02-12T08:38:29.798 INFO:teuthology.orchestra.run.trial160.stdout:(90/158): python3-pluggy-0.13.1-7.el9.noarch.rp 412 kB/s | 41 kB 00:00 2026-02-12T08:38:29.820 INFO:teuthology.orchestra.run.trial181.stdout:(61/158): zip-3.0-35.el9.x86_64.rpm 9.5 MB/s | 266 kB 00:00 2026-02-12T08:38:29.881 INFO:teuthology.orchestra.run.trial160.stdout:(91/158): python3-protobuf-3.14.0-17.el9.noarch 3.2 MB/s | 267 kB 00:00 2026-02-12T08:38:29.884 INFO:teuthology.orchestra.run.trial181.stdout:(62/158): boost-program-options-1.75.0-13.el9.x 1.6 MB/s | 104 kB 00:00 2026-02-12T08:38:29.905 INFO:teuthology.orchestra.run.trial181.stdout:(63/158): flexiblas-3.0.4-8.el9.x86_64.rpm 1.5 MB/s | 33 kB 00:00 2026-02-12T08:38:29.996 INFO:teuthology.orchestra.run.trial160.stdout:(92/158): python3-py-1.10.0-6.el9.noarch.rpm 4.1 MB/s | 477 kB 00:00 2026-02-12T08:38:30.014 INFO:teuthology.orchestra.run.trial181.stdout:(64/158): flexiblas-netlib-3.0.4-8.el9.x86_64.r 27 MB/s | 3.0 MB 00:00 2026-02-12T08:38:30.036 INFO:teuthology.orchestra.run.trial181.stdout:(65/158): flexiblas-openblas-openmp-3.0.4-8.el9 844 kB/s | 18 kB 00:00 2026-02-12T08:38:30.060 INFO:teuthology.orchestra.run.trial181.stdout:(66/158): libasan8-15.1.1-2.5.el9.x86_64.rpm 21 MB/s | 523 kB 00:00 2026-02-12T08:38:30.084 INFO:teuthology.orchestra.run.trial181.stdout:(67/158): libnbd-1.20.3-4.el9.x86_64.rpm 6.9 MB/s | 164 kB 00:00 2026-02-12T08:38:30.107 INFO:teuthology.orchestra.run.trial181.stdout:(68/158): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.7 MB/s | 160 kB 00:00 2026-02-12T08:38:30.119 INFO:teuthology.orchestra.run.trial160.stdout:(93/158): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2026-02-12T08:38:30.129 INFO:teuthology.orchestra.run.trial181.stdout:(69/158): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-12T08:38:30.153 INFO:teuthology.orchestra.run.trial181.stdout:(70/158): librdkafka-1.6.1-102.el9.x86_64.rpm 27 MB/s | 662 kB 00:00 2026-02-12T08:38:30.176 INFO:teuthology.orchestra.run.trial181.stdout:(71/158): libstoragemgmt-1.10.1-1.el9.x86_64.rp 10 MB/s | 246 kB 00:00 2026-02-12T08:38:30.200 INFO:teuthology.orchestra.run.trial181.stdout:(72/158): libubsan-11.5.0-14.el9.x86_64.rpm 7.4 MB/s | 176 kB 00:00 2026-02-12T08:38:30.202 INFO:teuthology.orchestra.run.trial160.stdout:(94/158): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2026-02-12T08:38:30.223 INFO:teuthology.orchestra.run.trial181.stdout:(73/158): libxslt-1.1.34-12.el9.x86_64.rpm 9.7 MB/s | 233 kB 00:00 2026-02-12T08:38:30.247 INFO:teuthology.orchestra.run.trial181.stdout:(74/158): lttng-ust-2.12.0-6.el9.x86_64.rpm 12 MB/s | 292 kB 00:00 2026-02-12T08:38:30.271 INFO:teuthology.orchestra.run.trial181.stdout:(75/158): lua-5.4.4-4.el9.x86_64.rpm 7.9 MB/s | 188 kB 00:00 2026-02-12T08:38:30.293 INFO:teuthology.orchestra.run.trial181.stdout:(76/158): openblas-0.3.29-1.el9.x86_64.rpm 1.9 MB/s | 42 kB 00:00 2026-02-12T08:38:30.331 INFO:teuthology.orchestra.run.trial160.stdout:(95/158): python3-pytest-6.2.2-7.el9.noarch.rpm 3.9 MB/s | 519 kB 00:00 2026-02-12T08:38:30.366 INFO:teuthology.orchestra.run.trial181.stdout:(77/158): openblas-openmp-0.3.29-1.el9.x86_64.r 72 MB/s | 5.3 MB 00:00 2026-02-12T08:38:30.413 INFO:teuthology.orchestra.run.trial160.stdout:(96/158): python3-requests-oauthlib-1.3.0-12.el 655 kB/s | 54 kB 00:00 2026-02-12T08:38:30.554 INFO:teuthology.orchestra.run.trial181.stdout:(78/158): protobuf-3.14.0-17.el9.x86_64.rpm 5.4 MB/s | 1.0 MB 00:00 2026-02-12T08:38:30.649 INFO:teuthology.orchestra.run.trial181.stdout:(79/158): python3-babel-2.9.1-2.el9.noarch.rpm 63 MB/s | 6.0 MB 00:00 2026-02-12T08:38:30.674 INFO:teuthology.orchestra.run.trial181.stdout:(80/158): python3-devel-3.9.25-2.el9.x86_64.rpm 9.7 MB/s | 244 kB 00:00 2026-02-12T08:38:30.696 INFO:teuthology.orchestra.run.trial181.stdout:(81/158): python3-iniconfig-1.1.1-7.el9.noarch. 785 kB/s | 17 kB 00:00 2026-02-12T08:38:30.720 INFO:teuthology.orchestra.run.trial181.stdout:(82/158): python3-jinja2-2.11.3-8.el9.noarch.rp 10 MB/s | 249 kB 00:00 2026-02-12T08:38:30.743 INFO:teuthology.orchestra.run.trial181.stdout:(83/158): python3-jmespath-1.0.1-1.el9.noarch.r 2.1 MB/s | 48 kB 00:00 2026-02-12T08:38:30.766 INFO:teuthology.orchestra.run.trial181.stdout:(84/158): python3-libstoragemgmt-1.10.1-1.el9.x 7.4 MB/s | 177 kB 00:00 2026-02-12T08:38:30.793 INFO:teuthology.orchestra.run.trial181.stdout:(85/158): python3-lxml-4.6.5-3.el9.x86_64.rpm 45 MB/s | 1.2 MB 00:00 2026-02-12T08:38:30.815 INFO:teuthology.orchestra.run.trial181.stdout:(86/158): python3-markupsafe-1.1.1-12.el9.x86_6 1.5 MB/s | 35 kB 00:00 2026-02-12T08:38:30.909 INFO:teuthology.orchestra.run.trial181.stdout:(87/158): python3-numpy-1.23.5-2.el9.x86_64.rpm 66 MB/s | 6.1 MB 00:00 2026-02-12T08:38:30.934 INFO:teuthology.orchestra.run.trial181.stdout:(88/158): python3-numpy-f2py-1.23.5-2.el9.x86_6 17 MB/s | 442 kB 00:00 2026-02-12T08:38:30.957 INFO:teuthology.orchestra.run.trial181.stdout:(89/158): python3-packaging-20.9-5.el9.noarch.r 3.3 MB/s | 77 kB 00:00 2026-02-12T08:38:30.979 INFO:teuthology.orchestra.run.trial181.stdout:(90/158): python3-pluggy-0.13.1-7.el9.noarch.rp 1.8 MB/s | 41 kB 00:00 2026-02-12T08:38:31.002 INFO:teuthology.orchestra.run.trial181.stdout:(91/158): python3-protobuf-3.14.0-17.el9.noarch 12 MB/s | 267 kB 00:00 2026-02-12T08:38:31.027 INFO:teuthology.orchestra.run.trial181.stdout:(92/158): python3-py-1.10.0-6.el9.noarch.rpm 18 MB/s | 477 kB 00:00 2026-02-12T08:38:31.052 INFO:teuthology.orchestra.run.trial181.stdout:(93/158): python3-pyasn1-0.4.8-6.el9.noarch.rpm 6.3 MB/s | 159 kB 00:00 2026-02-12T08:38:31.076 INFO:teuthology.orchestra.run.trial181.stdout:(94/158): python3-pyasn1-modules-0.4.8-6.el9.no 11 MB/s | 279 kB 00:00 2026-02-12T08:38:31.108 INFO:teuthology.orchestra.run.trial181.stdout:(95/158): python3-pytest-6.2.2-7.el9.noarch.rpm 16 MB/s | 519 kB 00:00 2026-02-12T08:38:31.131 INFO:teuthology.orchestra.run.trial181.stdout:(96/158): python3-requests-oauthlib-1.3.0-12.el 2.3 MB/s | 54 kB 00:00 2026-02-12T08:38:31.393 INFO:teuthology.orchestra.run.trial181.stdout:(97/158): python3-scipy-1.9.3-2.el9.x86_64.rpm 74 MB/s | 19 MB 00:00 2026-02-12T08:38:31.416 INFO:teuthology.orchestra.run.trial181.stdout:(98/158): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-12T08:38:31.439 INFO:teuthology.orchestra.run.trial181.stdout:(99/158): qatlib-25.08.0-2.el9.x86_64.rpm 10 MB/s | 240 kB 00:00 2026-02-12T08:38:31.461 INFO:teuthology.orchestra.run.trial181.stdout:(100/158): qatlib-service-25.08.0-2.el9.x86_64. 1.7 MB/s | 37 kB 00:00 2026-02-12T08:38:31.483 INFO:teuthology.orchestra.run.trial181.stdout:(101/158): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.9 MB/s | 66 kB 00:00 2026-02-12T08:38:31.505 INFO:teuthology.orchestra.run.trial181.stdout:(102/158): socat-1.7.4.1-8.el9.x86_64.rpm 13 MB/s | 303 kB 00:00 2026-02-12T08:38:31.529 INFO:teuthology.orchestra.run.trial181.stdout:(103/158): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.9 MB/s | 189 kB 00:00 2026-02-12T08:38:31.551 INFO:teuthology.orchestra.run.trial181.stdout:(104/158): xmlsec1-openssl-1.2.29-13.el9.x86_64 4.0 MB/s | 90 kB 00:00 2026-02-12T08:38:31.573 INFO:teuthology.orchestra.run.trial181.stdout:(105/158): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.9 MB/s | 64 kB 00:00 2026-02-12T08:38:31.610 INFO:teuthology.orchestra.run.trial181.stdout:(106/158): lua-devel-5.4.4-4.el9.x86_64.rpm 614 kB/s | 22 kB 00:00 2026-02-12T08:38:31.657 INFO:teuthology.orchestra.run.trial181.stdout:(107/158): protobuf-compiler-3.14.0-17.el9.x86_ 18 MB/s | 862 kB 00:00 2026-02-12T08:38:31.685 INFO:teuthology.orchestra.run.trial160.stdout:(97/158): python3-scipy-1.9.3-2.el9.x86_64.rpm 15 MB/s | 19 MB 00:01 2026-02-12T08:38:31.768 INFO:teuthology.orchestra.run.trial160.stdout:(98/158): python3-toml-0.10.2-6.el9.noarch.rpm 505 kB/s | 42 kB 00:00 2026-02-12T08:38:31.850 INFO:teuthology.orchestra.run.trial160.stdout:(99/158): qatlib-25.08.0-2.el9.x86_64.rpm 2.8 MB/s | 240 kB 00:00 2026-02-12T08:38:31.861 INFO:teuthology.orchestra.run.trial181.stdout:(108/158): abseil-cpp-20211102.0-4.el9.x86_64.r 2.6 MB/s | 551 kB 00:00 2026-02-12T08:38:31.893 INFO:teuthology.orchestra.run.trial181.stdout:(109/158): gperftools-libs-2.9.1-3.el9.x86_64.r 9.4 MB/s | 308 kB 00:00 2026-02-12T08:38:31.917 INFO:teuthology.orchestra.run.trial181.stdout:(110/158): grpc-data-1.46.7-10.el9.noarch.rpm 809 kB/s | 19 kB 00:00 2026-02-12T08:38:31.934 INFO:teuthology.orchestra.run.trial160.stdout:(100/158): qatlib-service-25.08.0-2.el9.x86_64. 443 kB/s | 37 kB 00:00 2026-02-12T08:38:32.016 INFO:teuthology.orchestra.run.trial160.stdout:(101/158): qatzip-libs-1.3.1-1.el9.x86_64.rpm 812 kB/s | 66 kB 00:00 2026-02-12T08:38:32.021 INFO:teuthology.orchestra.run.trial181.stdout:(111/158): libarrow-9.0.0-15.el9.x86_64.rpm 43 MB/s | 4.4 MB 00:00 2026-02-12T08:38:32.045 INFO:teuthology.orchestra.run.trial181.stdout:(112/158): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.0 MB/s | 25 kB 00:00 2026-02-12T08:38:32.069 INFO:teuthology.orchestra.run.trial181.stdout:(113/158): liboath-2.6.12-1.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2026-02-12T08:38:32.093 INFO:teuthology.orchestra.run.trial181.stdout:(114/158): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2026-02-12T08:38:32.099 INFO:teuthology.orchestra.run.trial160.stdout:(102/158): socat-1.7.4.1-8.el9.x86_64.rpm 3.6 MB/s | 303 kB 00:00 2026-02-12T08:38:32.118 INFO:teuthology.orchestra.run.trial181.stdout:(115/158): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2026-02-12T08:38:32.146 INFO:teuthology.orchestra.run.trial181.stdout:(116/158): parquet-libs-9.0.0-15.el9.x86_64.rpm 30 MB/s | 838 kB 00:00 2026-02-12T08:38:32.172 INFO:teuthology.orchestra.run.trial181.stdout:(117/158): python3-asyncssh-2.13.2-5.el9.noarch 20 MB/s | 548 kB 00:00 2026-02-12T08:38:32.183 INFO:teuthology.orchestra.run.trial160.stdout:(103/158): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.2 MB/s | 189 kB 00:00 2026-02-12T08:38:32.196 INFO:teuthology.orchestra.run.trial181.stdout:(118/158): python3-autocommand-2.2.2-8.el9.noar 1.2 MB/s | 29 kB 00:00 2026-02-12T08:38:32.220 INFO:teuthology.orchestra.run.trial181.stdout:(119/158): python3-backports-tarfile-1.2.0-1.el 2.4 MB/s | 60 kB 00:00 2026-02-12T08:38:32.244 INFO:teuthology.orchestra.run.trial181.stdout:(120/158): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.8 MB/s | 43 kB 00:00 2026-02-12T08:38:32.266 INFO:teuthology.orchestra.run.trial160.stdout:(104/158): xmlsec1-openssl-1.2.29-13.el9.x86_64 1.1 MB/s | 90 kB 00:00 2026-02-12T08:38:32.268 INFO:teuthology.orchestra.run.trial181.stdout:(121/158): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2026-02-12T08:38:32.292 INFO:teuthology.orchestra.run.trial181.stdout:(122/158): python3-certifi-2023.05.07-4.el9.noa 592 kB/s | 14 kB 00:00 2026-02-12T08:38:32.317 INFO:teuthology.orchestra.run.trial181.stdout:(123/158): python3-cheroot-10.0.1-4.el9.noarch. 6.9 MB/s | 173 kB 00:00 2026-02-12T08:38:32.342 INFO:teuthology.orchestra.run.trial181.stdout:(124/158): python3-cherrypy-18.6.1-2.el9.noarch 14 MB/s | 358 kB 00:00 2026-02-12T08:38:32.348 INFO:teuthology.orchestra.run.trial160.stdout:(105/158): xmlstarlet-1.6.1-20.el9.x86_64.rpm 779 kB/s | 64 kB 00:00 2026-02-12T08:38:32.367 INFO:teuthology.orchestra.run.trial181.stdout:(125/158): python3-google-auth-2.45.0-1.el9.noa 10 MB/s | 254 kB 00:00 2026-02-12T08:38:32.401 INFO:teuthology.orchestra.run.trial181.stdout:(126/158): python3-grpcio-1.46.7-10.el9.x86_64. 61 MB/s | 2.0 MB 00:00 2026-02-12T08:38:32.425 INFO:teuthology.orchestra.run.trial181.stdout:(127/158): python3-grpcio-tools-1.46.7-10.el9.x 5.8 MB/s | 144 kB 00:00 2026-02-12T08:38:32.450 INFO:teuthology.orchestra.run.trial181.stdout:(128/158): python3-influxdb-5.3.1-1.el9.noarch. 5.6 MB/s | 139 kB 00:00 2026-02-12T08:38:32.465 INFO:teuthology.orchestra.run.trial160.stdout:(106/158): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2026-02-12T08:38:32.474 INFO:teuthology.orchestra.run.trial181.stdout:(129/158): python3-isodate-0.6.1-3.el9.noarch.r 2.3 MB/s | 56 kB 00:00 2026-02-12T08:38:32.498 INFO:teuthology.orchestra.run.trial181.stdout:(130/158): python3-jaraco-8.2.1-3.el9.noarch.rp 450 kB/s | 11 kB 00:00 2026-02-12T08:38:32.522 INFO:teuthology.orchestra.run.trial181.stdout:(131/158): python3-jaraco-classes-3.2.1-5.el9.n 741 kB/s | 18 kB 00:00 2026-02-12T08:38:32.546 INFO:teuthology.orchestra.run.trial181.stdout:(132/158): python3-jaraco-collections-3.0.0-8.e 970 kB/s | 23 kB 00:00 2026-02-12T08:38:32.566 INFO:teuthology.orchestra.run.trial160.stdout:(107/158): protobuf-compiler-3.14.0-17.el9.x86_ 8.3 MB/s | 862 kB 00:00 2026-02-12T08:38:32.570 INFO:teuthology.orchestra.run.trial181.stdout:(133/158): python3-jaraco-context-6.0.1-3.el9.n 823 kB/s | 20 kB 00:00 2026-02-12T08:38:32.593 INFO:teuthology.orchestra.run.trial181.stdout:(134/158): python3-jaraco-functools-3.5.0-2.el9 816 kB/s | 19 kB 00:00 2026-02-12T08:38:32.618 INFO:teuthology.orchestra.run.trial181.stdout:(135/158): python3-jaraco-text-4.0.0-2.el9.noar 1.1 MB/s | 26 kB 00:00 2026-02-12T08:38:32.647 INFO:teuthology.orchestra.run.trial181.stdout:(136/158): python3-kubernetes-26.1.0-3.el9.noar 35 MB/s | 1.0 MB 00:00 2026-02-12T08:38:32.673 INFO:teuthology.orchestra.run.trial181.stdout:(137/158): python3-more-itertools-8.12.0-2.el9. 3.0 MB/s | 79 kB 00:00 2026-02-12T08:38:32.697 INFO:teuthology.orchestra.run.trial181.stdout:(138/158): python3-msgpack-1.0.3-2.el9.x86_64.r 3.5 MB/s | 86 kB 00:00 2026-02-12T08:38:32.721 INFO:teuthology.orchestra.run.trial181.stdout:(139/158): python3-natsort-7.1.1-5.el9.noarch.r 2.4 MB/s | 58 kB 00:00 2026-02-12T08:38:32.745 INFO:teuthology.orchestra.run.trial181.stdout:(140/158): python3-portend-3.1.0-2.el9.noarch.r 687 kB/s | 16 kB 00:00 2026-02-12T08:38:32.769 INFO:teuthology.orchestra.run.trial181.stdout:(141/158): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2026-02-12T08:38:32.794 INFO:teuthology.orchestra.run.trial181.stdout:(142/158): python3-repoze-lru-0.7-16.el9.noarch 1.3 MB/s | 31 kB 00:00 2026-02-12T08:38:32.818 INFO:teuthology.orchestra.run.trial181.stdout:(143/158): python3-routes-2.5.1-5.el9.noarch.rp 7.5 MB/s | 188 kB 00:00 2026-02-12T08:38:32.843 INFO:teuthology.orchestra.run.trial181.stdout:(144/158): python3-rsa-4.9-2.el9.noarch.rpm 2.4 MB/s | 59 kB 00:00 2026-02-12T08:38:32.867 INFO:teuthology.orchestra.run.trial181.stdout:(145/158): python3-saml-1.16.0-1.el9.noarch.rpm 5.0 MB/s | 125 kB 00:00 2026-02-12T08:38:32.891 INFO:teuthology.orchestra.run.trial181.stdout:(146/158): python3-tempora-5.0.0-2.el9.noarch.r 1.5 MB/s | 36 kB 00:00 2026-02-12T08:38:32.916 INFO:teuthology.orchestra.run.trial181.stdout:(147/158): python3-typing-extensions-4.15.0-1.e 3.5 MB/s | 86 kB 00:00 2026-02-12T08:38:32.940 INFO:teuthology.orchestra.run.trial181.stdout:(148/158): python3-websocket-client-1.2.3-2.el9 3.6 MB/s | 90 kB 00:00 2026-02-12T08:38:32.964 INFO:teuthology.orchestra.run.trial181.stdout:(149/158): python3-xmlsec-1.3.13-1.el9.x86_64.r 2.0 MB/s | 48 kB 00:00 2026-02-12T08:38:32.988 INFO:teuthology.orchestra.run.trial181.stdout:(150/158): python3-xmltodict-0.12.0-15.el9.noar 923 kB/s | 22 kB 00:00 2026-02-12T08:38:33.012 INFO:teuthology.orchestra.run.trial181.stdout:(151/158): python3-zc-lockfile-2.0-10.el9.noarc 832 kB/s | 20 kB 00:00 2026-02-12T08:38:33.037 INFO:teuthology.orchestra.run.trial181.stdout:(152/158): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2026-02-12T08:38:33.061 INFO:teuthology.orchestra.run.trial160.stdout:(108/158): abseil-cpp-20211102.0-4.el9.x86_64.r 1.1 MB/s | 551 kB 00:00 2026-02-12T08:38:33.068 INFO:teuthology.orchestra.run.trial181.stdout:(153/158): thrift-0.15.0-4.el9.x86_64.rpm 51 MB/s | 1.6 MB 00:00 2026-02-12T08:38:33.093 INFO:teuthology.orchestra.run.trial181.stdout:(154/158): yaml-cpp-0.6.3-5.el9.x86_64.rpm 4.9 MB/s | 122 kB 00:00 2026-02-12T08:38:33.134 INFO:teuthology.orchestra.run.trial160.stdout:(109/158): gperftools-libs-2.9.1-3.el9.x86_64.r 4.1 MB/s | 308 kB 00:00 2026-02-12T08:38:33.204 INFO:teuthology.orchestra.run.trial160.stdout:(110/158): grpc-data-1.46.7-10.el9.noarch.rpm 278 kB/s | 19 kB 00:00 2026-02-12T08:38:33.486 INFO:teuthology.orchestra.run.trial160.stdout:(111/158): libarrow-9.0.0-15.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2026-02-12T08:38:33.556 INFO:teuthology.orchestra.run.trial160.stdout:(112/158): libarrow-doc-9.0.0-15.el9.noarch.rpm 353 kB/s | 25 kB 00:00 2026-02-12T08:38:33.627 INFO:teuthology.orchestra.run.trial160.stdout:(113/158): liboath-2.6.12-1.el9.x86_64.rpm 696 kB/s | 49 kB 00:00 2026-02-12T08:38:33.698 INFO:teuthology.orchestra.run.trial160.stdout:(114/158): libunwind-1.6.2-1.el9.x86_64.rpm 949 kB/s | 67 kB 00:00 2026-02-12T08:38:33.771 INFO:teuthology.orchestra.run.trial160.stdout:(115/158): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2026-02-12T08:38:33.857 INFO:teuthology.orchestra.run.trial160.stdout:(116/158): parquet-libs-9.0.0-15.el9.x86_64.rpm 9.5 MB/s | 838 kB 00:00 2026-02-12T08:38:33.932 INFO:teuthology.orchestra.run.trial160.stdout:(117/158): python3-asyncssh-2.13.2-5.el9.noarch 7.2 MB/s | 548 kB 00:00 2026-02-12T08:38:34.003 INFO:teuthology.orchestra.run.trial160.stdout:(118/158): python3-autocommand-2.2.2-8.el9.noar 417 kB/s | 29 kB 00:00 2026-02-12T08:38:34.074 INFO:teuthology.orchestra.run.trial160.stdout:(119/158): python3-backports-tarfile-1.2.0-1.el 845 kB/s | 60 kB 00:00 2026-02-12T08:38:34.145 INFO:teuthology.orchestra.run.trial160.stdout:(120/158): python3-bcrypt-3.2.2-1.el9.x86_64.rp 614 kB/s | 43 kB 00:00 2026-02-12T08:38:34.215 INFO:teuthology.orchestra.run.trial160.stdout:(121/158): python3-cachetools-4.2.4-1.el9.noarc 458 kB/s | 32 kB 00:00 2026-02-12T08:38:34.285 INFO:teuthology.orchestra.run.trial160.stdout:(122/158): python3-certifi-2023.05.07-4.el9.noa 201 kB/s | 14 kB 00:00 2026-02-12T08:38:34.358 INFO:teuthology.orchestra.run.trial160.stdout:(123/158): python3-cheroot-10.0.1-4.el9.noarch. 2.3 MB/s | 173 kB 00:00 2026-02-12T08:38:34.435 INFO:teuthology.orchestra.run.trial160.stdout:(124/158): python3-cherrypy-18.6.1-2.el9.noarch 4.5 MB/s | 358 kB 00:00 2026-02-12T08:38:34.508 INFO:teuthology.orchestra.run.trial160.stdout:(125/158): python3-google-auth-2.45.0-1.el9.noa 3.4 MB/s | 254 kB 00:00 2026-02-12T08:38:34.619 INFO:teuthology.orchestra.run.trial160.stdout:(126/158): python3-grpcio-1.46.7-10.el9.x86_64. 18 MB/s | 2.0 MB 00:00 2026-02-12T08:38:34.692 INFO:teuthology.orchestra.run.trial160.stdout:(127/158): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2026-02-12T08:38:34.766 INFO:teuthology.orchestra.run.trial160.stdout:(128/158): python3-influxdb-5.3.1-1.el9.noarch. 1.8 MB/s | 139 kB 00:00 2026-02-12T08:38:34.837 INFO:teuthology.orchestra.run.trial160.stdout:(129/158): python3-isodate-0.6.1-3.el9.noarch.r 789 kB/s | 56 kB 00:00 2026-02-12T08:38:34.907 INFO:teuthology.orchestra.run.trial160.stdout:(130/158): python3-jaraco-8.2.1-3.el9.noarch.rp 152 kB/s | 11 kB 00:00 2026-02-12T08:38:34.978 INFO:teuthology.orchestra.run.trial160.stdout:(131/158): python3-jaraco-classes-3.2.1-5.el9.n 251 kB/s | 18 kB 00:00 2026-02-12T08:38:35.049 INFO:teuthology.orchestra.run.trial160.stdout:(132/158): python3-jaraco-collections-3.0.0-8.e 327 kB/s | 23 kB 00:00 2026-02-12T08:38:35.119 INFO:teuthology.orchestra.run.trial160.stdout:(133/158): python3-jaraco-context-6.0.1-3.el9.n 279 kB/s | 20 kB 00:00 2026-02-12T08:38:35.190 INFO:teuthology.orchestra.run.trial160.stdout:(134/158): python3-jaraco-functools-3.5.0-2.el9 276 kB/s | 19 kB 00:00 2026-02-12T08:38:35.260 INFO:teuthology.orchestra.run.trial160.stdout:(135/158): python3-jaraco-text-4.0.0-2.el9.noar 376 kB/s | 26 kB 00:00 2026-02-12T08:38:35.336 INFO:teuthology.orchestra.run.trial160.stdout:(136/158): python3-kubernetes-26.1.0-3.el9.noar 14 MB/s | 1.0 MB 00:00 2026-02-12T08:38:35.407 INFO:teuthology.orchestra.run.trial160.stdout:(137/158): python3-more-itertools-8.12.0-2.el9. 1.1 MB/s | 79 kB 00:00 2026-02-12T08:38:35.478 INFO:teuthology.orchestra.run.trial160.stdout:(138/158): python3-msgpack-1.0.3-2.el9.x86_64.r 1.2 MB/s | 86 kB 00:00 2026-02-12T08:38:35.549 INFO:teuthology.orchestra.run.trial160.stdout:(139/158): python3-natsort-7.1.1-5.el9.noarch.r 812 kB/s | 58 kB 00:00 2026-02-12T08:38:35.619 INFO:teuthology.orchestra.run.trial160.stdout:(140/158): python3-portend-3.1.0-2.el9.noarch.r 234 kB/s | 16 kB 00:00 2026-02-12T08:38:35.690 INFO:teuthology.orchestra.run.trial160.stdout:(141/158): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2026-02-12T08:38:35.761 INFO:teuthology.orchestra.run.trial160.stdout:(142/158): python3-repoze-lru-0.7-16.el9.noarch 435 kB/s | 31 kB 00:00 2026-02-12T08:38:35.834 INFO:teuthology.orchestra.run.trial160.stdout:(143/158): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2026-02-12T08:38:35.905 INFO:teuthology.orchestra.run.trial160.stdout:(144/158): python3-rsa-4.9-2.el9.noarch.rpm 829 kB/s | 59 kB 00:00 2026-02-12T08:38:35.977 INFO:teuthology.orchestra.run.trial160.stdout:(145/158): python3-saml-1.16.0-1.el9.noarch.rpm 1.7 MB/s | 125 kB 00:00 2026-02-12T08:38:36.047 INFO:teuthology.orchestra.run.trial160.stdout:(146/158): python3-tempora-5.0.0-2.el9.noarch.r 506 kB/s | 36 kB 00:00 2026-02-12T08:38:36.123 INFO:teuthology.orchestra.run.trial160.stdout:(147/158): python3-typing-extensions-4.15.0-1.e 1.1 MB/s | 86 kB 00:00 2026-02-12T08:38:36.194 INFO:teuthology.orchestra.run.trial160.stdout:(148/158): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2026-02-12T08:38:36.265 INFO:teuthology.orchestra.run.trial160.stdout:(149/158): python3-xmlsec-1.3.13-1.el9.x86_64.r 681 kB/s | 48 kB 00:00 2026-02-12T08:38:36.336 INFO:teuthology.orchestra.run.trial160.stdout:(150/158): python3-xmltodict-0.12.0-15.el9.noar 315 kB/s | 22 kB 00:00 2026-02-12T08:38:36.406 INFO:teuthology.orchestra.run.trial160.stdout:(151/158): python3-zc-lockfile-2.0-10.el9.noarc 283 kB/s | 20 kB 00:00 2026-02-12T08:38:36.423 INFO:teuthology.orchestra.run.trial181.stdout:(155/158): librados2-20.3.0-5161.g2401a109.el9. 1.0 MB/s | 3.3 MB 00:03 2026-02-12T08:38:36.478 INFO:teuthology.orchestra.run.trial160.stdout:(152/158): re2-20211101-20.el9.x86_64.rpm 2.6 MB/s | 191 kB 00:00 2026-02-12T08:38:36.580 INFO:teuthology.orchestra.run.trial160.stdout:(153/158): thrift-0.15.0-4.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2026-02-12T08:38:36.652 INFO:teuthology.orchestra.run.trial160.stdout:(154/158): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.7 MB/s | 122 kB 00:00 2026-02-12T08:38:38.650 INFO:teuthology.orchestra.run.trial181.stdout:(156/158): librbd1-20.3.0-5161.g2401a109.el9.x8 1.2 MB/s | 2.7 MB 00:02 2026-02-12T08:38:39.212 INFO:teuthology.orchestra.run.trial160.stdout:(155/158): librados2-20.3.0-5161.g2401a109.el9. 1.3 MB/s | 3.3 MB 00:02 2026-02-12T08:38:40.798 INFO:teuthology.orchestra.run.trial160.stdout:(156/158): librbd1-20.3.0-5161.g2401a109.el9.x8 1.7 MB/s | 2.7 MB 00:01 2026-02-12T08:39:02.702 INFO:teuthology.orchestra.run.trial181.stdout:(157/158): ceph-test-20.3.0-5161.g2401a109.el9. 863 kB/s | 126 MB 02:29 2026-02-12T08:39:02.974 INFO:teuthology.orchestra.run.trial160.stdout:(157/158): ceph-test-20.3.0-5161.g2401a109.el9. 1.0 MB/s | 126 MB 02:07 2026-02-12T08:42:51.137 INFO:teuthology.orchestra.run.trial181.stdout:(158/158): ceph-osd-crimson-debuginfo-20.3.0-51 1.1 MB/s | 429 MB 06:33 2026-02-12T08:42:51.139 INFO:teuthology.orchestra.run.trial181.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:42:51.139 INFO:teuthology.orchestra.run.trial181.stdout:Total 2.0 MB/s | 826 MB 06:51 2026-02-12T08:42:51.688 INFO:teuthology.orchestra.run.trial181.stdout:Running transaction check 2026-02-12T08:42:51.741 INFO:teuthology.orchestra.run.trial181.stdout:Transaction check succeeded. 2026-02-12T08:42:51.741 INFO:teuthology.orchestra.run.trial181.stdout:Running transaction test 2026-02-12T08:42:54.378 INFO:teuthology.orchestra.run.trial181.stdout:Transaction test succeeded. 2026-02-12T08:42:54.378 INFO:teuthology.orchestra.run.trial181.stdout:Running transaction 2026-02-12T08:42:57.084 INFO:teuthology.orchestra.run.trial181.stdout: Preparing : 1/1 2026-02-12T08:42:57.087 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/160 2026-02-12T08:42:57.095 INFO:teuthology.orchestra.run.trial181.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/160 2026-02-12T08:42:57.107 INFO:teuthology.orchestra.run.trial181.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/160 2026-02-12T08:42:57.251 INFO:teuthology.orchestra.run.trial181.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/160 2026-02-12T08:42:57.254 INFO:teuthology.orchestra.run.trial181.stdout: Upgrading : librados2-2:20.3.0-5161.g2401a109.el9.x86_64 5/160 2026-02-12T08:42:57.301 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: librados2-2:20.3.0-5161.g2401a109.el9.x86_64 5/160 2026-02-12T08:42:57.302 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 6/160 2026-02-12T08:42:57.314 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 6/160 2026-02-12T08:42:57.316 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libcephfs-daemon-2:20.3.0-5161.g2401a109.el9.x86 7/160 2026-02-12T08:42:57.317 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86 8/160 2026-02-12T08:42:57.342 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86 8/160 2026-02-12T08:42:57.348 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 9/160 2026-02-12T08:42:57.356 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 10/160 2026-02-12T08:42:57.358 INFO:teuthology.orchestra.run.trial181.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 11/160 2026-02-12T08:42:57.361 INFO:teuthology.orchestra.run.trial181.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 12/160 2026-02-12T08:42:57.363 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 13/160 2026-02-12T08:42:57.367 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 14/160 2026-02-12T08:42:57.485 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 15/160 2026-02-12T08:42:57.486 INFO:teuthology.orchestra.run.trial181.stdout: Upgrading : librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 16/160 2026-02-12T08:42:57.532 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 16/160 2026-02-12T08:42:57.538 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 17/160 2026-02-12T08:42:57.546 INFO:teuthology.orchestra.run.trial181.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 18/160 2026-02-12T08:42:57.547 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 19/160 2026-02-12T08:42:57.569 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 19/160 2026-02-12T08:42:57.570 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86 20/160 2026-02-12T08:42:57.581 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86 20/160 2026-02-12T08:42:57.584 INFO:teuthology.orchestra.run.trial181.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 21/160 2026-02-12T08:42:57.615 INFO:teuthology.orchestra.run.trial181.stdout: Installing : re2-1:20211101-20.el9.x86_64 22/160 2026-02-12T08:42:57.620 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 23/160 2026-02-12T08:42:57.624 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 24/160 2026-02-12T08:42:57.645 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 25/160 2026-02-12T08:42:57.650 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/160 2026-02-12T08:42:57.653 INFO:teuthology.orchestra.run.trial181.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/160 2026-02-12T08:42:57.657 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 28/160 2026-02-12T08:42:57.658 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libasan8-15.1.1-2.5.el9.x86_64 29/160 2026-02-12T08:42:57.669 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: libasan8-15.1.1-2.5.el9.x86_64 29/160 2026-02-12T08:42:57.674 INFO:teuthology.orchestra.run.trial181.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/160 2026-02-12T08:42:57.697 INFO:teuthology.orchestra.run.trial181.stdout: Installing : unzip-6.0-59.el9.x86_64 31/160 2026-02-12T08:42:57.710 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 32/160 2026-02-12T08:42:57.716 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 33/160 2026-02-12T08:42:57.719 INFO:teuthology.orchestra.run.trial181.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 34/160 2026-02-12T08:42:57.725 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 35/160 2026-02-12T08:42:57.727 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 36/160 2026-02-12T08:42:57.728 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 37/160 2026-02-12T08:42:57.738 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 38/160 2026-02-12T08:42:57.772 INFO:teuthology.orchestra.run.trial181.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 39/160 2026-02-12T08:42:57.777 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-ceph-common-2:20.3.0-5161.g2401a109.el9. 40/160 2026-02-12T08:42:57.788 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-ceph-argparse-2:20.3.0-5161.g2401a109.el 41/160 2026-02-12T08:42:57.799 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_6 42/160 2026-02-12T08:42:57.805 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 43/160 2026-02-12T08:42:57.829 INFO:teuthology.orchestra.run.trial181.stdout: Installing : zip-3.0-35.el9.x86_64 44/160 2026-02-12T08:42:57.832 INFO:teuthology.orchestra.run.trial181.stdout: Installing : luarocks-3.9.2-5.el9.noarch 45/160 2026-02-12T08:42:57.883 INFO:teuthology.orchestra.run.trial181.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 46/160 2026-02-12T08:42:57.895 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/160 2026-02-12T08:42:57.903 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/160 2026-02-12T08:42:57.906 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/160 2026-02-12T08:42:57.908 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/160 2026-02-12T08:42:57.912 INFO:teuthology.orchestra.run.trial181.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 51/160 2026-02-12T08:42:57.929 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 52/160 2026-02-12T08:42:57.934 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 53/160 2026-02-12T08:42:57.937 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/160 2026-02-12T08:42:57.945 INFO:teuthology.orchestra.run.trial181.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 55/160 2026-02-12T08:42:57.952 INFO:teuthology.orchestra.run.trial181.stdout: Installing : librados-devel-2:20.3.0-5161.g2401a109.el9.x86_6 56/160 2026-02-12T08:42:57.964 INFO:teuthology.orchestra.run.trial181.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 57/160 2026-02-12T08:42:57.968 INFO:teuthology.orchestra.run.trial181.stdout: Installing : thrift-0.15.0-4.el9.x86_64 58/160 2026-02-12T08:42:57.972 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 59/160 2026-02-12T08:42:57.986 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 60/160 2026-02-12T08:42:57.991 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 61/160 2026-02-12T08:42:57.995 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 62/160 2026-02-12T08:42:58.007 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 63/160 2026-02-12T08:42:58.016 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 64/160 2026-02-12T08:42:58.022 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 65/160 2026-02-12T08:42:58.041 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 66/160 2026-02-12T08:42:58.052 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 67/160 2026-02-12T08:42:58.068 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 68/160 2026-02-12T08:42:58.072 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 69/160 2026-02-12T08:42:58.080 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/160 2026-02-12T08:42:58.120 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/160 2026-02-12T08:42:58.446 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/160 2026-02-12T08:42:58.456 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/160 2026-02-12T08:42:58.460 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/160 2026-02-12T08:42:58.465 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/160 2026-02-12T08:42:58.471 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/160 2026-02-12T08:42:58.475 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 77/160 2026-02-12T08:42:58.480 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/160 2026-02-12T08:42:58.486 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 79/160 2026-02-12T08:42:58.488 INFO:teuthology.orchestra.run.trial181.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 80/160 2026-02-12T08:42:58.489 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 81/160 2026-02-12T08:42:58.518 INFO:teuthology.orchestra.run.trial181.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 82/160 2026-02-12T08:42:58.562 INFO:teuthology.orchestra.run.trial181.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 83/160 2026-02-12T08:42:58.572 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 84/160 2026-02-12T08:42:58.618 INFO:teuthology.orchestra.run.trial181.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 85/160 2026-02-12T08:42:58.647 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-py-1.10.0-6.el9.noarch 86/160 2026-02-12T08:42:58.657 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 87/160 2026-02-12T08:42:58.664 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 88/160 2026-02-12T08:42:58.669 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-pluggy-0.13.1-7.el9.noarch 89/160 2026-02-12T08:42:58.676 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 90/160 2026-02-12T08:42:58.680 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 91/160 2026-02-12T08:42:58.714 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-iniconfig-1.1.1-7.el9.noarch 92/160 2026-02-12T08:42:58.939 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 93/160 2026-02-12T08:42:58.963 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 94/160 2026-02-12T08:42:58.967 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 95/160 2026-02-12T08:42:59.025 INFO:teuthology.orchestra.run.trial181.stdout: Installing : openblas-0.3.29-1.el9.x86_64 96/160 2026-02-12T08:42:59.026 INFO:teuthology.orchestra.run.trial181.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 97/160 2026-02-12T08:42:59.047 INFO:teuthology.orchestra.run.trial181.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/160 2026-02-12T08:42:59.374 INFO:teuthology.orchestra.run.trial181.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/160 2026-02-12T08:42:59.447 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 100/160 2026-02-12T08:43:00.121 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 101/160 2026-02-12T08:43:00.136 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 102/160 2026-02-12T08:43:00.142 INFO:teuthology.orchestra.run.trial181.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 103/160 2026-02-12T08:43:00.394 INFO:teuthology.orchestra.run.trial181.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 104/160 2026-02-12T08:43:00.396 INFO:teuthology.orchestra.run.trial181.stdout: Installing : librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 105/160 2026-02-12T08:43:00.414 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 105/160 2026-02-12T08:43:00.415 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 106/160 2026-02-12T08:43:01.371 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 107/160 2026-02-12T08:43:01.373 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 107/160 2026-02-12T08:43:01.392 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 107/160 2026-02-12T08:43:01.403 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 108/160 2026-02-12T08:43:01.411 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-packaging-20.9-5.el9.noarch 109/160 2026-02-12T08:43:01.424 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-ply-3.11-14.el9.noarch 110/160 2026-02-12T08:43:01.440 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 111/160 2026-02-12T08:43:01.516 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 112/160 2026-02-12T08:43:01.524 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 113/160 2026-02-12T08:43:01.548 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 114/160 2026-02-12T08:43:01.577 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 115/160 2026-02-12T08:43:01.628 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 116/160 2026-02-12T08:43:01.634 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 117/160 2026-02-12T08:43:01.638 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 118/160 2026-02-12T08:43:01.642 INFO:teuthology.orchestra.run.trial181.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 119/160 2026-02-12T08:43:01.645 INFO:teuthology.orchestra.run.trial181.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 120/160 2026-02-12T08:43:01.645 INFO:teuthology.orchestra.run.trial181.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 121/160 2026-02-12T08:43:01.662 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 121/160 2026-02-12T08:43:01.775 INFO:teuthology.orchestra.run.trial181.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 122/160 2026-02-12T08:43:01.777 INFO:teuthology.orchestra.run.trial181.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 123/160 2026-02-12T08:43:02.047 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 123/160 2026-02-12T08:43:02.047 INFO:teuthology.orchestra.run.trial181.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T08:43:02.047 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:43:02.310 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 124/160 2026-02-12T08:43:02.350 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 124/160 2026-02-12T08:43:02.350 INFO:teuthology.orchestra.run.trial181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T08:43:02.350 INFO:teuthology.orchestra.run.trial181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T08:43:02.351 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:43:02.354 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 125/160 2026-02-12T08:43:05.030 INFO:teuthology.orchestra.run.trial160.stdout:(158/158): ceph-osd-crimson-debuginfo-20.3.0-51 1.1 MB/s | 429 MB 06:34 2026-02-12T08:43:05.032 INFO:teuthology.orchestra.run.trial160.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:43:05.033 INFO:teuthology.orchestra.run.trial160.stdout:Total 2.0 MB/s | 826 MB 06:43 2026-02-12T08:43:05.573 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction check 2026-02-12T08:43:05.626 INFO:teuthology.orchestra.run.trial160.stdout:Transaction check succeeded. 2026-02-12T08:43:05.627 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction test 2026-02-12T08:43:07.074 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 125/160 2026-02-12T08:43:07.074 INFO:teuthology.orchestra.run.trial181.stdout:skipping the directory /sys 2026-02-12T08:43:07.074 INFO:teuthology.orchestra.run.trial181.stdout:skipping the directory /proc 2026-02-12T08:43:07.074 INFO:teuthology.orchestra.run.trial181.stdout:skipping the directory /mnt 2026-02-12T08:43:07.074 INFO:teuthology.orchestra.run.trial181.stdout:skipping the directory /var/tmp 2026-02-12T08:43:07.075 INFO:teuthology.orchestra.run.trial181.stdout:skipping the directory /home 2026-02-12T08:43:07.075 INFO:teuthology.orchestra.run.trial181.stdout:skipping the directory /root 2026-02-12T08:43:07.075 INFO:teuthology.orchestra.run.trial181.stdout:skipping the directory /tmp 2026-02-12T08:43:07.075 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:43:07.166 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 126/160 2026-02-12T08:43:07.188 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 126/160 2026-02-12T08:43:07.189 INFO:teuthology.orchestra.run.trial181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:07.189 INFO:teuthology.orchestra.run.trial181.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T08:43:07.189 INFO:teuthology.orchestra.run.trial181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T08:43:07.189 INFO:teuthology.orchestra.run.trial181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T08:43:07.189 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:43:07.398 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 127/160 2026-02-12T08:43:07.419 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 127/160 2026-02-12T08:43:07.419 INFO:teuthology.orchestra.run.trial181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:07.420 INFO:teuthology.orchestra.run.trial181.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T08:43:07.420 INFO:teuthology.orchestra.run.trial181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T08:43:07.420 INFO:teuthology.orchestra.run.trial181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T08:43:07.420 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:43:07.425 INFO:teuthology.orchestra.run.trial181.stdout: Installing : mailcap-2.1.49-5.el9.noarch 128/160 2026-02-12T08:43:07.427 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 129/160 2026-02-12T08:43:07.444 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 130/160 2026-02-12T08:43:07.444 INFO:teuthology.orchestra.run.trial181.stdout:Creating group 'qat' with GID 992. 2026-02-12T08:43:07.444 INFO:teuthology.orchestra.run.trial181.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T08:43:07.444 INFO:teuthology.orchestra.run.trial181.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T08:43:07.444 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:43:07.453 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 130/160 2026-02-12T08:43:07.476 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 130/160 2026-02-12T08:43:07.476 INFO:teuthology.orchestra.run.trial181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T08:43:07.476 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:43:07.510 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 131/160 2026-02-12T08:43:08.109 INFO:teuthology.orchestra.run.trial181.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 132/160 2026-02-12T08:43:08.267 INFO:teuthology.orchestra.run.trial160.stdout:Transaction test succeeded. 2026-02-12T08:43:08.268 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction 2026-02-12T08:43:10.981 INFO:teuthology.orchestra.run.trial160.stdout: Preparing : 1/1 2026-02-12T08:43:10.984 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/160 2026-02-12T08:43:10.992 INFO:teuthology.orchestra.run.trial160.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/160 2026-02-12T08:43:11.003 INFO:teuthology.orchestra.run.trial160.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/160 2026-02-12T08:43:11.145 INFO:teuthology.orchestra.run.trial160.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/160 2026-02-12T08:43:11.147 INFO:teuthology.orchestra.run.trial160.stdout: Upgrading : librados2-2:20.3.0-5161.g2401a109.el9.x86_64 5/160 2026-02-12T08:43:11.195 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: librados2-2:20.3.0-5161.g2401a109.el9.x86_64 5/160 2026-02-12T08:43:11.196 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 6/160 2026-02-12T08:43:11.207 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 6/160 2026-02-12T08:43:11.209 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libcephfs-daemon-2:20.3.0-5161.g2401a109.el9.x86 7/160 2026-02-12T08:43:11.210 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86 8/160 2026-02-12T08:43:11.236 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86 8/160 2026-02-12T08:43:11.242 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 9/160 2026-02-12T08:43:11.250 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 10/160 2026-02-12T08:43:11.252 INFO:teuthology.orchestra.run.trial160.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 11/160 2026-02-12T08:43:11.255 INFO:teuthology.orchestra.run.trial160.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 12/160 2026-02-12T08:43:11.257 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 13/160 2026-02-12T08:43:11.261 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 14/160 2026-02-12T08:43:11.376 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 15/160 2026-02-12T08:43:11.377 INFO:teuthology.orchestra.run.trial160.stdout: Upgrading : librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 16/160 2026-02-12T08:43:11.423 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 16/160 2026-02-12T08:43:11.430 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 17/160 2026-02-12T08:43:11.438 INFO:teuthology.orchestra.run.trial160.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 18/160 2026-02-12T08:43:11.439 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 19/160 2026-02-12T08:43:11.461 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 19/160 2026-02-12T08:43:11.462 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86 20/160 2026-02-12T08:43:11.473 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86 20/160 2026-02-12T08:43:11.476 INFO:teuthology.orchestra.run.trial160.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 21/160 2026-02-12T08:43:11.509 INFO:teuthology.orchestra.run.trial160.stdout: Installing : re2-1:20211101-20.el9.x86_64 22/160 2026-02-12T08:43:11.514 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 23/160 2026-02-12T08:43:11.518 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 24/160 2026-02-12T08:43:11.539 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 25/160 2026-02-12T08:43:11.544 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/160 2026-02-12T08:43:11.547 INFO:teuthology.orchestra.run.trial160.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/160 2026-02-12T08:43:11.551 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 28/160 2026-02-12T08:43:11.552 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libasan8-15.1.1-2.5.el9.x86_64 29/160 2026-02-12T08:43:11.563 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: libasan8-15.1.1-2.5.el9.x86_64 29/160 2026-02-12T08:43:11.567 INFO:teuthology.orchestra.run.trial160.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/160 2026-02-12T08:43:11.590 INFO:teuthology.orchestra.run.trial160.stdout: Installing : unzip-6.0-59.el9.x86_64 31/160 2026-02-12T08:43:11.603 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 32/160 2026-02-12T08:43:11.609 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 33/160 2026-02-12T08:43:11.613 INFO:teuthology.orchestra.run.trial160.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 34/160 2026-02-12T08:43:11.619 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 35/160 2026-02-12T08:43:11.620 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 36/160 2026-02-12T08:43:11.622 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 37/160 2026-02-12T08:43:11.632 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 38/160 2026-02-12T08:43:11.666 INFO:teuthology.orchestra.run.trial160.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 39/160 2026-02-12T08:43:11.670 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-ceph-common-2:20.3.0-5161.g2401a109.el9. 40/160 2026-02-12T08:43:11.682 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-ceph-argparse-2:20.3.0-5161.g2401a109.el 41/160 2026-02-12T08:43:11.693 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_6 42/160 2026-02-12T08:43:11.699 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 43/160 2026-02-12T08:43:11.723 INFO:teuthology.orchestra.run.trial160.stdout: Installing : zip-3.0-35.el9.x86_64 44/160 2026-02-12T08:43:11.726 INFO:teuthology.orchestra.run.trial160.stdout: Installing : luarocks-3.9.2-5.el9.noarch 45/160 2026-02-12T08:43:11.776 INFO:teuthology.orchestra.run.trial160.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 46/160 2026-02-12T08:43:11.789 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/160 2026-02-12T08:43:11.796 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/160 2026-02-12T08:43:11.800 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/160 2026-02-12T08:43:11.802 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/160 2026-02-12T08:43:11.806 INFO:teuthology.orchestra.run.trial160.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 51/160 2026-02-12T08:43:11.822 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 52/160 2026-02-12T08:43:11.827 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 53/160 2026-02-12T08:43:11.831 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/160 2026-02-12T08:43:11.838 INFO:teuthology.orchestra.run.trial160.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 55/160 2026-02-12T08:43:11.846 INFO:teuthology.orchestra.run.trial160.stdout: Installing : librados-devel-2:20.3.0-5161.g2401a109.el9.x86_6 56/160 2026-02-12T08:43:11.858 INFO:teuthology.orchestra.run.trial160.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 57/160 2026-02-12T08:43:11.862 INFO:teuthology.orchestra.run.trial160.stdout: Installing : thrift-0.15.0-4.el9.x86_64 58/160 2026-02-12T08:43:11.866 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 59/160 2026-02-12T08:43:11.880 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 60/160 2026-02-12T08:43:11.884 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 61/160 2026-02-12T08:43:11.889 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 62/160 2026-02-12T08:43:11.900 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 63/160 2026-02-12T08:43:11.909 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 64/160 2026-02-12T08:43:11.916 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 65/160 2026-02-12T08:43:11.935 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 66/160 2026-02-12T08:43:11.946 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 67/160 2026-02-12T08:43:11.962 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 68/160 2026-02-12T08:43:11.966 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 69/160 2026-02-12T08:43:11.974 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/160 2026-02-12T08:43:12.014 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/160 2026-02-12T08:43:12.339 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/160 2026-02-12T08:43:12.349 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/160 2026-02-12T08:43:12.353 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/160 2026-02-12T08:43:12.359 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/160 2026-02-12T08:43:12.365 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/160 2026-02-12T08:43:12.368 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 77/160 2026-02-12T08:43:12.371 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/160 2026-02-12T08:43:12.377 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 79/160 2026-02-12T08:43:12.379 INFO:teuthology.orchestra.run.trial160.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 80/160 2026-02-12T08:43:12.381 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 81/160 2026-02-12T08:43:12.410 INFO:teuthology.orchestra.run.trial160.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 82/160 2026-02-12T08:43:12.454 INFO:teuthology.orchestra.run.trial160.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 83/160 2026-02-12T08:43:12.463 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 84/160 2026-02-12T08:43:12.510 INFO:teuthology.orchestra.run.trial160.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 85/160 2026-02-12T08:43:12.539 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-py-1.10.0-6.el9.noarch 86/160 2026-02-12T08:43:12.548 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 87/160 2026-02-12T08:43:12.555 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 88/160 2026-02-12T08:43:12.561 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-pluggy-0.13.1-7.el9.noarch 89/160 2026-02-12T08:43:12.568 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 90/160 2026-02-12T08:43:12.572 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 91/160 2026-02-12T08:43:12.606 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-iniconfig-1.1.1-7.el9.noarch 92/160 2026-02-12T08:43:12.830 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 93/160 2026-02-12T08:43:12.854 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 94/160 2026-02-12T08:43:12.858 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 95/160 2026-02-12T08:43:12.917 INFO:teuthology.orchestra.run.trial160.stdout: Installing : openblas-0.3.29-1.el9.x86_64 96/160 2026-02-12T08:43:12.919 INFO:teuthology.orchestra.run.trial160.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 97/160 2026-02-12T08:43:12.940 INFO:teuthology.orchestra.run.trial160.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/160 2026-02-12T08:43:13.266 INFO:teuthology.orchestra.run.trial160.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/160 2026-02-12T08:43:13.339 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 100/160 2026-02-12T08:43:13.519 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86 133/160 2026-02-12T08:43:13.582 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86 134/160 2026-02-12T08:43:13.584 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 135/160 2026-02-12T08:43:13.598 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 135/160 2026-02-12T08:43:13.598 INFO:teuthology.orchestra.run.trial181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:13.598 INFO:teuthology.orchestra.run.trial181.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T08:43:13.598 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:43:13.609 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 136/160 2026-02-12T08:43:13.632 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 136/160 2026-02-12T08:43:13.632 INFO:teuthology.orchestra.run.trial181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:13.632 INFO:teuthology.orchestra.run.trial181.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T08:43:13.632 INFO:teuthology.orchestra.run.trial181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T08:43:13.633 INFO:teuthology.orchestra.run.trial181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T08:43:13.633 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:43:13.692 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: cephadm-2:20.3.0-5161.g2401a109.el9.noarch 137/160 2026-02-12T08:43:13.696 INFO:teuthology.orchestra.run.trial181.stdout: Installing : cephadm-2:20.3.0-5161.g2401a109.el9.noarch 137/160 2026-02-12T08:43:13.703 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5161.g2401a109.e 138/160 2026-02-12T08:43:13.726 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5161.g2401a109. 139/160 2026-02-12T08:43:13.727 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noa 140/160 2026-02-12T08:43:14.013 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 101/160 2026-02-12T08:43:14.027 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 102/160 2026-02-12T08:43:14.033 INFO:teuthology.orchestra.run.trial160.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 103/160 2026-02-12T08:43:14.285 INFO:teuthology.orchestra.run.trial160.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 104/160 2026-02-12T08:43:14.286 INFO:teuthology.orchestra.run.trial160.stdout: Installing : librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 105/160 2026-02-12T08:43:14.304 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 105/160 2026-02-12T08:43:14.305 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 106/160 2026-02-12T08:43:15.246 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 107/160 2026-02-12T08:43:15.248 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 107/160 2026-02-12T08:43:15.265 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 107/160 2026-02-12T08:43:15.276 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 108/160 2026-02-12T08:43:15.282 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-packaging-20.9-5.el9.noarch 109/160 2026-02-12T08:43:15.296 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-ply-3.11-14.el9.noarch 110/160 2026-02-12T08:43:15.305 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noa 140/160 2026-02-12T08:43:15.311 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 111/160 2026-02-12T08:43:15.312 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.n 141/160 2026-02-12T08:43:15.387 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 112/160 2026-02-12T08:43:15.396 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 113/160 2026-02-12T08:43:15.419 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 114/160 2026-02-12T08:43:15.449 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 115/160 2026-02-12T08:43:15.500 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 116/160 2026-02-12T08:43:15.506 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 117/160 2026-02-12T08:43:15.510 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 118/160 2026-02-12T08:43:15.514 INFO:teuthology.orchestra.run.trial160.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 119/160 2026-02-12T08:43:15.516 INFO:teuthology.orchestra.run.trial160.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 120/160 2026-02-12T08:43:15.517 INFO:teuthology.orchestra.run.trial160.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 121/160 2026-02-12T08:43:15.534 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 121/160 2026-02-12T08:43:15.648 INFO:teuthology.orchestra.run.trial160.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 122/160 2026-02-12T08:43:15.650 INFO:teuthology.orchestra.run.trial160.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 123/160 2026-02-12T08:43:15.769 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.n 141/160 2026-02-12T08:43:15.770 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5161.g240 142/160 2026-02-12T08:43:15.782 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5161.g240 142/160 2026-02-12T08:43:15.782 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.n 143/160 2026-02-12T08:43:15.844 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.n 143/160 2026-02-12T08:43:15.885 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5161.g2401a109.el 144/160 2026-02-12T08:43:15.886 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 145/160 2026-02-12T08:43:15.907 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 145/160 2026-02-12T08:43:15.907 INFO:teuthology.orchestra.run.trial181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:15.907 INFO:teuthology.orchestra.run.trial181.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T08:43:15.907 INFO:teuthology.orchestra.run.trial181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T08:43:15.907 INFO:teuthology.orchestra.run.trial181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T08:43:15.907 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:43:15.918 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 146/160 2026-02-12T08:43:15.921 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 123/160 2026-02-12T08:43:15.921 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T08:43:15.921 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:43:16.182 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 124/160 2026-02-12T08:43:16.225 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 124/160 2026-02-12T08:43:16.225 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T08:43:16.226 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T08:43:16.226 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:43:16.230 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 125/160 2026-02-12T08:43:18.182 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 146/160 2026-02-12T08:43:20.889 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 125/160 2026-02-12T08:43:20.890 INFO:teuthology.orchestra.run.trial160.stdout:skipping the directory /sys 2026-02-12T08:43:20.890 INFO:teuthology.orchestra.run.trial160.stdout:skipping the directory /proc 2026-02-12T08:43:20.890 INFO:teuthology.orchestra.run.trial160.stdout:skipping the directory /mnt 2026-02-12T08:43:20.890 INFO:teuthology.orchestra.run.trial160.stdout:skipping the directory /var/tmp 2026-02-12T08:43:20.890 INFO:teuthology.orchestra.run.trial160.stdout:skipping the directory /home 2026-02-12T08:43:20.890 INFO:teuthology.orchestra.run.trial160.stdout:skipping the directory /root 2026-02-12T08:43:20.890 INFO:teuthology.orchestra.run.trial160.stdout:skipping the directory /tmp 2026-02-12T08:43:20.890 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:43:20.979 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 126/160 2026-02-12T08:43:21.002 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 126/160 2026-02-12T08:43:21.002 INFO:teuthology.orchestra.run.trial160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:21.002 INFO:teuthology.orchestra.run.trial160.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T08:43:21.002 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T08:43:21.002 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T08:43:21.002 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:43:21.208 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 127/160 2026-02-12T08:43:21.229 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 127/160 2026-02-12T08:43:21.229 INFO:teuthology.orchestra.run.trial160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:21.229 INFO:teuthology.orchestra.run.trial160.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T08:43:21.229 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T08:43:21.229 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T08:43:21.229 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:43:21.236 INFO:teuthology.orchestra.run.trial160.stdout: Installing : mailcap-2.1.49-5.el9.noarch 128/160 2026-02-12T08:43:21.238 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 129/160 2026-02-12T08:43:21.255 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 130/160 2026-02-12T08:43:21.255 INFO:teuthology.orchestra.run.trial160.stdout:Creating group 'qat' with GID 992. 2026-02-12T08:43:21.255 INFO:teuthology.orchestra.run.trial160.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T08:43:21.255 INFO:teuthology.orchestra.run.trial160.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T08:43:21.255 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:43:21.263 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 130/160 2026-02-12T08:43:21.286 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 130/160 2026-02-12T08:43:21.286 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T08:43:21.286 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:43:21.320 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 131/160 2026-02-12T08:43:21.909 INFO:teuthology.orchestra.run.trial160.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 132/160 2026-02-12T08:43:27.242 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86 133/160 2026-02-12T08:43:27.304 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86 134/160 2026-02-12T08:43:27.306 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 135/160 2026-02-12T08:43:27.320 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 135/160 2026-02-12T08:43:27.320 INFO:teuthology.orchestra.run.trial160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:27.320 INFO:teuthology.orchestra.run.trial160.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T08:43:27.320 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:43:27.331 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 136/160 2026-02-12T08:43:27.353 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 136/160 2026-02-12T08:43:27.353 INFO:teuthology.orchestra.run.trial160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:27.353 INFO:teuthology.orchestra.run.trial160.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T08:43:27.353 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T08:43:27.354 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T08:43:27.354 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:43:27.413 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: cephadm-2:20.3.0-5161.g2401a109.el9.noarch 137/160 2026-02-12T08:43:27.415 INFO:teuthology.orchestra.run.trial160.stdout: Installing : cephadm-2:20.3.0-5161.g2401a109.el9.noarch 137/160 2026-02-12T08:43:27.425 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5161.g2401a109.e 138/160 2026-02-12T08:43:27.449 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5161.g2401a109. 139/160 2026-02-12T08:43:27.451 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noa 140/160 2026-02-12T08:43:29.024 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noa 140/160 2026-02-12T08:43:29.031 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.n 141/160 2026-02-12T08:43:29.483 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.n 141/160 2026-02-12T08:43:29.484 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5161.g240 142/160 2026-02-12T08:43:29.496 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5161.g240 142/160 2026-02-12T08:43:29.497 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.n 143/160 2026-02-12T08:43:29.557 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.n 143/160 2026-02-12T08:43:29.597 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5161.g2401a109.el 144/160 2026-02-12T08:43:29.598 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 145/160 2026-02-12T08:43:29.619 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 145/160 2026-02-12T08:43:29.619 INFO:teuthology.orchestra.run.trial160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:29.619 INFO:teuthology.orchestra.run.trial160.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T08:43:29.619 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T08:43:29.619 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T08:43:29.619 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:43:29.631 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 146/160 2026-02-12T08:43:31.884 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 146/160 2026-02-12T08:43:40.762 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-debugsource-2:20.3.0-5161.g2401a109.el9.x86 147/160 2026-02-12T08:43:40.763 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a1 148/160 2026-02-12T08:43:41.255 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-2:20.3.0-5161.g2401a109.el9.x86_64 149/160 2026-02-12T08:43:41.256 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 150/160 2026-02-12T08:43:41.277 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 150/160 2026-02-12T08:43:41.278 INFO:teuthology.orchestra.run.trial181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:41.278 INFO:teuthology.orchestra.run.trial181.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T08:43:41.278 INFO:teuthology.orchestra.run.trial181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T08:43:41.278 INFO:teuthology.orchestra.run.trial181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T08:43:41.278 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:43:41.288 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5161.g2401a 151/160 2026-02-12T08:43:41.308 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5161.g2401a 151/160 2026-02-12T08:43:41.308 INFO:teuthology.orchestra.run.trial181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:41.308 INFO:teuthology.orchestra.run.trial181.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T08:43:41.308 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:43:41.420 INFO:teuthology.orchestra.run.trial181.stdout: Installing : rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 152/160 2026-02-12T08:43:41.440 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 152/160 2026-02-12T08:43:41.441 INFO:teuthology.orchestra.run.trial181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:41.441 INFO:teuthology.orchestra.run.trial181.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T08:43:41.441 INFO:teuthology.orchestra.run.trial181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T08:43:41.441 INFO:teuthology.orchestra.run.trial181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T08:43:41.441 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:43:48.518 INFO:teuthology.orchestra.run.trial181.stdout: Installing : python3-pytest-6.2.2-7.el9.noarch 153/160 2026-02-12T08:43:48.546 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 154/160 2026-02-12T08:43:48.566 INFO:teuthology.orchestra.run.trial181.stdout: Installing : libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_ 155/160 2026-02-12T08:43:48.593 INFO:teuthology.orchestra.run.trial181.stdout: Installing : rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 156/160 2026-02-12T08:43:48.656 INFO:teuthology.orchestra.run.trial181.stdout: Installing : rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 157/160 2026-02-12T08:43:48.691 INFO:teuthology.orchestra.run.trial181.stdout: Installing : ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 158/160 2026-02-12T08:43:48.692 INFO:teuthology.orchestra.run.trial181.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/160 2026-02-12T08:43:48.854 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/160 2026-02-12T08:43:48.855 INFO:teuthology.orchestra.run.trial181.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/160 2026-02-12T08:43:49.022 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2026-02-12T08:43:49.030 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86 160/160 2026-02-12T08:43:49.061 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86 160/160 2026-02-12T08:43:51.450 INFO:teuthology.orchestra.run.trial181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2026-02-12T08:43:51.451 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-2:20.3.0-5161.g2401a109.el9.x86_64 1/160 2026-02-12T08:43:51.451 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 2/160 2026-02-12T08:43:51.451 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 3/160 2026-02-12T08:43:51.451 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-debugsource-2:20.3.0-5161.g2401a109.el9.x86 4/160 2026-02-12T08:43:51.451 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 5/160 2026-02-12T08:43:51.451 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5161.g2401a 6/160 2026-02-12T08:43:51.451 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 7/160 2026-02-12T08:43:51.452 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 8/160 2026-02-12T08:43:51.452 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 9/160 2026-02-12T08:43:51.452 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 10/160 2026-02-12T08:43:51.452 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86 11/160 2026-02-12T08:43:51.452 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86 12/160 2026-02-12T08:43:51.452 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a1 13/160 2026-02-12T08:43:51.452 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 14/160 2026-02-12T08:43:51.452 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 15/160 2026-02-12T08:43:51.452 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 16/160 2026-02-12T08:43:51.452 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libcephfs-daemon-2:20.3.0-5161.g2401a109.el9.x86 17/160 2026-02-12T08:43:51.452 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_ 18/160 2026-02-12T08:43:51.452 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86 19/160 2026-02-12T08:43:51.453 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 20/160 2026-02-12T08:43:51.453 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 21/160 2026-02-12T08:43:51.453 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : librados-devel-2:20.3.0-5161.g2401a109.el9.x86_6 22/160 2026-02-12T08:43:51.453 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86 23/160 2026-02-12T08:43:51.453 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 24/160 2026-02-12T08:43:51.453 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5161.g2401a109.el 25/160 2026-02-12T08:43:51.453 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-ceph-common-2:20.3.0-5161.g2401a109.el9. 26/160 2026-02-12T08:43:51.453 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_6 27/160 2026-02-12T08:43:51.453 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 28/160 2026-02-12T08:43:51.453 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 29/160 2026-02-12T08:43:51.453 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 30/160 2026-02-12T08:43:51.453 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 31/160 2026-02-12T08:43:51.454 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 32/160 2026-02-12T08:43:51.454 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 33/160 2026-02-12T08:43:51.454 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5161.g2401a109. 34/160 2026-02-12T08:43:51.454 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noa 35/160 2026-02-12T08:43:51.454 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.n 36/160 2026-02-12T08:43:51.454 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5161.g240 37/160 2026-02-12T08:43:51.454 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.n 38/160 2026-02-12T08:43:51.454 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5161.g2401a109.el 39/160 2026-02-12T08:43:51.454 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 40/160 2026-02-12T08:43:51.454 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5161.g2401a109.e 41/160 2026-02-12T08:43:51.454 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 42/160 2026-02-12T08:43:51.454 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : cephadm-2:20.3.0-5161.g2401a109.el9.noarch 43/160 2026-02-12T08:43:51.455 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 44/160 2026-02-12T08:43:51.455 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 45/160 2026-02-12T08:43:51.455 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 46/160 2026-02-12T08:43:51.455 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 47/160 2026-02-12T08:43:51.455 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 48/160 2026-02-12T08:43:51.455 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 49/160 2026-02-12T08:43:51.455 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 50/160 2026-02-12T08:43:51.455 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 51/160 2026-02-12T08:43:51.455 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 52/160 2026-02-12T08:43:51.455 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 53/160 2026-02-12T08:43:51.455 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 54/160 2026-02-12T08:43:51.455 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 55/160 2026-02-12T08:43:51.455 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 56/160 2026-02-12T08:43:51.456 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-ply-3.11-14.el9.noarch 57/160 2026-02-12T08:43:51.456 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 58/160 2026-02-12T08:43:51.456 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 59/160 2026-02-12T08:43:51.456 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 60/160 2026-02-12T08:43:51.456 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 61/160 2026-02-12T08:43:51.456 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : unzip-6.0-59.el9.x86_64 62/160 2026-02-12T08:43:51.456 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : zip-3.0-35.el9.x86_64 63/160 2026-02-12T08:43:51.456 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 64/160 2026-02-12T08:43:51.456 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 65/160 2026-02-12T08:43:51.456 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 66/160 2026-02-12T08:43:51.456 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 67/160 2026-02-12T08:43:51.456 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libasan8-15.1.1-2.5.el9.x86_64 68/160 2026-02-12T08:43:51.456 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 69/160 2026-02-12T08:43:51.457 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 70/160 2026-02-12T08:43:51.457 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 71/160 2026-02-12T08:43:51.457 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 72/160 2026-02-12T08:43:51.457 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 73/160 2026-02-12T08:43:51.457 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 74/160 2026-02-12T08:43:51.457 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 75/160 2026-02-12T08:43:51.457 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 76/160 2026-02-12T08:43:51.457 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : lua-5.4.4-4.el9.x86_64 77/160 2026-02-12T08:43:51.457 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 78/160 2026-02-12T08:43:51.457 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 79/160 2026-02-12T08:43:51.457 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 80/160 2026-02-12T08:43:51.457 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 81/160 2026-02-12T08:43:51.458 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 82/160 2026-02-12T08:43:51.458 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-iniconfig-1.1.1-7.el9.noarch 83/160 2026-02-12T08:43:51.458 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 84/160 2026-02-12T08:43:51.458 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 85/160 2026-02-12T08:43:51.458 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 86/160 2026-02-12T08:43:51.458 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 87/160 2026-02-12T08:43:51.458 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 88/160 2026-02-12T08:43:51.458 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 89/160 2026-02-12T08:43:51.458 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 90/160 2026-02-12T08:43:51.458 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 91/160 2026-02-12T08:43:51.458 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-pluggy-0.13.1-7.el9.noarch 92/160 2026-02-12T08:43:51.458 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 93/160 2026-02-12T08:43:51.458 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-py-1.10.0-6.el9.noarch 94/160 2026-02-12T08:43:51.459 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 95/160 2026-02-12T08:43:51.459 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 96/160 2026-02-12T08:43:51.459 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-pytest-6.2.2-7.el9.noarch 97/160 2026-02-12T08:43:51.459 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 98/160 2026-02-12T08:43:51.459 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 99/160 2026-02-12T08:43:51.459 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 100/160 2026-02-12T08:43:51.459 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 101/160 2026-02-12T08:43:51.459 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 102/160 2026-02-12T08:43:51.459 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 103/160 2026-02-12T08:43:51.459 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 104/160 2026-02-12T08:43:51.459 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 105/160 2026-02-12T08:43:51.459 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 106/160 2026-02-12T08:43:51.460 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 107/160 2026-02-12T08:43:51.460 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 108/160 2026-02-12T08:43:51.460 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 109/160 2026-02-12T08:43:51.460 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 110/160 2026-02-12T08:43:51.460 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 111/160 2026-02-12T08:43:51.460 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 112/160 2026-02-12T08:43:51.460 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 113/160 2026-02-12T08:43:51.460 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 114/160 2026-02-12T08:43:51.460 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 115/160 2026-02-12T08:43:51.460 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 116/160 2026-02-12T08:43:51.460 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 117/160 2026-02-12T08:43:51.460 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 118/160 2026-02-12T08:43:51.461 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 119/160 2026-02-12T08:43:51.461 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 120/160 2026-02-12T08:43:51.461 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 121/160 2026-02-12T08:43:51.461 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 122/160 2026-02-12T08:43:51.461 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 123/160 2026-02-12T08:43:51.461 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 124/160 2026-02-12T08:43:51.461 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 125/160 2026-02-12T08:43:51.461 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 126/160 2026-02-12T08:43:51.461 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 127/160 2026-02-12T08:43:51.461 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 128/160 2026-02-12T08:43:51.461 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 129/160 2026-02-12T08:43:51.461 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 130/160 2026-02-12T08:43:51.461 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 131/160 2026-02-12T08:43:51.461 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 132/160 2026-02-12T08:43:51.462 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 133/160 2026-02-12T08:43:51.462 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 134/160 2026-02-12T08:43:51.462 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 135/160 2026-02-12T08:43:51.462 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 136/160 2026-02-12T08:43:51.462 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 137/160 2026-02-12T08:43:51.462 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 138/160 2026-02-12T08:43:51.462 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 139/160 2026-02-12T08:43:51.462 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 140/160 2026-02-12T08:43:51.462 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 141/160 2026-02-12T08:43:51.462 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 142/160 2026-02-12T08:43:51.462 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 143/160 2026-02-12T08:43:51.462 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 144/160 2026-02-12T08:43:51.462 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 145/160 2026-02-12T08:43:51.463 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 146/160 2026-02-12T08:43:51.463 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 147/160 2026-02-12T08:43:51.463 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 148/160 2026-02-12T08:43:51.463 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 149/160 2026-02-12T08:43:51.463 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 150/160 2026-02-12T08:43:51.463 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 151/160 2026-02-12T08:43:51.463 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 152/160 2026-02-12T08:43:51.463 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 153/160 2026-02-12T08:43:51.463 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : re2-1:20211101-20.el9.x86_64 154/160 2026-02-12T08:43:51.463 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 155/160 2026-02-12T08:43:51.463 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 156/160 2026-02-12T08:43:51.463 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : librados2-2:20.3.0-5161.g2401a109.el9.x86_64 157/160 2026-02-12T08:43:51.464 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 158/160 2026-02-12T08:43:51.464 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 159/160 2026-02-12T08:43:51.519 INFO:teuthology.orchestra.run.trial181.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 160/160 2026-02-12T08:43:51.519 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:43:51.519 INFO:teuthology.orchestra.run.trial181.stdout:Upgraded: 2026-02-12T08:43:51.519 INFO:teuthology.orchestra.run.trial181.stdout: librados2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.519 INFO:teuthology.orchestra.run.trial181.stdout: librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.519 INFO:teuthology.orchestra.run.trial181.stdout:Installed: 2026-02-12T08:43:51.519 INFO:teuthology.orchestra.run.trial181.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T08:43:51.519 INFO:teuthology.orchestra.run.trial181.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T08:43:51.519 INFO:teuthology.orchestra.run.trial181.stdout: ceph-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.519 INFO:teuthology.orchestra.run.trial181.stdout: ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.519 INFO:teuthology.orchestra.run.trial181.stdout: ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.519 INFO:teuthology.orchestra.run.trial181.stdout: ceph-debugsource-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.519 INFO:teuthology.orchestra.run.trial181.stdout: ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.519 INFO:teuthology.orchestra.run.trial181.stdout: ceph-grafana-dashboards-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:51.519 INFO:teuthology.orchestra.run.trial181.stdout: ceph-immutable-object-cache-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mgr-modules-core-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-prometheus-alerts-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: cephadm-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T08:43:51.520 INFO:teuthology.orchestra.run.trial181.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: libasan8-15.1.1-2.5.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: libcephfs-daemon-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.521 INFO:teuthology.orchestra.run.trial181.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T08:43:51.522 INFO:teuthology.orchestra.run.trial181.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-ceph-argparse-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-iniconfig-1.1.1-7.el9.noarch 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T08:43:51.523 INFO:teuthology.orchestra.run.trial181.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-pluggy-0.13.1-7.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-py-1.10.0-6.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-pytest-6.2.2-7.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T08:43:51.524 INFO:teuthology.orchestra.run.trial181.stdout: python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T08:43:51.525 INFO:teuthology.orchestra.run.trial181.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-12T08:43:51.526 INFO:teuthology.orchestra.run.trial181.stdout: zip-3.0-35.el9.x86_64 2026-02-12T08:43:51.526 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:43:51.526 INFO:teuthology.orchestra.run.trial181.stdout:Complete! 2026-02-12T08:43:51.671 DEBUG:teuthology.parallel:result is None 2026-02-12T08:43:53.973 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-debugsource-2:20.3.0-5161.g2401a109.el9.x86 147/160 2026-02-12T08:43:53.974 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a1 148/160 2026-02-12T08:43:54.456 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-2:20.3.0-5161.g2401a109.el9.x86_64 149/160 2026-02-12T08:43:54.457 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 150/160 2026-02-12T08:43:54.480 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 150/160 2026-02-12T08:43:54.480 INFO:teuthology.orchestra.run.trial160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:54.480 INFO:teuthology.orchestra.run.trial160.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T08:43:54.481 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T08:43:54.481 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T08:43:54.481 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:43:54.490 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5161.g2401a 151/160 2026-02-12T08:43:54.509 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5161.g2401a 151/160 2026-02-12T08:43:54.510 INFO:teuthology.orchestra.run.trial160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:54.510 INFO:teuthology.orchestra.run.trial160.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T08:43:54.510 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:43:54.619 INFO:teuthology.orchestra.run.trial160.stdout: Installing : rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 152/160 2026-02-12T08:43:54.638 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 152/160 2026-02-12T08:43:54.638 INFO:teuthology.orchestra.run.trial160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:54.638 INFO:teuthology.orchestra.run.trial160.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T08:43:54.639 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T08:43:54.639 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T08:43:54.639 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:01.576 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-pytest-6.2.2-7.el9.noarch 153/160 2026-02-12T08:44:01.584 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 154/160 2026-02-12T08:44:01.589 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_ 155/160 2026-02-12T08:44:01.597 INFO:teuthology.orchestra.run.trial160.stdout: Installing : rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 156/160 2026-02-12T08:44:01.638 INFO:teuthology.orchestra.run.trial160.stdout: Installing : rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 157/160 2026-02-12T08:44:01.641 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 158/160 2026-02-12T08:44:01.641 INFO:teuthology.orchestra.run.trial160.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/160 2026-02-12T08:44:01.653 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/160 2026-02-12T08:44:01.653 INFO:teuthology.orchestra.run.trial160.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/160 2026-02-12T08:44:01.663 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2026-02-12T08:44:01.669 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86 160/160 2026-02-12T08:44:01.692 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86 160/160 2026-02-12T08:44:04.948 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2026-02-12T08:44:04.949 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-2:20.3.0-5161.g2401a109.el9.x86_64 1/160 2026-02-12T08:44:04.949 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 2/160 2026-02-12T08:44:04.949 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 3/160 2026-02-12T08:44:04.949 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-debugsource-2:20.3.0-5161.g2401a109.el9.x86 4/160 2026-02-12T08:44:04.949 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 5/160 2026-02-12T08:44:04.949 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5161.g2401a 6/160 2026-02-12T08:44:04.949 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 7/160 2026-02-12T08:44:04.949 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 8/160 2026-02-12T08:44:04.950 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 9/160 2026-02-12T08:44:04.950 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 10/160 2026-02-12T08:44:04.950 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86 11/160 2026-02-12T08:44:04.950 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86 12/160 2026-02-12T08:44:04.950 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a1 13/160 2026-02-12T08:44:04.950 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 14/160 2026-02-12T08:44:04.950 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 15/160 2026-02-12T08:44:04.950 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 16/160 2026-02-12T08:44:04.950 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libcephfs-daemon-2:20.3.0-5161.g2401a109.el9.x86 17/160 2026-02-12T08:44:04.950 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_ 18/160 2026-02-12T08:44:04.950 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86 19/160 2026-02-12T08:44:04.950 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 20/160 2026-02-12T08:44:04.950 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 21/160 2026-02-12T08:44:04.951 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : librados-devel-2:20.3.0-5161.g2401a109.el9.x86_6 22/160 2026-02-12T08:44:04.951 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86 23/160 2026-02-12T08:44:04.951 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 24/160 2026-02-12T08:44:04.951 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5161.g2401a109.el 25/160 2026-02-12T08:44:04.951 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-ceph-common-2:20.3.0-5161.g2401a109.el9. 26/160 2026-02-12T08:44:04.951 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_6 27/160 2026-02-12T08:44:04.951 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 28/160 2026-02-12T08:44:04.951 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 29/160 2026-02-12T08:44:04.951 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 30/160 2026-02-12T08:44:04.951 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 31/160 2026-02-12T08:44:04.951 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 32/160 2026-02-12T08:44:04.951 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 33/160 2026-02-12T08:44:04.951 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5161.g2401a109. 34/160 2026-02-12T08:44:04.952 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noa 35/160 2026-02-12T08:44:04.952 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.n 36/160 2026-02-12T08:44:04.952 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5161.g240 37/160 2026-02-12T08:44:04.952 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.n 38/160 2026-02-12T08:44:04.952 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5161.g2401a109.el 39/160 2026-02-12T08:44:04.952 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 40/160 2026-02-12T08:44:04.952 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5161.g2401a109.e 41/160 2026-02-12T08:44:04.952 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 42/160 2026-02-12T08:44:04.952 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : cephadm-2:20.3.0-5161.g2401a109.el9.noarch 43/160 2026-02-12T08:44:04.952 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 44/160 2026-02-12T08:44:04.952 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 45/160 2026-02-12T08:44:04.952 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 46/160 2026-02-12T08:44:04.953 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 47/160 2026-02-12T08:44:04.953 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 48/160 2026-02-12T08:44:04.953 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 49/160 2026-02-12T08:44:04.953 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 50/160 2026-02-12T08:44:04.953 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 51/160 2026-02-12T08:44:04.953 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 52/160 2026-02-12T08:44:04.953 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 53/160 2026-02-12T08:44:04.953 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 54/160 2026-02-12T08:44:04.953 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 55/160 2026-02-12T08:44:04.953 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 56/160 2026-02-12T08:44:04.953 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-ply-3.11-14.el9.noarch 57/160 2026-02-12T08:44:04.953 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 58/160 2026-02-12T08:44:04.954 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 59/160 2026-02-12T08:44:04.954 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 60/160 2026-02-12T08:44:04.954 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 61/160 2026-02-12T08:44:04.954 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : unzip-6.0-59.el9.x86_64 62/160 2026-02-12T08:44:04.954 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : zip-3.0-35.el9.x86_64 63/160 2026-02-12T08:44:04.954 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 64/160 2026-02-12T08:44:04.954 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 65/160 2026-02-12T08:44:04.954 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 66/160 2026-02-12T08:44:04.954 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 67/160 2026-02-12T08:44:04.954 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libasan8-15.1.1-2.5.el9.x86_64 68/160 2026-02-12T08:44:04.954 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 69/160 2026-02-12T08:44:04.954 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 70/160 2026-02-12T08:44:04.954 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 71/160 2026-02-12T08:44:04.955 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 72/160 2026-02-12T08:44:04.955 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 73/160 2026-02-12T08:44:04.955 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 74/160 2026-02-12T08:44:04.955 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 75/160 2026-02-12T08:44:04.955 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 76/160 2026-02-12T08:44:04.955 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : lua-5.4.4-4.el9.x86_64 77/160 2026-02-12T08:44:04.955 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 78/160 2026-02-12T08:44:04.955 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 79/160 2026-02-12T08:44:04.955 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 80/160 2026-02-12T08:44:04.955 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 81/160 2026-02-12T08:44:04.955 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 82/160 2026-02-12T08:44:04.955 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-iniconfig-1.1.1-7.el9.noarch 83/160 2026-02-12T08:44:04.955 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 84/160 2026-02-12T08:44:04.956 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 85/160 2026-02-12T08:44:04.956 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 86/160 2026-02-12T08:44:04.956 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 87/160 2026-02-12T08:44:04.956 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 88/160 2026-02-12T08:44:04.956 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 89/160 2026-02-12T08:44:04.956 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 90/160 2026-02-12T08:44:04.956 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 91/160 2026-02-12T08:44:04.956 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-pluggy-0.13.1-7.el9.noarch 92/160 2026-02-12T08:44:04.956 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 93/160 2026-02-12T08:44:04.956 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-py-1.10.0-6.el9.noarch 94/160 2026-02-12T08:44:04.956 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 95/160 2026-02-12T08:44:04.956 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 96/160 2026-02-12T08:44:04.956 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-pytest-6.2.2-7.el9.noarch 97/160 2026-02-12T08:44:04.957 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 98/160 2026-02-12T08:44:04.957 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 99/160 2026-02-12T08:44:04.957 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 100/160 2026-02-12T08:44:04.957 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 101/160 2026-02-12T08:44:04.957 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 102/160 2026-02-12T08:44:04.957 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 103/160 2026-02-12T08:44:04.957 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 104/160 2026-02-12T08:44:04.957 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 105/160 2026-02-12T08:44:04.957 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 106/160 2026-02-12T08:44:04.957 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 107/160 2026-02-12T08:44:04.957 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 108/160 2026-02-12T08:44:04.957 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 109/160 2026-02-12T08:44:04.958 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 110/160 2026-02-12T08:44:04.958 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 111/160 2026-02-12T08:44:04.958 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 112/160 2026-02-12T08:44:04.958 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 113/160 2026-02-12T08:44:04.958 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 114/160 2026-02-12T08:44:04.958 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 115/160 2026-02-12T08:44:04.958 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 116/160 2026-02-12T08:44:04.958 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 117/160 2026-02-12T08:44:04.958 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 118/160 2026-02-12T08:44:04.958 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 119/160 2026-02-12T08:44:04.958 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 120/160 2026-02-12T08:44:04.958 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 121/160 2026-02-12T08:44:04.958 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 122/160 2026-02-12T08:44:04.959 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 123/160 2026-02-12T08:44:04.959 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 124/160 2026-02-12T08:44:04.959 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 125/160 2026-02-12T08:44:04.959 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 126/160 2026-02-12T08:44:04.959 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 127/160 2026-02-12T08:44:04.959 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 128/160 2026-02-12T08:44:04.959 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 129/160 2026-02-12T08:44:04.959 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 130/160 2026-02-12T08:44:04.959 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 131/160 2026-02-12T08:44:04.959 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 132/160 2026-02-12T08:44:04.959 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 133/160 2026-02-12T08:44:04.959 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 134/160 2026-02-12T08:44:04.960 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 135/160 2026-02-12T08:44:04.960 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 136/160 2026-02-12T08:44:04.960 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 137/160 2026-02-12T08:44:04.960 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 138/160 2026-02-12T08:44:04.960 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 139/160 2026-02-12T08:44:04.960 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 140/160 2026-02-12T08:44:04.960 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 141/160 2026-02-12T08:44:04.960 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 142/160 2026-02-12T08:44:04.960 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 143/160 2026-02-12T08:44:04.960 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 144/160 2026-02-12T08:44:04.960 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 145/160 2026-02-12T08:44:04.960 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 146/160 2026-02-12T08:44:04.960 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 147/160 2026-02-12T08:44:04.961 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 148/160 2026-02-12T08:44:04.961 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 149/160 2026-02-12T08:44:04.961 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 150/160 2026-02-12T08:44:04.961 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 151/160 2026-02-12T08:44:04.961 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 152/160 2026-02-12T08:44:04.961 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 153/160 2026-02-12T08:44:04.961 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : re2-1:20211101-20.el9.x86_64 154/160 2026-02-12T08:44:04.961 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 155/160 2026-02-12T08:44:04.961 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 156/160 2026-02-12T08:44:04.961 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : librados2-2:20.3.0-5161.g2401a109.el9.x86_64 157/160 2026-02-12T08:44:04.961 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 158/160 2026-02-12T08:44:04.961 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 159/160 2026-02-12T08:44:05.015 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 160/160 2026-02-12T08:44:05.016 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:05.016 INFO:teuthology.orchestra.run.trial160.stdout:Upgraded: 2026-02-12T08:44:05.016 INFO:teuthology.orchestra.run.trial160.stdout: librados2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.016 INFO:teuthology.orchestra.run.trial160.stdout: librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.016 INFO:teuthology.orchestra.run.trial160.stdout:Installed: 2026-02-12T08:44:05.016 INFO:teuthology.orchestra.run.trial160.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T08:44:05.016 INFO:teuthology.orchestra.run.trial160.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T08:44:05.016 INFO:teuthology.orchestra.run.trial160.stdout: ceph-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.016 INFO:teuthology.orchestra.run.trial160.stdout: ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.016 INFO:teuthology.orchestra.run.trial160.stdout: ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.016 INFO:teuthology.orchestra.run.trial160.stdout: ceph-debugsource-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.017 INFO:teuthology.orchestra.run.trial160.stdout: ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.017 INFO:teuthology.orchestra.run.trial160.stdout: ceph-grafana-dashboards-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:44:05.017 INFO:teuthology.orchestra.run.trial160.stdout: ceph-immutable-object-cache-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.017 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.017 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.017 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:44:05.017 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:44:05.017 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:44:05.017 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:44:05.017 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-modules-core-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:44:05.017 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:44:05.017 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.018 INFO:teuthology.orchestra.run.trial160.stdout: ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.018 INFO:teuthology.orchestra.run.trial160.stdout: ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.018 INFO:teuthology.orchestra.run.trial160.stdout: ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.018 INFO:teuthology.orchestra.run.trial160.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.018 INFO:teuthology.orchestra.run.trial160.stdout: ceph-prometheus-alerts-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:44:05.018 INFO:teuthology.orchestra.run.trial160.stdout: ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.018 INFO:teuthology.orchestra.run.trial160.stdout: ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.018 INFO:teuthology.orchestra.run.trial160.stdout: ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.018 INFO:teuthology.orchestra.run.trial160.stdout: ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:44:05.018 INFO:teuthology.orchestra.run.trial160.stdout: cephadm-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:44:05.018 INFO:teuthology.orchestra.run.trial160.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T08:44:05.018 INFO:teuthology.orchestra.run.trial160.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T08:44:05.018 INFO:teuthology.orchestra.run.trial160.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T08:44:05.019 INFO:teuthology.orchestra.run.trial160.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T08:44:05.019 INFO:teuthology.orchestra.run.trial160.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T08:44:05.019 INFO:teuthology.orchestra.run.trial160.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T08:44:05.019 INFO:teuthology.orchestra.run.trial160.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-12T08:44:05.019 INFO:teuthology.orchestra.run.trial160.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T08:44:05.019 INFO:teuthology.orchestra.run.trial160.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T08:44:05.019 INFO:teuthology.orchestra.run.trial160.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T08:44:05.019 INFO:teuthology.orchestra.run.trial160.stdout: libasan8-15.1.1-2.5.el9.x86_64 2026-02-12T08:44:05.019 INFO:teuthology.orchestra.run.trial160.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-12T08:44:05.019 INFO:teuthology.orchestra.run.trial160.stdout: libcephfs-daemon-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.019 INFO:teuthology.orchestra.run.trial160.stdout: libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.019 INFO:teuthology.orchestra.run.trial160.stdout: libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.020 INFO:teuthology.orchestra.run.trial160.stdout: libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.020 INFO:teuthology.orchestra.run.trial160.stdout: libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.020 INFO:teuthology.orchestra.run.trial160.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T08:44:05.020 INFO:teuthology.orchestra.run.trial160.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T08:44:05.020 INFO:teuthology.orchestra.run.trial160.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T08:44:05.020 INFO:teuthology.orchestra.run.trial160.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T08:44:05.020 INFO:teuthology.orchestra.run.trial160.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T08:44:05.020 INFO:teuthology.orchestra.run.trial160.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T08:44:05.020 INFO:teuthology.orchestra.run.trial160.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T08:44:05.020 INFO:teuthology.orchestra.run.trial160.stdout: librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.020 INFO:teuthology.orchestra.run.trial160.stdout: libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.020 INFO:teuthology.orchestra.run.trial160.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T08:44:05.020 INFO:teuthology.orchestra.run.trial160.stdout: librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.021 INFO:teuthology.orchestra.run.trial160.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T08:44:05.021 INFO:teuthology.orchestra.run.trial160.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-12T08:44:05.021 INFO:teuthology.orchestra.run.trial160.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T08:44:05.021 INFO:teuthology.orchestra.run.trial160.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T08:44:05.021 INFO:teuthology.orchestra.run.trial160.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-12T08:44:05.021 INFO:teuthology.orchestra.run.trial160.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T08:44:05.021 INFO:teuthology.orchestra.run.trial160.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T08:44:05.021 INFO:teuthology.orchestra.run.trial160.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T08:44:05.021 INFO:teuthology.orchestra.run.trial160.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T08:44:05.021 INFO:teuthology.orchestra.run.trial160.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T08:44:05.021 INFO:teuthology.orchestra.run.trial160.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-12T08:44:05.021 INFO:teuthology.orchestra.run.trial160.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T08:44:05.021 INFO:teuthology.orchestra.run.trial160.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T08:44:05.022 INFO:teuthology.orchestra.run.trial160.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T08:44:05.022 INFO:teuthology.orchestra.run.trial160.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T08:44:05.022 INFO:teuthology.orchestra.run.trial160.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T08:44:05.022 INFO:teuthology.orchestra.run.trial160.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T08:44:05.022 INFO:teuthology.orchestra.run.trial160.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T08:44:05.022 INFO:teuthology.orchestra.run.trial160.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T08:44:05.022 INFO:teuthology.orchestra.run.trial160.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T08:44:05.022 INFO:teuthology.orchestra.run.trial160.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T08:44:05.022 INFO:teuthology.orchestra.run.trial160.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T08:44:05.022 INFO:teuthology.orchestra.run.trial160.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T08:44:05.022 INFO:teuthology.orchestra.run.trial160.stdout: python3-ceph-argparse-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.022 INFO:teuthology.orchestra.run.trial160.stdout: python3-ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.022 INFO:teuthology.orchestra.run.trial160.stdout: python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T08:44:05.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T08:44:05.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T08:44:05.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T08:44:05.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T08:44:05.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T08:44:05.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T08:44:05.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T08:44:05.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T08:44:05.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-12T08:44:05.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-iniconfig-1.1.1-7.el9.noarch 2026-02-12T08:44:05.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-12T08:44:05.024 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T08:44:05.024 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T08:44:05.024 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T08:44:05.024 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T08:44:05.024 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T08:44:05.024 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T08:44:05.024 INFO:teuthology.orchestra.run.trial160.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T08:44:05.024 INFO:teuthology.orchestra.run.trial160.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T08:44:05.024 INFO:teuthology.orchestra.run.trial160.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T08:44:05.024 INFO:teuthology.orchestra.run.trial160.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T08:44:05.024 INFO:teuthology.orchestra.run.trial160.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-12T08:44:05.024 INFO:teuthology.orchestra.run.trial160.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T08:44:05.025 INFO:teuthology.orchestra.run.trial160.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T08:44:05.025 INFO:teuthology.orchestra.run.trial160.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-12T08:44:05.025 INFO:teuthology.orchestra.run.trial160.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T08:44:05.025 INFO:teuthology.orchestra.run.trial160.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T08:44:05.025 INFO:teuthology.orchestra.run.trial160.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T08:44:05.025 INFO:teuthology.orchestra.run.trial160.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T08:44:05.025 INFO:teuthology.orchestra.run.trial160.stdout: python3-pluggy-0.13.1-7.el9.noarch 2026-02-12T08:44:05.025 INFO:teuthology.orchestra.run.trial160.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T08:44:05.025 INFO:teuthology.orchestra.run.trial160.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T08:44:05.025 INFO:teuthology.orchestra.run.trial160.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T08:44:05.025 INFO:teuthology.orchestra.run.trial160.stdout: python3-py-1.10.0-6.el9.noarch 2026-02-12T08:44:05.025 INFO:teuthology.orchestra.run.trial160.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T08:44:05.025 INFO:teuthology.orchestra.run.trial160.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T08:44:05.026 INFO:teuthology.orchestra.run.trial160.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T08:44:05.026 INFO:teuthology.orchestra.run.trial160.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T08:44:05.026 INFO:teuthology.orchestra.run.trial160.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T08:44:05.026 INFO:teuthology.orchestra.run.trial160.stdout: python3-pytest-6.2.2-7.el9.noarch 2026-02-12T08:44:05.026 INFO:teuthology.orchestra.run.trial160.stdout: python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.026 INFO:teuthology.orchestra.run.trial160.stdout: python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.026 INFO:teuthology.orchestra.run.trial160.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T08:44:05.026 INFO:teuthology.orchestra.run.trial160.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T08:44:05.026 INFO:teuthology.orchestra.run.trial160.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T08:44:05.026 INFO:teuthology.orchestra.run.trial160.stdout: python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.026 INFO:teuthology.orchestra.run.trial160.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T08:44:05.026 INFO:teuthology.orchestra.run.trial160.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T08:44:05.026 INFO:teuthology.orchestra.run.trial160.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-12T08:44:05.027 INFO:teuthology.orchestra.run.trial160.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T08:44:05.027 INFO:teuthology.orchestra.run.trial160.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T08:44:05.027 INFO:teuthology.orchestra.run.trial160.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T08:44:05.027 INFO:teuthology.orchestra.run.trial160.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T08:44:05.027 INFO:teuthology.orchestra.run.trial160.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T08:44:05.027 INFO:teuthology.orchestra.run.trial160.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T08:44:05.027 INFO:teuthology.orchestra.run.trial160.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-12T08:44:05.027 INFO:teuthology.orchestra.run.trial160.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T08:44:05.027 INFO:teuthology.orchestra.run.trial160.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T08:44:05.027 INFO:teuthology.orchestra.run.trial160.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T08:44:05.027 INFO:teuthology.orchestra.run.trial160.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T08:44:05.027 INFO:teuthology.orchestra.run.trial160.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T08:44:05.028 INFO:teuthology.orchestra.run.trial160.stdout: rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.028 INFO:teuthology.orchestra.run.trial160.stdout: rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.028 INFO:teuthology.orchestra.run.trial160.stdout: rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.028 INFO:teuthology.orchestra.run.trial160.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T08:44:05.028 INFO:teuthology.orchestra.run.trial160.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T08:44:05.028 INFO:teuthology.orchestra.run.trial160.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T08:44:05.028 INFO:teuthology.orchestra.run.trial160.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T08:44:05.028 INFO:teuthology.orchestra.run.trial160.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-12T08:44:05.028 INFO:teuthology.orchestra.run.trial160.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-12T08:44:05.028 INFO:teuthology.orchestra.run.trial160.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T08:44:05.028 INFO:teuthology.orchestra.run.trial160.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-12T08:44:05.028 INFO:teuthology.orchestra.run.trial160.stdout: zip-3.0-35.el9.x86_64 2026-02-12T08:44:05.028 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:05.029 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-12T08:44:05.164 DEBUG:teuthology.parallel:result is None 2026-02-12T08:44:05.165 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:44:05.336 DEBUG:teuthology.orchestra.run.trial160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T08:44:05.358 INFO:teuthology.orchestra.run.trial160.stdout:20.3.0-5161.g2401a109.el9 2026-02-12T08:44:05.358 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5161.g2401a109.el9 2026-02-12T08:44:05.358 INFO:teuthology.task.install:The correct ceph version 20.3.0-5161.g2401a109 is installed. 2026-02-12T08:44:05.360 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:44:05.477 DEBUG:teuthology.orchestra.run.trial181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T08:44:05.499 INFO:teuthology.orchestra.run.trial181.stdout:20.3.0-5161.g2401a109.el9 2026-02-12T08:44:05.499 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5161.g2401a109.el9 2026-02-12T08:44:05.499 INFO:teuthology.task.install:The correct ceph version 20.3.0-5161.g2401a109 is installed. 2026-02-12T08:44:05.501 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-12T08:44:05.501 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:44:05.501 DEBUG:teuthology.orchestra.run.trial160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T08:44:05.529 DEBUG:teuthology.orchestra.run.trial181:> set -ex 2026-02-12T08:44:05.529 DEBUG:teuthology.orchestra.run.trial181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T08:44:05.565 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-12T08:44:05.566 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:44:05.566 DEBUG:teuthology.orchestra.run.trial160:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T08:44:05.592 DEBUG:teuthology.orchestra.run.trial160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T08:44:05.655 DEBUG:teuthology.orchestra.run.trial181:> set -ex 2026-02-12T08:44:05.655 DEBUG:teuthology.orchestra.run.trial181:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T08:44:05.680 DEBUG:teuthology.orchestra.run.trial181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T08:44:05.746 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-12T08:44:05.746 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:44:05.746 DEBUG:teuthology.orchestra.run.trial160:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T08:44:05.770 DEBUG:teuthology.orchestra.run.trial160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T08:44:05.833 DEBUG:teuthology.orchestra.run.trial181:> set -ex 2026-02-12T08:44:05.833 DEBUG:teuthology.orchestra.run.trial181:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T08:44:05.858 DEBUG:teuthology.orchestra.run.trial181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T08:44:05.922 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-12T08:44:05.923 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:44:05.923 DEBUG:teuthology.orchestra.run.trial160:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T08:44:05.949 DEBUG:teuthology.orchestra.run.trial160:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T08:44:06.013 DEBUG:teuthology.orchestra.run.trial181:> set -ex 2026-02-12T08:44:06.013 DEBUG:teuthology.orchestra.run.trial181:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T08:44:06.038 DEBUG:teuthology.orchestra.run.trial181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T08:44:06.102 INFO:teuthology.run_tasks:Running task pexec... 2026-02-12T08:44:06.121 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-12T08:44:06.122 DEBUG:teuthology.orchestra.run.trial160:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-12T08:44:06.123 DEBUG:teuthology.orchestra.run.trial181:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-12T08:44:06.126 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial160.front.sepia.ceph.com 2026-02-12T08:44:06.126 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-12T08:44:06.145 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial181.front.sepia.ceph.com 2026-02-12T08:44:06.146 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-12T08:44:06.176 DEBUG:teuthology.parallel:result is None 2026-02-12T08:44:06.196 DEBUG:teuthology.parallel:result is None 2026-02-12T08:44:06.196 INFO:teuthology.run_tasks:Running task install... 2026-02-12T08:44:06.210 DEBUG:teuthology.task.install:project ceph 2026-02-12T08:44:06.210 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'}} 2026-02-12T08:44:06.210 DEBUG:teuthology.task.install:config {'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'} 2026-02-12T08:44:06.210 INFO:teuthology.task.install:Using flavor: debug 2026-02-12T08:44:06.218 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-12T08:44:06.218 INFO:teuthology.task.install:extra packages: [] 2026-02-12T08:44:06.218 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875', 'tag': None, 'wait_for_package': False} 2026-02-12T08:44:06.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:44:06.220 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875', 'tag': None, 'wait_for_package': False} 2026-02-12T08:44:06.220 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:44:06.402 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/ 2026-02-12T08:44:06.402 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5161.g2401a109 2026-02-12T08:44:06.411 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/ 2026-02-12T08:44:06.411 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5161.g2401a109 2026-02-12T08:44:06.743 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T08:44:06.743 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:44:06.743 DEBUG:teuthology.orchestra.run.trial160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T08:44:06.769 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-pytest on remote rpm x86_64 2026-02-12T08:44:06.769 DEBUG:teuthology.orchestra.run.trial160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2401a109e2ac85dfa20fc57328da663aa754c875/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T08:44:06.792 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T08:44:06.793 DEBUG:teuthology.orchestra.run.trial181:> set -ex 2026-02-12T08:44:06.793 DEBUG:teuthology.orchestra.run.trial181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T08:44:06.820 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-pytest on remote rpm x86_64 2026-02-12T08:44:06.820 DEBUG:teuthology.orchestra.run.trial181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2401a109e2ac85dfa20fc57328da663aa754c875/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T08:44:06.834 DEBUG:teuthology.orchestra.run.trial160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T08:44:06.885 DEBUG:teuthology.orchestra.run.trial181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T08:44:06.897 DEBUG:teuthology.orchestra.run.trial160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T08:44:06.948 DEBUG:teuthology.orchestra.run.trial181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T08:44:06.952 INFO:teuthology.orchestra.run.trial160.stdout:check_obsoletes = 1 2026-02-12T08:44:06.961 DEBUG:teuthology.orchestra.run.trial160:> sudo yum clean all 2026-02-12T08:44:07.004 INFO:teuthology.orchestra.run.trial181.stdout:check_obsoletes = 1 2026-02-12T08:44:07.013 DEBUG:teuthology.orchestra.run.trial181:> sudo yum clean all 2026-02-12T08:44:07.121 INFO:teuthology.orchestra.run.trial160.stdout:56 files removed 2026-02-12T08:44:07.136 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-pytest 2026-02-12T08:44:07.177 INFO:teuthology.orchestra.run.trial181.stdout:56 files removed 2026-02-12T08:44:07.193 DEBUG:teuthology.orchestra.run.trial181:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-pytest 2026-02-12T08:44:07.979 INFO:teuthology.orchestra.run.trial160.stdout:ceph packages for x86_64 136 kB/s | 94 kB 00:00 2026-02-12T08:44:08.024 INFO:teuthology.orchestra.run.trial181.stdout:ceph packages for x86_64 138 kB/s | 94 kB 00:00 2026-02-12T08:44:08.642 INFO:teuthology.orchestra.run.trial160.stdout:ceph noarch packages 38 kB/s | 24 kB 00:00 2026-02-12T08:44:08.683 INFO:teuthology.orchestra.run.trial181.stdout:ceph noarch packages 38 kB/s | 24 kB 00:00 2026-02-12T08:44:09.229 INFO:teuthology.orchestra.run.trial160.stdout:ceph source packages 3.7 kB/s | 2.1 kB 00:00 2026-02-12T08:44:09.263 INFO:teuthology.orchestra.run.trial181.stdout:ceph source packages 3.7 kB/s | 2.1 kB 00:00 2026-02-12T08:44:10.161 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - BaseOS 9.7 MB/s | 8.9 MB 00:00 2026-02-12T08:44:11.379 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - AppStream 39 MB/s | 27 MB 00:00 2026-02-12T08:44:14.808 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 7.8 MB 00:01 2026-02-12T08:44:16.009 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 20 kB 00:00 2026-02-12T08:44:17.519 INFO:teuthology.orchestra.run.trial181.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.9 MB 00:08 2026-02-12T08:44:18.215 INFO:teuthology.orchestra.run.trial160.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 20 MB 00:02 2026-02-12T08:44:20.551 INFO:teuthology.orchestra.run.trial181.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-12T08:44:21.417 INFO:teuthology.orchestra.run.trial160.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-12T08:44:22.661 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.661 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.662 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.662 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.663 INFO:teuthology.orchestra.run.trial160.stdout:Package cephadm-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:44:22.663 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-immutable-object-cache-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.664 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.664 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:44:22.665 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:44:22.665 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:44:22.665 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:44:22.666 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.666 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.667 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.667 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:44:22.668 INFO:teuthology.orchestra.run.trial160.stdout:Package librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.668 INFO:teuthology.orchestra.run.trial160.stdout:Package libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.669 INFO:teuthology.orchestra.run.trial160.stdout:Package libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.669 INFO:teuthology.orchestra.run.trial160.stdout:Package librados2-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.669 INFO:teuthology.orchestra.run.trial160.stdout:Package librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.670 INFO:teuthology.orchestra.run.trial160.stdout:Package python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.670 INFO:teuthology.orchestra.run.trial160.stdout:Package python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.671 INFO:teuthology.orchestra.run.trial160.stdout:Package python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.671 INFO:teuthology.orchestra.run.trial160.stdout:Package python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.672 INFO:teuthology.orchestra.run.trial160.stdout:Package rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.672 INFO:teuthology.orchestra.run.trial160.stdout:Package rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.673 INFO:teuthology.orchestra.run.trial160.stdout:Package rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:22.673 INFO:teuthology.orchestra.run.trial160.stdout:Package python3-pytest-6.2.2-7.el9.noarch is already installed. 2026-02-12T08:44:22.691 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-12T08:44:22.691 INFO:teuthology.orchestra.run.trial160.stdout:Nothing to do. 2026-02-12T08:44:22.692 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-12T08:44:22.718 DEBUG:teuthology.parallel:result is None 2026-02-12T08:44:24.091 INFO:teuthology.orchestra.run.trial181.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 7.8 MB 00:01 2026-02-12T08:44:25.002 INFO:teuthology.orchestra.run.trial181.stdout:CentOS Stream 9 - Extras packages 106 kB/s | 20 kB 00:00 2026-02-12T08:44:25.567 INFO:teuthology.orchestra.run.trial181.stdout:Extra Packages for Enterprise Linux 41 MB/s | 20 MB 00:00 2026-02-12T08:44:28.759 INFO:teuthology.orchestra.run.trial181.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-12T08:44:30.013 INFO:teuthology.orchestra.run.trial181.stdout:Package ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.014 INFO:teuthology.orchestra.run.trial181.stdout:Package ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.014 INFO:teuthology.orchestra.run.trial181.stdout:Package ceph-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.015 INFO:teuthology.orchestra.run.trial181.stdout:Package ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.015 INFO:teuthology.orchestra.run.trial181.stdout:Package cephadm-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:44:30.015 INFO:teuthology.orchestra.run.trial181.stdout:Package ceph-immutable-object-cache-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.016 INFO:teuthology.orchestra.run.trial181.stdout:Package ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.016 INFO:teuthology.orchestra.run.trial181.stdout:Package ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:44:30.017 INFO:teuthology.orchestra.run.trial181.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:44:30.017 INFO:teuthology.orchestra.run.trial181.stdout:Package ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:44:30.017 INFO:teuthology.orchestra.run.trial181.stdout:Package ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:44:30.018 INFO:teuthology.orchestra.run.trial181.stdout:Package ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.018 INFO:teuthology.orchestra.run.trial181.stdout:Package ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.019 INFO:teuthology.orchestra.run.trial181.stdout:Package ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.019 INFO:teuthology.orchestra.run.trial181.stdout:Package ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:44:30.020 INFO:teuthology.orchestra.run.trial181.stdout:Package librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.020 INFO:teuthology.orchestra.run.trial181.stdout:Package libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.021 INFO:teuthology.orchestra.run.trial181.stdout:Package libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.021 INFO:teuthology.orchestra.run.trial181.stdout:Package librados2-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.021 INFO:teuthology.orchestra.run.trial181.stdout:Package librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.022 INFO:teuthology.orchestra.run.trial181.stdout:Package python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.022 INFO:teuthology.orchestra.run.trial181.stdout:Package python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.023 INFO:teuthology.orchestra.run.trial181.stdout:Package python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.023 INFO:teuthology.orchestra.run.trial181.stdout:Package python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.023 INFO:teuthology.orchestra.run.trial181.stdout:Package rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.024 INFO:teuthology.orchestra.run.trial181.stdout:Package rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.024 INFO:teuthology.orchestra.run.trial181.stdout:Package rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:30.025 INFO:teuthology.orchestra.run.trial181.stdout:Package python3-pytest-6.2.2-7.el9.noarch is already installed. 2026-02-12T08:44:30.043 INFO:teuthology.orchestra.run.trial181.stdout:Dependencies resolved. 2026-02-12T08:44:30.043 INFO:teuthology.orchestra.run.trial181.stdout:Nothing to do. 2026-02-12T08:44:30.043 INFO:teuthology.orchestra.run.trial181.stdout:Complete! 2026-02-12T08:44:30.070 DEBUG:teuthology.parallel:result is None 2026-02-12T08:44:30.070 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:44:30.232 DEBUG:teuthology.orchestra.run.trial160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T08:44:30.253 INFO:teuthology.orchestra.run.trial160.stdout:20.3.0-5161.g2401a109.el9 2026-02-12T08:44:30.254 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5161.g2401a109.el9 2026-02-12T08:44:30.254 INFO:teuthology.task.install:The correct ceph version 20.3.0-5161.g2401a109 is installed. 2026-02-12T08:44:30.256 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:44:30.403 DEBUG:teuthology.orchestra.run.trial181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T08:44:30.425 INFO:teuthology.orchestra.run.trial181.stdout:20.3.0-5161.g2401a109.el9 2026-02-12T08:44:30.425 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5161.g2401a109.el9 2026-02-12T08:44:30.425 INFO:teuthology.task.install:The correct ceph version 20.3.0-5161.g2401a109 is installed. 2026-02-12T08:44:30.427 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-12T08:44:30.427 INFO:teuthology.run_tasks:Running task ceph... 2026-02-12T08:44:30.529 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-12T08:44:30.529 DEBUG:teuthology.orchestra.run.trial160:> sudo chmod 777 /var/log/ceph 2026-02-12T08:44:30.531 DEBUG:teuthology.orchestra.run.trial181:> sudo chmod 777 /var/log/ceph 2026-02-12T08:44:30.556 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-12T08:44:30.556 DEBUG:teuthology.orchestra.run.trial160:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T08:44:30.596 DEBUG:teuthology.orchestra.run.trial181:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T08:44:30.620 INFO:tasks.ceph:Creating extra log directories... 2026-02-12T08:44:30.620 DEBUG:teuthology.orchestra.run.trial160:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T08:44:30.660 DEBUG:teuthology.orchestra.run.trial181:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T08:44:30.695 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-12T08:44:30.695 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-12T08:44:30.695 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41539', 'branch': 'main', 'description': 'crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} tasks/rados_python}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '41539', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)'], 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'}}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c'}}, 'owner': 'scheduled_matan@soko04.front.sepia.ceph.com', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9353, 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c', 'targets': {'trial160.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAAKUX27+dsBDoFcBgYTki9D0KRk3E5JFCsed6IinBk4NStVlfF1PZ1W3PHDvsz4h05WcCvXWmymhxaRZBC0Gfo=', 'trial181.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAPHVmezqIhAtfcKlMVEXUgOpd2yum3GJdle0P0re9fB7JpAPhiGtvmcw9XA8qTDnSDmayz1ObsfF1oBoPI1pWA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)'], 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ["rados/test_python.sh -m 'not (wait or tier or ec)'"]}, 'timeout': '1h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'c433f1062990a0488dc29a553589bc609a460691', 'timestamp': '2026-02-09_15:50:17', 'tube': 'trial', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.2161924'} 2026-02-12T08:44:30.696 DEBUG:teuthology.orchestra.run.trial160:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T08:44:30.726 DEBUG:teuthology.orchestra.run.trial181:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T08:44:30.744 DEBUG:teuthology.orchestra.run.trial160:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T08:44:30.783 DEBUG:teuthology.orchestra.run.trial181:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T08:44:30.807 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:44:30.807 DEBUG:teuthology.orchestra.run.trial160:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T08:44:30.864 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T08:44:30.864 DEBUG:teuthology.orchestra.run.trial160:> stat /dev/vg_nvme/lv_1 2026-02-12T08:44:30.920 INFO:teuthology.orchestra.run.trial160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T08:44:30.921 INFO:teuthology.orchestra.run.trial160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:44:30.921 INFO:teuthology.orchestra.run.trial160.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-12T08:44:30.921 INFO:teuthology.orchestra.run.trial160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:44:30.921 INFO:teuthology.orchestra.run.trial160.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:44:30.921 INFO:teuthology.orchestra.run.trial160.stdout:Access: 2026-02-12 08:44:01.884517932 +0000 2026-02-12T08:44:30.921 INFO:teuthology.orchestra.run.trial160.stdout:Modify: 2026-02-12 08:43:15.946629550 +0000 2026-02-12T08:44:30.921 INFO:teuthology.orchestra.run.trial160.stdout:Change: 2026-02-12 08:43:15.946629550 +0000 2026-02-12T08:44:30.921 INFO:teuthology.orchestra.run.trial160.stdout: Birth: 2026-02-12 08:43:15.946629550 +0000 2026-02-12T08:44:30.922 DEBUG:teuthology.orchestra.run.trial160:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T08:44:30.983 INFO:teuthology.orchestra.run.trial160.stderr:1+0 records in 2026-02-12T08:44:30.984 INFO:teuthology.orchestra.run.trial160.stderr:1+0 records out 2026-02-12T08:44:30.984 INFO:teuthology.orchestra.run.trial160.stderr:512 bytes copied, 0.000153738 s, 3.3 MB/s 2026-02-12T08:44:30.985 DEBUG:teuthology.orchestra.run.trial160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T08:44:31.042 DEBUG:teuthology.orchestra.run.trial160:> stat /dev/vg_nvme/lv_2 2026-02-12T08:44:31.098 INFO:teuthology.orchestra.run.trial160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T08:44:31.098 INFO:teuthology.orchestra.run.trial160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:44:31.099 INFO:teuthology.orchestra.run.trial160.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-12T08:44:31.099 INFO:teuthology.orchestra.run.trial160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:44:31.099 INFO:teuthology.orchestra.run.trial160.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:44:31.099 INFO:teuthology.orchestra.run.trial160.stdout:Access: 2026-02-12 08:44:01.885517930 +0000 2026-02-12T08:44:31.099 INFO:teuthology.orchestra.run.trial160.stdout:Modify: 2026-02-12 08:43:15.946629550 +0000 2026-02-12T08:44:31.099 INFO:teuthology.orchestra.run.trial160.stdout:Change: 2026-02-12 08:43:15.946629550 +0000 2026-02-12T08:44:31.099 INFO:teuthology.orchestra.run.trial160.stdout: Birth: 2026-02-12 08:43:15.946629550 +0000 2026-02-12T08:44:31.099 DEBUG:teuthology.orchestra.run.trial160:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T08:44:31.163 INFO:teuthology.orchestra.run.trial160.stderr:1+0 records in 2026-02-12T08:44:31.163 INFO:teuthology.orchestra.run.trial160.stderr:1+0 records out 2026-02-12T08:44:31.163 INFO:teuthology.orchestra.run.trial160.stderr:512 bytes copied, 0.000154931 s, 3.3 MB/s 2026-02-12T08:44:31.164 DEBUG:teuthology.orchestra.run.trial160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T08:44:31.221 DEBUG:teuthology.orchestra.run.trial160:> stat /dev/vg_nvme/lv_3 2026-02-12T08:44:31.277 INFO:teuthology.orchestra.run.trial160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T08:44:31.277 INFO:teuthology.orchestra.run.trial160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:44:31.277 INFO:teuthology.orchestra.run.trial160.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-12T08:44:31.277 INFO:teuthology.orchestra.run.trial160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:44:31.277 INFO:teuthology.orchestra.run.trial160.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:44:31.277 INFO:teuthology.orchestra.run.trial160.stdout:Access: 2026-02-12 08:44:01.885517930 +0000 2026-02-12T08:44:31.277 INFO:teuthology.orchestra.run.trial160.stdout:Modify: 2026-02-12 08:43:15.946629550 +0000 2026-02-12T08:44:31.277 INFO:teuthology.orchestra.run.trial160.stdout:Change: 2026-02-12 08:43:15.946629550 +0000 2026-02-12T08:44:31.278 INFO:teuthology.orchestra.run.trial160.stdout: Birth: 2026-02-12 08:43:15.946629550 +0000 2026-02-12T08:44:31.278 DEBUG:teuthology.orchestra.run.trial160:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T08:44:31.340 INFO:teuthology.orchestra.run.trial160.stderr:1+0 records in 2026-02-12T08:44:31.340 INFO:teuthology.orchestra.run.trial160.stderr:1+0 records out 2026-02-12T08:44:31.340 INFO:teuthology.orchestra.run.trial160.stderr:512 bytes copied, 0.000146084 s, 3.5 MB/s 2026-02-12T08:44:31.342 DEBUG:teuthology.orchestra.run.trial160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T08:44:31.399 DEBUG:teuthology.orchestra.run.trial160:> stat /dev/vg_nvme/lv_4 2026-02-12T08:44:31.455 INFO:teuthology.orchestra.run.trial160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T08:44:31.455 INFO:teuthology.orchestra.run.trial160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:44:31.455 INFO:teuthology.orchestra.run.trial160.stdout:Device: 6h/6d Inode: 1287 Links: 1 2026-02-12T08:44:31.455 INFO:teuthology.orchestra.run.trial160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:44:31.456 INFO:teuthology.orchestra.run.trial160.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:44:31.456 INFO:teuthology.orchestra.run.trial160.stdout:Access: 2026-02-12 08:44:01.885517930 +0000 2026-02-12T08:44:31.456 INFO:teuthology.orchestra.run.trial160.stdout:Modify: 2026-02-12 08:43:15.945629552 +0000 2026-02-12T08:44:31.456 INFO:teuthology.orchestra.run.trial160.stdout:Change: 2026-02-12 08:43:15.945629552 +0000 2026-02-12T08:44:31.456 INFO:teuthology.orchestra.run.trial160.stdout: Birth: 2026-02-12 08:43:15.945629552 +0000 2026-02-12T08:44:31.456 DEBUG:teuthology.orchestra.run.trial160:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T08:44:31.517 INFO:teuthology.orchestra.run.trial160.stderr:1+0 records in 2026-02-12T08:44:31.517 INFO:teuthology.orchestra.run.trial160.stderr:1+0 records out 2026-02-12T08:44:31.517 INFO:teuthology.orchestra.run.trial160.stderr:512 bytes copied, 0.000132849 s, 3.9 MB/s 2026-02-12T08:44:31.518 DEBUG:teuthology.orchestra.run.trial160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T08:44:31.574 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-12T08:44:31.574 DEBUG:teuthology.orchestra.run.trial181:> set -ex 2026-02-12T08:44:31.575 DEBUG:teuthology.orchestra.run.trial181:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T08:44:31.593 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T08:44:31.593 DEBUG:teuthology.orchestra.run.trial181:> stat /dev/vg_nvme/lv_1 2026-02-12T08:44:31.652 INFO:teuthology.orchestra.run.trial181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T08:44:31.652 INFO:teuthology.orchestra.run.trial181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:44:31.652 INFO:teuthology.orchestra.run.trial181.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-12T08:44:31.652 INFO:teuthology.orchestra.run.trial181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:44:31.652 INFO:teuthology.orchestra.run.trial181.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:44:31.652 INFO:teuthology.orchestra.run.trial181.stdout:Access: 2026-02-12 08:43:49.364425951 +0000 2026-02-12T08:44:31.652 INFO:teuthology.orchestra.run.trial181.stdout:Modify: 2026-02-12 08:43:02.072263312 +0000 2026-02-12T08:44:31.653 INFO:teuthology.orchestra.run.trial181.stdout:Change: 2026-02-12 08:43:02.072263312 +0000 2026-02-12T08:44:31.653 INFO:teuthology.orchestra.run.trial181.stdout: Birth: 2026-02-12 08:43:02.072263312 +0000 2026-02-12T08:44:31.653 DEBUG:teuthology.orchestra.run.trial181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T08:44:31.715 INFO:teuthology.orchestra.run.trial181.stderr:1+0 records in 2026-02-12T08:44:31.716 INFO:teuthology.orchestra.run.trial181.stderr:1+0 records out 2026-02-12T08:44:31.716 INFO:teuthology.orchestra.run.trial181.stderr:512 bytes copied, 0.000136293 s, 3.8 MB/s 2026-02-12T08:44:31.718 DEBUG:teuthology.orchestra.run.trial181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T08:44:31.775 DEBUG:teuthology.orchestra.run.trial181:> stat /dev/vg_nvme/lv_2 2026-02-12T08:44:31.831 INFO:teuthology.orchestra.run.trial181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T08:44:31.832 INFO:teuthology.orchestra.run.trial181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:44:31.832 INFO:teuthology.orchestra.run.trial181.stdout:Device: 6h/6d Inode: 1308 Links: 1 2026-02-12T08:44:31.832 INFO:teuthology.orchestra.run.trial181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:44:31.832 INFO:teuthology.orchestra.run.trial181.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:44:31.832 INFO:teuthology.orchestra.run.trial181.stdout:Access: 2026-02-12 08:43:49.364425951 +0000 2026-02-12T08:44:31.832 INFO:teuthology.orchestra.run.trial181.stdout:Modify: 2026-02-12 08:43:02.072263312 +0000 2026-02-12T08:44:31.832 INFO:teuthology.orchestra.run.trial181.stdout:Change: 2026-02-12 08:43:02.072263312 +0000 2026-02-12T08:44:31.832 INFO:teuthology.orchestra.run.trial181.stdout: Birth: 2026-02-12 08:43:02.072263312 +0000 2026-02-12T08:44:31.833 DEBUG:teuthology.orchestra.run.trial181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T08:44:31.895 INFO:teuthology.orchestra.run.trial181.stderr:1+0 records in 2026-02-12T08:44:31.895 INFO:teuthology.orchestra.run.trial181.stderr:1+0 records out 2026-02-12T08:44:31.895 INFO:teuthology.orchestra.run.trial181.stderr:512 bytes copied, 0.000143066 s, 3.6 MB/s 2026-02-12T08:44:31.896 DEBUG:teuthology.orchestra.run.trial181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T08:44:31.954 DEBUG:teuthology.orchestra.run.trial181:> stat /dev/vg_nvme/lv_3 2026-02-12T08:44:32.011 INFO:teuthology.orchestra.run.trial181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T08:44:32.011 INFO:teuthology.orchestra.run.trial181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:44:32.011 INFO:teuthology.orchestra.run.trial181.stdout:Device: 6h/6d Inode: 1306 Links: 1 2026-02-12T08:44:32.011 INFO:teuthology.orchestra.run.trial181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:44:32.011 INFO:teuthology.orchestra.run.trial181.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:44:32.011 INFO:teuthology.orchestra.run.trial181.stdout:Access: 2026-02-12 08:43:49.365425933 +0000 2026-02-12T08:44:32.011 INFO:teuthology.orchestra.run.trial181.stdout:Modify: 2026-02-12 08:43:02.072263312 +0000 2026-02-12T08:44:32.011 INFO:teuthology.orchestra.run.trial181.stdout:Change: 2026-02-12 08:43:02.072263312 +0000 2026-02-12T08:44:32.011 INFO:teuthology.orchestra.run.trial181.stdout: Birth: 2026-02-12 08:43:02.072263312 +0000 2026-02-12T08:44:32.012 DEBUG:teuthology.orchestra.run.trial181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T08:44:32.074 INFO:teuthology.orchestra.run.trial181.stderr:1+0 records in 2026-02-12T08:44:32.074 INFO:teuthology.orchestra.run.trial181.stderr:1+0 records out 2026-02-12T08:44:32.074 INFO:teuthology.orchestra.run.trial181.stderr:512 bytes copied, 0.000144749 s, 3.5 MB/s 2026-02-12T08:44:32.075 DEBUG:teuthology.orchestra.run.trial181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T08:44:32.131 DEBUG:teuthology.orchestra.run.trial181:> stat /dev/vg_nvme/lv_4 2026-02-12T08:44:32.188 INFO:teuthology.orchestra.run.trial181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T08:44:32.188 INFO:teuthology.orchestra.run.trial181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:44:32.188 INFO:teuthology.orchestra.run.trial181.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-12T08:44:32.188 INFO:teuthology.orchestra.run.trial181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:44:32.188 INFO:teuthology.orchestra.run.trial181.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:44:32.188 INFO:teuthology.orchestra.run.trial181.stdout:Access: 2026-02-12 08:43:49.365425933 +0000 2026-02-12T08:44:32.189 INFO:teuthology.orchestra.run.trial181.stdout:Modify: 2026-02-12 08:43:02.072263312 +0000 2026-02-12T08:44:32.189 INFO:teuthology.orchestra.run.trial181.stdout:Change: 2026-02-12 08:43:02.072263312 +0000 2026-02-12T08:44:32.189 INFO:teuthology.orchestra.run.trial181.stdout: Birth: 2026-02-12 08:43:02.072263312 +0000 2026-02-12T08:44:32.189 DEBUG:teuthology.orchestra.run.trial181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T08:44:32.251 INFO:teuthology.orchestra.run.trial181.stderr:1+0 records in 2026-02-12T08:44:32.251 INFO:teuthology.orchestra.run.trial181.stderr:1+0 records out 2026-02-12T08:44:32.252 INFO:teuthology.orchestra.run.trial181.stderr:512 bytes copied, 0.000133858 s, 3.8 MB/s 2026-02-12T08:44:32.253 DEBUG:teuthology.orchestra.run.trial181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T08:44:32.310 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-12T08:44:32.310 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial160.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial181.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-12T08:44:32.310 INFO:tasks.ceph:Generating config... 2026-02-12T08:44:32.313 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-12T08:44:32.313 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-12T08:44:32.314 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-12T08:44:32.314 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-12T08:44:32.314 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-12T08:44:32.314 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-12T08:44:32.314 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-12T08:44:32.314 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-12T08:44:32.314 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-12T08:44:32.314 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-12T08:44:32.314 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-12T08:44:32.314 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-12T08:44:32.314 INFO:tasks.ceph:[osd] debug ms = 20 2026-02-12T08:44:32.315 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-12T08:44:32.315 INFO:tasks.ceph:[osd] debug seastore = 20 2026-02-12T08:44:32.315 INFO:tasks.ceph:[osd] debug seastore backref = 20 2026-02-12T08:44:32.315 INFO:tasks.ceph:[osd] debug seastore cache = 20 2026-02-12T08:44:32.315 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2026-02-12T08:44:32.315 INFO:tasks.ceph:[osd] debug seastore device = 20 2026-02-12T08:44:32.315 INFO:tasks.ceph:[osd] debug seastore epm = 20 2026-02-12T08:44:32.315 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2026-02-12T08:44:32.315 INFO:tasks.ceph:[osd] debug seastore journal = 20 2026-02-12T08:44:32.315 INFO:tasks.ceph:[osd] debug seastore lba = 20 2026-02-12T08:44:32.315 INFO:tasks.ceph:[osd] debug seastore odata = 20 2026-02-12T08:44:32.315 INFO:tasks.ceph:[osd] debug seastore omap = 20 2026-02-12T08:44:32.315 INFO:tasks.ceph:[osd] debug seastore onode = 20 2026-02-12T08:44:32.316 INFO:tasks.ceph:[osd] debug seastore t = 20 2026-02-12T08:44:32.316 INFO:tasks.ceph:[osd] debug seastore tm = 20 2026-02-12T08:44:32.316 INFO:tasks.ceph:[osd] osd objectstore = seastore 2026-02-12T08:44:32.316 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-12T08:44:32.316 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-12T08:44:32.316 INFO:tasks.ceph:[osd] seastore cachepin type = 2Q 2026-02-12T08:44:32.316 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-12T08:44:32.316 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-12T08:44:32.316 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-12T08:44:32.316 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-12T08:44:32.316 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-12T08:44:32.316 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-12T08:44:32.317 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-12T08:44:32.317 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-12T08:44:32.317 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-12T08:44:32.317 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-12T08:44:32.317 INFO:tasks.ceph:Setting up mon.a... 2026-02-12T08:44:32.317 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-12T08:44:32.360 INFO:teuthology.orchestra.run.trial160.stdout:creating /etc/ceph/ceph.keyring 2026-02-12T08:44:32.363 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-12T08:44:32.448 DEBUG:teuthology.orchestra.run.trial160:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T08:44:32.473 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.160')] 2026-02-12T08:44:32.474 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.160', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-12T08:44:32.476 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:44:32.476 DEBUG:teuthology.orchestra.run.trial160:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T08:44:32.530 DEBUG:teuthology.orchestra.run.trial160:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.160 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:44:32.609 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:44:32.607+0000 7f831767ef40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:44:32.609 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:44:32.607+0000 7f831767ef40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:44:32.609 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:44:32.607+0000 7f831767ef40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:44:32.611 INFO:teuthology.orchestra.run.trial160.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:44:32.611 INFO:teuthology.orchestra.run.trial160.stdout:monmaptool: generated fsid c797b341-9be1-4308-bb3e-bbe04740db3f 2026-02-12T08:44:32.611 INFO:teuthology.orchestra.run.trial160.stdout:setting min_mon_release = tentacle 2026-02-12T08:44:32.611 INFO:teuthology.orchestra.run.trial160.stdout:epoch 0 2026-02-12T08:44:32.611 INFO:teuthology.orchestra.run.trial160.stdout:fsid c797b341-9be1-4308-bb3e-bbe04740db3f 2026-02-12T08:44:32.611 INFO:teuthology.orchestra.run.trial160.stdout:last_changed 2026-02-12T08:44:32.608341+0000 2026-02-12T08:44:32.611 INFO:teuthology.orchestra.run.trial160.stdout:created 2026-02-12T08:44:32.608341+0000 2026-02-12T08:44:32.611 INFO:teuthology.orchestra.run.trial160.stdout:min_mon_release 20 (tentacle) 2026-02-12T08:44:32.612 INFO:teuthology.orchestra.run.trial160.stdout:election_strategy: 1 2026-02-12T08:44:32.612 INFO:teuthology.orchestra.run.trial160.stdout:0: [v2:10.20.193.160:3300/0,v1:10.20.193.160:6789/0] mon.a 2026-02-12T08:44:32.612 INFO:teuthology.orchestra.run.trial160.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-12T08:44:32.613 DEBUG:teuthology.orchestra.run.trial160:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T08:44:32.667 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c797b341-9be1-4308-bb3e-bbe04740db3f... 2026-02-12T08:44:32.669 DEBUG:teuthology.orchestra.run.trial160:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T08:44:32.709 DEBUG:teuthology.orchestra.run.trial181:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T08:44:32.747 INFO:teuthology.orchestra.run.trial160.stdout:[global] 2026-02-12T08:44:32.748 INFO:teuthology.orchestra.run.trial160.stdout: chdir = "" 2026-02-12T08:44:32.748 INFO:teuthology.orchestra.run.trial160.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T08:44:32.748 INFO:teuthology.orchestra.run.trial160.stdout: auth supported = cephx 2026-02-12T08:44:32.748 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.748 INFO:teuthology.orchestra.run.trial160.stdout: filestore xattr use omap = true 2026-02-12T08:44:32.748 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.748 INFO:teuthology.orchestra.run.trial160.stdout: mon clock drift allowed = 1.000 2026-02-12T08:44:32.748 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.748 INFO:teuthology.orchestra.run.trial160.stdout: osd crush chooseleaf type = 0 2026-02-12T08:44:32.748 INFO:teuthology.orchestra.run.trial160.stdout: auth debug = true 2026-02-12T08:44:32.749 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.749 INFO:teuthology.orchestra.run.trial160.stdout: ms die on old message = true 2026-02-12T08:44:32.749 INFO:teuthology.orchestra.run.trial160.stdout: ms die on bug = true 2026-02-12T08:44:32.749 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.749 INFO:teuthology.orchestra.run.trial160.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T08:44:32.749 INFO:teuthology.orchestra.run.trial160.stdout: mon pg warn max object skew = 0 2026-02-12T08:44:32.749 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.749 INFO:teuthology.orchestra.run.trial160.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T08:44:32.749 INFO:teuthology.orchestra.run.trial160.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T08:44:32.749 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.749 INFO:teuthology.orchestra.run.trial160.stdout: osd pool default size = 2 2026-02-12T08:44:32.750 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.750 INFO:teuthology.orchestra.run.trial160.stdout: mon osd allow primary affinity = true 2026-02-12T08:44:32.750 INFO:teuthology.orchestra.run.trial160.stdout: mon osd allow pg remap = true 2026-02-12T08:44:32.750 INFO:teuthology.orchestra.run.trial160.stdout: mon warn on legacy crush tunables = false 2026-02-12T08:44:32.750 INFO:teuthology.orchestra.run.trial160.stdout: mon warn on crush straw calc version zero = false 2026-02-12T08:44:32.750 INFO:teuthology.orchestra.run.trial160.stdout: mon warn on no sortbitwise = false 2026-02-12T08:44:32.750 INFO:teuthology.orchestra.run.trial160.stdout: mon warn on osd down out interval zero = false 2026-02-12T08:44:32.750 INFO:teuthology.orchestra.run.trial160.stdout: mon warn on too few osds = false 2026-02-12T08:44:32.750 INFO:teuthology.orchestra.run.trial160.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T08:44:32.750 INFO:teuthology.orchestra.run.trial160.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T08:44:32.750 INFO:teuthology.orchestra.run.trial160.stdout: mon_allow_pool_size_one = true 2026-02-12T08:44:32.750 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.751 INFO:teuthology.orchestra.run.trial160.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T08:44:32.751 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.751 INFO:teuthology.orchestra.run.trial160.stdout: osd default data pool replay window = 5 2026-02-12T08:44:32.751 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.751 INFO:teuthology.orchestra.run.trial160.stdout: mon allow pool delete = true 2026-02-12T08:44:32.751 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.751 INFO:teuthology.orchestra.run.trial160.stdout: mon cluster log file level = debug 2026-02-12T08:44:32.751 INFO:teuthology.orchestra.run.trial160.stdout: debug asserts on shutdown = true 2026-02-12T08:44:32.751 INFO:teuthology.orchestra.run.trial160.stdout: mon health detail to clog = false 2026-02-12T08:44:32.751 INFO:teuthology.orchestra.run.trial160.stdout: mon host = 10.20.193.160 2026-02-12T08:44:32.751 INFO:teuthology.orchestra.run.trial160.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-12T08:44:32.751 INFO:teuthology.orchestra.run.trial160.stdout: ms client mode = crc 2026-02-12T08:44:32.752 INFO:teuthology.orchestra.run.trial160.stdout: ms cluster mode = crc 2026-02-12T08:44:32.752 INFO:teuthology.orchestra.run.trial160.stdout: ms mon client mode = crc 2026-02-12T08:44:32.752 INFO:teuthology.orchestra.run.trial160.stdout: ms mon cluster mode = crc 2026-02-12T08:44:32.752 INFO:teuthology.orchestra.run.trial160.stdout: ms mon service mode = crc 2026-02-12T08:44:32.752 INFO:teuthology.orchestra.run.trial160.stdout: ms service mode = crc 2026-02-12T08:44:32.752 INFO:teuthology.orchestra.run.trial160.stdout: fsid = c797b341-9be1-4308-bb3e-bbe04740db3f 2026-02-12T08:44:32.752 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.752 INFO:teuthology.orchestra.run.trial160.stdout:[osd] 2026-02-12T08:44:32.752 INFO:teuthology.orchestra.run.trial160.stdout: osd journal size = 100 2026-02-12T08:44:32.752 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.752 INFO:teuthology.orchestra.run.trial160.stdout: osd scrub load threshold = 5.0 2026-02-12T08:44:32.752 INFO:teuthology.orchestra.run.trial160.stdout: osd scrub max interval = 600 2026-02-12T08:44:32.752 INFO:teuthology.orchestra.run.trial160.stdout: osd mclock profile = high_recovery_ops 2026-02-12T08:44:32.753 INFO:teuthology.orchestra.run.trial160.stdout: osd mclock skip benchmark = true 2026-02-12T08:44:32.753 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.753 INFO:teuthology.orchestra.run.trial160.stdout: osd recover clone overlap = true 2026-02-12T08:44:32.753 INFO:teuthology.orchestra.run.trial160.stdout: osd recovery max chunk = 1048576 2026-02-12T08:44:32.753 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.753 INFO:teuthology.orchestra.run.trial160.stdout: osd debug shutdown = true 2026-02-12T08:44:32.753 INFO:teuthology.orchestra.run.trial160.stdout: osd debug op order = true 2026-02-12T08:44:32.753 INFO:teuthology.orchestra.run.trial160.stdout: osd debug verify stray on activate = true 2026-02-12T08:44:32.753 INFO:teuthology.orchestra.run.trial160.stdout: osd debug trim objects = true 2026-02-12T08:44:32.753 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.753 INFO:teuthology.orchestra.run.trial160.stdout: osd open classes on start = true 2026-02-12T08:44:32.753 INFO:teuthology.orchestra.run.trial160.stdout: osd debug pg log writeout = true 2026-02-12T08:44:32.754 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.754 INFO:teuthology.orchestra.run.trial160.stdout: osd deep scrub update digest min age = 30 2026-02-12T08:44:32.754 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.754 INFO:teuthology.orchestra.run.trial160.stdout: osd map max advance = 10 2026-02-12T08:44:32.754 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.754 INFO:teuthology.orchestra.run.trial160.stdout: journal zero on create = true 2026-02-12T08:44:32.754 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.754 INFO:teuthology.orchestra.run.trial160.stdout: filestore ondisk finisher threads = 3 2026-02-12T08:44:32.754 INFO:teuthology.orchestra.run.trial160.stdout: filestore apply finisher threads = 3 2026-02-12T08:44:32.754 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.754 INFO:teuthology.orchestra.run.trial160.stdout: bdev debug aio = true 2026-02-12T08:44:32.754 INFO:teuthology.orchestra.run.trial160.stdout: osd debug misdirected ops = true 2026-02-12T08:44:32.754 INFO:teuthology.orchestra.run.trial160.stdout: debug monc = 20 2026-02-12T08:44:32.755 INFO:teuthology.orchestra.run.trial160.stdout: crimson cpu num = 4 2026-02-12T08:44:32.755 INFO:teuthology.orchestra.run.trial160.stdout: crimson osd obc lru size = 10 2026-02-12T08:44:32.755 INFO:teuthology.orchestra.run.trial160.stdout: debug ms = 20 2026-02-12T08:44:32.755 INFO:teuthology.orchestra.run.trial160.stdout: debug osd = 20 2026-02-12T08:44:32.755 INFO:teuthology.orchestra.run.trial160.stdout: debug seastore = 20 2026-02-12T08:44:32.755 INFO:teuthology.orchestra.run.trial160.stdout: debug seastore backref = 20 2026-02-12T08:44:32.755 INFO:teuthology.orchestra.run.trial160.stdout: debug seastore cache = 20 2026-02-12T08:44:32.755 INFO:teuthology.orchestra.run.trial160.stdout: debug seastore cleaner = 20 2026-02-12T08:44:32.755 INFO:teuthology.orchestra.run.trial160.stdout: debug seastore device = 20 2026-02-12T08:44:32.755 INFO:teuthology.orchestra.run.trial160.stdout: debug seastore epm = 20 2026-02-12T08:44:32.755 INFO:teuthology.orchestra.run.trial160.stdout: debug seastore fixedkv tree = 20 2026-02-12T08:44:32.755 INFO:teuthology.orchestra.run.trial160.stdout: debug seastore journal = 20 2026-02-12T08:44:32.756 INFO:teuthology.orchestra.run.trial160.stdout: debug seastore lba = 20 2026-02-12T08:44:32.756 INFO:teuthology.orchestra.run.trial160.stdout: debug seastore odata = 20 2026-02-12T08:44:32.756 INFO:teuthology.orchestra.run.trial160.stdout: debug seastore omap = 20 2026-02-12T08:44:32.756 INFO:teuthology.orchestra.run.trial160.stdout: debug seastore onode = 20 2026-02-12T08:44:32.756 INFO:teuthology.orchestra.run.trial160.stdout: debug seastore t = 20 2026-02-12T08:44:32.756 INFO:teuthology.orchestra.run.trial160.stdout: debug seastore tm = 20 2026-02-12T08:44:32.756 INFO:teuthology.orchestra.run.trial160.stdout: osd objectstore = seastore 2026-02-12T08:44:32.756 INFO:teuthology.orchestra.run.trial160.stdout: osd shutdown pgref assert = True 2026-02-12T08:44:32.756 INFO:teuthology.orchestra.run.trial160.stdout: seastore cachepin size pershard = 64M 2026-02-12T08:44:32.756 INFO:teuthology.orchestra.run.trial160.stdout: seastore cachepin type = 2Q 2026-02-12T08:44:32.756 INFO:teuthology.orchestra.run.trial160.stdout: seastore max concurrent transactions = 8 2026-02-12T08:44:32.756 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.756 INFO:teuthology.orchestra.run.trial160.stdout:[mgr] 2026-02-12T08:44:32.757 INFO:teuthology.orchestra.run.trial160.stdout: debug ms = 1 2026-02-12T08:44:32.757 INFO:teuthology.orchestra.run.trial160.stdout: debug mgr = 20 2026-02-12T08:44:32.757 INFO:teuthology.orchestra.run.trial160.stdout: debug mon = 20 2026-02-12T08:44:32.757 INFO:teuthology.orchestra.run.trial160.stdout: debug auth = 20 2026-02-12T08:44:32.757 INFO:teuthology.orchestra.run.trial160.stdout: mon reweight min pgs per osd = 4 2026-02-12T08:44:32.757 INFO:teuthology.orchestra.run.trial160.stdout: mon reweight min bytes per osd = 10 2026-02-12T08:44:32.757 INFO:teuthology.orchestra.run.trial160.stdout: mgr/telemetry/nag = false 2026-02-12T08:44:32.757 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.757 INFO:teuthology.orchestra.run.trial160.stdout:[mon] 2026-02-12T08:44:32.757 INFO:teuthology.orchestra.run.trial160.stdout: debug ms = 1 2026-02-12T08:44:32.757 INFO:teuthology.orchestra.run.trial160.stdout: debug mon = 20 2026-02-12T08:44:32.757 INFO:teuthology.orchestra.run.trial160.stdout: debug paxos = 20 2026-02-12T08:44:32.757 INFO:teuthology.orchestra.run.trial160.stdout: debug auth = 20 2026-02-12T08:44:32.758 INFO:teuthology.orchestra.run.trial160.stdout: mon data avail warn = 5 2026-02-12T08:44:32.758 INFO:teuthology.orchestra.run.trial160.stdout: mon mgr mkfs grace = 240 2026-02-12T08:44:32.758 INFO:teuthology.orchestra.run.trial160.stdout: mon reweight min pgs per osd = 4 2026-02-12T08:44:32.758 INFO:teuthology.orchestra.run.trial160.stdout: mon osd reporter subtree level = osd 2026-02-12T08:44:32.758 INFO:teuthology.orchestra.run.trial160.stdout: mon osd prime pg temp = true 2026-02-12T08:44:32.758 INFO:teuthology.orchestra.run.trial160.stdout: mon reweight min bytes per osd = 10 2026-02-12T08:44:32.758 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.758 INFO:teuthology.orchestra.run.trial160.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T08:44:32.758 INFO:teuthology.orchestra.run.trial160.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T08:44:32.758 INFO:teuthology.orchestra.run.trial160.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T08:44:32.758 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.758 INFO:teuthology.orchestra.run.trial160.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T08:44:32.758 INFO:teuthology.orchestra.run.trial160.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T08:44:32.759 INFO:teuthology.orchestra.run.trial160.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T08:44:32.759 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.759 INFO:teuthology.orchestra.run.trial160.stdout: # 1m isn't quite enough 2026-02-12T08:44:32.759 INFO:teuthology.orchestra.run.trial160.stdout: mon_down_mkfs_grace = 2m 2026-02-12T08:44:32.759 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.759 INFO:teuthology.orchestra.run.trial160.stdout: mon_warn_on_filestore_osds = false 2026-02-12T08:44:32.759 INFO:teuthology.orchestra.run.trial160.stdout: mon min osdmap epochs = 50 2026-02-12T08:44:32.759 INFO:teuthology.orchestra.run.trial160.stdout: mon osdmap full prune interval = 2 2026-02-12T08:44:32.759 INFO:teuthology.orchestra.run.trial160.stdout: mon osdmap full prune min = 15 2026-02-12T08:44:32.759 INFO:teuthology.orchestra.run.trial160.stdout: mon osdmap full prune txsize = 2 2026-02-12T08:44:32.759 INFO:teuthology.orchestra.run.trial160.stdout: paxos service trim min = 10 2026-02-12T08:44:32.759 INFO:teuthology.orchestra.run.trial160.stdout: osd pool default crimson = True 2026-02-12T08:44:32.760 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:44:32.760 INFO:teuthology.orchestra.run.trial160.stdout:[client] 2026-02-12T08:44:32.760 INFO:teuthology.orchestra.run.trial160.stdout: rgw cache enabled = true 2026-02-12T08:44:32.760 INFO:teuthology.orchestra.run.trial160.stdout: rgw enable ops log = true 2026-02-12T08:44:32.760 INFO:teuthology.orchestra.run.trial160.stdout: rgw enable usage log = true 2026-02-12T08:44:32.760 INFO:teuthology.orchestra.run.trial160.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T08:44:32.760 INFO:teuthology.orchestra.run.trial160.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T08:44:32.760 INFO:teuthology.orchestra.run.trial160.stdout:[mon.a] 2026-02-12T08:44:32.762 INFO:teuthology.orchestra.run.trial181.stdout:[global] 2026-02-12T08:44:32.762 INFO:teuthology.orchestra.run.trial181.stdout: chdir = "" 2026-02-12T08:44:32.762 INFO:teuthology.orchestra.run.trial181.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T08:44:32.762 INFO:teuthology.orchestra.run.trial181.stdout: auth supported = cephx 2026-02-12T08:44:32.762 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.762 INFO:teuthology.orchestra.run.trial181.stdout: filestore xattr use omap = true 2026-02-12T08:44:32.763 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.763 INFO:teuthology.orchestra.run.trial181.stdout: mon clock drift allowed = 1.000 2026-02-12T08:44:32.763 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.763 INFO:teuthology.orchestra.run.trial181.stdout: osd crush chooseleaf type = 0 2026-02-12T08:44:32.763 INFO:teuthology.orchestra.run.trial181.stdout: auth debug = true 2026-02-12T08:44:32.763 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.763 INFO:teuthology.orchestra.run.trial181.stdout: ms die on old message = true 2026-02-12T08:44:32.763 INFO:teuthology.orchestra.run.trial181.stdout: ms die on bug = true 2026-02-12T08:44:32.763 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.763 INFO:teuthology.orchestra.run.trial181.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T08:44:32.763 INFO:teuthology.orchestra.run.trial181.stdout: mon pg warn max object skew = 0 2026-02-12T08:44:32.763 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.764 INFO:teuthology.orchestra.run.trial181.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T08:44:32.764 INFO:teuthology.orchestra.run.trial181.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T08:44:32.764 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.764 INFO:teuthology.orchestra.run.trial181.stdout: osd pool default size = 2 2026-02-12T08:44:32.764 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.764 INFO:teuthology.orchestra.run.trial181.stdout: mon osd allow primary affinity = true 2026-02-12T08:44:32.764 INFO:teuthology.orchestra.run.trial181.stdout: mon osd allow pg remap = true 2026-02-12T08:44:32.764 INFO:teuthology.orchestra.run.trial181.stdout: mon warn on legacy crush tunables = false 2026-02-12T08:44:32.764 INFO:teuthology.orchestra.run.trial181.stdout: mon warn on crush straw calc version zero = false 2026-02-12T08:44:32.764 INFO:teuthology.orchestra.run.trial181.stdout: mon warn on no sortbitwise = false 2026-02-12T08:44:32.764 INFO:teuthology.orchestra.run.trial181.stdout: mon warn on osd down out interval zero = false 2026-02-12T08:44:32.764 INFO:teuthology.orchestra.run.trial181.stdout: mon warn on too few osds = false 2026-02-12T08:44:32.765 INFO:teuthology.orchestra.run.trial181.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T08:44:32.765 INFO:teuthology.orchestra.run.trial181.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T08:44:32.765 INFO:teuthology.orchestra.run.trial181.stdout: mon_allow_pool_size_one = true 2026-02-12T08:44:32.765 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.765 INFO:teuthology.orchestra.run.trial181.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T08:44:32.765 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.765 INFO:teuthology.orchestra.run.trial181.stdout: osd default data pool replay window = 5 2026-02-12T08:44:32.765 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.765 INFO:teuthology.orchestra.run.trial181.stdout: mon allow pool delete = true 2026-02-12T08:44:32.765 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.765 INFO:teuthology.orchestra.run.trial181.stdout: mon cluster log file level = debug 2026-02-12T08:44:32.765 INFO:teuthology.orchestra.run.trial181.stdout: debug asserts on shutdown = true 2026-02-12T08:44:32.765 INFO:teuthology.orchestra.run.trial181.stdout: mon health detail to clog = false 2026-02-12T08:44:32.766 INFO:teuthology.orchestra.run.trial181.stdout: mon host = 10.20.193.160 2026-02-12T08:44:32.766 INFO:teuthology.orchestra.run.trial181.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-12T08:44:32.766 INFO:teuthology.orchestra.run.trial181.stdout: ms client mode = crc 2026-02-12T08:44:32.766 INFO:teuthology.orchestra.run.trial181.stdout: ms cluster mode = crc 2026-02-12T08:44:32.766 INFO:teuthology.orchestra.run.trial181.stdout: ms mon client mode = crc 2026-02-12T08:44:32.766 INFO:teuthology.orchestra.run.trial181.stdout: ms mon cluster mode = crc 2026-02-12T08:44:32.766 INFO:teuthology.orchestra.run.trial181.stdout: ms mon service mode = crc 2026-02-12T08:44:32.766 INFO:teuthology.orchestra.run.trial181.stdout: ms service mode = crc 2026-02-12T08:44:32.766 INFO:teuthology.orchestra.run.trial181.stdout: fsid = c797b341-9be1-4308-bb3e-bbe04740db3f 2026-02-12T08:44:32.766 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.766 INFO:teuthology.orchestra.run.trial181.stdout:[osd] 2026-02-12T08:44:32.766 INFO:teuthology.orchestra.run.trial181.stdout: osd journal size = 100 2026-02-12T08:44:32.767 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.767 INFO:teuthology.orchestra.run.trial181.stdout: osd scrub load threshold = 5.0 2026-02-12T08:44:32.767 INFO:teuthology.orchestra.run.trial181.stdout: osd scrub max interval = 600 2026-02-12T08:44:32.767 INFO:teuthology.orchestra.run.trial181.stdout: osd mclock profile = high_recovery_ops 2026-02-12T08:44:32.767 INFO:teuthology.orchestra.run.trial181.stdout: osd mclock skip benchmark = true 2026-02-12T08:44:32.767 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.767 INFO:teuthology.orchestra.run.trial181.stdout: osd recover clone overlap = true 2026-02-12T08:44:32.767 INFO:teuthology.orchestra.run.trial181.stdout: osd recovery max chunk = 1048576 2026-02-12T08:44:32.767 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.767 INFO:teuthology.orchestra.run.trial181.stdout: osd debug shutdown = true 2026-02-12T08:44:32.767 INFO:teuthology.orchestra.run.trial181.stdout: osd debug op order = true 2026-02-12T08:44:32.767 INFO:teuthology.orchestra.run.trial181.stdout: osd debug verify stray on activate = true 2026-02-12T08:44:32.767 INFO:teuthology.orchestra.run.trial181.stdout: osd debug trim objects = true 2026-02-12T08:44:32.768 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.768 INFO:teuthology.orchestra.run.trial181.stdout: osd open classes on start = true 2026-02-12T08:44:32.768 INFO:teuthology.orchestra.run.trial181.stdout: osd debug pg log writeout = true 2026-02-12T08:44:32.768 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.768 INFO:teuthology.orchestra.run.trial181.stdout: osd deep scrub update digest min age = 30 2026-02-12T08:44:32.768 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.768 INFO:teuthology.orchestra.run.trial181.stdout: osd map max advance = 10 2026-02-12T08:44:32.768 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.768 INFO:teuthology.orchestra.run.trial181.stdout: journal zero on create = true 2026-02-12T08:44:32.768 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.768 INFO:teuthology.orchestra.run.trial181.stdout: filestore ondisk finisher threads = 3 2026-02-12T08:44:32.768 INFO:teuthology.orchestra.run.trial181.stdout: filestore apply finisher threads = 3 2026-02-12T08:44:32.769 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.769 INFO:teuthology.orchestra.run.trial181.stdout: bdev debug aio = true 2026-02-12T08:44:32.769 INFO:teuthology.orchestra.run.trial181.stdout: osd debug misdirected ops = true 2026-02-12T08:44:32.769 INFO:teuthology.orchestra.run.trial181.stdout: debug monc = 20 2026-02-12T08:44:32.769 INFO:teuthology.orchestra.run.trial181.stdout: crimson cpu num = 4 2026-02-12T08:44:32.769 INFO:teuthology.orchestra.run.trial181.stdout: crimson osd obc lru size = 10 2026-02-12T08:44:32.769 INFO:teuthology.orchestra.run.trial181.stdout: debug ms = 20 2026-02-12T08:44:32.769 INFO:teuthology.orchestra.run.trial181.stdout: debug osd = 20 2026-02-12T08:44:32.769 INFO:teuthology.orchestra.run.trial181.stdout: debug seastore = 20 2026-02-12T08:44:32.769 INFO:teuthology.orchestra.run.trial181.stdout: debug seastore backref = 20 2026-02-12T08:44:32.769 INFO:teuthology.orchestra.run.trial181.stdout: debug seastore cache = 20 2026-02-12T08:44:32.769 INFO:teuthology.orchestra.run.trial181.stdout: debug seastore cleaner = 20 2026-02-12T08:44:32.769 INFO:teuthology.orchestra.run.trial181.stdout: debug seastore device = 20 2026-02-12T08:44:32.770 INFO:teuthology.orchestra.run.trial181.stdout: debug seastore epm = 20 2026-02-12T08:44:32.770 INFO:teuthology.orchestra.run.trial181.stdout: debug seastore fixedkv tree = 20 2026-02-12T08:44:32.770 INFO:teuthology.orchestra.run.trial181.stdout: debug seastore journal = 20 2026-02-12T08:44:32.770 INFO:teuthology.orchestra.run.trial181.stdout: debug seastore lba = 20 2026-02-12T08:44:32.770 INFO:teuthology.orchestra.run.trial181.stdout: debug seastore odata = 20 2026-02-12T08:44:32.770 INFO:teuthology.orchestra.run.trial181.stdout: debug seastore omap = 20 2026-02-12T08:44:32.770 INFO:teuthology.orchestra.run.trial181.stdout: debug seastore onode = 20 2026-02-12T08:44:32.770 INFO:teuthology.orchestra.run.trial181.stdout: debug seastore t = 20 2026-02-12T08:44:32.770 INFO:teuthology.orchestra.run.trial181.stdout: debug seastore tm = 20 2026-02-12T08:44:32.770 INFO:teuthology.orchestra.run.trial181.stdout: osd objectstore = seastore 2026-02-12T08:44:32.770 INFO:teuthology.orchestra.run.trial181.stdout: osd shutdown pgref assert = True 2026-02-12T08:44:32.770 INFO:teuthology.orchestra.run.trial181.stdout: seastore cachepin size pershard = 64M 2026-02-12T08:44:32.770 INFO:teuthology.orchestra.run.trial181.stdout: seastore cachepin type = 2Q 2026-02-12T08:44:32.771 INFO:teuthology.orchestra.run.trial181.stdout: seastore max concurrent transactions = 8 2026-02-12T08:44:32.771 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.771 INFO:teuthology.orchestra.run.trial181.stdout:[mgr] 2026-02-12T08:44:32.771 INFO:teuthology.orchestra.run.trial181.stdout: debug ms = 1 2026-02-12T08:44:32.771 INFO:teuthology.orchestra.run.trial181.stdout: debug mgr = 20 2026-02-12T08:44:32.771 INFO:teuthology.orchestra.run.trial181.stdout: debug mon = 20 2026-02-12T08:44:32.771 INFO:teuthology.orchestra.run.trial181.stdout: debug auth = 20 2026-02-12T08:44:32.771 INFO:teuthology.orchestra.run.trial181.stdout: mon reweight min pgs per osd = 4 2026-02-12T08:44:32.771 INFO:teuthology.orchestra.run.trial181.stdout: mon reweight min bytes per osd = 10 2026-02-12T08:44:32.771 INFO:teuthology.orchestra.run.trial181.stdout: mgr/telemetry/nag = false 2026-02-12T08:44:32.771 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.771 INFO:teuthology.orchestra.run.trial181.stdout:[mon] 2026-02-12T08:44:32.771 INFO:teuthology.orchestra.run.trial181.stdout: debug ms = 1 2026-02-12T08:44:32.772 INFO:teuthology.orchestra.run.trial181.stdout: debug mon = 20 2026-02-12T08:44:32.772 INFO:teuthology.orchestra.run.trial181.stdout: debug paxos = 20 2026-02-12T08:44:32.772 INFO:teuthology.orchestra.run.trial181.stdout: debug auth = 20 2026-02-12T08:44:32.772 INFO:teuthology.orchestra.run.trial181.stdout: mon data avail warn = 5 2026-02-12T08:44:32.772 INFO:teuthology.orchestra.run.trial181.stdout: mon mgr mkfs grace = 240 2026-02-12T08:44:32.772 INFO:teuthology.orchestra.run.trial181.stdout: mon reweight min pgs per osd = 4 2026-02-12T08:44:32.772 INFO:teuthology.orchestra.run.trial181.stdout: mon osd reporter subtree level = osd 2026-02-12T08:44:32.772 INFO:teuthology.orchestra.run.trial181.stdout: mon osd prime pg temp = true 2026-02-12T08:44:32.772 INFO:teuthology.orchestra.run.trial181.stdout: mon reweight min bytes per osd = 10 2026-02-12T08:44:32.772 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.772 INFO:teuthology.orchestra.run.trial181.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T08:44:32.772 INFO:teuthology.orchestra.run.trial181.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T08:44:32.772 INFO:teuthology.orchestra.run.trial181.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T08:44:32.773 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.773 INFO:teuthology.orchestra.run.trial181.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T08:44:32.773 INFO:teuthology.orchestra.run.trial181.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T08:44:32.773 INFO:teuthology.orchestra.run.trial181.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T08:44:32.773 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.773 INFO:teuthology.orchestra.run.trial181.stdout: # 1m isn't quite enough 2026-02-12T08:44:32.773 INFO:teuthology.orchestra.run.trial181.stdout: mon_down_mkfs_grace = 2m 2026-02-12T08:44:32.773 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.773 INFO:teuthology.orchestra.run.trial181.stdout: mon_warn_on_filestore_osds = false 2026-02-12T08:44:32.773 INFO:teuthology.orchestra.run.trial181.stdout: mon min osdmap epochs = 50 2026-02-12T08:44:32.773 INFO:teuthology.orchestra.run.trial181.stdout: mon osdmap full prune interval = 2 2026-02-12T08:44:32.773 INFO:teuthology.orchestra.run.trial181.stdout: mon osdmap full prune min = 15 2026-02-12T08:44:32.773 INFO:teuthology.orchestra.run.trial181.stdout: mon osdmap full prune txsize = 2 2026-02-12T08:44:32.774 INFO:teuthology.orchestra.run.trial181.stdout: paxos service trim min = 10 2026-02-12T08:44:32.774 INFO:teuthology.orchestra.run.trial181.stdout: osd pool default crimson = True 2026-02-12T08:44:32.774 INFO:teuthology.orchestra.run.trial181.stdout: 2026-02-12T08:44:32.774 INFO:teuthology.orchestra.run.trial181.stdout:[client] 2026-02-12T08:44:32.774 INFO:teuthology.orchestra.run.trial181.stdout: rgw cache enabled = true 2026-02-12T08:44:32.774 INFO:teuthology.orchestra.run.trial181.stdout: rgw enable ops log = true 2026-02-12T08:44:32.774 INFO:teuthology.orchestra.run.trial181.stdout: rgw enable usage log = true 2026-02-12T08:44:32.774 INFO:teuthology.orchestra.run.trial181.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T08:44:32.774 INFO:teuthology.orchestra.run.trial181.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T08:44:32.774 INFO:teuthology.orchestra.run.trial181.stdout:[mon.a] 2026-02-12T08:44:32.775 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-12T08:44:32.775 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-12T08:44:32.852 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-12T08:44:32.852 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:44:32.853 DEBUG:teuthology.orchestra.run.trial160:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-12T08:44:32.869 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:44:32.869 DEBUG:teuthology.orchestra.run.trial160:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-12T08:44:32.927 INFO:tasks.ceph:Sending monmap to node ubuntu@trial160.front.sepia.ceph.com 2026-02-12T08:44:32.928 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:44:32.928 DEBUG:teuthology.orchestra.run.trial160:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T08:44:32.928 DEBUG:teuthology.orchestra.run.trial160:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T08:44:32.999 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:44:33.000 DEBUG:teuthology.orchestra.run.trial160:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:44:33.056 INFO:tasks.ceph:Sending monmap to node ubuntu@trial181.front.sepia.ceph.com 2026-02-12T08:44:33.057 DEBUG:teuthology.orchestra.run.trial181:> set -ex 2026-02-12T08:44:33.057 DEBUG:teuthology.orchestra.run.trial181:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T08:44:33.057 DEBUG:teuthology.orchestra.run.trial181:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T08:44:33.091 DEBUG:teuthology.orchestra.run.trial181:> set -ex 2026-02-12T08:44:33.091 DEBUG:teuthology.orchestra.run.trial181:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:44:33.147 INFO:tasks.ceph:Setting up mon nodes... 2026-02-12T08:44:33.147 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-12T08:44:33.148 DEBUG:teuthology.orchestra.run.trial181:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T08:44:33.239 INFO:teuthology.orchestra.run.trial181.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T08:44:33.242 INFO:tasks.ceph:Setting up mds nodes... 2026-02-12T08:44:33.242 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-12T08:44:33.243 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-12T08:44:33.285 INFO:teuthology.orchestra.run.trial160.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-12T08:44:33.296 DEBUG:teuthology.orchestra.run.trial181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-12T08:44:33.339 INFO:teuthology.orchestra.run.trial181.stdout:creating /etc/ceph/ceph.client.1.keyring 2026-02-12T08:44:33.351 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-12T08:44:33.352 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial160.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial181.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-12T08:44:33.352 DEBUG:teuthology.orchestra.run.trial160:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-12T08:44:33.379 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-12T08:44:33.379 INFO:tasks.ceph:role: osd.0 2026-02-12T08:44:33.379 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial160.front.sepia.ceph.com 2026-02-12T08:44:33.379 DEBUG:teuthology.orchestra.run.trial160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T08:44:33.443 INFO:teuthology.orchestra.run.trial160.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T08:44:33.443 INFO:teuthology.orchestra.run.trial160.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T08:44:33.444 INFO:teuthology.orchestra.run.trial160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T08:44:33.444 INFO:teuthology.orchestra.run.trial160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T08:44:33.444 INFO:teuthology.orchestra.run.trial160.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T08:44:33.444 INFO:teuthology.orchestra.run.trial160.stdout: = sunit=0 swidth=0 blks 2026-02-12T08:44:33.444 INFO:teuthology.orchestra.run.trial160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T08:44:33.444 INFO:teuthology.orchestra.run.trial160.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T08:44:33.444 INFO:teuthology.orchestra.run.trial160.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T08:44:33.444 INFO:teuthology.orchestra.run.trial160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T08:44:34.023 INFO:teuthology.orchestra.run.trial160.stdout:Discarding blocks...Done. 2026-02-12T08:44:34.025 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial160.front.sepia.ceph.com -o noatime 2026-02-12T08:44:34.025 DEBUG:teuthology.orchestra.run.trial160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-12T08:44:34.098 DEBUG:teuthology.orchestra.run.trial160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-12T08:44:34.165 DEBUG:teuthology.orchestra.run.trial160:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-12T08:44:34.229 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-12T08:44:34.229 INFO:tasks.ceph:role: osd.1 2026-02-12T08:44:34.229 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial160.front.sepia.ceph.com 2026-02-12T08:44:34.229 DEBUG:teuthology.orchestra.run.trial160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T08:44:34.294 INFO:teuthology.orchestra.run.trial160.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T08:44:34.294 INFO:teuthology.orchestra.run.trial160.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T08:44:34.294 INFO:teuthology.orchestra.run.trial160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T08:44:34.294 INFO:teuthology.orchestra.run.trial160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T08:44:34.295 INFO:teuthology.orchestra.run.trial160.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T08:44:34.295 INFO:teuthology.orchestra.run.trial160.stdout: = sunit=0 swidth=0 blks 2026-02-12T08:44:34.295 INFO:teuthology.orchestra.run.trial160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T08:44:34.295 INFO:teuthology.orchestra.run.trial160.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T08:44:34.295 INFO:teuthology.orchestra.run.trial160.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T08:44:34.295 INFO:teuthology.orchestra.run.trial160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T08:44:34.854 INFO:teuthology.orchestra.run.trial160.stdout:Discarding blocks...Done. 2026-02-12T08:44:34.856 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial160.front.sepia.ceph.com -o noatime 2026-02-12T08:44:34.856 DEBUG:teuthology.orchestra.run.trial160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-12T08:44:34.928 DEBUG:teuthology.orchestra.run.trial160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-12T08:44:34.996 DEBUG:teuthology.orchestra.run.trial160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:44:35.146 INFO:teuthology.orchestra.run.trial160.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T08:44:35.206 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:35,205 seastar - Reactor backend: linux-aio 2026-02-12T08:44:35.220 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:35,218 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:44:35.220 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:35,218 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:44:35.222 INFO:teuthology.orchestra.run.trial160.stderr:==18530==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:44:35.278 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:35,276 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-12T08:44:35.278 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:35,276 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-12T08:44:35.278 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:35,276 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-12T08:44:35.278 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:35,276 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-12T08:44:35.278 INFO:teuthology.orchestra.run.trial160.stderr:DEBUG 2026-02-12 08:44:35,277 [shard 0:main] seastar - reactor::drain 2026-02-12T08:44:37.374 INFO:teuthology.orchestra.run.trial160.stderr:----------------------------------------------------- 2026-02-12T08:44:37.375 INFO:teuthology.orchestra.run.trial160.stderr:Suppressions used: 2026-02-12T08:44:37.375 INFO:teuthology.orchestra.run.trial160.stderr: count bytes template 2026-02-12T08:44:37.375 INFO:teuthology.orchestra.run.trial160.stderr: 1 8 MallocExtension::Register 2026-02-12T08:44:37.375 INFO:teuthology.orchestra.run.trial160.stderr:----------------------------------------------------- 2026-02-12T08:44:37.375 INFO:teuthology.orchestra.run.trial160.stderr: 2026-02-12T08:44:37.393 INFO:teuthology.orchestra.run.trial160.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T08:44:37.394 INFO:teuthology.orchestra.run.trial160.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T08:44:37.438 INFO:teuthology.orchestra.run.trial160.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T08:44:37.438 INFO:teuthology.orchestra.run.trial160.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T08:44:37.445 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:37,444 seastar - Reactor backend: linux-aio 2026-02-12T08:44:37.458 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:37,456 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:44:37.458 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:37,456 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:44:37.461 INFO:teuthology.orchestra.run.trial160.stderr:==18528==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:44:37.461 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:37,460 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T08:44:37.520 INFO:teuthology.orchestra.run.trial160.stderr:DEBUG 2026-02-12 08:44:37,518 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-12T08:44:37.600 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x316a775 0x9c3de81 0x9c3e1f6 0x9c3eca5 0x9c3f1a3 0x9c3f7d3 0x9c3f93d 0x9d1fcad 0x9d32ab0 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:37.600 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x9bf2094 0x9d2f72c 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:37.600 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x109048a 0xf2dc9c 0x9c3d9d0 0x9c3dccd 0x9c3df40 0x9c3fc67 0x9d1ee32 0x9d1f5ab 0x9d1fa96 0x9d1fe29 0x9d32ab0 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:37.632 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x9c42231 0x9c42b69 0x9d2eb39 0x9d31b32 0x9d34537 0x9cf4b05 0x9cf3b05 0x7e4e747 0x7e51542 0x8f4a6cf 0x8f4d03d 0x7869e31 0x78a0834 0x6f918a5 0x754759e 0x75476f2 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f674ac 0x9be50b1 0x9be58ec 0xeced0d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46b04 2026-02-12T08:44:37.699 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x7d70899 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f674ac 0x9be50b1 0x9be58ec 0xeced0d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46b04 2026-02-12T08:44:37.738 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x2a50c6f 0x7d708a6 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:37.738 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6638 /lib64/libasan.so.8+0x151b7 0x2a5129f 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:37.739 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x2a50c14 0x7d708a6 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:37.865 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x10903bb 0xf2dc9c 0x9c3d803 0x9c3dccd 0x9c3df40 0x9c3ef40 0x9c3f4ae 0x9c3f7d3 0x9c3f93d 0x9d1fcad 0x9d32ab0 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:37.865 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libstdc++.so.6+0xc6443 0x9c4dc67 0x9c4e4cf 0x9d2b9bc 0x9d2bf8e 0x9d3645b 0x788188f 0x7bd6cd5 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:37.865 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xec07 /lib64/libasan.so.8+0xec796 0xcb00b1 0x9d3114f 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:37.947 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x12978a /lib64/libasan.so.8+0xc6631 /lib64/libasan.so.8+0x151b7 0x2a5129f 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f674ac 0x9be50b1 0x9be58ec 0xeced0d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46b04 2026-02-12T08:44:37.962 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x2a51102 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:37.962 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cc0c /lib64/libasan.so.8+0x1006bc /lib64/libasan.so.8+0xc6619 /lib64/libasan.so.8+0x151b7 0x2a5129f 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:37.962 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x2a51095 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:40.183 INFO:teuthology.orchestra.run.trial160.stderr:----------------------------------------------------- 2026-02-12T08:44:40.184 INFO:teuthology.orchestra.run.trial160.stderr:Suppressions used: 2026-02-12T08:44:40.184 INFO:teuthology.orchestra.run.trial160.stderr: count bytes template 2026-02-12T08:44:40.184 INFO:teuthology.orchestra.run.trial160.stderr: 1 8 MallocExtension::Register 2026-02-12T08:44:40.184 INFO:teuthology.orchestra.run.trial160.stderr:----------------------------------------------------- 2026-02-12T08:44:40.184 INFO:teuthology.orchestra.run.trial160.stderr: 2026-02-12T08:44:40.219 DEBUG:teuthology.orchestra.run.trial160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-12T08:44:40.245 DEBUG:teuthology.orchestra.run.trial160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:44:40.395 INFO:teuthology.orchestra.run.trial160.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T08:44:40.453 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:40,452 seastar - Reactor backend: linux-aio 2026-02-12T08:44:40.463 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:40,461 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:44:40.463 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:40,461 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:44:40.465 INFO:teuthology.orchestra.run.trial160.stderr:==18594==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:44:40.521 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:40,519 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-12T08:44:40.521 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:40,519 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-12T08:44:40.521 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:40,519 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-12T08:44:40.521 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:40,519 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-12T08:44:40.521 INFO:teuthology.orchestra.run.trial160.stderr:DEBUG 2026-02-12 08:44:40,520 [shard 0:main] seastar - reactor::drain 2026-02-12T08:44:42.574 INFO:teuthology.orchestra.run.trial160.stderr:----------------------------------------------------- 2026-02-12T08:44:42.574 INFO:teuthology.orchestra.run.trial160.stderr:Suppressions used: 2026-02-12T08:44:42.574 INFO:teuthology.orchestra.run.trial160.stderr: count bytes template 2026-02-12T08:44:42.574 INFO:teuthology.orchestra.run.trial160.stderr: 1 8 MallocExtension::Register 2026-02-12T08:44:42.575 INFO:teuthology.orchestra.run.trial160.stderr:----------------------------------------------------- 2026-02-12T08:44:42.575 INFO:teuthology.orchestra.run.trial160.stderr: 2026-02-12T08:44:42.594 INFO:teuthology.orchestra.run.trial160.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T08:44:42.594 INFO:teuthology.orchestra.run.trial160.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T08:44:42.635 INFO:teuthology.orchestra.run.trial160.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T08:44:42.635 INFO:teuthology.orchestra.run.trial160.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T08:44:42.642 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:42,641 seastar - Reactor backend: linux-aio 2026-02-12T08:44:42.656 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:42,655 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:44:42.657 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:42,655 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:44:42.661 INFO:teuthology.orchestra.run.trial160.stderr:==18592==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:44:42.661 INFO:teuthology.orchestra.run.trial160.stderr:INFO 2026-02-12 08:44:42,660 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T08:44:42.724 INFO:teuthology.orchestra.run.trial160.stderr:DEBUG 2026-02-12 08:44:42,722 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-12T08:44:42.804 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 32 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x11916f /lib64/libasan.so.8+0xebbf /lib64/libasan.so.8+0xec796 0xcb00b1 0x9d3114f 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f914c6 0x754759e 0x75476f2 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f674ac 0x9be50b1 0x9be58ec 0xeced0d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46b04 2026-02-12T08:44:42.804 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x9c88fcc 0x9cf4c96 0x9cf5490 0x9d04526 0x9d06fb1 0x9d071c2 0x9d0726e 0x9d2f38d 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:42.804 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x316a71f 0x9c3df2e 0x9c3fc67 0x9c401b4 0x9c403b3 0x9d256d5 0x9d25e30 0x9d300be 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:42.804 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297e4 /lib64/libasan.so.8+0xc6631 /lib64/libasan.so.8+0x157e7 0x10904af 0xf2dc9c 0x9c3d803 0x9c3dccd 0x9c3df40 0x9c3e1f6 0x9c3eca5 0x9c3f1a3 0x9c3f7d3 0x9c3f93d 0x9d1fcad 0x9d32ab0 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:42.878 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x7164c27 0x710f15f 0x6f914c6 0x754759e 0x75476f2 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:42.878 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0xcb7a24 0x109042a 0xf2dc9c 0x9c414ee 0x9c4179b 0x9d36701 0x788188f 0x7b86d85 0x7bdb25b 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f914c6 0x754759e 0x75476f2 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:42.902 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6622 /lib64/libasan.so.8+0x151b7 0x2a5129f 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f674ac 0x9be50b1 0x9be58ec 0xeced0d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46b04 2026-02-12T08:44:42.943 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x2a50b9b 0x7d708a6 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:42.944 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6622 /lib64/libasan.so.8+0x151b7 0x2a5129f 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:42.946 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x2a510ad 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:43.070 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1294e3 /lib64/libasan.so.8+0x1297ad /lib64/libasan.so.8+0xc6631 /lib64/libasan.so.8+0x157e7 0x9d12855 0x9d1296f 0x9d12a9a 0x9d12fc4 0x9d2f84f 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:43.070 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc250 /lib64/libasan.so.8+0xc553 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7fc 0x9b1228b 0x9cf92b2 0x9cf93e0 0x9d2b7eb 0x9d2bf8e 0x9d3645b 0x788188f 0x7bd6cd5 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:43.071 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x129787 /lib64/libasan.so.8+0xc6631 /lib64/libasan.so.8+0x151b7 0x1124fe8 0xf2dc91 0x9c3d9d0 0x9c3dccd 0x9c3df40 0x9c3e1f6 0x9c3eca5 0x9c3f1a3 0x9c3f7d3 0x9c3f93d 0x9d1fcad 0x9d32ab0 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:43.153 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x29fc44a 0x2a51240 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f674ac 0x9be50b1 0x9be58ec 0xeced0d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46b04 2026-02-12T08:44:43.167 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x2a5116c 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:43.168 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x7d70884 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:43.168 INFO:teuthology.orchestra.run.trial160.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cc0c /lib64/libasan.so.8+0x1006bc /lib64/libasan.so.8+0xc6619 /lib64/libasan.so.8+0x151b7 0x2a5129f 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:45.379 INFO:teuthology.orchestra.run.trial160.stderr:----------------------------------------------------- 2026-02-12T08:44:45.379 INFO:teuthology.orchestra.run.trial160.stderr:Suppressions used: 2026-02-12T08:44:45.379 INFO:teuthology.orchestra.run.trial160.stderr: count bytes template 2026-02-12T08:44:45.379 INFO:teuthology.orchestra.run.trial160.stderr: 1 8 MallocExtension::Register 2026-02-12T08:44:45.379 INFO:teuthology.orchestra.run.trial160.stderr:----------------------------------------------------- 2026-02-12T08:44:45.379 INFO:teuthology.orchestra.run.trial160.stderr: 2026-02-12T08:44:45.415 DEBUG:teuthology.orchestra.run.trial160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-12T08:44:45.441 DEBUG:teuthology.orchestra.run.trial181:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-12T08:44:45.467 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-12T08:44:45.467 INFO:tasks.ceph:role: osd.2 2026-02-12T08:44:45.468 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial181.front.sepia.ceph.com 2026-02-12T08:44:45.468 DEBUG:teuthology.orchestra.run.trial181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T08:44:45.532 INFO:teuthology.orchestra.run.trial181.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T08:44:45.532 INFO:teuthology.orchestra.run.trial181.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T08:44:45.533 INFO:teuthology.orchestra.run.trial181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T08:44:45.533 INFO:teuthology.orchestra.run.trial181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T08:44:45.533 INFO:teuthology.orchestra.run.trial181.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T08:44:45.533 INFO:teuthology.orchestra.run.trial181.stdout: = sunit=0 swidth=0 blks 2026-02-12T08:44:45.533 INFO:teuthology.orchestra.run.trial181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T08:44:45.533 INFO:teuthology.orchestra.run.trial181.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T08:44:45.533 INFO:teuthology.orchestra.run.trial181.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T08:44:45.533 INFO:teuthology.orchestra.run.trial181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T08:44:46.110 INFO:teuthology.orchestra.run.trial181.stdout:Discarding blocks...Done. 2026-02-12T08:44:46.112 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial181.front.sepia.ceph.com -o noatime 2026-02-12T08:44:46.112 DEBUG:teuthology.orchestra.run.trial181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-12T08:44:46.179 DEBUG:teuthology.orchestra.run.trial181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-12T08:44:46.246 DEBUG:teuthology.orchestra.run.trial181:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-12T08:44:46.310 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-12T08:44:46.311 INFO:tasks.ceph:role: osd.3 2026-02-12T08:44:46.311 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial181.front.sepia.ceph.com 2026-02-12T08:44:46.311 DEBUG:teuthology.orchestra.run.trial181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T08:44:46.377 INFO:teuthology.orchestra.run.trial181.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T08:44:46.377 INFO:teuthology.orchestra.run.trial181.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T08:44:46.377 INFO:teuthology.orchestra.run.trial181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T08:44:46.377 INFO:teuthology.orchestra.run.trial181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T08:44:46.377 INFO:teuthology.orchestra.run.trial181.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T08:44:46.377 INFO:teuthology.orchestra.run.trial181.stdout: = sunit=0 swidth=0 blks 2026-02-12T08:44:46.378 INFO:teuthology.orchestra.run.trial181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T08:44:46.378 INFO:teuthology.orchestra.run.trial181.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T08:44:46.378 INFO:teuthology.orchestra.run.trial181.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T08:44:46.378 INFO:teuthology.orchestra.run.trial181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T08:44:46.937 INFO:teuthology.orchestra.run.trial181.stdout:Discarding blocks...Done. 2026-02-12T08:44:46.939 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial181.front.sepia.ceph.com -o noatime 2026-02-12T08:44:46.939 DEBUG:teuthology.orchestra.run.trial181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2026-02-12T08:44:47.008 DEBUG:teuthology.orchestra.run.trial181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-12T08:44:47.075 DEBUG:teuthology.orchestra.run.trial181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:44:47.221 INFO:teuthology.orchestra.run.trial181.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T08:44:47.274 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:47,273 seastar - Reactor backend: linux-aio 2026-02-12T08:44:47.283 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:47,282 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:44:47.284 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:47,282 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:44:47.286 INFO:teuthology.orchestra.run.trial181.stderr:==18106==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:44:47.342 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:47,340 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-12T08:44:47.342 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:47,340 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-12T08:44:47.342 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:47,340 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-12T08:44:47.342 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:47,340 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-12T08:44:47.342 INFO:teuthology.orchestra.run.trial181.stderr:DEBUG 2026-02-12 08:44:47,341 [shard 0:main] seastar - reactor::drain 2026-02-12T08:44:49.622 INFO:teuthology.orchestra.run.trial181.stderr:----------------------------------------------------- 2026-02-12T08:44:49.622 INFO:teuthology.orchestra.run.trial181.stderr:Suppressions used: 2026-02-12T08:44:49.622 INFO:teuthology.orchestra.run.trial181.stderr: count bytes template 2026-02-12T08:44:49.622 INFO:teuthology.orchestra.run.trial181.stderr: 1 8 MallocExtension::Register 2026-02-12T08:44:49.622 INFO:teuthology.orchestra.run.trial181.stderr:----------------------------------------------------- 2026-02-12T08:44:49.622 INFO:teuthology.orchestra.run.trial181.stderr: 2026-02-12T08:44:49.641 INFO:teuthology.orchestra.run.trial181.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T08:44:49.641 INFO:teuthology.orchestra.run.trial181.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T08:44:49.682 INFO:teuthology.orchestra.run.trial181.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T08:44:49.682 INFO:teuthology.orchestra.run.trial181.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T08:44:49.689 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:49,688 seastar - Reactor backend: linux-aio 2026-02-12T08:44:49.700 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:49,699 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:44:49.700 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:49,699 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:44:49.704 INFO:teuthology.orchestra.run.trial181.stderr:==18104==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:44:49.704 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:49,703 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T08:44:49.762 INFO:teuthology.orchestra.run.trial181.stderr:DEBUG 2026-02-12 08:44:49,761 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-12T08:44:49.842 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xa361 /lib64/libasan.so.8+0xc488 /lib64/libasan.so.8+0x8eea /lib64/libasan.so.8+0xedc65 0xe0b375 0xe0b5ab 0x7bd71fa 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:49.842 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x157d7 0x10904af 0xf2dc9c 0x9c3d9d0 0x9c3dccd 0x9c3df40 0x9c3fc67 0x9c401b4 0x9c403b3 0x9d256d5 0x9d25e30 0x9d300be 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:49.842 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x191c1b /lib64/libasan.so.8+0xc748 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7fc 0x9d1dfff 0x9d1e080 0x9d1e153 0x9d1e3d2 0x9d1e5a5 0x9d1e801 0x9d1e8f2 0x9d1f492 0x9d1fa96 0x9d1fe29 0x9d32ab0 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:49.843 INFO:teuthology.orchestra.run.trial181.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffb3bd3f17 0xffffffffb38910d2 0xffffffffb454d451 0xffffffffb4600ba2 2026-02-12T08:44:49.874 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65f2 /lib64/libasan.so.8+0x157e7 0xc95a72 0xca6fdd 0x9d32fef 0x9cf4b05 0x9cf3b05 0x7bdb876 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f914c6 0x754759e 0x75476f2 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f674ac 0x9be50b1 0x9be58ec 0xeced0d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46b04 2026-02-12T08:44:49.916 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x191ccd /lib64/libasan.so.8+0xc748 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7fc 0x133e054 0x2a56894 0x7f6ff1c 0x7f704d2 0x7f705fe 0x7f72a89 0x7f736e1 0x7db2f4e 0x7e2de59 0x7e50ef6 0x8f4a6cf 0x8f4d03d 0x7869e31 0x78a0834 0x6f918a5 0x754759e 0x75476f2 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:49.917 INFO:teuthology.orchestra.run.trial181.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffb3891052 0xffffffffb454d451 0xffffffffb4600ba2 2026-02-12T08:44:49.917 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x10902ca 0xf2dc9c 0x9c4222a 0x9c42b69 0x9d2eb39 0x9d317d5 0x9d34537 0x9cf4b05 0x9cf3b05 0x7e4e747 0x7e51542 0x8f4a6cf 0x8f4d03d 0x7869e31 0x78a0834 0x6f918a5 0x754759e 0x75476f2 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:49.918 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6622 /lib64/libasan.so.8+0x151b7 0x34bd665 0x34f80b3 0x34f82dd 0x35006a6 0x356d7dc 0x356d9db 0x356db41 0x33de5ca 0x33df48e 0xd00deb 0xd0109e 0xe3ac45 0x6f5dfa6 0x7191787 0x710f26a 0x6f914c6 0x754759e 0x75476f2 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:49.942 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x29fc44a 0x2a51240 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f674ac 0x9be50b1 0x9be58ec 0xeced0d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46b04 2026-02-12T08:44:49.983 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6622 /lib64/libasan.so.8+0x151b7 0x2a5129f 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:49.983 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x2a50bcc 0x7d708a6 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:49.984 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x2a51235 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:50.122 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xeabb6 0xe1ce8e 0xe1d249 0x9d32d2c 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:50.122 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc662c /lib64/libasan.so.8+0x151b7 0x316a7d9 0x9c3df2e 0x9c3e1f6 0x9c3eca5 0x9c3f1a3 0x9c3f7d3 0x9c3f93d 0x9d1fcad 0x9d32ab0 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:50.122 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x9d35927 0x9d36778 0x788188f 0x7bd6cd5 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:50.204 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cbf3 /lib64/libasan.so.8+0x1006bc /lib64/libasan.so.8+0xc6619 /lib64/libasan.so.8+0x151b7 0x2a5129f 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f674ac 0x9be50b1 0x9be58ec 0xeced0d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46b04 2026-02-12T08:44:50.220 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x129787 /lib64/libasan.so.8+0xc6631 /lib64/libasan.so.8+0x151b7 0x2a5129f 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:50.220 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297ad /lib64/libasan.so.8+0xc6631 /lib64/libasan.so.8+0x151b7 0x2a5129f 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:50.221 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x2a50b58 0x7d708a6 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:52.473 INFO:teuthology.orchestra.run.trial181.stderr:----------------------------------------------------- 2026-02-12T08:44:52.473 INFO:teuthology.orchestra.run.trial181.stderr:Suppressions used: 2026-02-12T08:44:52.473 INFO:teuthology.orchestra.run.trial181.stderr: count bytes template 2026-02-12T08:44:52.473 INFO:teuthology.orchestra.run.trial181.stderr: 1 8 MallocExtension::Register 2026-02-12T08:44:52.473 INFO:teuthology.orchestra.run.trial181.stderr:----------------------------------------------------- 2026-02-12T08:44:52.474 INFO:teuthology.orchestra.run.trial181.stderr: 2026-02-12T08:44:52.507 DEBUG:teuthology.orchestra.run.trial181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-12T08:44:52.533 DEBUG:teuthology.orchestra.run.trial181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:44:52.684 INFO:teuthology.orchestra.run.trial181.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T08:44:52.737 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:52,736 seastar - Reactor backend: linux-aio 2026-02-12T08:44:52.746 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:52,745 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:44:52.746 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:52,745 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:44:52.749 INFO:teuthology.orchestra.run.trial181.stderr:==18172==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:44:52.805 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:52,804 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-12T08:44:52.805 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:52,804 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-12T08:44:52.806 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:52,804 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-12T08:44:52.806 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:52,804 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-12T08:44:52.806 INFO:teuthology.orchestra.run.trial181.stderr:DEBUG 2026-02-12 08:44:52,804 [shard 0:main] seastar - reactor::drain 2026-02-12T08:44:54.909 INFO:teuthology.orchestra.run.trial181.stderr:----------------------------------------------------- 2026-02-12T08:44:54.909 INFO:teuthology.orchestra.run.trial181.stderr:Suppressions used: 2026-02-12T08:44:54.909 INFO:teuthology.orchestra.run.trial181.stderr: count bytes template 2026-02-12T08:44:54.910 INFO:teuthology.orchestra.run.trial181.stderr: 1 8 MallocExtension::Register 2026-02-12T08:44:54.910 INFO:teuthology.orchestra.run.trial181.stderr:----------------------------------------------------- 2026-02-12T08:44:54.910 INFO:teuthology.orchestra.run.trial181.stderr: 2026-02-12T08:44:54.929 INFO:teuthology.orchestra.run.trial181.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T08:44:54.929 INFO:teuthology.orchestra.run.trial181.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T08:44:54.970 INFO:teuthology.orchestra.run.trial181.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T08:44:54.970 INFO:teuthology.orchestra.run.trial181.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T08:44:54.977 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:54,976 seastar - Reactor backend: linux-aio 2026-02-12T08:44:54.989 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:54,988 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:44:54.990 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:54,988 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:44:54.994 INFO:teuthology.orchestra.run.trial181.stderr:==18170==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:44:54.994 INFO:teuthology.orchestra.run.trial181.stderr:INFO 2026-02-12 08:44:54,993 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T08:44:55.056 INFO:teuthology.orchestra.run.trial181.stderr:DEBUG 2026-02-12 08:44:55,055 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-12T08:44:55.137 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x9c4c4df 0x9d127a7 0x9d1296f 0x9d12ad0 0x9d12fc4 0x9d2f84f 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:55.137 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1585b 0x35e89ab 0x35e8b2b 0x36049a8 0x9c4fecb 0x9c4ffd3 0x9d0fd7b 0x9d0ff10 0x9d102a2 0x9d11889 0x9d12ba4 0x9d12fc4 0x9d2f84f 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:55.137 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65f2 /lib64/libasan.so.8+0x15e57 0x9bfdb7f 0x9c36f98 0x9d08328 0x9d347a4 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:55.169 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x9d2bea9 0x9d3645b 0x7b85178 0x7b85fc0 0x7bdb25b 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f914c6 0x754759e 0x75476f2 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f674ac 0x9be50b1 0x9be58ec 0xeced0d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46b04 2026-02-12T08:44:55.211 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x16ce6 0x9d2678c 0x9d2b950 0x9d2bf8e 0x9d3645b 0x788188f 0x7bd80f9 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f914c6 0x754759e 0x75476f2 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:55.212 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cc0c /lib64/libasan.so.8+0x1006bc /lib64/libasan.so.8+0xc6619 /lib64/libasan.so.8+0x157e7 0x10904af 0xf2dc9c 0x9d2effd 0x9d318da 0x9d34537 0x9cf4b05 0x9cf3b05 0x8f48cb7 0x8f49ecc 0x8f4d03d 0x7869e31 0x78a0834 0x6f918a5 0x754759e 0x75476f2 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:55.212 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0xb4e82c 0xc07d33 0xc07f24 0xc07fd9 0xc08095 0xc08321 0xc7486c 0xa5c3f89 0xc6a2d7 0xa110601 0xa6263c7 0xa626747 0xb52f99 0xb9aa67 0xc74983 0xc74c18 0xc7b03b 0xc7b57a 0xa5c3e7a 0xc6c8fa 0xa545999 0xa618fe2 0x10da527 0x7e516a1 0x8f4a6cf 0x8f4d03d 0x7869e31 0x78a0834 0x6f918a5 0x754759e 0x75476f2 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:55.238 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x2a511a9 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f674ac 0x9be50b1 0x9be58ec 0xeced0d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46b04 2026-02-12T08:44:55.278 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x29fc44a 0x2a51240 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:55.278 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x129859 /lib64/libasan.so.8+0xc6631 /lib64/libasan.so.8+0x151b7 0x2a5129f 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:55.281 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6611 /lib64/libasan.so.8+0x151b7 0x2a5129f 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:55.413 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x78453c3 0x9d36519 0x788188f 0x7bd6cd5 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:55.413 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65f2 /lib64/libasan.so.8+0x151b7 0x1124fe8 0xf2dc91 0x9c4222a 0x9c42b69 0x9d2eb39 0x9d2fa59 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:55.413 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0xa888bf 0x9c4c12e 0x9d127a7 0x9d1296f 0x9d12a9a 0x9d12fc4 0x9d2f84f 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:55.496 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1294d6 /lib64/libasan.so.8+0x1297ad /lib64/libasan.so.8+0xc6631 /lib64/libasan.so.8+0x151b7 0x2a5129f 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f674ac 0x9be50b1 0x9be58ec 0xeced0d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46b04 2026-02-12T08:44:55.511 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x2a50c2b 0x7d708a6 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:55.512 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x2a50087 0x7d70884 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:55.512 INFO:teuthology.orchestra.run.trial181.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6622 /lib64/libasan.so.8+0x151b7 0x2a5129f 0x7d7086b 0x7d8ce10 0x7e2ea95 0x7dae38f 0x7864ca5 0x786599a 0x799acdc 0x7823dae 0x789ee50 0x78e75e3 0x78e785c 0x7988a34 0x7988b93 0x799ae3f 0x7855926 0x79776a3 0x7977732 0x79777d6 0x73d42f8 0x73f4757 0x73f93f8 0x753a894 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:44:57.765 INFO:teuthology.orchestra.run.trial181.stderr:----------------------------------------------------- 2026-02-12T08:44:57.765 INFO:teuthology.orchestra.run.trial181.stderr:Suppressions used: 2026-02-12T08:44:57.765 INFO:teuthology.orchestra.run.trial181.stderr: count bytes template 2026-02-12T08:44:57.765 INFO:teuthology.orchestra.run.trial181.stderr: 1 8 MallocExtension::Register 2026-02-12T08:44:57.766 INFO:teuthology.orchestra.run.trial181.stderr:----------------------------------------------------- 2026-02-12T08:44:57.766 INFO:teuthology.orchestra.run.trial181.stderr: 2026-02-12T08:44:57.800 DEBUG:teuthology.orchestra.run.trial181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-12T08:44:57.825 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-12T08:44:57.826 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:44:57.826 DEBUG:teuthology.orchestra.run.trial160:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-12T08:44:57.852 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:44:57.852 DEBUG:teuthology.orchestra.run.trial160:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-12T08:44:57.916 DEBUG:teuthology.orchestra.run.trial181:> set -ex 2026-02-12T08:44:57.916 DEBUG:teuthology.orchestra.run.trial181:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-12T08:44:57.941 DEBUG:teuthology.orchestra.run.trial181:> set -ex 2026-02-12T08:44:57.942 DEBUG:teuthology.orchestra.run.trial181:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-12T08:44:58.006 DEBUG:teuthology.orchestra.run.trial181:> set -ex 2026-02-12T08:44:58.006 DEBUG:teuthology.orchestra.run.trial181:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-12T08:44:58.069 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:44:58.070 DEBUG:teuthology.orchestra.run.trial160:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-12T08:44:58.088 DEBUG:teuthology.orchestra.run.trial181:> set -ex 2026-02-12T08:44:58.089 DEBUG:teuthology.orchestra.run.trial181:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2026-02-12T08:44:58.128 INFO:tasks.ceph:Adding keys to all mons... 2026-02-12T08:44:58.128 DEBUG:teuthology.orchestra.run.trial160:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-12T08:44:58.152 INFO:teuthology.orchestra.run.trial160.stdout:[osd.0] 2026-02-12T08:44:58.153 INFO:teuthology.orchestra.run.trial160.stdout: key = AQD1ko1pLI0rHxAAVLZTregNZ6bbUDduWzx+Tg== 2026-02-12T08:44:58.153 INFO:teuthology.orchestra.run.trial160.stdout:[osd.1] 2026-02-12T08:44:58.153 INFO:teuthology.orchestra.run.trial160.stdout: key = AQD6ko1pBNZPKxAAUcguWymuqbDliR8UfEEpYw== 2026-02-12T08:44:58.153 INFO:teuthology.orchestra.run.trial160.stdout:[mgr.x] 2026-02-12T08:44:58.153 INFO:teuthology.orchestra.run.trial160.stdout: key = AQDxko1p5m81DhAAH2IurRLYZxZbHFJ5yWmUfg== 2026-02-12T08:44:58.153 INFO:teuthology.orchestra.run.trial160.stdout:[osd.2] 2026-02-12T08:44:58.153 INFO:teuthology.orchestra.run.trial160.stdout: key = AQABk41pjiidLRAATX086vpg4XHFhvyVH9WujA== 2026-02-12T08:44:58.153 INFO:teuthology.orchestra.run.trial160.stdout:[osd.3] 2026-02-12T08:44:58.154 INFO:teuthology.orchestra.run.trial160.stdout: key = AQAHk41pqwSKAxAAGq7APQKxLn8kY7lhD4qaHA== 2026-02-12T08:44:58.154 INFO:teuthology.orchestra.run.trial160.stdout:[client.0] 2026-02-12T08:44:58.154 INFO:teuthology.orchestra.run.trial160.stdout: key = AQDxko1pShXxEBAAJnPcN0ryJQQ2f7RRm5Fyyw== 2026-02-12T08:44:58.154 INFO:teuthology.orchestra.run.trial160.stdout:[client.1] 2026-02-12T08:44:58.154 INFO:teuthology.orchestra.run.trial160.stdout: key = AQDxko1pNMQvFBAA3HctVfyHpjGwuMkYn/oo6A== 2026-02-12T08:44:58.155 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T08:44:58.245 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T08:44:58.294 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-12T08:44:58.343 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T08:44:58.392 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T08:44:58.440 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-12T08:44:58.490 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-12T08:44:58.540 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-12T08:44:58.540 DEBUG:teuthology.orchestra.run.trial160:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-12T08:44:58.565 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T08:44:58.651 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:44:58.648+0000 7f64adb02c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:44:58.651 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:44:58.648+0000 7f64adb02c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:44:58.662 DEBUG:teuthology.orchestra.run.trial160:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-12T08:44:58.687 DEBUG:teuthology.orchestra.run.trial160:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:44:58.744 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-12T08:44:58.745 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-12T08:44:58.745 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-12T08:44:58.787 INFO:tasks.ceph.mon.a:Started 2026-02-12T08:44:58.787 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-12T08:44:58.788 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-12T08:44:58.788 DEBUG:teuthology.orchestra.run.trial181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-12T08:44:58.791 INFO:tasks.ceph.mgr.x:Started 2026-02-12T08:44:58.791 DEBUG:tasks.ceph:set 0 configs 2026-02-12T08:44:58.791 DEBUG:teuthology.orchestra.run.trial160:> sudo ceph --cluster ceph config dump 2026-02-12T08:44:58.850 INFO:tasks.ceph.mon.a.trial160.stderr:2026-02-12T08:44:58.848+0000 7f98d6e34c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:44:58.850 INFO:tasks.ceph.mon.a.trial160.stderr:2026-02-12T08:44:58.848+0000 7f98d6e34c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:44:58.850 INFO:tasks.ceph.mon.a.trial160.stderr:2026-02-12T08:44:58.848+0000 7f98d6e34c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:44:58.851 INFO:tasks.ceph.mgr.x.trial181.stderr:2026-02-12T08:44:58.849+0000 7f9573030fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:44:58.866 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:44:58.862+0000 7fe2409ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:44:58.870 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:44:58.868+0000 7fe2409ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:44:58.875 INFO:tasks.ceph.mgr.x.trial181.stderr:2026-02-12T08:44:58.873+0000 7f9573030fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:44:58.875 INFO:tasks.ceph.mgr.x.trial181.stderr:2026-02-12T08:44:58.873+0000 7f9573030fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:44:58.903 INFO:teuthology.orchestra.run.trial160.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-12T08:44:58.912 INFO:tasks.ceph:Setting crush tunables to default 2026-02-12T08:44:58.912 DEBUG:teuthology.orchestra.run.trial160:> sudo ceph --cluster ceph osd crush tunables default 2026-02-12T08:44:58.988 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:44:58.982+0000 7f70ebd0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:44:58.990 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:44:58.988+0000 7f70ebd0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:44:59.026 INFO:teuthology.orchestra.run.trial160.stderr:adjusted tunables profile to default 2026-02-12T08:44:59.034 INFO:tasks.ceph:check_enable_crimson: True 2026-02-12T08:44:59.035 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-12T08:44:59.035 DEBUG:teuthology.orchestra.run.trial160:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-12T08:44:59.109 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:44:59.104+0000 7f866fc3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:44:59.112 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:44:59.110+0000 7f866fc3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:44:59.150 INFO:tasks.ceph.mon.a.trial160.stderr:2026-02-12T08:44:59.148+0000 7f98ce1f1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-12T08:44:59.150 INFO:tasks.ceph.mon.a.trial160.stderr:Please be aware that this feature is experimental, untested, 2026-02-12T08:44:59.150 INFO:tasks.ceph.mon.a.trial160.stderr:unsupported, and may result in data corruption, data loss, 2026-02-12T08:44:59.150 INFO:tasks.ceph.mon.a.trial160.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-12T08:44:59.151 INFO:tasks.ceph.mon.a.trial160.stderr:feature with important data. 2026-02-12T08:44:59.151 INFO:tasks.ceph.mon.a.trial160.stderr: 2026-02-12T08:44:59.719 INFO:tasks.ceph.mgr.x.trial181.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-12T08:44:59.720 INFO:tasks.ceph.mgr.x.trial181.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-12T08:44:59.720 INFO:tasks.ceph.mgr.x.trial181.stderr: from numpy import show_config as show_numpy_config 2026-02-12T08:45:00.038 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-12T08:45:00.038 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:45:00.038 DEBUG:teuthology.orchestra.run.trial160:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-12T08:45:00.063 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:45:00.064 DEBUG:teuthology.orchestra.run.trial160:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-12T08:45:00.127 DEBUG:teuthology.orchestra.run.trial181:> set -ex 2026-02-12T08:45:00.127 DEBUG:teuthology.orchestra.run.trial181:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-12T08:45:00.153 DEBUG:teuthology.orchestra.run.trial181:> set -ex 2026-02-12T08:45:00.153 DEBUG:teuthology.orchestra.run.trial181:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-12T08:45:00.217 DEBUG:teuthology.orchestra.run.trial181:> sudo ceph --cluster ceph osd new 08e24387-f907-4c27-b328-107847d40189 0 2026-02-12T08:45:00.330 INFO:teuthology.orchestra.run.trial181.stderr:2026-02-12T08:45:00.325+0000 7f1454b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:00.333 INFO:teuthology.orchestra.run.trial181.stderr:2026-02-12T08:45:00.331+0000 7f1454b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:00.373 INFO:teuthology.orchestra.run.trial181.stdout:0 2026-02-12T08:45:00.381 DEBUG:teuthology.orchestra.run.trial181:> sudo ceph --cluster ceph osd new 80832139-0c52-48e0-8a77-de6bae106aa0 1 2026-02-12T08:45:00.456 INFO:teuthology.orchestra.run.trial181.stderr:2026-02-12T08:45:00.451+0000 7fc41cb7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:00.458 INFO:teuthology.orchestra.run.trial181.stderr:2026-02-12T08:45:00.456+0000 7fc41cb7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:00.497 INFO:teuthology.orchestra.run.trial181.stdout:1 2026-02-12T08:45:00.505 DEBUG:teuthology.orchestra.run.trial181:> sudo ceph --cluster ceph osd new 0576b5bb-5f7d-4f62-bbd7-6c3f5bb2167e 2 2026-02-12T08:45:00.582 INFO:teuthology.orchestra.run.trial181.stderr:2026-02-12T08:45:00.576+0000 7f2080651640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:00.584 INFO:teuthology.orchestra.run.trial181.stderr:2026-02-12T08:45:00.582+0000 7f2080651640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:00.624 INFO:teuthology.orchestra.run.trial181.stdout:2 2026-02-12T08:45:00.633 DEBUG:teuthology.orchestra.run.trial181:> sudo ceph --cluster ceph osd new 67abb3bd-4150-40dc-ad83-430b9edbfac7 3 2026-02-12T08:45:00.707 INFO:teuthology.orchestra.run.trial181.stderr:2026-02-12T08:45:00.702+0000 7f71e12cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:00.709 INFO:teuthology.orchestra.run.trial181.stderr:2026-02-12T08:45:00.707+0000 7f71e12cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:00.748 INFO:teuthology.orchestra.run.trial181.stdout:3 2026-02-12T08:45:00.756 DEBUG:teuthology.orchestra.run.trial160:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-12T08:45:00.785 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-12T08:45:00.785 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-12T08:45:00.828 INFO:tasks.ceph.osd.0:Started 2026-02-12T08:45:00.828 DEBUG:teuthology.orchestra.run.trial160:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-12T08:45:00.857 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-12T08:45:00.857 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-12T08:45:00.900 INFO:tasks.ceph.osd.1:Started 2026-02-12T08:45:00.900 DEBUG:teuthology.orchestra.run.trial181:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-12T08:45:00.929 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-12T08:45:00.929 DEBUG:teuthology.orchestra.run.trial181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-12T08:45:00.971 INFO:tasks.ceph.osd.2:Started 2026-02-12T08:45:00.971 DEBUG:teuthology.orchestra.run.trial181:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2026-02-12T08:45:01.000 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-12T08:45:01.001 DEBUG:teuthology.orchestra.run.trial181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2026-02-12T08:45:01.043 INFO:tasks.ceph.osd.3:Started 2026-02-12T08:45:01.044 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T08:45:01.121 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:01.117+0000 7f2f5b90b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:01.124 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:01.122+0000 7f2f5b90b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:01.158 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:45:01.158 INFO:teuthology.orchestra.run.trial160.stdout:{"epoch":7,"fsid":"c797b341-9be1-4308-bb3e-bbe04740db3f","created":"2026-02-12T08:44:58.861211+0000","modified":"2026-02-12T08:45:00.746823+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T08:45:00.746823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"08e24387-f907-4c27-b328-107847d40189","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"80832139-0c52-48e0-8a77-de6bae106aa0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0576b5bb-5f7d-4f62-bbd7-6c3f5bb2167e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"67abb3bd-4150-40dc-ad83-430b9edbfac7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:45:01.166 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-12T08:45:01.167 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-12T08:45:01.570 DEBUG:teuthology.orchestra.run.trial160:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T08:45:01.638 INFO:teuthology.misc.health.trial160.stderr:2026-02-12T08:45:01.633+0000 7fee62df5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:01.641 INFO:teuthology.misc.health.trial160.stderr:2026-02-12T08:45:01.639+0000 7fee62df5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:01.674 INFO:teuthology.misc.health.trial160.stdout: 2026-02-12T08:45:01.674 INFO:teuthology.misc.health.trial160.stdout:{"epoch":7,"fsid":"c797b341-9be1-4308-bb3e-bbe04740db3f","created":"2026-02-12T08:44:58.861211+0000","modified":"2026-02-12T08:45:00.746823+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T08:45:00.746823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"08e24387-f907-4c27-b328-107847d40189","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"80832139-0c52-48e0-8a77-de6bae106aa0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0576b5bb-5f7d-4f62-bbd7-6c3f5bb2167e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"67abb3bd-4150-40dc-ad83-430b9edbfac7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:45:01.681 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-12T08:45:02.103 INFO:tasks.ceph.mgr.x.trial181.stderr:2026-02-12T08:45:02.101+0000 7f948db9b640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-12T08:45:08.084 DEBUG:teuthology.orchestra.run.trial160:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T08:45:08.155 INFO:teuthology.misc.health.trial160.stderr:2026-02-12T08:45:08.150+0000 7ff249a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:08.157 INFO:teuthology.misc.health.trial160.stderr:2026-02-12T08:45:08.155+0000 7ff249a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:08.273 INFO:teuthology.misc.health.trial160.stdout: 2026-02-12T08:45:08.274 INFO:teuthology.misc.health.trial160.stdout:{"epoch":10,"fsid":"c797b341-9be1-4308-bb3e-bbe04740db3f","created":"2026-02-12T08:44:58.861211+0000","modified":"2026-02-12T08:45:07.306145+0000","last_up_change":"2026-02-12T08:45:07.306145+0000","last_in_change":"2026-02-12T08:45:00.746823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"08e24387-f907-4c27-b328-107847d40189","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"80832139-0c52-48e0-8a77-de6bae106aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6800","nonce":2703029037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6801","nonce":2703029037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6804","nonce":2703029037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6803","nonce":2703029037}]},"public_addr":"10.20.193.160:6800/2703029037","cluster_addr":"10.20.193.160:6801/2703029037","heartbeat_back_addr":"10.20.193.160:6804/2703029037","heartbeat_front_addr":"10.20.193.160:6803/2703029037","state":["exists","up"]},{"osd":2,"uuid":"0576b5bb-5f7d-4f62-bbd7-6c3f5bb2167e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"67abb3bd-4150-40dc-ad83-430b9edbfac7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:45:08.281 DEBUG:teuthology.misc:1 of 4 OSDs are up 2026-02-12T08:45:14.685 DEBUG:teuthology.orchestra.run.trial160:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T08:45:14.756 INFO:teuthology.misc.health.trial160.stderr:2026-02-12T08:45:14.752+0000 7f8a2fb7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:14.759 INFO:teuthology.misc.health.trial160.stderr:2026-02-12T08:45:14.757+0000 7f8a2fb7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:14.874 INFO:teuthology.misc.health.trial160.stdout: 2026-02-12T08:45:14.874 INFO:teuthology.misc.health.trial160.stdout:{"epoch":14,"fsid":"c797b341-9be1-4308-bb3e-bbe04740db3f","created":"2026-02-12T08:44:58.861211+0000","modified":"2026-02-12T08:45:11.323124+0000","last_up_change":"2026-02-12T08:45:08.310916+0000","last_in_change":"2026-02-12T08:45:00.746823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T08:45:09.117943+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"08e24387-f907-4c27-b328-107847d40189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6810","nonce":2357199504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6809","nonce":2357199504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6808","nonce":2357199504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6807","nonce":2357199504}]},"public_addr":"10.20.193.160:6810/2357199504","cluster_addr":"10.20.193.160:6809/2357199504","heartbeat_back_addr":"10.20.193.160:6808/2357199504","heartbeat_front_addr":"10.20.193.160:6807/2357199504","state":["exists","up"]},{"osd":1,"uuid":"80832139-0c52-48e0-8a77-de6bae106aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6800","nonce":2703029037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6801","nonce":2703029037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6804","nonce":2703029037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6803","nonce":2703029037}]},"public_addr":"10.20.193.160:6800/2703029037","cluster_addr":"10.20.193.160:6801/2703029037","heartbeat_back_addr":"10.20.193.160:6804/2703029037","heartbeat_front_addr":"10.20.193.160:6803/2703029037","state":["exists","up"]},{"osd":2,"uuid":"0576b5bb-5f7d-4f62-bbd7-6c3f5bb2167e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6802","nonce":3317306639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6805","nonce":3317306639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6809","nonce":3317306639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6812","nonce":3317306639}]},"public_addr":"10.20.193.181:6802/3317306639","cluster_addr":"10.20.193.181:6805/3317306639","heartbeat_back_addr":"10.20.193.181:6809/3317306639","heartbeat_front_addr":"10.20.193.181:6812/3317306639","state":["exists","up"]},{"osd":3,"uuid":"67abb3bd-4150-40dc-ad83-430b9edbfac7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6804","nonce":2582487837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6803","nonce":2582487837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6811","nonce":2582487837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6810","nonce":2582487837}]},"public_addr":"10.20.193.181:6804/2582487837","cluster_addr":"10.20.193.181:6803/2582487837","heartbeat_back_addr":"10.20.193.181:6811/2582487837","heartbeat_front_addr":"10.20.193.181:6810/2582487837","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:45:14.883 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-12T08:45:14.883 INFO:tasks.ceph:Creating RBD pool 2026-02-12T08:45:14.883 DEBUG:teuthology.orchestra.run.trial160:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-12T08:45:14.959 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:14.953+0000 7fec5488b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:14.961 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:14.959+0000 7fec5488b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:15.929 INFO:teuthology.orchestra.run.trial160.stderr:pool 'rbd' created 2026-02-12T08:45:15.941 DEBUG:teuthology.orchestra.run.trial160:> rbd --cluster ceph pool init rbd 2026-02-12T08:45:15.983 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:15.981+0000 7f2d4d0eb240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:15.983 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:15.981+0000 7f2d4d0eb240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:15.986 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:15.984+0000 7f2d4d0eb240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:18.967 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-12T08:45:18.969 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-12T08:45:18.969 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-12T08:45:19.085 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:19.080+0000 7f42746cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:19.088 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:19.086+0000 7f42746cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:19.201 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:45:19.211 INFO:teuthology.orchestra.run.trial160.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-12T08:45:19.211 INFO:tasks.ceph_manager:config epoch is 1 2026-02-12T08:45:19.211 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-12T08:45:19.211 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-12T08:45:19.212 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-12T08:45:19.287 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:19.283+0000 7f281845a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:19.289 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:19.287+0000 7f281845a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:19.437 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:45:19.446 INFO:teuthology.orchestra.run.trial160.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6800","nonce":1570191288},{"type":"v1","addr":"10.20.193.181:6801","nonce":1570191288}]},"active_addr":"10.20.193.181:6801/1570191288","active_change":"2026-02-12T08:45:01.091133+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.181:0","nonce":2086044513}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.181:0","nonce":3191549532}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.181:0","nonce":3329803077}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.181:0","nonce":1333626193}]}]} 2026-02-12T08:45:19.449 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-12T08:45:19.450 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-12T08:45:19.450 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T08:45:19.526 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:19.521+0000 7f1453ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:19.528 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:19.526+0000 7f1453ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:19.641 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:45:19.641 INFO:teuthology.orchestra.run.trial160.stdout:{"epoch":18,"fsid":"c797b341-9be1-4308-bb3e-bbe04740db3f","created":"2026-02-12T08:44:58.861211+0000","modified":"2026-02-12T08:45:18.932320+0000","last_up_change":"2026-02-12T08:45:08.310916+0000","last_in_change":"2026-02-12T08:45:00.746823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T08:45:09.117943+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T08:45:15.075447+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"08e24387-f907-4c27-b328-107847d40189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6810","nonce":2357199504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6809","nonce":2357199504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6808","nonce":2357199504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6807","nonce":2357199504}]},"public_addr":"10.20.193.160:6810/2357199504","cluster_addr":"10.20.193.160:6809/2357199504","heartbeat_back_addr":"10.20.193.160:6808/2357199504","heartbeat_front_addr":"10.20.193.160:6807/2357199504","state":["exists","up"]},{"osd":1,"uuid":"80832139-0c52-48e0-8a77-de6bae106aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6800","nonce":2703029037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6801","nonce":2703029037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6804","nonce":2703029037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6803","nonce":2703029037}]},"public_addr":"10.20.193.160:6800/2703029037","cluster_addr":"10.20.193.160:6801/2703029037","heartbeat_back_addr":"10.20.193.160:6804/2703029037","heartbeat_front_addr":"10.20.193.160:6803/2703029037","state":["exists","up"]},{"osd":2,"uuid":"0576b5bb-5f7d-4f62-bbd7-6c3f5bb2167e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6802","nonce":3317306639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6805","nonce":3317306639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6809","nonce":3317306639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6812","nonce":3317306639}]},"public_addr":"10.20.193.181:6802/3317306639","cluster_addr":"10.20.193.181:6805/3317306639","heartbeat_back_addr":"10.20.193.181:6809/3317306639","heartbeat_front_addr":"10.20.193.181:6812/3317306639","state":["exists","up"]},{"osd":3,"uuid":"67abb3bd-4150-40dc-ad83-430b9edbfac7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6804","nonce":2582487837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6803","nonce":2582487837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6811","nonce":2582487837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6810","nonce":2582487837}]},"public_addr":"10.20.193.181:6804/2582487837","cluster_addr":"10.20.193.181:6803/2582487837","heartbeat_back_addr":"10.20.193.181:6811/2582487837","heartbeat_front_addr":"10.20.193.181:6810/2582487837","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:45:19.650 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-12T08:45:19.650 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T08:45:19.726 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:19.722+0000 7f2d2b50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:19.729 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:19.727+0000 7f2d2b50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:19.842 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:45:19.843 INFO:teuthology.orchestra.run.trial160.stdout:{"epoch":18,"fsid":"c797b341-9be1-4308-bb3e-bbe04740db3f","created":"2026-02-12T08:44:58.861211+0000","modified":"2026-02-12T08:45:18.932320+0000","last_up_change":"2026-02-12T08:45:08.310916+0000","last_in_change":"2026-02-12T08:45:00.746823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T08:45:09.117943+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T08:45:15.075447+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"08e24387-f907-4c27-b328-107847d40189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6810","nonce":2357199504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6809","nonce":2357199504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6808","nonce":2357199504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6807","nonce":2357199504}]},"public_addr":"10.20.193.160:6810/2357199504","cluster_addr":"10.20.193.160:6809/2357199504","heartbeat_back_addr":"10.20.193.160:6808/2357199504","heartbeat_front_addr":"10.20.193.160:6807/2357199504","state":["exists","up"]},{"osd":1,"uuid":"80832139-0c52-48e0-8a77-de6bae106aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6800","nonce":2703029037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6801","nonce":2703029037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6804","nonce":2703029037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6803","nonce":2703029037}]},"public_addr":"10.20.193.160:6800/2703029037","cluster_addr":"10.20.193.160:6801/2703029037","heartbeat_back_addr":"10.20.193.160:6804/2703029037","heartbeat_front_addr":"10.20.193.160:6803/2703029037","state":["exists","up"]},{"osd":2,"uuid":"0576b5bb-5f7d-4f62-bbd7-6c3f5bb2167e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6802","nonce":3317306639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6805","nonce":3317306639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6809","nonce":3317306639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6812","nonce":3317306639}]},"public_addr":"10.20.193.181:6802/3317306639","cluster_addr":"10.20.193.181:6805/3317306639","heartbeat_back_addr":"10.20.193.181:6809/3317306639","heartbeat_front_addr":"10.20.193.181:6812/3317306639","state":["exists","up"]},{"osd":3,"uuid":"67abb3bd-4150-40dc-ad83-430b9edbfac7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6804","nonce":2582487837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6803","nonce":2582487837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6811","nonce":2582487837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6810","nonce":2582487837}]},"public_addr":"10.20.193.181:6804/2582487837","cluster_addr":"10.20.193.181:6803/2582487837","heartbeat_back_addr":"10.20.193.181:6811/2582487837","heartbeat_front_addr":"10.20.193.181:6810/2582487837","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:45:19.853 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-12T08:45:19.854 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-12T08:45:19.854 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-12T08:45:19.855 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-12T08:45:19.939 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:19.934+0000 7f079301a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:19.940 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:19.934+0000 7f0206f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:19.940 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:19.934+0000 7ff6b2ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:19.941 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:19.935+0000 7f9268a8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:19.942 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:19.940+0000 7f079301a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:19.942 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:19.940+0000 7f0206f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:19.942 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:19.940+0000 7ff6b2ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:19.943 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:19.941+0000 7f9268a8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:19.960 INFO:teuthology.orchestra.run.trial160.stdout:47244640267 2026-02-12T08:45:19.961 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-12T08:45:19.962 INFO:teuthology.orchestra.run.trial160.stdout:47244640267 2026-02-12T08:45:19.963 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T08:45:19.964 INFO:teuthology.orchestra.run.trial160.stdout:42949672972 2026-02-12T08:45:19.964 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T08:45:19.965 INFO:teuthology.orchestra.run.trial160.stdout:47244640267 2026-02-12T08:45:19.966 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T08:45:20.083 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:20.078+0000 7fcd047dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:20.084 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:20.078+0000 7f18af70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:20.085 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:20.081+0000 7fe6dff0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:20.086 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:20.083+0000 7fcd047dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:20.086 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:20.084+0000 7f18af70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:20.088 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:20.086+0000 7fe6dff0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:20.125 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:20.120+0000 7fa8ad251640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:20.128 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:20.126+0000 7fa8ad251640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:20.205 INFO:teuthology.orchestra.run.trial160.stdout:47244640266 2026-02-12T08:45:20.206 INFO:teuthology.orchestra.run.trial160.stdout:47244640266 2026-02-12T08:45:20.208 INFO:teuthology.orchestra.run.trial160.stdout:42949672969 2026-02-12T08:45:20.217 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640266 for osd.0 2026-02-12T08:45:20.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640266 for osd.3 2026-02-12T08:45:20.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672972 got 42949672969 for osd.1 2026-02-12T08:45:20.244 INFO:teuthology.orchestra.run.trial160.stdout:47244640265 2026-02-12T08:45:20.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640265 for osd.2 2026-02-12T08:45:21.219 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T08:45:21.219 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-12T08:45:21.220 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T08:45:21.255 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T08:45:21.304 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:21.298+0000 7f7586c51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:21.304 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:21.298+0000 7f981d83d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:21.304 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:21.299+0000 7fed7445a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:21.306 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:21.304+0000 7f7586c51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:21.306 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:21.304+0000 7f981d83d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:21.307 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:21.305+0000 7fed7445a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:21.346 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:21.340+0000 7f972285a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:21.348 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:21.346+0000 7f972285a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:21.421 INFO:teuthology.orchestra.run.trial160.stdout:47244640266 2026-02-12T08:45:21.426 INFO:teuthology.orchestra.run.trial160.stdout:47244640266 2026-02-12T08:45:21.429 INFO:teuthology.orchestra.run.trial160.stdout:42949672969 2026-02-12T08:45:21.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640266 for osd.3 2026-02-12T08:45:21.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640266 for osd.0 2026-02-12T08:45:21.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672972 got 42949672969 for osd.1 2026-02-12T08:45:21.462 INFO:teuthology.orchestra.run.trial160.stdout:47244640265 2026-02-12T08:45:21.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640265 for osd.2 2026-02-12T08:45:22.433 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-12T08:45:22.439 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T08:45:22.449 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T08:45:22.473 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T08:45:22.514 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:22.509+0000 7fb82bf0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:22.519 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:22.515+0000 7fb82bf0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:22.559 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:22.552+0000 7fa7c985a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:22.559 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:22.553+0000 7f6212b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:22.560 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:22.555+0000 7ff787ffd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:22.561 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:22.559+0000 7fa7c985a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:22.561 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:22.559+0000 7f6212b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:22.563 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:22.561+0000 7ff787ffd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:22.635 INFO:teuthology.orchestra.run.trial160.stdout:47244640267 2026-02-12T08:45:22.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640267 for osd.3 2026-02-12T08:45:22.647 DEBUG:teuthology.parallel:result is None 2026-02-12T08:45:22.674 INFO:teuthology.orchestra.run.trial160.stdout:47244640267 2026-02-12T08:45:22.680 INFO:teuthology.orchestra.run.trial160.stdout:42949672972 2026-02-12T08:45:22.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640267 for osd.0 2026-02-12T08:45:22.686 DEBUG:teuthology.parallel:result is None 2026-02-12T08:45:22.686 INFO:teuthology.orchestra.run.trial160.stdout:47244640267 2026-02-12T08:45:22.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672972 got 42949672972 for osd.1 2026-02-12T08:45:22.692 DEBUG:teuthology.parallel:result is None 2026-02-12T08:45:22.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640267 for osd.2 2026-02-12T08:45:22.698 DEBUG:teuthology.parallel:result is None 2026-02-12T08:45:22.698 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-12T08:45:22.699 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T08:45:22.816 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:22.811+0000 7fd5eb2c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:22.818 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:22.816+0000 7fd5eb2c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:22.932 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:45:22.933 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-12T08:45:22.942 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2026-02-12T08:45:21.099990+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":2840,"kb_used_data":2840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208663784,"statfs":{"total":213674622976,"available":213671714816,"internally_reserved":0,"allocated":2908160,"data_stored":2908160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.171978"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.949252+0000","last_change":"2026-02-12T08:45:18.951814+0000","last_active":"2026-02-12T08:45:18.949252+0000","last_peered":"2026-02-12T08:45:18.949252+0000","last_clean":"2026-02-12T08:45:18.949252+0000","last_became_active":"2026-02-12T08:45:16.961720+0000","last_became_peered":"2026-02-12T08:45:16.961720+0000","last_unstale":"2026-02-12T08:45:18.949252+0000","last_undegraded":"2026-02-12T08:45:18.949252+0000","last_fullsized":"2026-02-12T08:45:18.949252+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.946403+0000","last_change":"2026-02-12T08:45:18.949365+0000","last_active":"2026-02-12T08:45:18.946403+0000","last_peered":"2026-02-12T08:45:18.946403+0000","last_clean":"2026-02-12T08:45:18.946403+0000","last_became_active":"2026-02-12T08:45:16.961363+0000","last_became_peered":"2026-02-12T08:45:16.961363+0000","last_unstale":"2026-02-12T08:45:18.946403+0000","last_undegraded":"2026-02-12T08:45:18.946403+0000","last_fullsized":"2026-02-12T08:45:18.946403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.949239+0000","last_change":"2026-02-12T08:45:18.955883+0000","last_active":"2026-02-12T08:45:18.949239+0000","last_peered":"2026-02-12T08:45:18.949239+0000","last_clean":"2026-02-12T08:45:18.949239+0000","last_became_active":"2026-02-12T08:45:16.963774+0000","last_became_peered":"2026-02-12T08:45:16.963774+0000","last_unstale":"2026-02-12T08:45:18.949239+0000","last_undegraded":"2026-02-12T08:45:18.949239+0000","last_fullsized":"2026-02-12T08:45:18.949239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.947490+0000","last_change":"2026-02-12T08:45:18.949323+0000","last_active":"2026-02-12T08:45:18.947490+0000","last_peered":"2026-02-12T08:45:18.947490+0000","last_clean":"2026-02-12T08:45:18.947490+0000","last_became_active":"2026-02-12T08:45:16.968304+0000","last_became_peered":"2026-02-12T08:45:16.968304+0000","last_unstale":"2026-02-12T08:45:18.947490+0000","last_undegraded":"2026-02-12T08:45:18.947490+0000","last_fullsized":"2026-02-12T08:45:18.947490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.953800+0000","last_change":"2026-02-12T08:45:18.955561+0000","last_active":"2026-02-12T08:45:18.953800+0000","last_peered":"2026-02-12T08:45:18.953800+0000","last_clean":"2026-02-12T08:45:18.953800+0000","last_became_active":"2026-02-12T08:45:16.972386+0000","last_became_peered":"2026-02-12T08:45:16.972386+0000","last_unstale":"2026-02-12T08:45:18.953800+0000","last_undegraded":"2026-02-12T08:45:18.953800+0000","last_fullsized":"2026-02-12T08:45:18.953800+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.945566+0000","last_change":"2026-02-12T08:45:18.948247+0000","last_active":"2026-02-12T08:45:18.945566+0000","last_peered":"2026-02-12T08:45:18.945566+0000","last_clean":"2026-02-12T08:45:18.945566+0000","last_became_active":"2026-02-12T08:45:16.971309+0000","last_became_peered":"2026-02-12T08:45:16.971309+0000","last_unstale":"2026-02-12T08:45:18.945566+0000","last_undegraded":"2026-02-12T08:45:18.945566+0000","last_fullsized":"2026-02-12T08:45:18.945566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.949265+0000","last_change":"2026-02-12T08:45:18.951336+0000","last_active":"2026-02-12T08:45:18.949265+0000","last_peered":"2026-02-12T08:45:18.949265+0000","last_clean":"2026-02-12T08:45:18.949265+0000","last_became_active":"2026-02-12T08:45:16.964692+0000","last_became_peered":"2026-02-12T08:45:16.964692+0000","last_unstale":"2026-02-12T08:45:18.949265+0000","last_undegraded":"2026-02-12T08:45:18.949265+0000","last_fullsized":"2026-02-12T08:45:18.949265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.946993+0000","last_change":"2026-02-12T08:45:18.949960+0000","last_active":"2026-02-12T08:45:18.946993+0000","last_peered":"2026-02-12T08:45:18.946993+0000","last_clean":"2026-02-12T08:45:18.946993+0000","last_became_active":"2026-02-12T08:45:16.965299+0000","last_became_peered":"2026-02-12T08:45:16.965299+0000","last_unstale":"2026-02-12T08:45:18.946993+0000","last_undegraded":"2026-02-12T08:45:18.946993+0000","last_fullsized":"2026-02-12T08:45:18.946993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":90,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.946639+0000","last_change":"2026-02-12T08:45:10.358748+0000","last_active":"2026-02-12T08:45:18.946639+0000","last_peered":"2026-02-12T08:45:18.946639+0000","last_clean":"2026-02-12T08:45:18.946639+0000","last_became_active":"2026-02-12T08:45:10.349703+0000","last_became_peered":"2026-02-12T08:45:10.349703+0000","last_unstale":"2026-02-12T08:45:18.946639+0000","last_undegraded":"2026-02-12T08:45:18.946639+0000","last_fullsized":"2026-02-12T08:45:18.946639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:09.313699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:09.313699+0000","last_clean_scrub_stamp":"2026-02-12T08:45:09.313699+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160254132224,"internally_reserved":0,"allocated":1835008,"data_stored":1835008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53417488384,"internally_reserved":0,"allocated":1167360,"data_stored":1167360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166332,"statfs":{"total":53418655744,"available":53418323968,"internally_reserved":0,"allocated":331776,"data_stored":331776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1140,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165516,"statfs":{"total":53418655744,"available":53417488384,"internally_reserved":0,"allocated":1167360,"data_stored":1167360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166328,"statfs":{"total":53418655744,"available":53418319872,"internally_reserved":0,"allocated":335872,"data_stored":335872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1048,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165608,"statfs":{"total":53418655744,"available":53417582592,"internally_reserved":0,"allocated":1073152,"data_stored":1073152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53418655744,"available":53417488384,"internally_reserved":0,"allocated":1167360,"data_stored":1167360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53418655744,"available":53418323968,"internally_reserved":0,"allocated":331776,"data_stored":331776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53418655744,"available":53418319872,"internally_reserved":0,"allocated":335872,"data_stored":335872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53417488384,"internally_reserved":0,"allocated":1167360,"data_stored":1167360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T08:45:22.944 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T08:45:23.020 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:23.015+0000 7efe15ba4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:23.022 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:23.020+0000 7efe15ba4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:23.134 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:45:23.135 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-12T08:45:23.144 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2026-02-12T08:45:23.100320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":2840,"kb_used_data":2840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208663784,"statfs":{"total":213674622976,"available":213671714816,"internally_reserved":0,"allocated":2908160,"data_stored":2908160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.171585"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.949252+0000","last_change":"2026-02-12T08:45:18.951814+0000","last_active":"2026-02-12T08:45:18.949252+0000","last_peered":"2026-02-12T08:45:18.949252+0000","last_clean":"2026-02-12T08:45:18.949252+0000","last_became_active":"2026-02-12T08:45:16.961720+0000","last_became_peered":"2026-02-12T08:45:16.961720+0000","last_unstale":"2026-02-12T08:45:18.949252+0000","last_undegraded":"2026-02-12T08:45:18.949252+0000","last_fullsized":"2026-02-12T08:45:18.949252+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.946403+0000","last_change":"2026-02-12T08:45:18.949365+0000","last_active":"2026-02-12T08:45:18.946403+0000","last_peered":"2026-02-12T08:45:18.946403+0000","last_clean":"2026-02-12T08:45:18.946403+0000","last_became_active":"2026-02-12T08:45:16.961363+0000","last_became_peered":"2026-02-12T08:45:16.961363+0000","last_unstale":"2026-02-12T08:45:18.946403+0000","last_undegraded":"2026-02-12T08:45:18.946403+0000","last_fullsized":"2026-02-12T08:45:18.946403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.949239+0000","last_change":"2026-02-12T08:45:18.955883+0000","last_active":"2026-02-12T08:45:18.949239+0000","last_peered":"2026-02-12T08:45:18.949239+0000","last_clean":"2026-02-12T08:45:18.949239+0000","last_became_active":"2026-02-12T08:45:16.963774+0000","last_became_peered":"2026-02-12T08:45:16.963774+0000","last_unstale":"2026-02-12T08:45:18.949239+0000","last_undegraded":"2026-02-12T08:45:18.949239+0000","last_fullsized":"2026-02-12T08:45:18.949239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.947490+0000","last_change":"2026-02-12T08:45:18.949323+0000","last_active":"2026-02-12T08:45:18.947490+0000","last_peered":"2026-02-12T08:45:18.947490+0000","last_clean":"2026-02-12T08:45:18.947490+0000","last_became_active":"2026-02-12T08:45:16.968304+0000","last_became_peered":"2026-02-12T08:45:16.968304+0000","last_unstale":"2026-02-12T08:45:18.947490+0000","last_undegraded":"2026-02-12T08:45:18.947490+0000","last_fullsized":"2026-02-12T08:45:18.947490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.953800+0000","last_change":"2026-02-12T08:45:18.955561+0000","last_active":"2026-02-12T08:45:18.953800+0000","last_peered":"2026-02-12T08:45:18.953800+0000","last_clean":"2026-02-12T08:45:18.953800+0000","last_became_active":"2026-02-12T08:45:16.972386+0000","last_became_peered":"2026-02-12T08:45:16.972386+0000","last_unstale":"2026-02-12T08:45:18.953800+0000","last_undegraded":"2026-02-12T08:45:18.953800+0000","last_fullsized":"2026-02-12T08:45:18.953800+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.945566+0000","last_change":"2026-02-12T08:45:18.948247+0000","last_active":"2026-02-12T08:45:18.945566+0000","last_peered":"2026-02-12T08:45:18.945566+0000","last_clean":"2026-02-12T08:45:18.945566+0000","last_became_active":"2026-02-12T08:45:16.971309+0000","last_became_peered":"2026-02-12T08:45:16.971309+0000","last_unstale":"2026-02-12T08:45:18.945566+0000","last_undegraded":"2026-02-12T08:45:18.945566+0000","last_fullsized":"2026-02-12T08:45:18.945566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.949265+0000","last_change":"2026-02-12T08:45:18.951336+0000","last_active":"2026-02-12T08:45:18.949265+0000","last_peered":"2026-02-12T08:45:18.949265+0000","last_clean":"2026-02-12T08:45:18.949265+0000","last_became_active":"2026-02-12T08:45:16.964692+0000","last_became_peered":"2026-02-12T08:45:16.964692+0000","last_unstale":"2026-02-12T08:45:18.949265+0000","last_undegraded":"2026-02-12T08:45:18.949265+0000","last_fullsized":"2026-02-12T08:45:18.949265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.946993+0000","last_change":"2026-02-12T08:45:18.949960+0000","last_active":"2026-02-12T08:45:18.946993+0000","last_peered":"2026-02-12T08:45:18.946993+0000","last_clean":"2026-02-12T08:45:18.946993+0000","last_became_active":"2026-02-12T08:45:16.965299+0000","last_became_peered":"2026-02-12T08:45:16.965299+0000","last_unstale":"2026-02-12T08:45:18.946993+0000","last_undegraded":"2026-02-12T08:45:18.946993+0000","last_fullsized":"2026-02-12T08:45:18.946993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":90,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:45:18.946639+0000","last_change":"2026-02-12T08:45:10.358748+0000","last_active":"2026-02-12T08:45:18.946639+0000","last_peered":"2026-02-12T08:45:18.946639+0000","last_clean":"2026-02-12T08:45:18.946639+0000","last_became_active":"2026-02-12T08:45:10.349703+0000","last_became_peered":"2026-02-12T08:45:10.349703+0000","last_unstale":"2026-02-12T08:45:18.946639+0000","last_undegraded":"2026-02-12T08:45:18.946639+0000","last_fullsized":"2026-02-12T08:45:18.946639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:09.313699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:09.313699+0000","last_clean_scrub_stamp":"2026-02-12T08:45:09.313699+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160254132224,"internally_reserved":0,"allocated":1835008,"data_stored":1835008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53417488384,"internally_reserved":0,"allocated":1167360,"data_stored":1167360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166332,"statfs":{"total":53418655744,"available":53418323968,"internally_reserved":0,"allocated":331776,"data_stored":331776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1140,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165516,"statfs":{"total":53418655744,"available":53417488384,"internally_reserved":0,"allocated":1167360,"data_stored":1167360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166328,"statfs":{"total":53418655744,"available":53418319872,"internally_reserved":0,"allocated":335872,"data_stored":335872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1048,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165608,"statfs":{"total":53418655744,"available":53417582592,"internally_reserved":0,"allocated":1073152,"data_stored":1073152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53418655744,"available":53417488384,"internally_reserved":0,"allocated":1167360,"data_stored":1167360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53418655744,"available":53418323968,"internally_reserved":0,"allocated":331776,"data_stored":331776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53418655744,"available":53418319872,"internally_reserved":0,"allocated":335872,"data_stored":335872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53417488384,"internally_reserved":0,"allocated":1167360,"data_stored":1167360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T08:45:23.145 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-12T08:45:23.146 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-12T08:45:23.146 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-12T08:45:23.146 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-12T08:45:23.222 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:23.218+0000 7f5ec450b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:23.225 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:45:23.223+0000 7f5ec450b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:23.364 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:45:23.364 INFO:teuthology.orchestra.run.trial160.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-12T08:45:23.374 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-12T08:45:23.374 INFO:teuthology.run_tasks:Running task workunit... 2026-02-12T08:45:23.405 INFO:tasks.workunit:Pulling workunits from ref 6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c 2026-02-12T08:45:23.406 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-12T08:45:23.406 DEBUG:teuthology.orchestra.run.trial160:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-12T08:45:23.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:45:23.423 INFO:teuthology.orchestra.run.trial160.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-12T08:45:23.424 DEBUG:teuthology.orchestra.run.trial160:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-12T08:45:23.479 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-12T08:45:23.479 DEBUG:teuthology.orchestra.run.trial160:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-12T08:45:23.535 INFO:tasks.workunit:timeout=1h 2026-02-12T08:45:23.535 INFO:tasks.workunit:cleanup=True 2026-02-12T08:45:23.536 DEBUG:teuthology.orchestra.run.trial160:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c 2026-02-12T08:45:23.599 INFO:tasks.workunit.client.0.trial160.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-12T08:45:46.668 INFO:tasks.workunit.client.0.trial160.stderr:Note: switching to '6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c'. 2026-02-12T08:45:46.669 INFO:tasks.workunit.client.0.trial160.stderr: 2026-02-12T08:45:46.669 INFO:tasks.workunit.client.0.trial160.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-12T08:45:46.669 INFO:tasks.workunit.client.0.trial160.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-12T08:45:46.669 INFO:tasks.workunit.client.0.trial160.stderr:state without impacting any branches by switching back to a branch. 2026-02-12T08:45:46.669 INFO:tasks.workunit.client.0.trial160.stderr: 2026-02-12T08:45:46.669 INFO:tasks.workunit.client.0.trial160.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-12T08:45:46.669 INFO:tasks.workunit.client.0.trial160.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-12T08:45:46.669 INFO:tasks.workunit.client.0.trial160.stderr: 2026-02-12T08:45:46.669 INFO:tasks.workunit.client.0.trial160.stderr: git switch -c 2026-02-12T08:45:46.670 INFO:tasks.workunit.client.0.trial160.stderr: 2026-02-12T08:45:46.670 INFO:tasks.workunit.client.0.trial160.stderr:Or undo this operation with: 2026-02-12T08:45:46.670 INFO:tasks.workunit.client.0.trial160.stderr: 2026-02-12T08:45:46.670 INFO:tasks.workunit.client.0.trial160.stderr: git switch - 2026-02-12T08:45:46.670 INFO:tasks.workunit.client.0.trial160.stderr: 2026-02-12T08:45:46.670 INFO:tasks.workunit.client.0.trial160.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-12T08:45:46.670 INFO:tasks.workunit.client.0.trial160.stderr: 2026-02-12T08:45:46.670 INFO:tasks.workunit.client.0.trial160.stderr:HEAD is now at 6bf51b64d77 Merge pull request #67261 from Matan-B/wip-matanb-crimson-66488-revert 2026-02-12T08:45:46.671 DEBUG:teuthology.orchestra.run.trial160:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-12T08:45:46.728 INFO:tasks.workunit.client.0.trial160.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-12T08:45:46.730 INFO:tasks.workunit.client.0.trial160.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-12T08:45:46.730 INFO:tasks.workunit.client.0.trial160.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-12T08:45:46.827 INFO:tasks.workunit.client.0.trial160.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-12T08:45:46.859 INFO:tasks.workunit.client.0.trial160.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-12T08:45:46.883 INFO:tasks.workunit.client.0.trial160.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-12T08:45:46.884 INFO:tasks.workunit.client.0.trial160.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-12T08:45:46.885 INFO:tasks.workunit.client.0.trial160.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-12T08:45:46.911 INFO:tasks.workunit.client.0.trial160.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-12T08:45:46.915 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-12T08:45:46.915 DEBUG:teuthology.orchestra.run.trial160:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-12T08:45:46.974 INFO:tasks.workunit:Running workunits matching rados/test_python.sh on client.0... 2026-02-12T08:45:46.977 INFO:tasks.workunit:Running workunit rados/test_python.sh... 2026-02-12T08:45:46.977 DEBUG:teuthology.orchestra.run.trial160:workunit test rados/test_python.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh -m 'not (wait or tier or ec)' 2026-02-12T08:45:47.034 INFO:tasks.workunit.client.0.trial160.stderr:+ ceph osd pool create rbd 2026-02-12T08:45:47.090 INFO:tasks.workunit.client.0.trial160.stderr:2026-02-12T08:45:47.084+0000 7fac670cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:47.092 INFO:tasks.workunit.client.0.trial160.stderr:2026-02-12T08:45:47.090+0000 7fac670cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:45:47.260 INFO:tasks.workunit.client.0.trial160.stderr:pool 'rbd' already exists 2026-02-12T08:45:47.268 INFO:tasks.workunit.client.0.trial160.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh 2026-02-12T08:45:47.268 INFO:tasks.workunit.client.0.trial160.stderr:+ python3 -m pytest -v /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/../../../src/test/pybind/test_rados.py -m 'not (wait or tier or ec)' 2026-02-12T08:45:47.344 INFO:tasks.workunit.client.0.trial160.stdout:============================= test session starts ============================== 2026-02-12T08:45:47.344 INFO:tasks.workunit.client.0.trial160.stdout:platform linux -- Python 3.9.25, pytest-6.2.2, py-1.10.0, pluggy-0.13.1 -- /usr/bin/python3 2026-02-12T08:45:47.344 INFO:tasks.workunit.client.0.trial160.stdout:cachedir: .pytest_cache 2026-02-12T08:45:47.344 INFO:tasks.workunit.client.0.trial160.stdout:rootdir: /home/ubuntu/cephtest/clone.client.0/src/test/pybind, configfile: pytest.ini 2026-02-12T08:45:47.485 INFO:tasks.workunit.client.0.trial160.stdout:collecting ... collected 91 items / 5 deselected / 86 selected 2026-02-12T08:45:47.485 INFO:tasks.workunit.client.0.trial160.stdout: 2026-02-12T08:45:47.491 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::test_rados_init_error PASSED [ 1%] 2026-02-12T08:45:47.540 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::test_rados_init PASSED [ 2%] 2026-02-12T08:45:47.553 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::test_ioctx_context_manager PASSED [ 3%] 2026-02-12T08:45:47.559 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::test_parse_argv PASSED [ 4%] 2026-02-12T08:45:47.563 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::test_parse_argv_empty_str PASSED [ 5%] 2026-02-12T08:45:47.570 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRadosStateError::test_configuring PASSED [ 6%] 2026-02-12T08:45:47.582 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRadosStateError::test_connected PASSED [ 8%] 2026-02-12T08:45:47.594 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRadosStateError::test_shutdown PASSED [ 9%] 2026-02-12T08:45:47.609 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_ping_monitor PASSED [ 10%] 2026-02-12T08:45:47.623 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_annotations PASSED [ 11%] 2026-02-12T08:45:49.175 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_create PASSED [ 12%] 2026-02-12T08:45:51.179 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_create_utf8 PASSED [ 13%] 2026-02-12T08:45:53.190 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_pool_lookup_utf8 PASSED [ 15%] 2026-02-12T08:45:55.198 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_eexist PASSED [ 16%] 2026-02-12T08:46:03.235 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_list_pools PASSED [ 17%] 2026-02-12T08:46:03.254 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_get_fsid PASSED [ 18%] 2026-02-12T08:46:04.240 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_blocklist_add PASSED [ 19%] 2026-02-12T08:46:04.257 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_get_cluster_stats PASSED [ 20%] 2026-02-12T08:46:04.271 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestRados::test_monitor_log PASSED [ 22%] 2026-02-12T08:46:07.249 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_last_version PASSED [ 23%] 2026-02-12T08:46:09.877 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_stats PASSED [ 24%] 2026-02-12T08:46:13.891 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_write PASSED [ 25%] 2026-02-12T08:46:17.911 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_write_full PASSED [ 26%] 2026-02-12T08:46:21.927 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_writesame PASSED [ 27%] 2026-02-12T08:46:25.944 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_append PASSED [ 29%] 2026-02-12T08:46:29.960 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_write_zeros PASSED [ 30%] 2026-02-12T08:46:33.974 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_trunc PASSED [ 31%] 2026-02-12T08:46:37.993 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_cmpext PASSED [ 32%] 2026-02-12T08:46:41.882 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_list_objects_empty PASSED [ 33%] 2026-02-12T08:46:45.898 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_read_crc PASSED [ 34%] 2026-02-12T08:46:49.881 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_list_objects PASSED [ 36%] 2026-02-12T08:46:53.894 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_list_ns_objects PASSED [ 37%] 2026-02-12T08:46:57.910 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_xattrs PASSED [ 38%] 2026-02-12T08:47:01.916 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_obj_xattrs PASSED [ 39%] 2026-02-12T08:47:04.931 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_pool_id PASSED [ 40%] 2026-02-12T08:47:07.939 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_pool_name PASSED [ 41%] 2026-02-12T08:47:12.898 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_create_snap PASSED [ 43%] 2026-02-12T08:47:15.912 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_list_snaps_empty PASSED [ 44%] 2026-02-12T08:47:21.888 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_list_snaps PASSED [ 45%] 2026-02-12T08:47:25.902 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_lookup_snap PASSED [ 46%] 2026-02-12T08:47:29.889 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_snap_timestamp PASSED [ 47%] 2026-02-12T08:47:34.907 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_remove_snap PASSED [ 48%] 2026-02-12T08:47:40.928 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_snap_rollback PASSED [ 50%] 2026-02-12T08:47:46.953 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_snap_rollback_removed PASSED [ 51%] 2026-02-12T08:47:52.907 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_snap_read PASSED [ 52%] 2026-02-12T08:47:56.922 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_set_omap PASSED [ 53%] 2026-02-12T08:48:00.939 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_set_omap_aio PASSED [ 54%] 2026-02-12T08:48:04.957 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_write_ops PASSED [ 55%] 2026-02-12T08:48:08.896 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_execute_op PASSED [ 56%] 2026-02-12T08:48:12.910 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_writesame_op PASSED [ 58%] 2026-02-12T08:48:16.928 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_omap_vals_by_keys PASSED [ 59%] 2026-02-12T08:48:20.939 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_get_omap_keys PASSED [ 60%] 2026-02-12T08:48:24.956 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_clear_omap PASSED [ 61%] 2026-02-12T08:48:28.900 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_remove_omap_range2 PASSED [ 62%] 2026-02-12T08:48:32.912 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_omap_cmp PASSED [ 63%] 2026-02-12T08:48:36.928 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_cmpext_op PASSED [ 65%] 2026-02-12T08:48:40.942 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_xattrs_op PASSED [ 66%] 2026-02-12T08:48:43.956 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_locator PASSED [ 67%] 2026-02-12T08:48:47.968 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_operate_aio_write_op PASSED [ 68%] 2026-02-12T08:48:51.911 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_write PASSED [ 69%] 2026-02-12T08:48:55.918 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_cmpext PASSED [ 70%] 2026-02-12T08:48:59.907 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_rmxattr PASSED [ 72%] 2026-02-12T08:49:03.918 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_write_no_comp_ref PASSED [ 73%] 2026-02-12T08:49:07.938 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_append PASSED [ 74%] 2026-02-12T08:49:11.950 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_write_full PASSED [ 75%] 2026-02-12T08:49:15.969 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_writesame PASSED [ 76%] 2026-02-12T08:49:19.912 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_stat PASSED [ 77%] 2026-02-12T08:49:23.922 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_remove PASSED [ 79%] 2026-02-12T08:49:27.942 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_lock PASSED [ 80%] 2026-02-12T08:49:31.952 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_execute PASSED [ 81%] 2026-02-12T08:49:35.964 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_execute PASSED [ 82%] 2026-02-12T08:49:39.917 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_aio_setxattr PASSED [ 83%] 2026-02-12T08:49:48.917 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_applications PASSED [ 84%] 2026-02-12T08:49:51.941 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_service_daemon PASSED [ 86%] 2026-02-12T08:49:54.953 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx::test_alignment PASSED [ 87%] 2026-02-12T08:49:57.963 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx2::test_get_last_version PASSED [ 88%] 2026-02-12T08:50:00.925 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoctx2::test_get_stats PASSED [ 89%] 2026-02-12T08:50:03.942 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestObject::test_read PASSED [ 90%] 2026-02-12T08:50:06.954 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestObject::test_seek PASSED [ 91%] 2026-02-12T08:50:09.963 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestObject::test_write PASSED [ 93%] 2026-02-12T08:50:17.987 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestIoCtxSelfManagedSnaps::test PASSED [ 94%] 2026-02-12T08:50:18.003 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestCommand::test_monmap_dump PASSED [ 95%] 2026-02-12T08:50:18.070 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestCommand::test_osd_bench PASSED [ 96%] 2026-02-12T08:50:18.921 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestCommand::test_ceph_osd_pool_create_utf8 PASSED [ 97%] 2026-02-12T08:50:24.934 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestWatchNotify::test PASSED [ 98%] 2026-02-12T08:50:30.953 INFO:tasks.workunit.client.0.trial160.stdout:../../../clone.client.0/src/test/pybind/test_rados.py::TestWatchNotify::test_aio_notify PASSED [100%] 2026-02-12T08:50:30.953 INFO:tasks.workunit.client.0.trial160.stdout: 2026-02-12T08:50:30.953 INFO:tasks.workunit.client.0.trial160.stdout:================= 86 passed, 5 deselected in 283.61s (0:04:43) ================= 2026-02-12T08:50:30.976 INFO:tasks.workunit.client.0.trial160.stderr:+ exit 0 2026-02-12T08:50:30.977 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-12T08:50:30.978 DEBUG:teuthology.orchestra.run.trial160:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-12T08:50:31.047 INFO:tasks.workunit:Stopping ["rados/test_python.sh -m 'not (wait or tier or ec)'"] on client.0... 2026-02-12T08:50:31.047 DEBUG:teuthology.orchestra.run.trial160:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-12T08:50:31.441 DEBUG:teuthology.parallel:result is None 2026-02-12T08:50:31.441 DEBUG:teuthology.orchestra.run.trial160:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-12T08:50:31.466 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-12T08:50:31.466 DEBUG:teuthology.orchestra.run.trial160:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-12T08:50:31.522 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-12T08:50:31.523 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-12T08:50:31.545 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-12T08:50:31.546 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T08:50:31.639 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:31.635+0000 7f4b27f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:31.642 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:31.640+0000 7f4b27f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:31.754 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:50:31.755 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-12T08:50:31.764 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":452,"stamp":"2026-02-12T08:50:31.152951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":15996,"kb_used_data":15996,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208650628,"statfs":{"total":213674622976,"available":213658243072,"internally_reserved":0,"allocated":16379904,"data_stored":16379904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.221142"},"pg_stats":[{"pgid":"73.f","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.955320+0000","last_change":"2026-02-12T08:50:19.978077+0000","last_active":"2026-02-12T08:50:27.955320+0000","last_peered":"2026-02-12T08:50:27.955320+0000","last_clean":"2026-02-12T08:50:27.955320+0000","last_became_active":"2026-02-12T08:50:19.965615+0000","last_became_peered":"2026-02-12T08:50:19.965615+0000","last_unstale":"2026-02-12T08:50:27.955320+0000","last_undegraded":"2026-02-12T08:50:27.955320+0000","last_fullsized":"2026-02-12T08:50:27.955320+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.e","version":"0'0","reported_seq":26,"reported_epoch":297,"state":"active+clean","last_fresh":"2026-02-12T08:50:26.946033+0000","last_change":"2026-02-12T08:50:19.986367+0000","last_active":"2026-02-12T08:50:26.946033+0000","last_peered":"2026-02-12T08:50:26.946033+0000","last_clean":"2026-02-12T08:50:26.946033+0000","last_became_active":"2026-02-12T08:50:19.981781+0000","last_became_peered":"2026-02-12T08:50:19.981781+0000","last_unstale":"2026-02-12T08:50:26.946033+0000","last_undegraded":"2026-02-12T08:50:26.946033+0000","last_fullsized":"2026-02-12T08:50:26.946033+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.d","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956119+0000","last_change":"2026-02-12T08:50:19.980456+0000","last_active":"2026-02-12T08:50:27.956119+0000","last_peered":"2026-02-12T08:50:27.956119+0000","last_clean":"2026-02-12T08:50:27.956119+0000","last_became_active":"2026-02-12T08:50:19.975333+0000","last_became_peered":"2026-02-12T08:50:19.975333+0000","last_unstale":"2026-02-12T08:50:27.956119+0000","last_undegraded":"2026-02-12T08:50:27.956119+0000","last_fullsized":"2026-02-12T08:50:27.956119+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.c","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956921+0000","last_change":"2026-02-12T08:50:19.973112+0000","last_active":"2026-02-12T08:50:27.956921+0000","last_peered":"2026-02-12T08:50:27.956921+0000","last_clean":"2026-02-12T08:50:27.956921+0000","last_became_active":"2026-02-12T08:50:19.965297+0000","last_became_peered":"2026-02-12T08:50:19.965297+0000","last_unstale":"2026-02-12T08:50:27.956921+0000","last_undegraded":"2026-02-12T08:50:27.956921+0000","last_fullsized":"2026-02-12T08:50:27.956921+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.b","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.958472+0000","last_change":"2026-02-12T08:50:20.011343+0000","last_active":"2026-02-12T08:50:27.958472+0000","last_peered":"2026-02-12T08:50:27.958472+0000","last_clean":"2026-02-12T08:50:27.958472+0000","last_became_active":"2026-02-12T08:50:19.993163+0000","last_became_peered":"2026-02-12T08:50:19.993163+0000","last_unstale":"2026-02-12T08:50:27.958472+0000","last_undegraded":"2026-02-12T08:50:27.958472+0000","last_fullsized":"2026-02-12T08:50:27.958472+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.a","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.958436+0000","last_change":"2026-02-12T08:50:19.985094+0000","last_active":"2026-02-12T08:50:27.958436+0000","last_peered":"2026-02-12T08:50:27.958436+0000","last_clean":"2026-02-12T08:50:27.958436+0000","last_became_active":"2026-02-12T08:50:19.980430+0000","last_became_peered":"2026-02-12T08:50:19.980430+0000","last_unstale":"2026-02-12T08:50:27.958436+0000","last_undegraded":"2026-02-12T08:50:27.958436+0000","last_fullsized":"2026-02-12T08:50:27.958436+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.9","version":"0'0","reported_seq":26,"reported_epoch":297,"state":"active+clean","last_fresh":"2026-02-12T08:50:26.946248+0000","last_change":"2026-02-12T08:50:20.001410+0000","last_active":"2026-02-12T08:50:26.946248+0000","last_peered":"2026-02-12T08:50:26.946248+0000","last_clean":"2026-02-12T08:50:26.946248+0000","last_became_active":"2026-02-12T08:50:19.982100+0000","last_became_peered":"2026-02-12T08:50:19.982100+0000","last_unstale":"2026-02-12T08:50:26.946248+0000","last_undegraded":"2026-02-12T08:50:26.946248+0000","last_fullsized":"2026-02-12T08:50:26.946248+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.8","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.954168+0000","last_change":"2026-02-12T08:50:20.065937+0000","last_active":"2026-02-12T08:50:27.954168+0000","last_peered":"2026-02-12T08:50:27.954168+0000","last_clean":"2026-02-12T08:50:27.954168+0000","last_became_active":"2026-02-12T08:50:20.054520+0000","last_became_peered":"2026-02-12T08:50:20.054520+0000","last_unstale":"2026-02-12T08:50:27.954168+0000","last_undegraded":"2026-02-12T08:50:27.954168+0000","last_fullsized":"2026-02-12T08:50:27.954168+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.7","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.955762+0000","last_change":"2026-02-12T08:50:19.998203+0000","last_active":"2026-02-12T08:50:27.955762+0000","last_peered":"2026-02-12T08:50:27.955762+0000","last_clean":"2026-02-12T08:50:27.955762+0000","last_became_active":"2026-02-12T08:50:19.990147+0000","last_became_peered":"2026-02-12T08:50:19.990147+0000","last_unstale":"2026-02-12T08:50:27.955762+0000","last_undegraded":"2026-02-12T08:50:27.955762+0000","last_fullsized":"2026-02-12T08:50:27.955762+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.6","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.958728+0000","last_change":"2026-02-12T08:50:20.015036+0000","last_active":"2026-02-12T08:50:27.958728+0000","last_peered":"2026-02-12T08:50:27.958728+0000","last_clean":"2026-02-12T08:50:27.958728+0000","last_became_active":"2026-02-12T08:50:19.997617+0000","last_became_peered":"2026-02-12T08:50:19.997617+0000","last_unstale":"2026-02-12T08:50:27.958728+0000","last_undegraded":"2026-02-12T08:50:27.958728+0000","last_fullsized":"2026-02-12T08:50:27.958728+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.5","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956157+0000","last_change":"2026-02-12T08:50:20.042238+0000","last_active":"2026-02-12T08:50:27.956157+0000","last_peered":"2026-02-12T08:50:27.956157+0000","last_clean":"2026-02-12T08:50:27.956157+0000","last_became_active":"2026-02-12T08:50:20.029241+0000","last_became_peered":"2026-02-12T08:50:20.029241+0000","last_unstale":"2026-02-12T08:50:27.956157+0000","last_undegraded":"2026-02-12T08:50:27.956157+0000","last_fullsized":"2026-02-12T08:50:27.956157+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.4","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956079+0000","last_change":"2026-02-12T08:50:19.990016+0000","last_active":"2026-02-12T08:50:27.956079+0000","last_peered":"2026-02-12T08:50:27.956079+0000","last_clean":"2026-02-12T08:50:27.956079+0000","last_became_active":"2026-02-12T08:50:19.984578+0000","last_became_peered":"2026-02-12T08:50:19.984578+0000","last_unstale":"2026-02-12T08:50:27.956079+0000","last_undegraded":"2026-02-12T08:50:27.956079+0000","last_fullsized":"2026-02-12T08:50:27.956079+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.3","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.953357+0000","last_change":"2026-02-12T08:50:20.011295+0000","last_active":"2026-02-12T08:50:27.953357+0000","last_peered":"2026-02-12T08:50:27.953357+0000","last_clean":"2026-02-12T08:50:27.953357+0000","last_became_active":"2026-02-12T08:50:19.987458+0000","last_became_peered":"2026-02-12T08:50:19.987458+0000","last_unstale":"2026-02-12T08:50:27.953357+0000","last_undegraded":"2026-02-12T08:50:27.953357+0000","last_fullsized":"2026-02-12T08:50:27.953357+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.2","version":"0'0","reported_seq":26,"reported_epoch":297,"state":"active+clean","last_fresh":"2026-02-12T08:50:26.946639+0000","last_change":"2026-02-12T08:50:19.999958+0000","last_active":"2026-02-12T08:50:26.946639+0000","last_peered":"2026-02-12T08:50:26.946639+0000","last_clean":"2026-02-12T08:50:26.946639+0000","last_became_active":"2026-02-12T08:50:19.985668+0000","last_became_peered":"2026-02-12T08:50:19.985668+0000","last_unstale":"2026-02-12T08:50:26.946639+0000","last_undegraded":"2026-02-12T08:50:26.946639+0000","last_fullsized":"2026-02-12T08:50:26.946639+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.1","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956319+0000","last_change":"2026-02-12T08:50:20.029137+0000","last_active":"2026-02-12T08:50:27.956319+0000","last_peered":"2026-02-12T08:50:27.956319+0000","last_clean":"2026-02-12T08:50:27.956319+0000","last_became_active":"2026-02-12T08:50:20.024593+0000","last_became_peered":"2026-02-12T08:50:20.024593+0000","last_unstale":"2026-02-12T08:50:27.956319+0000","last_undegraded":"2026-02-12T08:50:27.956319+0000","last_fullsized":"2026-02-12T08:50:27.956319+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.0","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.954307+0000","last_change":"2026-02-12T08:50:20.007998+0000","last_active":"2026-02-12T08:50:27.954307+0000","last_peered":"2026-02-12T08:50:27.954307+0000","last_clean":"2026-02-12T08:50:27.954307+0000","last_became_active":"2026-02-12T08:50:19.984507+0000","last_became_peered":"2026-02-12T08:50:19.984507+0000","last_unstale":"2026-02-12T08:50:27.954307+0000","last_undegraded":"2026-02-12T08:50:27.954307+0000","last_fullsized":"2026-02-12T08:50:27.954307+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":930,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.953667+0000","last_change":"2026-02-12T08:45:10.358748+0000","last_active":"2026-02-12T08:50:27.953667+0000","last_peered":"2026-02-12T08:50:27.953667+0000","last_clean":"2026-02-12T08:50:27.953667+0000","last_became_active":"2026-02-12T08:45:10.349703+0000","last_became_peered":"2026-02-12T08:45:10.349703+0000","last_unstale":"2026-02-12T08:50:27.953667+0000","last_undegraded":"2026-02-12T08:50:27.953667+0000","last_fullsized":"2026-02-12T08:50:27.953667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:09.313699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:09.313699+0000","last_clean_scrub_stamp":"2026-02-12T08:45:09.313699+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":856,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956977+0000","last_change":"2026-02-12T08:45:18.949960+0000","last_active":"2026-02-12T08:50:27.956977+0000","last_peered":"2026-02-12T08:50:27.956977+0000","last_clean":"2026-02-12T08:50:27.956977+0000","last_became_active":"2026-02-12T08:45:16.965299+0000","last_became_peered":"2026-02-12T08:45:16.965299+0000","last_unstale":"2026-02-12T08:50:27.956977+0000","last_undegraded":"2026-02-12T08:50:27.956977+0000","last_fullsized":"2026-02-12T08:50:27.956977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":855,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956485+0000","last_change":"2026-02-12T08:45:18.951336+0000","last_active":"2026-02-12T08:50:27.956485+0000","last_peered":"2026-02-12T08:50:27.956485+0000","last_clean":"2026-02-12T08:50:27.956485+0000","last_became_active":"2026-02-12T08:45:16.964692+0000","last_became_peered":"2026-02-12T08:45:16.964692+0000","last_unstale":"2026-02-12T08:50:27.956485+0000","last_undegraded":"2026-02-12T08:50:27.956485+0000","last_fullsized":"2026-02-12T08:50:27.956485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":852,"reported_epoch":297,"state":"active+clean","last_fresh":"2026-02-12T08:50:26.944973+0000","last_change":"2026-02-12T08:45:18.948247+0000","last_active":"2026-02-12T08:50:26.944973+0000","last_peered":"2026-02-12T08:50:26.944973+0000","last_clean":"2026-02-12T08:50:26.944973+0000","last_became_active":"2026-02-12T08:45:16.971309+0000","last_became_peered":"2026-02-12T08:45:16.971309+0000","last_unstale":"2026-02-12T08:50:26.944973+0000","last_undegraded":"2026-02-12T08:50:26.944973+0000","last_fullsized":"2026-02-12T08:50:26.944973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":857,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.958091+0000","last_change":"2026-02-12T08:45:18.955561+0000","last_active":"2026-02-12T08:50:27.958091+0000","last_peered":"2026-02-12T08:50:27.958091+0000","last_clean":"2026-02-12T08:50:27.958091+0000","last_became_active":"2026-02-12T08:45:16.972386+0000","last_became_peered":"2026-02-12T08:45:16.972386+0000","last_unstale":"2026-02-12T08:50:27.958091+0000","last_undegraded":"2026-02-12T08:50:27.958091+0000","last_fullsized":"2026-02-12T08:50:27.958091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":852,"reported_epoch":297,"state":"active+clean","last_fresh":"2026-02-12T08:50:26.946446+0000","last_change":"2026-02-12T08:45:18.949323+0000","last_active":"2026-02-12T08:50:26.946446+0000","last_peered":"2026-02-12T08:50:26.946446+0000","last_clean":"2026-02-12T08:50:26.946446+0000","last_became_active":"2026-02-12T08:45:16.968304+0000","last_became_peered":"2026-02-12T08:45:16.968304+0000","last_unstale":"2026-02-12T08:50:26.946446+0000","last_undegraded":"2026-02-12T08:50:26.946446+0000","last_fullsized":"2026-02-12T08:50:26.946446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":855,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.957370+0000","last_change":"2026-02-12T08:45:18.955883+0000","last_active":"2026-02-12T08:50:27.957370+0000","last_peered":"2026-02-12T08:50:27.957370+0000","last_clean":"2026-02-12T08:50:27.957370+0000","last_became_active":"2026-02-12T08:45:16.963774+0000","last_became_peered":"2026-02-12T08:45:16.963774+0000","last_unstale":"2026-02-12T08:50:27.957370+0000","last_undegraded":"2026-02-12T08:50:27.957370+0000","last_fullsized":"2026-02-12T08:50:27.957370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":855,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.955735+0000","last_change":"2026-02-12T08:45:18.949365+0000","last_active":"2026-02-12T08:50:27.955735+0000","last_peered":"2026-02-12T08:50:27.955735+0000","last_clean":"2026-02-12T08:50:27.955735+0000","last_became_active":"2026-02-12T08:45:16.961363+0000","last_became_peered":"2026-02-12T08:45:16.961363+0000","last_unstale":"2026-02-12T08:50:27.955735+0000","last_undegraded":"2026-02-12T08:50:27.955735+0000","last_fullsized":"2026-02-12T08:50:27.955735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":855,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956648+0000","last_change":"2026-02-12T08:45:18.951814+0000","last_active":"2026-02-12T08:50:27.956648+0000","last_peered":"2026-02-12T08:50:27.956648+0000","last_clean":"2026-02-12T08:50:27.956648+0000","last_became_active":"2026-02-12T08:45:16.961720+0000","last_became_peered":"2026-02-12T08:45:16.961720+0000","last_unstale":"2026-02-12T08:50:27.956648+0000","last_undegraded":"2026-02-12T08:50:27.956648+0000","last_fullsized":"2026-02-12T08:50:27.956648+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":73,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213658112000,"internally_reserved":0,"allocated":16510976,"data_stored":16510976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160243978240,"internally_reserved":0,"allocated":11988992,"data_stored":11988992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53413969920,"internally_reserved":0,"allocated":4685824,"data_stored":4685824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673279,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3328,"kb_used_data":3328,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52163328,"statfs":{"total":53418655744,"available":53415247872,"internally_reserved":0,"allocated":3407872,"data_stored":3407872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4568,"kb_used_data":4568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162088,"statfs":{"total":53418655744,"available":53413978112,"internally_reserved":0,"allocated":4677632,"data_stored":4677632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3692,"kb_used_data":3692,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162964,"statfs":{"total":53418655744,"available":53414875136,"internally_reserved":0,"allocated":3780608,"data_stored":3780608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4408,"kb_used_data":4408,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162248,"statfs":{"total":53418655744,"available":53414141952,"internally_reserved":0,"allocated":4513792,"data_stored":4513792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53418655744,"available":53413969920,"internally_reserved":0,"allocated":4685824,"data_stored":4685824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53418655744,"available":53415141376,"internally_reserved":0,"allocated":3514368,"data_stored":3514368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53418655744,"available":53414866944,"internally_reserved":0,"allocated":3788800,"data_stored":3788800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53413969920,"internally_reserved":0,"allocated":4685824,"data_stored":4685824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":0,"total":53418655744,"available":53414133760,"internally_reserved":0,"allocated":4521984,"data_stored":4521984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":1,"total":53418655744,"available":53415141376,"internally_reserved":0,"allocated":3514368,"data_stored":3514368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":2,"total":53418655744,"available":53414866944,"internally_reserved":0,"allocated":3788800,"data_stored":3788800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":3,"total":53418655744,"available":53413969920,"internally_reserved":0,"allocated":4685824,"data_stored":4685824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T08:50:31.766 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T08:50:31.842 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:31.838+0000 7f3092a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:31.844 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:31.842+0000 7f3092a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:31.958 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:50:31.959 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-12T08:50:31.968 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":452,"stamp":"2026-02-12T08:50:31.152951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":15996,"kb_used_data":15996,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208650628,"statfs":{"total":213674622976,"available":213658243072,"internally_reserved":0,"allocated":16379904,"data_stored":16379904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.221142"},"pg_stats":[{"pgid":"73.f","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.955320+0000","last_change":"2026-02-12T08:50:19.978077+0000","last_active":"2026-02-12T08:50:27.955320+0000","last_peered":"2026-02-12T08:50:27.955320+0000","last_clean":"2026-02-12T08:50:27.955320+0000","last_became_active":"2026-02-12T08:50:19.965615+0000","last_became_peered":"2026-02-12T08:50:19.965615+0000","last_unstale":"2026-02-12T08:50:27.955320+0000","last_undegraded":"2026-02-12T08:50:27.955320+0000","last_fullsized":"2026-02-12T08:50:27.955320+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.e","version":"0'0","reported_seq":26,"reported_epoch":297,"state":"active+clean","last_fresh":"2026-02-12T08:50:26.946033+0000","last_change":"2026-02-12T08:50:19.986367+0000","last_active":"2026-02-12T08:50:26.946033+0000","last_peered":"2026-02-12T08:50:26.946033+0000","last_clean":"2026-02-12T08:50:26.946033+0000","last_became_active":"2026-02-12T08:50:19.981781+0000","last_became_peered":"2026-02-12T08:50:19.981781+0000","last_unstale":"2026-02-12T08:50:26.946033+0000","last_undegraded":"2026-02-12T08:50:26.946033+0000","last_fullsized":"2026-02-12T08:50:26.946033+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.d","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956119+0000","last_change":"2026-02-12T08:50:19.980456+0000","last_active":"2026-02-12T08:50:27.956119+0000","last_peered":"2026-02-12T08:50:27.956119+0000","last_clean":"2026-02-12T08:50:27.956119+0000","last_became_active":"2026-02-12T08:50:19.975333+0000","last_became_peered":"2026-02-12T08:50:19.975333+0000","last_unstale":"2026-02-12T08:50:27.956119+0000","last_undegraded":"2026-02-12T08:50:27.956119+0000","last_fullsized":"2026-02-12T08:50:27.956119+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.c","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956921+0000","last_change":"2026-02-12T08:50:19.973112+0000","last_active":"2026-02-12T08:50:27.956921+0000","last_peered":"2026-02-12T08:50:27.956921+0000","last_clean":"2026-02-12T08:50:27.956921+0000","last_became_active":"2026-02-12T08:50:19.965297+0000","last_became_peered":"2026-02-12T08:50:19.965297+0000","last_unstale":"2026-02-12T08:50:27.956921+0000","last_undegraded":"2026-02-12T08:50:27.956921+0000","last_fullsized":"2026-02-12T08:50:27.956921+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.b","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.958472+0000","last_change":"2026-02-12T08:50:20.011343+0000","last_active":"2026-02-12T08:50:27.958472+0000","last_peered":"2026-02-12T08:50:27.958472+0000","last_clean":"2026-02-12T08:50:27.958472+0000","last_became_active":"2026-02-12T08:50:19.993163+0000","last_became_peered":"2026-02-12T08:50:19.993163+0000","last_unstale":"2026-02-12T08:50:27.958472+0000","last_undegraded":"2026-02-12T08:50:27.958472+0000","last_fullsized":"2026-02-12T08:50:27.958472+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.a","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.958436+0000","last_change":"2026-02-12T08:50:19.985094+0000","last_active":"2026-02-12T08:50:27.958436+0000","last_peered":"2026-02-12T08:50:27.958436+0000","last_clean":"2026-02-12T08:50:27.958436+0000","last_became_active":"2026-02-12T08:50:19.980430+0000","last_became_peered":"2026-02-12T08:50:19.980430+0000","last_unstale":"2026-02-12T08:50:27.958436+0000","last_undegraded":"2026-02-12T08:50:27.958436+0000","last_fullsized":"2026-02-12T08:50:27.958436+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.9","version":"0'0","reported_seq":26,"reported_epoch":297,"state":"active+clean","last_fresh":"2026-02-12T08:50:26.946248+0000","last_change":"2026-02-12T08:50:20.001410+0000","last_active":"2026-02-12T08:50:26.946248+0000","last_peered":"2026-02-12T08:50:26.946248+0000","last_clean":"2026-02-12T08:50:26.946248+0000","last_became_active":"2026-02-12T08:50:19.982100+0000","last_became_peered":"2026-02-12T08:50:19.982100+0000","last_unstale":"2026-02-12T08:50:26.946248+0000","last_undegraded":"2026-02-12T08:50:26.946248+0000","last_fullsized":"2026-02-12T08:50:26.946248+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.8","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.954168+0000","last_change":"2026-02-12T08:50:20.065937+0000","last_active":"2026-02-12T08:50:27.954168+0000","last_peered":"2026-02-12T08:50:27.954168+0000","last_clean":"2026-02-12T08:50:27.954168+0000","last_became_active":"2026-02-12T08:50:20.054520+0000","last_became_peered":"2026-02-12T08:50:20.054520+0000","last_unstale":"2026-02-12T08:50:27.954168+0000","last_undegraded":"2026-02-12T08:50:27.954168+0000","last_fullsized":"2026-02-12T08:50:27.954168+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.7","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.955762+0000","last_change":"2026-02-12T08:50:19.998203+0000","last_active":"2026-02-12T08:50:27.955762+0000","last_peered":"2026-02-12T08:50:27.955762+0000","last_clean":"2026-02-12T08:50:27.955762+0000","last_became_active":"2026-02-12T08:50:19.990147+0000","last_became_peered":"2026-02-12T08:50:19.990147+0000","last_unstale":"2026-02-12T08:50:27.955762+0000","last_undegraded":"2026-02-12T08:50:27.955762+0000","last_fullsized":"2026-02-12T08:50:27.955762+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.6","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.958728+0000","last_change":"2026-02-12T08:50:20.015036+0000","last_active":"2026-02-12T08:50:27.958728+0000","last_peered":"2026-02-12T08:50:27.958728+0000","last_clean":"2026-02-12T08:50:27.958728+0000","last_became_active":"2026-02-12T08:50:19.997617+0000","last_became_peered":"2026-02-12T08:50:19.997617+0000","last_unstale":"2026-02-12T08:50:27.958728+0000","last_undegraded":"2026-02-12T08:50:27.958728+0000","last_fullsized":"2026-02-12T08:50:27.958728+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.5","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956157+0000","last_change":"2026-02-12T08:50:20.042238+0000","last_active":"2026-02-12T08:50:27.956157+0000","last_peered":"2026-02-12T08:50:27.956157+0000","last_clean":"2026-02-12T08:50:27.956157+0000","last_became_active":"2026-02-12T08:50:20.029241+0000","last_became_peered":"2026-02-12T08:50:20.029241+0000","last_unstale":"2026-02-12T08:50:27.956157+0000","last_undegraded":"2026-02-12T08:50:27.956157+0000","last_fullsized":"2026-02-12T08:50:27.956157+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.4","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956079+0000","last_change":"2026-02-12T08:50:19.990016+0000","last_active":"2026-02-12T08:50:27.956079+0000","last_peered":"2026-02-12T08:50:27.956079+0000","last_clean":"2026-02-12T08:50:27.956079+0000","last_became_active":"2026-02-12T08:50:19.984578+0000","last_became_peered":"2026-02-12T08:50:19.984578+0000","last_unstale":"2026-02-12T08:50:27.956079+0000","last_undegraded":"2026-02-12T08:50:27.956079+0000","last_fullsized":"2026-02-12T08:50:27.956079+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.3","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.953357+0000","last_change":"2026-02-12T08:50:20.011295+0000","last_active":"2026-02-12T08:50:27.953357+0000","last_peered":"2026-02-12T08:50:27.953357+0000","last_clean":"2026-02-12T08:50:27.953357+0000","last_became_active":"2026-02-12T08:50:19.987458+0000","last_became_peered":"2026-02-12T08:50:19.987458+0000","last_unstale":"2026-02-12T08:50:27.953357+0000","last_undegraded":"2026-02-12T08:50:27.953357+0000","last_fullsized":"2026-02-12T08:50:27.953357+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.2","version":"0'0","reported_seq":26,"reported_epoch":297,"state":"active+clean","last_fresh":"2026-02-12T08:50:26.946639+0000","last_change":"2026-02-12T08:50:19.999958+0000","last_active":"2026-02-12T08:50:26.946639+0000","last_peered":"2026-02-12T08:50:26.946639+0000","last_clean":"2026-02-12T08:50:26.946639+0000","last_became_active":"2026-02-12T08:50:19.985668+0000","last_became_peered":"2026-02-12T08:50:19.985668+0000","last_unstale":"2026-02-12T08:50:26.946639+0000","last_undegraded":"2026-02-12T08:50:26.946639+0000","last_fullsized":"2026-02-12T08:50:26.946639+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.1","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956319+0000","last_change":"2026-02-12T08:50:20.029137+0000","last_active":"2026-02-12T08:50:27.956319+0000","last_peered":"2026-02-12T08:50:27.956319+0000","last_clean":"2026-02-12T08:50:27.956319+0000","last_became_active":"2026-02-12T08:50:20.024593+0000","last_became_peered":"2026-02-12T08:50:20.024593+0000","last_unstale":"2026-02-12T08:50:27.956319+0000","last_undegraded":"2026-02-12T08:50:27.956319+0000","last_fullsized":"2026-02-12T08:50:27.956319+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.0","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.954307+0000","last_change":"2026-02-12T08:50:20.007998+0000","last_active":"2026-02-12T08:50:27.954307+0000","last_peered":"2026-02-12T08:50:27.954307+0000","last_clean":"2026-02-12T08:50:27.954307+0000","last_became_active":"2026-02-12T08:50:19.984507+0000","last_became_peered":"2026-02-12T08:50:19.984507+0000","last_unstale":"2026-02-12T08:50:27.954307+0000","last_undegraded":"2026-02-12T08:50:27.954307+0000","last_fullsized":"2026-02-12T08:50:27.954307+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":930,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.953667+0000","last_change":"2026-02-12T08:45:10.358748+0000","last_active":"2026-02-12T08:50:27.953667+0000","last_peered":"2026-02-12T08:50:27.953667+0000","last_clean":"2026-02-12T08:50:27.953667+0000","last_became_active":"2026-02-12T08:45:10.349703+0000","last_became_peered":"2026-02-12T08:45:10.349703+0000","last_unstale":"2026-02-12T08:50:27.953667+0000","last_undegraded":"2026-02-12T08:50:27.953667+0000","last_fullsized":"2026-02-12T08:50:27.953667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:09.313699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:09.313699+0000","last_clean_scrub_stamp":"2026-02-12T08:45:09.313699+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":856,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956977+0000","last_change":"2026-02-12T08:45:18.949960+0000","last_active":"2026-02-12T08:50:27.956977+0000","last_peered":"2026-02-12T08:50:27.956977+0000","last_clean":"2026-02-12T08:50:27.956977+0000","last_became_active":"2026-02-12T08:45:16.965299+0000","last_became_peered":"2026-02-12T08:45:16.965299+0000","last_unstale":"2026-02-12T08:50:27.956977+0000","last_undegraded":"2026-02-12T08:50:27.956977+0000","last_fullsized":"2026-02-12T08:50:27.956977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":855,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956485+0000","last_change":"2026-02-12T08:45:18.951336+0000","last_active":"2026-02-12T08:50:27.956485+0000","last_peered":"2026-02-12T08:50:27.956485+0000","last_clean":"2026-02-12T08:50:27.956485+0000","last_became_active":"2026-02-12T08:45:16.964692+0000","last_became_peered":"2026-02-12T08:45:16.964692+0000","last_unstale":"2026-02-12T08:50:27.956485+0000","last_undegraded":"2026-02-12T08:50:27.956485+0000","last_fullsized":"2026-02-12T08:50:27.956485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":852,"reported_epoch":297,"state":"active+clean","last_fresh":"2026-02-12T08:50:26.944973+0000","last_change":"2026-02-12T08:45:18.948247+0000","last_active":"2026-02-12T08:50:26.944973+0000","last_peered":"2026-02-12T08:50:26.944973+0000","last_clean":"2026-02-12T08:50:26.944973+0000","last_became_active":"2026-02-12T08:45:16.971309+0000","last_became_peered":"2026-02-12T08:45:16.971309+0000","last_unstale":"2026-02-12T08:50:26.944973+0000","last_undegraded":"2026-02-12T08:50:26.944973+0000","last_fullsized":"2026-02-12T08:50:26.944973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":857,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.958091+0000","last_change":"2026-02-12T08:45:18.955561+0000","last_active":"2026-02-12T08:50:27.958091+0000","last_peered":"2026-02-12T08:50:27.958091+0000","last_clean":"2026-02-12T08:50:27.958091+0000","last_became_active":"2026-02-12T08:45:16.972386+0000","last_became_peered":"2026-02-12T08:45:16.972386+0000","last_unstale":"2026-02-12T08:50:27.958091+0000","last_undegraded":"2026-02-12T08:50:27.958091+0000","last_fullsized":"2026-02-12T08:50:27.958091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":852,"reported_epoch":297,"state":"active+clean","last_fresh":"2026-02-12T08:50:26.946446+0000","last_change":"2026-02-12T08:45:18.949323+0000","last_active":"2026-02-12T08:50:26.946446+0000","last_peered":"2026-02-12T08:50:26.946446+0000","last_clean":"2026-02-12T08:50:26.946446+0000","last_became_active":"2026-02-12T08:45:16.968304+0000","last_became_peered":"2026-02-12T08:45:16.968304+0000","last_unstale":"2026-02-12T08:50:26.946446+0000","last_undegraded":"2026-02-12T08:50:26.946446+0000","last_fullsized":"2026-02-12T08:50:26.946446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":855,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.957370+0000","last_change":"2026-02-12T08:45:18.955883+0000","last_active":"2026-02-12T08:50:27.957370+0000","last_peered":"2026-02-12T08:50:27.957370+0000","last_clean":"2026-02-12T08:50:27.957370+0000","last_became_active":"2026-02-12T08:45:16.963774+0000","last_became_peered":"2026-02-12T08:45:16.963774+0000","last_unstale":"2026-02-12T08:50:27.957370+0000","last_undegraded":"2026-02-12T08:50:27.957370+0000","last_fullsized":"2026-02-12T08:50:27.957370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":855,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.955735+0000","last_change":"2026-02-12T08:45:18.949365+0000","last_active":"2026-02-12T08:50:27.955735+0000","last_peered":"2026-02-12T08:50:27.955735+0000","last_clean":"2026-02-12T08:50:27.955735+0000","last_became_active":"2026-02-12T08:45:16.961363+0000","last_became_peered":"2026-02-12T08:45:16.961363+0000","last_unstale":"2026-02-12T08:50:27.955735+0000","last_undegraded":"2026-02-12T08:50:27.955735+0000","last_fullsized":"2026-02-12T08:50:27.955735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":855,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956648+0000","last_change":"2026-02-12T08:45:18.951814+0000","last_active":"2026-02-12T08:50:27.956648+0000","last_peered":"2026-02-12T08:50:27.956648+0000","last_clean":"2026-02-12T08:50:27.956648+0000","last_became_active":"2026-02-12T08:45:16.961720+0000","last_became_peered":"2026-02-12T08:45:16.961720+0000","last_unstale":"2026-02-12T08:50:27.956648+0000","last_undegraded":"2026-02-12T08:50:27.956648+0000","last_fullsized":"2026-02-12T08:50:27.956648+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":73,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213658112000,"internally_reserved":0,"allocated":16510976,"data_stored":16510976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160243978240,"internally_reserved":0,"allocated":11988992,"data_stored":11988992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53413969920,"internally_reserved":0,"allocated":4685824,"data_stored":4685824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673279,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3328,"kb_used_data":3328,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52163328,"statfs":{"total":53418655744,"available":53415247872,"internally_reserved":0,"allocated":3407872,"data_stored":3407872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4568,"kb_used_data":4568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162088,"statfs":{"total":53418655744,"available":53413978112,"internally_reserved":0,"allocated":4677632,"data_stored":4677632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3692,"kb_used_data":3692,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162964,"statfs":{"total":53418655744,"available":53414875136,"internally_reserved":0,"allocated":3780608,"data_stored":3780608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4408,"kb_used_data":4408,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162248,"statfs":{"total":53418655744,"available":53414141952,"internally_reserved":0,"allocated":4513792,"data_stored":4513792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53418655744,"available":53413969920,"internally_reserved":0,"allocated":4685824,"data_stored":4685824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53418655744,"available":53415141376,"internally_reserved":0,"allocated":3514368,"data_stored":3514368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53418655744,"available":53414866944,"internally_reserved":0,"allocated":3788800,"data_stored":3788800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53413969920,"internally_reserved":0,"allocated":4685824,"data_stored":4685824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":0,"total":53418655744,"available":53414133760,"internally_reserved":0,"allocated":4521984,"data_stored":4521984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":1,"total":53418655744,"available":53415141376,"internally_reserved":0,"allocated":3514368,"data_stored":3514368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":2,"total":53418655744,"available":53414866944,"internally_reserved":0,"allocated":3788800,"data_stored":3788800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":3,"total":53418655744,"available":53413969920,"internally_reserved":0,"allocated":4685824,"data_stored":4685824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T08:50:31.970 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-12T08:50:31.971 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T08:50:32.048 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:32.044+0000 7f316381a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:32.050 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:32.049+0000 7f316381a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:32.163 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:50:32.163 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-12T08:50:32.172 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":452,"stamp":"2026-02-12T08:50:31.152951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":15996,"kb_used_data":15996,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208650628,"statfs":{"total":213674622976,"available":213658243072,"internally_reserved":0,"allocated":16379904,"data_stored":16379904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.221142"},"pg_stats":[{"pgid":"73.f","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.955320+0000","last_change":"2026-02-12T08:50:19.978077+0000","last_active":"2026-02-12T08:50:27.955320+0000","last_peered":"2026-02-12T08:50:27.955320+0000","last_clean":"2026-02-12T08:50:27.955320+0000","last_became_active":"2026-02-12T08:50:19.965615+0000","last_became_peered":"2026-02-12T08:50:19.965615+0000","last_unstale":"2026-02-12T08:50:27.955320+0000","last_undegraded":"2026-02-12T08:50:27.955320+0000","last_fullsized":"2026-02-12T08:50:27.955320+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.e","version":"0'0","reported_seq":26,"reported_epoch":297,"state":"active+clean","last_fresh":"2026-02-12T08:50:26.946033+0000","last_change":"2026-02-12T08:50:19.986367+0000","last_active":"2026-02-12T08:50:26.946033+0000","last_peered":"2026-02-12T08:50:26.946033+0000","last_clean":"2026-02-12T08:50:26.946033+0000","last_became_active":"2026-02-12T08:50:19.981781+0000","last_became_peered":"2026-02-12T08:50:19.981781+0000","last_unstale":"2026-02-12T08:50:26.946033+0000","last_undegraded":"2026-02-12T08:50:26.946033+0000","last_fullsized":"2026-02-12T08:50:26.946033+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.d","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956119+0000","last_change":"2026-02-12T08:50:19.980456+0000","last_active":"2026-02-12T08:50:27.956119+0000","last_peered":"2026-02-12T08:50:27.956119+0000","last_clean":"2026-02-12T08:50:27.956119+0000","last_became_active":"2026-02-12T08:50:19.975333+0000","last_became_peered":"2026-02-12T08:50:19.975333+0000","last_unstale":"2026-02-12T08:50:27.956119+0000","last_undegraded":"2026-02-12T08:50:27.956119+0000","last_fullsized":"2026-02-12T08:50:27.956119+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.c","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956921+0000","last_change":"2026-02-12T08:50:19.973112+0000","last_active":"2026-02-12T08:50:27.956921+0000","last_peered":"2026-02-12T08:50:27.956921+0000","last_clean":"2026-02-12T08:50:27.956921+0000","last_became_active":"2026-02-12T08:50:19.965297+0000","last_became_peered":"2026-02-12T08:50:19.965297+0000","last_unstale":"2026-02-12T08:50:27.956921+0000","last_undegraded":"2026-02-12T08:50:27.956921+0000","last_fullsized":"2026-02-12T08:50:27.956921+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.b","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.958472+0000","last_change":"2026-02-12T08:50:20.011343+0000","last_active":"2026-02-12T08:50:27.958472+0000","last_peered":"2026-02-12T08:50:27.958472+0000","last_clean":"2026-02-12T08:50:27.958472+0000","last_became_active":"2026-02-12T08:50:19.993163+0000","last_became_peered":"2026-02-12T08:50:19.993163+0000","last_unstale":"2026-02-12T08:50:27.958472+0000","last_undegraded":"2026-02-12T08:50:27.958472+0000","last_fullsized":"2026-02-12T08:50:27.958472+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.a","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.958436+0000","last_change":"2026-02-12T08:50:19.985094+0000","last_active":"2026-02-12T08:50:27.958436+0000","last_peered":"2026-02-12T08:50:27.958436+0000","last_clean":"2026-02-12T08:50:27.958436+0000","last_became_active":"2026-02-12T08:50:19.980430+0000","last_became_peered":"2026-02-12T08:50:19.980430+0000","last_unstale":"2026-02-12T08:50:27.958436+0000","last_undegraded":"2026-02-12T08:50:27.958436+0000","last_fullsized":"2026-02-12T08:50:27.958436+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.9","version":"0'0","reported_seq":26,"reported_epoch":297,"state":"active+clean","last_fresh":"2026-02-12T08:50:26.946248+0000","last_change":"2026-02-12T08:50:20.001410+0000","last_active":"2026-02-12T08:50:26.946248+0000","last_peered":"2026-02-12T08:50:26.946248+0000","last_clean":"2026-02-12T08:50:26.946248+0000","last_became_active":"2026-02-12T08:50:19.982100+0000","last_became_peered":"2026-02-12T08:50:19.982100+0000","last_unstale":"2026-02-12T08:50:26.946248+0000","last_undegraded":"2026-02-12T08:50:26.946248+0000","last_fullsized":"2026-02-12T08:50:26.946248+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.8","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.954168+0000","last_change":"2026-02-12T08:50:20.065937+0000","last_active":"2026-02-12T08:50:27.954168+0000","last_peered":"2026-02-12T08:50:27.954168+0000","last_clean":"2026-02-12T08:50:27.954168+0000","last_became_active":"2026-02-12T08:50:20.054520+0000","last_became_peered":"2026-02-12T08:50:20.054520+0000","last_unstale":"2026-02-12T08:50:27.954168+0000","last_undegraded":"2026-02-12T08:50:27.954168+0000","last_fullsized":"2026-02-12T08:50:27.954168+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.7","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.955762+0000","last_change":"2026-02-12T08:50:19.998203+0000","last_active":"2026-02-12T08:50:27.955762+0000","last_peered":"2026-02-12T08:50:27.955762+0000","last_clean":"2026-02-12T08:50:27.955762+0000","last_became_active":"2026-02-12T08:50:19.990147+0000","last_became_peered":"2026-02-12T08:50:19.990147+0000","last_unstale":"2026-02-12T08:50:27.955762+0000","last_undegraded":"2026-02-12T08:50:27.955762+0000","last_fullsized":"2026-02-12T08:50:27.955762+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.6","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.958728+0000","last_change":"2026-02-12T08:50:20.015036+0000","last_active":"2026-02-12T08:50:27.958728+0000","last_peered":"2026-02-12T08:50:27.958728+0000","last_clean":"2026-02-12T08:50:27.958728+0000","last_became_active":"2026-02-12T08:50:19.997617+0000","last_became_peered":"2026-02-12T08:50:19.997617+0000","last_unstale":"2026-02-12T08:50:27.958728+0000","last_undegraded":"2026-02-12T08:50:27.958728+0000","last_fullsized":"2026-02-12T08:50:27.958728+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.5","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956157+0000","last_change":"2026-02-12T08:50:20.042238+0000","last_active":"2026-02-12T08:50:27.956157+0000","last_peered":"2026-02-12T08:50:27.956157+0000","last_clean":"2026-02-12T08:50:27.956157+0000","last_became_active":"2026-02-12T08:50:20.029241+0000","last_became_peered":"2026-02-12T08:50:20.029241+0000","last_unstale":"2026-02-12T08:50:27.956157+0000","last_undegraded":"2026-02-12T08:50:27.956157+0000","last_fullsized":"2026-02-12T08:50:27.956157+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.4","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956079+0000","last_change":"2026-02-12T08:50:19.990016+0000","last_active":"2026-02-12T08:50:27.956079+0000","last_peered":"2026-02-12T08:50:27.956079+0000","last_clean":"2026-02-12T08:50:27.956079+0000","last_became_active":"2026-02-12T08:50:19.984578+0000","last_became_peered":"2026-02-12T08:50:19.984578+0000","last_unstale":"2026-02-12T08:50:27.956079+0000","last_undegraded":"2026-02-12T08:50:27.956079+0000","last_fullsized":"2026-02-12T08:50:27.956079+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.3","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.953357+0000","last_change":"2026-02-12T08:50:20.011295+0000","last_active":"2026-02-12T08:50:27.953357+0000","last_peered":"2026-02-12T08:50:27.953357+0000","last_clean":"2026-02-12T08:50:27.953357+0000","last_became_active":"2026-02-12T08:50:19.987458+0000","last_became_peered":"2026-02-12T08:50:19.987458+0000","last_unstale":"2026-02-12T08:50:27.953357+0000","last_undegraded":"2026-02-12T08:50:27.953357+0000","last_fullsized":"2026-02-12T08:50:27.953357+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.2","version":"0'0","reported_seq":26,"reported_epoch":297,"state":"active+clean","last_fresh":"2026-02-12T08:50:26.946639+0000","last_change":"2026-02-12T08:50:19.999958+0000","last_active":"2026-02-12T08:50:26.946639+0000","last_peered":"2026-02-12T08:50:26.946639+0000","last_clean":"2026-02-12T08:50:26.946639+0000","last_became_active":"2026-02-12T08:50:19.985668+0000","last_became_peered":"2026-02-12T08:50:19.985668+0000","last_unstale":"2026-02-12T08:50:26.946639+0000","last_undegraded":"2026-02-12T08:50:26.946639+0000","last_fullsized":"2026-02-12T08:50:26.946639+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.1","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956319+0000","last_change":"2026-02-12T08:50:20.029137+0000","last_active":"2026-02-12T08:50:27.956319+0000","last_peered":"2026-02-12T08:50:27.956319+0000","last_clean":"2026-02-12T08:50:27.956319+0000","last_became_active":"2026-02-12T08:50:20.024593+0000","last_became_peered":"2026-02-12T08:50:20.024593+0000","last_unstale":"2026-02-12T08:50:27.956319+0000","last_undegraded":"2026-02-12T08:50:27.956319+0000","last_fullsized":"2026-02-12T08:50:27.956319+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.0","version":"0'0","reported_seq":29,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.954307+0000","last_change":"2026-02-12T08:50:20.007998+0000","last_active":"2026-02-12T08:50:27.954307+0000","last_peered":"2026-02-12T08:50:27.954307+0000","last_clean":"2026-02-12T08:50:27.954307+0000","last_became_active":"2026-02-12T08:50:19.984507+0000","last_became_peered":"2026-02-12T08:50:19.984507+0000","last_unstale":"2026-02-12T08:50:27.954307+0000","last_undegraded":"2026-02-12T08:50:27.954307+0000","last_fullsized":"2026-02-12T08:50:27.954307+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":930,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.953667+0000","last_change":"2026-02-12T08:45:10.358748+0000","last_active":"2026-02-12T08:50:27.953667+0000","last_peered":"2026-02-12T08:50:27.953667+0000","last_clean":"2026-02-12T08:50:27.953667+0000","last_became_active":"2026-02-12T08:45:10.349703+0000","last_became_peered":"2026-02-12T08:45:10.349703+0000","last_unstale":"2026-02-12T08:50:27.953667+0000","last_undegraded":"2026-02-12T08:50:27.953667+0000","last_fullsized":"2026-02-12T08:50:27.953667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:09.313699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:09.313699+0000","last_clean_scrub_stamp":"2026-02-12T08:45:09.313699+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":856,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956977+0000","last_change":"2026-02-12T08:45:18.949960+0000","last_active":"2026-02-12T08:50:27.956977+0000","last_peered":"2026-02-12T08:50:27.956977+0000","last_clean":"2026-02-12T08:50:27.956977+0000","last_became_active":"2026-02-12T08:45:16.965299+0000","last_became_peered":"2026-02-12T08:45:16.965299+0000","last_unstale":"2026-02-12T08:50:27.956977+0000","last_undegraded":"2026-02-12T08:50:27.956977+0000","last_fullsized":"2026-02-12T08:50:27.956977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":855,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956485+0000","last_change":"2026-02-12T08:45:18.951336+0000","last_active":"2026-02-12T08:50:27.956485+0000","last_peered":"2026-02-12T08:50:27.956485+0000","last_clean":"2026-02-12T08:50:27.956485+0000","last_became_active":"2026-02-12T08:45:16.964692+0000","last_became_peered":"2026-02-12T08:45:16.964692+0000","last_unstale":"2026-02-12T08:50:27.956485+0000","last_undegraded":"2026-02-12T08:50:27.956485+0000","last_fullsized":"2026-02-12T08:50:27.956485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":852,"reported_epoch":297,"state":"active+clean","last_fresh":"2026-02-12T08:50:26.944973+0000","last_change":"2026-02-12T08:45:18.948247+0000","last_active":"2026-02-12T08:50:26.944973+0000","last_peered":"2026-02-12T08:50:26.944973+0000","last_clean":"2026-02-12T08:50:26.944973+0000","last_became_active":"2026-02-12T08:45:16.971309+0000","last_became_peered":"2026-02-12T08:45:16.971309+0000","last_unstale":"2026-02-12T08:50:26.944973+0000","last_undegraded":"2026-02-12T08:50:26.944973+0000","last_fullsized":"2026-02-12T08:50:26.944973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":857,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.958091+0000","last_change":"2026-02-12T08:45:18.955561+0000","last_active":"2026-02-12T08:50:27.958091+0000","last_peered":"2026-02-12T08:50:27.958091+0000","last_clean":"2026-02-12T08:50:27.958091+0000","last_became_active":"2026-02-12T08:45:16.972386+0000","last_became_peered":"2026-02-12T08:45:16.972386+0000","last_unstale":"2026-02-12T08:50:27.958091+0000","last_undegraded":"2026-02-12T08:50:27.958091+0000","last_fullsized":"2026-02-12T08:50:27.958091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":852,"reported_epoch":297,"state":"active+clean","last_fresh":"2026-02-12T08:50:26.946446+0000","last_change":"2026-02-12T08:45:18.949323+0000","last_active":"2026-02-12T08:50:26.946446+0000","last_peered":"2026-02-12T08:50:26.946446+0000","last_clean":"2026-02-12T08:50:26.946446+0000","last_became_active":"2026-02-12T08:45:16.968304+0000","last_became_peered":"2026-02-12T08:45:16.968304+0000","last_unstale":"2026-02-12T08:50:26.946446+0000","last_undegraded":"2026-02-12T08:50:26.946446+0000","last_fullsized":"2026-02-12T08:50:26.946446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":855,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.957370+0000","last_change":"2026-02-12T08:45:18.955883+0000","last_active":"2026-02-12T08:50:27.957370+0000","last_peered":"2026-02-12T08:50:27.957370+0000","last_clean":"2026-02-12T08:50:27.957370+0000","last_became_active":"2026-02-12T08:45:16.963774+0000","last_became_peered":"2026-02-12T08:45:16.963774+0000","last_unstale":"2026-02-12T08:50:27.957370+0000","last_undegraded":"2026-02-12T08:50:27.957370+0000","last_fullsized":"2026-02-12T08:50:27.957370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":855,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.955735+0000","last_change":"2026-02-12T08:45:18.949365+0000","last_active":"2026-02-12T08:50:27.955735+0000","last_peered":"2026-02-12T08:50:27.955735+0000","last_clean":"2026-02-12T08:50:27.955735+0000","last_became_active":"2026-02-12T08:45:16.961363+0000","last_became_peered":"2026-02-12T08:45:16.961363+0000","last_unstale":"2026-02-12T08:50:27.955735+0000","last_undegraded":"2026-02-12T08:50:27.955735+0000","last_fullsized":"2026-02-12T08:50:27.955735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":855,"reported_epoch":298,"state":"active+clean","last_fresh":"2026-02-12T08:50:27.956648+0000","last_change":"2026-02-12T08:45:18.951814+0000","last_active":"2026-02-12T08:50:27.956648+0000","last_peered":"2026-02-12T08:50:27.956648+0000","last_clean":"2026-02-12T08:50:27.956648+0000","last_became_active":"2026-02-12T08:45:16.961720+0000","last_became_peered":"2026-02-12T08:45:16.961720+0000","last_unstale":"2026-02-12T08:50:27.956648+0000","last_undegraded":"2026-02-12T08:50:27.956648+0000","last_fullsized":"2026-02-12T08:50:27.956648+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":73,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213658112000,"internally_reserved":0,"allocated":16510976,"data_stored":16510976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160243978240,"internally_reserved":0,"allocated":11988992,"data_stored":11988992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53413969920,"internally_reserved":0,"allocated":4685824,"data_stored":4685824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673279,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3328,"kb_used_data":3328,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52163328,"statfs":{"total":53418655744,"available":53415247872,"internally_reserved":0,"allocated":3407872,"data_stored":3407872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4568,"kb_used_data":4568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162088,"statfs":{"total":53418655744,"available":53413978112,"internally_reserved":0,"allocated":4677632,"data_stored":4677632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3692,"kb_used_data":3692,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162964,"statfs":{"total":53418655744,"available":53414875136,"internally_reserved":0,"allocated":3780608,"data_stored":3780608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4408,"kb_used_data":4408,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162248,"statfs":{"total":53418655744,"available":53414141952,"internally_reserved":0,"allocated":4513792,"data_stored":4513792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53418655744,"available":53413969920,"internally_reserved":0,"allocated":4685824,"data_stored":4685824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53418655744,"available":53415141376,"internally_reserved":0,"allocated":3514368,"data_stored":3514368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53418655744,"available":53414866944,"internally_reserved":0,"allocated":3788800,"data_stored":3788800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53413969920,"internally_reserved":0,"allocated":4685824,"data_stored":4685824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":0,"total":53418655744,"available":53414133760,"internally_reserved":0,"allocated":4521984,"data_stored":4521984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":1,"total":53418655744,"available":53415141376,"internally_reserved":0,"allocated":3514368,"data_stored":3514368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":2,"total":53418655744,"available":53414866944,"internally_reserved":0,"allocated":3788800,"data_stored":3788800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":3,"total":53418655744,"available":53413969920,"internally_reserved":0,"allocated":4685824,"data_stored":4685824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T08:50:32.174 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T08:50:32.249 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:32.245+0000 7f1732bd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:32.252 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:32.250+0000 7f1732bd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:32.364 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:50:32.365 INFO:teuthology.orchestra.run.trial160.stdout:{"epoch":299,"fsid":"c797b341-9be1-4308-bb3e-bbe04740db3f","created":"2026-02-12T08:44:58.861211+0000","modified":"2026-02-12T08:50:30.944515+0000","last_up_change":"2026-02-12T08:45:08.310916+0000","last_in_change":"2026-02-12T08:45:00.746823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":75,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T08:45:09.117943+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T08:45:15.075447+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":73,"pool_name":"黅","create_time":"2026-02-12T08:50:18.087044+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"292","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"08e24387-f907-4c27-b328-107847d40189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":296,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6810","nonce":2357199504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6809","nonce":2357199504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6808","nonce":2357199504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6807","nonce":2357199504}]},"public_addr":"10.20.193.160:6810/2357199504","cluster_addr":"10.20.193.160:6809/2357199504","heartbeat_back_addr":"10.20.193.160:6808/2357199504","heartbeat_front_addr":"10.20.193.160:6807/2357199504","state":["exists","up"]},{"osd":1,"uuid":"80832139-0c52-48e0-8a77-de6bae106aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":296,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6800","nonce":2703029037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6801","nonce":2703029037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6804","nonce":2703029037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6803","nonce":2703029037}]},"public_addr":"10.20.193.160:6800/2703029037","cluster_addr":"10.20.193.160:6801/2703029037","heartbeat_back_addr":"10.20.193.160:6804/2703029037","heartbeat_front_addr":"10.20.193.160:6803/2703029037","state":["exists","up"]},{"osd":2,"uuid":"0576b5bb-5f7d-4f62-bbd7-6c3f5bb2167e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":296,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6802","nonce":3317306639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6805","nonce":3317306639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6809","nonce":3317306639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6812","nonce":3317306639}]},"public_addr":"10.20.193.181:6802/3317306639","cluster_addr":"10.20.193.181:6805/3317306639","heartbeat_back_addr":"10.20.193.181:6809/3317306639","heartbeat_front_addr":"10.20.193.181:6812/3317306639","state":["exists","up"]},{"osd":3,"uuid":"67abb3bd-4150-40dc-ad83-430b9edbfac7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":296,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6804","nonce":2582487837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6803","nonce":2582487837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6811","nonce":2582487837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.181:6810","nonce":2582487837}]},"public_addr":"10.20.193.181:6804/2582487837","cluster_addr":"10.20.193.181:6803/2582487837","heartbeat_back_addr":"10.20.193.181:6811/2582487837","heartbeat_front_addr":"10.20.193.181:6810/2582487837","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":28,"snaps":[{"begin":1,"length":1}]},{"pool":33,"snaps":[{"begin":1,"length":1}]},{"pool":34,"snaps":[{"begin":1,"length":1}]},{"pool":35,"snaps":[{"begin":1,"length":1}]},{"pool":36,"snaps":[{"begin":1,"length":1}]},{"pool":72,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:50:33.375 INFO:tasks.ceph:Scrubbing osd.0 2026-02-12T08:50:33.376 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-12T08:50:33.456 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:33.450+0000 7f611c70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:33.459 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:33.457+0000 7f611c70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:33.474 INFO:teuthology.orchestra.run.trial160.stdout:{ 2026-02-12T08:50:33.474 INFO:teuthology.orchestra.run.trial160.stdout: "success": "" 2026-02-12T08:50:33.474 INFO:teuthology.orchestra.run.trial160.stdout:} 2026-02-12T08:50:33.483 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-12T08:50:33.560 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:33.555+0000 7f987290b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:33.562 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:33.561+0000 7f987290b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:33.675 INFO:teuthology.orchestra.run.trial160.stderr:instructed osd(s) 0 to deep-scrub 2026-02-12T08:50:33.685 INFO:tasks.ceph:Scrubbing osd.1 2026-02-12T08:50:33.685 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-12T08:50:33.765 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:33.758+0000 7f4b9070b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:33.767 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:33.766+0000 7f4b9070b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:33.777 INFO:teuthology.orchestra.run.trial160.stdout:{ 2026-02-12T08:50:33.778 INFO:teuthology.orchestra.run.trial160.stdout: "success": "" 2026-02-12T08:50:33.778 INFO:teuthology.orchestra.run.trial160.stdout:} 2026-02-12T08:50:33.785 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-12T08:50:33.861 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:33.857+0000 7ff1b8f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:33.863 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:33.862+0000 7ff1b8f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:33.975 INFO:teuthology.orchestra.run.trial160.stderr:instructed osd(s) 1 to deep-scrub 2026-02-12T08:50:33.987 INFO:tasks.ceph:Scrubbing osd.2 2026-02-12T08:50:33.987 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-12T08:50:34.067 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:34.060+0000 7ff37facb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:34.069 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:34.067+0000 7ff37facb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:34.081 INFO:teuthology.orchestra.run.trial160.stdout:{ 2026-02-12T08:50:34.081 INFO:teuthology.orchestra.run.trial160.stdout: "success": "" 2026-02-12T08:50:34.081 INFO:teuthology.orchestra.run.trial160.stdout:} 2026-02-12T08:50:34.087 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-12T08:50:34.164 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:34.159+0000 7efd3701a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:34.167 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:34.165+0000 7efd3701a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:34.277 INFO:teuthology.orchestra.run.trial160.stderr:instructed osd(s) 2 to deep-scrub 2026-02-12T08:50:34.286 INFO:tasks.ceph:Scrubbing osd.3 2026-02-12T08:50:34.287 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-12T08:50:34.365 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:34.358+0000 7ff368c11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:34.367 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:34.365+0000 7ff368c11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:34.378 INFO:teuthology.orchestra.run.trial160.stdout:{ 2026-02-12T08:50:34.378 INFO:teuthology.orchestra.run.trial160.stdout: "success": "" 2026-02-12T08:50:34.378 INFO:teuthology.orchestra.run.trial160.stdout:} 2026-02-12T08:50:34.384 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-12T08:50:34.461 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:34.456+0000 7f46f33c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:34.464 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:34.462+0000 7f46f33c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:34.576 INFO:teuthology.orchestra.run.trial160.stderr:instructed osd(s) 3 to deep-scrub 2026-02-12T08:50:34.586 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T08:50:34.664 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:34.660+0000 7efd51c51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:34.666 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:34.665+0000 7efd51c51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:34.780 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:50:34.781 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-12T08:50:34.790 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":454,"stamp":"2026-02-12T08:50:33.920136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":15156,"kb_used_data":15156,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208651468,"statfs":{"total":213674622976,"available":213659103232,"internally_reserved":0,"allocated":15519744,"data_stored":15519744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.767742"},"pg_stats":[{"pgid":"73.f","version":"0'0","reported_seq":32,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.973908+0000","last_change":"2026-02-12T08:50:19.978077+0000","last_active":"2026-02-12T08:50:30.973908+0000","last_peered":"2026-02-12T08:50:30.973908+0000","last_clean":"2026-02-12T08:50:30.973908+0000","last_became_active":"2026-02-12T08:50:19.965615+0000","last_became_peered":"2026-02-12T08:50:19.965615+0000","last_unstale":"2026-02-12T08:50:30.973908+0000","last_undegraded":"2026-02-12T08:50:30.973908+0000","last_fullsized":"2026-02-12T08:50:30.973908+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.e","version":"0'0","reported_seq":32,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.965581+0000","last_change":"2026-02-12T08:50:19.986367+0000","last_active":"2026-02-12T08:50:30.965581+0000","last_peered":"2026-02-12T08:50:30.965581+0000","last_clean":"2026-02-12T08:50:30.965581+0000","last_became_active":"2026-02-12T08:50:19.981781+0000","last_became_peered":"2026-02-12T08:50:19.981781+0000","last_unstale":"2026-02-12T08:50:30.965581+0000","last_undegraded":"2026-02-12T08:50:30.965581+0000","last_fullsized":"2026-02-12T08:50:30.965581+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.d","version":"0'0","reported_seq":32,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.981472+0000","last_change":"2026-02-12T08:50:19.980456+0000","last_active":"2026-02-12T08:50:30.981472+0000","last_peered":"2026-02-12T08:50:30.981472+0000","last_clean":"2026-02-12T08:50:30.981472+0000","last_became_active":"2026-02-12T08:50:19.975333+0000","last_became_peered":"2026-02-12T08:50:19.975333+0000","last_unstale":"2026-02-12T08:50:30.981472+0000","last_undegraded":"2026-02-12T08:50:30.981472+0000","last_fullsized":"2026-02-12T08:50:30.981472+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.c","version":"0'0","reported_seq":32,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.979757+0000","last_change":"2026-02-12T08:50:19.973112+0000","last_active":"2026-02-12T08:50:30.979757+0000","last_peered":"2026-02-12T08:50:30.979757+0000","last_clean":"2026-02-12T08:50:30.979757+0000","last_became_active":"2026-02-12T08:50:19.965297+0000","last_became_peered":"2026-02-12T08:50:19.965297+0000","last_unstale":"2026-02-12T08:50:30.979757+0000","last_undegraded":"2026-02-12T08:50:30.979757+0000","last_fullsized":"2026-02-12T08:50:30.979757+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.b","version":"0'0","reported_seq":32,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.981463+0000","last_change":"2026-02-12T08:50:20.011343+0000","last_active":"2026-02-12T08:50:30.981463+0000","last_peered":"2026-02-12T08:50:30.981463+0000","last_clean":"2026-02-12T08:50:30.981463+0000","last_became_active":"2026-02-12T08:50:19.993163+0000","last_became_peered":"2026-02-12T08:50:19.993163+0000","last_unstale":"2026-02-12T08:50:30.981463+0000","last_undegraded":"2026-02-12T08:50:30.981463+0000","last_fullsized":"2026-02-12T08:50:30.981463+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.a","version":"0'0","reported_seq":32,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.965291+0000","last_change":"2026-02-12T08:50:19.985094+0000","last_active":"2026-02-12T08:50:30.965291+0000","last_peered":"2026-02-12T08:50:30.965291+0000","last_clean":"2026-02-12T08:50:30.965291+0000","last_became_active":"2026-02-12T08:50:19.980430+0000","last_became_peered":"2026-02-12T08:50:19.980430+0000","last_unstale":"2026-02-12T08:50:30.965291+0000","last_undegraded":"2026-02-12T08:50:30.965291+0000","last_fullsized":"2026-02-12T08:50:30.965291+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.9","version":"0'0","reported_seq":32,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.966256+0000","last_change":"2026-02-12T08:50:20.001410+0000","last_active":"2026-02-12T08:50:30.966256+0000","last_peered":"2026-02-12T08:50:30.966256+0000","last_clean":"2026-02-12T08:50:30.966256+0000","last_became_active":"2026-02-12T08:50:19.982100+0000","last_became_peered":"2026-02-12T08:50:19.982100+0000","last_unstale":"2026-02-12T08:50:30.966256+0000","last_undegraded":"2026-02-12T08:50:30.966256+0000","last_fullsized":"2026-02-12T08:50:30.966256+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.8","version":"0'0","reported_seq":32,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.975813+0000","last_change":"2026-02-12T08:50:20.065937+0000","last_active":"2026-02-12T08:50:30.975813+0000","last_peered":"2026-02-12T08:50:30.975813+0000","last_clean":"2026-02-12T08:50:30.975813+0000","last_became_active":"2026-02-12T08:50:20.054520+0000","last_became_peered":"2026-02-12T08:50:20.054520+0000","last_unstale":"2026-02-12T08:50:30.975813+0000","last_undegraded":"2026-02-12T08:50:30.975813+0000","last_fullsized":"2026-02-12T08:50:30.975813+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.7","version":"0'0","reported_seq":32,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.968745+0000","last_change":"2026-02-12T08:50:19.998203+0000","last_active":"2026-02-12T08:50:30.968745+0000","last_peered":"2026-02-12T08:50:30.968745+0000","last_clean":"2026-02-12T08:50:30.968745+0000","last_became_active":"2026-02-12T08:50:19.990147+0000","last_became_peered":"2026-02-12T08:50:19.990147+0000","last_unstale":"2026-02-12T08:50:30.968745+0000","last_undegraded":"2026-02-12T08:50:30.968745+0000","last_fullsized":"2026-02-12T08:50:30.968745+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.6","version":"0'0","reported_seq":32,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.979120+0000","last_change":"2026-02-12T08:50:20.015036+0000","last_active":"2026-02-12T08:50:30.979120+0000","last_peered":"2026-02-12T08:50:30.979120+0000","last_clean":"2026-02-12T08:50:30.979120+0000","last_became_active":"2026-02-12T08:50:19.997617+0000","last_became_peered":"2026-02-12T08:50:19.997617+0000","last_unstale":"2026-02-12T08:50:30.979120+0000","last_undegraded":"2026-02-12T08:50:30.979120+0000","last_fullsized":"2026-02-12T08:50:30.979120+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.5","version":"0'0","reported_seq":32,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.980966+0000","last_change":"2026-02-12T08:50:20.042238+0000","last_active":"2026-02-12T08:50:30.980966+0000","last_peered":"2026-02-12T08:50:30.980966+0000","last_clean":"2026-02-12T08:50:30.980966+0000","last_became_active":"2026-02-12T08:50:20.029241+0000","last_became_peered":"2026-02-12T08:50:20.029241+0000","last_unstale":"2026-02-12T08:50:30.980966+0000","last_undegraded":"2026-02-12T08:50:30.980966+0000","last_fullsized":"2026-02-12T08:50:30.980966+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.4","version":"0'0","reported_seq":32,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.967344+0000","last_change":"2026-02-12T08:50:19.990016+0000","last_active":"2026-02-12T08:50:30.967344+0000","last_peered":"2026-02-12T08:50:30.967344+0000","last_clean":"2026-02-12T08:50:30.967344+0000","last_became_active":"2026-02-12T08:50:19.984578+0000","last_became_peered":"2026-02-12T08:50:19.984578+0000","last_unstale":"2026-02-12T08:50:30.967344+0000","last_undegraded":"2026-02-12T08:50:30.967344+0000","last_fullsized":"2026-02-12T08:50:30.967344+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.3","version":"0'0","reported_seq":32,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.967992+0000","last_change":"2026-02-12T08:50:20.011295+0000","last_active":"2026-02-12T08:50:30.967992+0000","last_peered":"2026-02-12T08:50:30.967992+0000","last_clean":"2026-02-12T08:50:30.967992+0000","last_became_active":"2026-02-12T08:50:19.987458+0000","last_became_peered":"2026-02-12T08:50:19.987458+0000","last_unstale":"2026-02-12T08:50:30.967992+0000","last_undegraded":"2026-02-12T08:50:30.967992+0000","last_fullsized":"2026-02-12T08:50:30.967992+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.2","version":"0'0","reported_seq":32,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.965603+0000","last_change":"2026-02-12T08:50:19.999958+0000","last_active":"2026-02-12T08:50:30.965603+0000","last_peered":"2026-02-12T08:50:30.965603+0000","last_clean":"2026-02-12T08:50:30.965603+0000","last_became_active":"2026-02-12T08:50:19.985668+0000","last_became_peered":"2026-02-12T08:50:19.985668+0000","last_unstale":"2026-02-12T08:50:30.965603+0000","last_undegraded":"2026-02-12T08:50:30.965603+0000","last_fullsized":"2026-02-12T08:50:30.965603+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.1","version":"0'0","reported_seq":32,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.968289+0000","last_change":"2026-02-12T08:50:20.029137+0000","last_active":"2026-02-12T08:50:30.968289+0000","last_peered":"2026-02-12T08:50:30.968289+0000","last_clean":"2026-02-12T08:50:30.968289+0000","last_became_active":"2026-02-12T08:50:20.024593+0000","last_became_peered":"2026-02-12T08:50:20.024593+0000","last_unstale":"2026-02-12T08:50:30.968289+0000","last_undegraded":"2026-02-12T08:50:30.968289+0000","last_fullsized":"2026-02-12T08:50:30.968289+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.0","version":"0'0","reported_seq":32,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.962291+0000","last_change":"2026-02-12T08:50:20.007998+0000","last_active":"2026-02-12T08:50:30.962291+0000","last_peered":"2026-02-12T08:50:30.962291+0000","last_clean":"2026-02-12T08:50:30.962291+0000","last_became_active":"2026-02-12T08:50:19.984507+0000","last_became_peered":"2026-02-12T08:50:19.984507+0000","last_unstale":"2026-02-12T08:50:30.962291+0000","last_undegraded":"2026-02-12T08:50:30.962291+0000","last_fullsized":"2026-02-12T08:50:30.962291+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:18.915972+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":933,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.968472+0000","last_change":"2026-02-12T08:45:10.358748+0000","last_active":"2026-02-12T08:50:30.968472+0000","last_peered":"2026-02-12T08:50:30.968472+0000","last_clean":"2026-02-12T08:50:30.968472+0000","last_became_active":"2026-02-12T08:45:10.349703+0000","last_became_peered":"2026-02-12T08:45:10.349703+0000","last_unstale":"2026-02-12T08:50:30.968472+0000","last_undegraded":"2026-02-12T08:50:30.968472+0000","last_fullsized":"2026-02-12T08:50:30.968472+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:09.313699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:09.313699+0000","last_clean_scrub_stamp":"2026-02-12T08:45:09.313699+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":859,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.969057+0000","last_change":"2026-02-12T08:45:18.949960+0000","last_active":"2026-02-12T08:50:30.969057+0000","last_peered":"2026-02-12T08:50:30.969057+0000","last_clean":"2026-02-12T08:50:30.969057+0000","last_became_active":"2026-02-12T08:45:16.965299+0000","last_became_peered":"2026-02-12T08:45:16.965299+0000","last_unstale":"2026-02-12T08:50:30.969057+0000","last_undegraded":"2026-02-12T08:50:30.969057+0000","last_fullsized":"2026-02-12T08:50:30.969057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":858,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.971091+0000","last_change":"2026-02-12T08:45:18.951336+0000","last_active":"2026-02-12T08:50:30.971091+0000","last_peered":"2026-02-12T08:50:30.971091+0000","last_clean":"2026-02-12T08:50:30.971091+0000","last_became_active":"2026-02-12T08:45:16.964692+0000","last_became_peered":"2026-02-12T08:45:16.964692+0000","last_unstale":"2026-02-12T08:50:30.971091+0000","last_undegraded":"2026-02-12T08:50:30.971091+0000","last_fullsized":"2026-02-12T08:50:30.971091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":858,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.962618+0000","last_change":"2026-02-12T08:45:18.948247+0000","last_active":"2026-02-12T08:50:30.962618+0000","last_peered":"2026-02-12T08:50:30.962618+0000","last_clean":"2026-02-12T08:50:30.962618+0000","last_became_active":"2026-02-12T08:45:16.971309+0000","last_became_peered":"2026-02-12T08:45:16.971309+0000","last_unstale":"2026-02-12T08:50:30.962618+0000","last_undegraded":"2026-02-12T08:50:30.962618+0000","last_fullsized":"2026-02-12T08:50:30.962618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":860,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.969487+0000","last_change":"2026-02-12T08:45:18.955561+0000","last_active":"2026-02-12T08:50:30.969487+0000","last_peered":"2026-02-12T08:50:30.969487+0000","last_clean":"2026-02-12T08:50:30.969487+0000","last_became_active":"2026-02-12T08:45:16.972386+0000","last_became_peered":"2026-02-12T08:45:16.972386+0000","last_unstale":"2026-02-12T08:50:30.969487+0000","last_undegraded":"2026-02-12T08:50:30.969487+0000","last_fullsized":"2026-02-12T08:50:30.969487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":858,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.967660+0000","last_change":"2026-02-12T08:45:18.949323+0000","last_active":"2026-02-12T08:50:30.967660+0000","last_peered":"2026-02-12T08:50:30.967660+0000","last_clean":"2026-02-12T08:50:30.967660+0000","last_became_active":"2026-02-12T08:45:16.968304+0000","last_became_peered":"2026-02-12T08:45:16.968304+0000","last_unstale":"2026-02-12T08:50:30.967660+0000","last_undegraded":"2026-02-12T08:50:30.967660+0000","last_fullsized":"2026-02-12T08:50:30.967660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":858,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.971400+0000","last_change":"2026-02-12T08:45:18.955883+0000","last_active":"2026-02-12T08:50:30.971400+0000","last_peered":"2026-02-12T08:50:30.971400+0000","last_clean":"2026-02-12T08:50:30.971400+0000","last_became_active":"2026-02-12T08:45:16.963774+0000","last_became_peered":"2026-02-12T08:45:16.963774+0000","last_unstale":"2026-02-12T08:50:30.971400+0000","last_undegraded":"2026-02-12T08:50:30.971400+0000","last_fullsized":"2026-02-12T08:50:30.971400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":858,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.976058+0000","last_change":"2026-02-12T08:45:18.949365+0000","last_active":"2026-02-12T08:50:30.976058+0000","last_peered":"2026-02-12T08:50:30.976058+0000","last_clean":"2026-02-12T08:50:30.976058+0000","last_became_active":"2026-02-12T08:45:16.961363+0000","last_became_peered":"2026-02-12T08:45:16.961363+0000","last_unstale":"2026-02-12T08:50:30.976058+0000","last_undegraded":"2026-02-12T08:50:30.976058+0000","last_fullsized":"2026-02-12T08:50:30.976058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":858,"reported_epoch":299,"state":"active+clean","last_fresh":"2026-02-12T08:50:30.968578+0000","last_change":"2026-02-12T08:45:18.951814+0000","last_active":"2026-02-12T08:50:30.968578+0000","last_peered":"2026-02-12T08:50:30.968578+0000","last_clean":"2026-02-12T08:50:30.968578+0000","last_became_active":"2026-02-12T08:45:16.961720+0000","last_became_peered":"2026-02-12T08:45:16.961720+0000","last_unstale":"2026-02-12T08:50:30.968578+0000","last_undegraded":"2026-02-12T08:50:30.968578+0000","last_fullsized":"2026-02-12T08:50:30.968578+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:45:15.923896+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":73,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213659103232,"internally_reserved":0,"allocated":15519744,"data_stored":15519744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160244703232,"internally_reserved":0,"allocated":11264000,"data_stored":11264000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53414318080,"internally_reserved":0,"allocated":4337664,"data_stored":4337664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673284,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3308,"kb_used_data":3308,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52163348,"statfs":{"total":53418655744,"available":53415268352,"internally_reserved":0,"allocated":3387392,"data_stored":3387392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4236,"kb_used_data":4236,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162420,"statfs":{"total":53418655744,"available":53414318080,"internally_reserved":0,"allocated":4337664,"data_stored":4337664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3456,"kb_used_data":3456,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52163200,"statfs":{"total":53418655744,"available":53415116800,"internally_reserved":0,"allocated":3538944,"data_stored":3538944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4156,"kb_used_data":4156,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162500,"statfs":{"total":53418655744,"available":53414400000,"internally_reserved":0,"allocated":4255744,"data_stored":4255744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53418655744,"available":53414318080,"internally_reserved":0,"allocated":4337664,"data_stored":4337664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53418655744,"available":53415268352,"internally_reserved":0,"allocated":3387392,"data_stored":3387392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53418655744,"available":53415116800,"internally_reserved":0,"allocated":3538944,"data_stored":3538944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53414318080,"internally_reserved":0,"allocated":4337664,"data_stored":4337664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":0,"total":53418655744,"available":53414400000,"internally_reserved":0,"allocated":4255744,"data_stored":4255744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":1,"total":53418655744,"available":53415268352,"internally_reserved":0,"allocated":3387392,"data_stored":3387392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":2,"total":53418655744,"available":53415116800,"internally_reserved":0,"allocated":3538944,"data_stored":3538944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":3,"total":53418655744,"available":53414318080,"internally_reserved":0,"allocated":4337664,"data_stored":4337664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T08:50:34.797 INFO:tasks.ceph:pgid 73.f last_scrub_stamp 2026-02-12T08:50:18.915972+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=18, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.797 INFO:tasks.ceph:pgid 73.e last_scrub_stamp 2026-02-12T08:50:18.915972+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=18, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.797 INFO:tasks.ceph:pgid 73.d last_scrub_stamp 2026-02-12T08:50:18.915972+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=18, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.797 INFO:tasks.ceph:pgid 73.c last_scrub_stamp 2026-02-12T08:50:18.915972+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=18, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.798 INFO:tasks.ceph:pgid 73.b last_scrub_stamp 2026-02-12T08:50:18.915972+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=18, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.798 INFO:tasks.ceph:pgid 73.a last_scrub_stamp 2026-02-12T08:50:18.915972+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=18, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.798 INFO:tasks.ceph:pgid 73.9 last_scrub_stamp 2026-02-12T08:50:18.915972+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=18, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.798 INFO:tasks.ceph:pgid 73.8 last_scrub_stamp 2026-02-12T08:50:18.915972+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=18, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.798 INFO:tasks.ceph:pgid 73.7 last_scrub_stamp 2026-02-12T08:50:18.915972+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=18, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.798 INFO:tasks.ceph:pgid 73.6 last_scrub_stamp 2026-02-12T08:50:18.915972+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=18, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.799 INFO:tasks.ceph:pgid 73.5 last_scrub_stamp 2026-02-12T08:50:18.915972+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=18, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.799 INFO:tasks.ceph:pgid 73.4 last_scrub_stamp 2026-02-12T08:50:18.915972+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=18, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.799 INFO:tasks.ceph:pgid 73.3 last_scrub_stamp 2026-02-12T08:50:18.915972+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=18, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.799 INFO:tasks.ceph:pgid 73.2 last_scrub_stamp 2026-02-12T08:50:18.915972+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=18, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.799 INFO:tasks.ceph:pgid 73.1 last_scrub_stamp 2026-02-12T08:50:18.915972+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=18, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.799 INFO:tasks.ceph:pgid 73.0 last_scrub_stamp 2026-02-12T08:50:18.915972+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=18, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.799 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-12T08:45:09.313699+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=45, tm_sec=9, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.800 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-12T08:45:15.923896+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.800 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-12T08:45:15.923896+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.800 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-12T08:45:15.923896+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.800 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-12T08:45:15.923896+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.800 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-12T08:45:15.923896+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.800 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-12T08:45:15.923896+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.800 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-12T08:45:15.923896+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.801 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-12T08:45:15.923896+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=45, tm_sec=15, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=50, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:50:34.801 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-12T08:50:54.802 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T08:50:54.881 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:54.877+0000 7fa8ee3cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:54.883 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:54.881+0000 7fa8ee3cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:54.996 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T08:50:54.996 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-12T08:50:55.005 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":464,"stamp":"2026-02-12T08:50:53.156454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":15220,"kb_used_data":15220,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208651404,"statfs":{"total":213674622976,"available":213659037696,"internally_reserved":0,"allocated":15585280,"data_stored":15585280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002294"},"pg_stats":[{"pgid":"73.f","version":"0'0","reported_seq":37,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:34.280592+0000","last_change":"2026-02-12T08:50:34.295417+0000","last_active":"2026-02-12T08:50:34.280592+0000","last_peered":"2026-02-12T08:50:34.280592+0000","last_clean":"2026-02-12T08:50:34.280592+0000","last_became_active":"2026-02-12T08:50:19.965615+0000","last_became_peered":"2026-02-12T08:50:19.965615+0000","last_unstale":"2026-02-12T08:50:34.280592+0000","last_undegraded":"2026-02-12T08:50:34.280592+0000","last_fullsized":"2026-02-12T08:50:34.280592+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:34.295368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:34.295368+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.e","version":"0'0","reported_seq":37,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:33.977688+0000","last_change":"2026-02-12T08:50:33.986996+0000","last_active":"2026-02-12T08:50:33.977688+0000","last_peered":"2026-02-12T08:50:33.977688+0000","last_clean":"2026-02-12T08:50:33.977688+0000","last_became_active":"2026-02-12T08:50:19.981781+0000","last_became_peered":"2026-02-12T08:50:19.981781+0000","last_unstale":"2026-02-12T08:50:33.977688+0000","last_undegraded":"2026-02-12T08:50:33.977688+0000","last_fullsized":"2026-02-12T08:50:33.977688+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:33.986937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:33.986937+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.d","version":"0'0","reported_seq":37,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:34.280815+0000","last_change":"2026-02-12T08:50:34.289247+0000","last_active":"2026-02-12T08:50:34.280815+0000","last_peered":"2026-02-12T08:50:34.280815+0000","last_clean":"2026-02-12T08:50:34.280815+0000","last_became_active":"2026-02-12T08:50:19.975333+0000","last_became_peered":"2026-02-12T08:50:19.975333+0000","last_unstale":"2026-02-12T08:50:34.280815+0000","last_undegraded":"2026-02-12T08:50:34.280815+0000","last_fullsized":"2026-02-12T08:50:34.280815+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:34.289164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:34.289164+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.c","version":"0'0","reported_seq":37,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:34.280070+0000","last_change":"2026-02-12T08:50:34.289741+0000","last_active":"2026-02-12T08:50:34.280070+0000","last_peered":"2026-02-12T08:50:34.280070+0000","last_clean":"2026-02-12T08:50:34.280070+0000","last_became_active":"2026-02-12T08:50:19.965297+0000","last_became_peered":"2026-02-12T08:50:19.965297+0000","last_unstale":"2026-02-12T08:50:34.280070+0000","last_undegraded":"2026-02-12T08:50:34.280070+0000","last_fullsized":"2026-02-12T08:50:34.280070+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:34.289687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:34.289687+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.b","version":"0'0","reported_seq":37,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:34.280493+0000","last_change":"2026-02-12T08:50:34.292694+0000","last_active":"2026-02-12T08:50:34.280493+0000","last_peered":"2026-02-12T08:50:34.280493+0000","last_clean":"2026-02-12T08:50:34.280493+0000","last_became_active":"2026-02-12T08:50:19.993163+0000","last_became_peered":"2026-02-12T08:50:19.993163+0000","last_unstale":"2026-02-12T08:50:34.280493+0000","last_undegraded":"2026-02-12T08:50:34.280493+0000","last_fullsized":"2026-02-12T08:50:34.280493+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:34.292615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:34.292615+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.a","version":"0'0","reported_seq":37,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:34.582472+0000","last_change":"2026-02-12T08:50:34.597770+0000","last_active":"2026-02-12T08:50:34.582472+0000","last_peered":"2026-02-12T08:50:34.582472+0000","last_clean":"2026-02-12T08:50:34.582472+0000","last_became_active":"2026-02-12T08:50:19.980430+0000","last_became_peered":"2026-02-12T08:50:19.980430+0000","last_unstale":"2026-02-12T08:50:34.582472+0000","last_undegraded":"2026-02-12T08:50:34.582472+0000","last_fullsized":"2026-02-12T08:50:34.582472+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:34.597690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:34.597690+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.9","version":"0'0","reported_seq":37,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:33.978494+0000","last_change":"2026-02-12T08:50:33.988642+0000","last_active":"2026-02-12T08:50:33.978494+0000","last_peered":"2026-02-12T08:50:33.978494+0000","last_clean":"2026-02-12T08:50:33.978494+0000","last_became_active":"2026-02-12T08:50:19.982100+0000","last_became_peered":"2026-02-12T08:50:19.982100+0000","last_unstale":"2026-02-12T08:50:33.978494+0000","last_undegraded":"2026-02-12T08:50:33.978494+0000","last_fullsized":"2026-02-12T08:50:33.978494+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:33.988592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:33.988592+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.8","version":"0'0","reported_seq":37,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:34.278446+0000","last_change":"2026-02-12T08:50:34.296077+0000","last_active":"2026-02-12T08:50:34.278446+0000","last_peered":"2026-02-12T08:50:34.278446+0000","last_clean":"2026-02-12T08:50:34.278446+0000","last_became_active":"2026-02-12T08:50:20.054520+0000","last_became_peered":"2026-02-12T08:50:20.054520+0000","last_unstale":"2026-02-12T08:50:34.278446+0000","last_undegraded":"2026-02-12T08:50:34.278446+0000","last_fullsized":"2026-02-12T08:50:34.278446+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:34.296021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:34.296021+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.7","version":"0'0","reported_seq":37,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:34.580946+0000","last_change":"2026-02-12T08:50:34.596333+0000","last_active":"2026-02-12T08:50:34.580946+0000","last_peered":"2026-02-12T08:50:34.580946+0000","last_clean":"2026-02-12T08:50:34.580946+0000","last_became_active":"2026-02-12T08:50:19.990147+0000","last_became_peered":"2026-02-12T08:50:19.990147+0000","last_unstale":"2026-02-12T08:50:34.580946+0000","last_undegraded":"2026-02-12T08:50:34.580946+0000","last_fullsized":"2026-02-12T08:50:34.580946+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:34.596269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:34.596269+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.6","version":"0'0","reported_seq":37,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:34.279572+0000","last_change":"2026-02-12T08:50:34.292970+0000","last_active":"2026-02-12T08:50:34.279572+0000","last_peered":"2026-02-12T08:50:34.279572+0000","last_clean":"2026-02-12T08:50:34.279572+0000","last_became_active":"2026-02-12T08:50:19.997617+0000","last_became_peered":"2026-02-12T08:50:19.997617+0000","last_unstale":"2026-02-12T08:50:34.279572+0000","last_undegraded":"2026-02-12T08:50:34.279572+0000","last_fullsized":"2026-02-12T08:50:34.279572+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:34.292899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:34.292899+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.5","version":"0'0","reported_seq":37,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:34.278572+0000","last_change":"2026-02-12T08:50:34.295966+0000","last_active":"2026-02-12T08:50:34.278572+0000","last_peered":"2026-02-12T08:50:34.278572+0000","last_clean":"2026-02-12T08:50:34.278572+0000","last_became_active":"2026-02-12T08:50:20.029241+0000","last_became_peered":"2026-02-12T08:50:20.029241+0000","last_unstale":"2026-02-12T08:50:34.278572+0000","last_undegraded":"2026-02-12T08:50:34.278572+0000","last_fullsized":"2026-02-12T08:50:34.278572+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:34.295893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:34.295893+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"73.4","version":"0'0","reported_seq":37,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:33.932067+0000","last_change":"2026-02-12T08:50:33.685455+0000","last_active":"2026-02-12T08:50:33.932067+0000","last_peered":"2026-02-12T08:50:33.932067+0000","last_clean":"2026-02-12T08:50:33.932067+0000","last_became_active":"2026-02-12T08:50:19.984578+0000","last_became_peered":"2026-02-12T08:50:19.984578+0000","last_unstale":"2026-02-12T08:50:33.932067+0000","last_undegraded":"2026-02-12T08:50:33.932067+0000","last_fullsized":"2026-02-12T08:50:33.932067+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:33.685383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:33.685383+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.3","version":"0'0","reported_seq":37,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:33.931425+0000","last_change":"2026-02-12T08:50:33.685476+0000","last_active":"2026-02-12T08:50:33.931425+0000","last_peered":"2026-02-12T08:50:33.931425+0000","last_clean":"2026-02-12T08:50:33.931425+0000","last_became_active":"2026-02-12T08:50:19.987458+0000","last_became_peered":"2026-02-12T08:50:19.987458+0000","last_unstale":"2026-02-12T08:50:33.931425+0000","last_undegraded":"2026-02-12T08:50:33.931425+0000","last_fullsized":"2026-02-12T08:50:33.931425+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:33.685421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:33.685421+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"73.2","version":"0'0","reported_seq":37,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:33.977729+0000","last_change":"2026-02-12T08:50:33.987530+0000","last_active":"2026-02-12T08:50:33.977729+0000","last_peered":"2026-02-12T08:50:33.977729+0000","last_clean":"2026-02-12T08:50:33.977729+0000","last_became_active":"2026-02-12T08:50:19.985668+0000","last_became_peered":"2026-02-12T08:50:19.985668+0000","last_unstale":"2026-02-12T08:50:33.977729+0000","last_undegraded":"2026-02-12T08:50:33.977729+0000","last_fullsized":"2026-02-12T08:50:33.977729+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:33.987477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:33.987477+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"73.1","version":"0'0","reported_seq":37,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:34.580689+0000","last_change":"2026-02-12T08:50:34.597294+0000","last_active":"2026-02-12T08:50:34.580689+0000","last_peered":"2026-02-12T08:50:34.580689+0000","last_clean":"2026-02-12T08:50:34.580689+0000","last_became_active":"2026-02-12T08:50:20.024593+0000","last_became_peered":"2026-02-12T08:50:20.024593+0000","last_unstale":"2026-02-12T08:50:34.580689+0000","last_undegraded":"2026-02-12T08:50:34.580689+0000","last_fullsized":"2026-02-12T08:50:34.580689+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:34.597215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:34.597215+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"73.0","version":"0'0","reported_seq":37,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:33.932062+0000","last_change":"2026-02-12T08:50:33.685783+0000","last_active":"2026-02-12T08:50:33.932062+0000","last_peered":"2026-02-12T08:50:33.932062+0000","last_clean":"2026-02-12T08:50:33.932062+0000","last_became_active":"2026-02-12T08:50:19.984507+0000","last_became_peered":"2026-02-12T08:50:19.984507+0000","last_unstale":"2026-02-12T08:50:33.932062+0000","last_undegraded":"2026-02-12T08:50:33.932062+0000","last_fullsized":"2026-02-12T08:50:33.932062+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":290,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:33.685733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:33.685733+0000","last_clean_scrub_stamp":"2026-02-12T08:50:18.915972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":938,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:34.576529+0000","last_change":"2026-02-12T08:50:34.610999+0000","last_active":"2026-02-12T08:50:34.576529+0000","last_peered":"2026-02-12T08:50:34.576529+0000","last_clean":"2026-02-12T08:50:34.576529+0000","last_became_active":"2026-02-12T08:45:10.349703+0000","last_became_peered":"2026-02-12T08:45:10.349703+0000","last_unstale":"2026-02-12T08:50:34.576529+0000","last_undegraded":"2026-02-12T08:50:34.576529+0000","last_fullsized":"2026-02-12T08:50:34.576529+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'52","last_scrub_stamp":"2026-02-12T08:50:34.610938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:34.610938+0000","last_clean_scrub_stamp":"2026-02-12T08:45:09.313699+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":864,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:34.578894+0000","last_change":"2026-02-12T08:50:34.603313+0000","last_active":"2026-02-12T08:50:34.578894+0000","last_peered":"2026-02-12T08:50:34.578894+0000","last_clean":"2026-02-12T08:50:34.578894+0000","last_became_active":"2026-02-12T08:45:16.965299+0000","last_became_peered":"2026-02-12T08:45:16.965299+0000","last_unstale":"2026-02-12T08:50:34.578894+0000","last_undegraded":"2026-02-12T08:50:34.578894+0000","last_fullsized":"2026-02-12T08:50:34.578894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'1","last_scrub_stamp":"2026-02-12T08:50:34.603255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:34.603255+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":863,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:34.577778+0000","last_change":"2026-02-12T08:50:34.591447+0000","last_active":"2026-02-12T08:50:34.577778+0000","last_peered":"2026-02-12T08:50:34.577778+0000","last_clean":"2026-02-12T08:50:34.577778+0000","last_became_active":"2026-02-12T08:45:16.964692+0000","last_became_peered":"2026-02-12T08:45:16.964692+0000","last_unstale":"2026-02-12T08:50:34.577778+0000","last_undegraded":"2026-02-12T08:50:34.577778+0000","last_fullsized":"2026-02-12T08:50:34.577778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:34.591387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:34.591387+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":863,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:33.975625+0000","last_change":"2026-02-12T08:50:33.984973+0000","last_active":"2026-02-12T08:50:33.975625+0000","last_peered":"2026-02-12T08:50:33.975625+0000","last_clean":"2026-02-12T08:50:33.975625+0000","last_became_active":"2026-02-12T08:45:16.971309+0000","last_became_peered":"2026-02-12T08:45:16.971309+0000","last_unstale":"2026-02-12T08:50:33.975625+0000","last_undegraded":"2026-02-12T08:50:33.975625+0000","last_fullsized":"2026-02-12T08:50:33.975625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:33.984914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:33.984914+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":865,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:34.578083+0000","last_change":"2026-02-12T08:50:34.599058+0000","last_active":"2026-02-12T08:50:34.578083+0000","last_peered":"2026-02-12T08:50:34.578083+0000","last_clean":"2026-02-12T08:50:34.578083+0000","last_became_active":"2026-02-12T08:45:16.972386+0000","last_became_peered":"2026-02-12T08:45:16.972386+0000","last_unstale":"2026-02-12T08:50:34.578083+0000","last_undegraded":"2026-02-12T08:50:34.578083+0000","last_fullsized":"2026-02-12T08:50:34.578083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'2","last_scrub_stamp":"2026-02-12T08:50:34.598984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:34.598984+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":863,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:33.976274+0000","last_change":"2026-02-12T08:50:33.986097+0000","last_active":"2026-02-12T08:50:33.976274+0000","last_peered":"2026-02-12T08:50:33.976274+0000","last_clean":"2026-02-12T08:50:33.976274+0000","last_became_active":"2026-02-12T08:45:16.968304+0000","last_became_peered":"2026-02-12T08:45:16.968304+0000","last_unstale":"2026-02-12T08:50:33.976274+0000","last_undegraded":"2026-02-12T08:50:33.976274+0000","last_fullsized":"2026-02-12T08:50:33.976274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:33.986036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:33.986036+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":863,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:34.579206+0000","last_change":"2026-02-12T08:50:34.594016+0000","last_active":"2026-02-12T08:50:34.579206+0000","last_peered":"2026-02-12T08:50:34.579206+0000","last_clean":"2026-02-12T08:50:34.579206+0000","last_became_active":"2026-02-12T08:45:16.963774+0000","last_became_peered":"2026-02-12T08:45:16.963774+0000","last_unstale":"2026-02-12T08:50:34.579206+0000","last_undegraded":"2026-02-12T08:50:34.579206+0000","last_fullsized":"2026-02-12T08:50:34.579206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:34.593939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:34.593939+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":863,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:34.277303+0000","last_change":"2026-02-12T08:50:34.293841+0000","last_active":"2026-02-12T08:50:34.277303+0000","last_peered":"2026-02-12T08:50:34.277303+0000","last_clean":"2026-02-12T08:50:34.277303+0000","last_became_active":"2026-02-12T08:45:16.961363+0000","last_became_peered":"2026-02-12T08:45:16.961363+0000","last_unstale":"2026-02-12T08:50:34.277303+0000","last_undegraded":"2026-02-12T08:50:34.277303+0000","last_fullsized":"2026-02-12T08:50:34.277303+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:34.293789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:34.293789+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":863,"reported_epoch":300,"state":"active+clean","last_fresh":"2026-02-12T08:50:34.579827+0000","last_change":"2026-02-12T08:50:34.595863+0000","last_active":"2026-02-12T08:50:34.579827+0000","last_peered":"2026-02-12T08:50:34.579827+0000","last_clean":"2026-02-12T08:50:34.579827+0000","last_became_active":"2026-02-12T08:45:16.961720+0000","last_became_peered":"2026-02-12T08:45:16.961720+0000","last_unstale":"2026-02-12T08:50:34.579827+0000","last_undegraded":"2026-02-12T08:50:34.579827+0000","last_fullsized":"2026-02-12T08:50:34.579827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:34.595780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:34.595780+0000","last_clean_scrub_stamp":"2026-02-12T08:45:15.923896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":73,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213659037696,"internally_reserved":0,"allocated":15585280,"data_stored":15585280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160244645888,"internally_reserved":0,"allocated":11321344,"data_stored":11321344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53414309888,"internally_reserved":0,"allocated":4345856,"data_stored":4345856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673304,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3332,"kb_used_data":3332,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52163324,"statfs":{"total":53418655744,"available":53415243776,"internally_reserved":0,"allocated":3411968,"data_stored":3411968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640595,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4244,"kb_used_data":4244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162412,"statfs":{"total":53418655744,"available":53414309888,"internally_reserved":0,"allocated":4345856,"data_stored":4345856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640595,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":3480,"kb_used_data":3480,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52163176,"statfs":{"total":53418655744,"available":53415092224,"internally_reserved":0,"allocated":3563520,"data_stored":3563520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640595,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":4164,"kb_used_data":4164,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52162492,"statfs":{"total":53418655744,"available":53414391808,"internally_reserved":0,"allocated":4263936,"data_stored":4263936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53418655744,"available":53414309888,"internally_reserved":0,"allocated":4345856,"data_stored":4345856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53418655744,"available":53415243776,"internally_reserved":0,"allocated":3411968,"data_stored":3411968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53418655744,"available":53415092224,"internally_reserved":0,"allocated":3563520,"data_stored":3563520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53414309888,"internally_reserved":0,"allocated":4345856,"data_stored":4345856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":0,"total":53418655744,"available":53414391808,"internally_reserved":0,"allocated":4263936,"data_stored":4263936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":1,"total":53418655744,"available":53415243776,"internally_reserved":0,"allocated":3411968,"data_stored":3411968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":2,"total":53418655744,"available":53415092224,"internally_reserved":0,"allocated":3563520,"data_stored":3563520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":73,"osd":3,"total":53418655744,"available":53414309888,"internally_reserved":0,"allocated":4345856,"data_stored":4345856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T08:50:55.008 DEBUG:teuthology.orchestra.run.trial160:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-12T08:50:55.084 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:55.078+0000 7f8c31e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:55.086 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-12T08:50:55.084+0000 7f8c31e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:55.217 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-12T08:50:55.217 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-12T08:50:55.217 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-12T08:50:55.217 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T08:50:55.281 INFO:tasks.ceph.osd.0:Stopped 2026-02-12T08:50:55.281 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-12T08:50:55.281 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T08:50:55.352 INFO:tasks.ceph.osd.1:Stopped 2026-02-12T08:50:55.352 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-12T08:50:55.352 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T08:50:55.439 INFO:tasks.ceph.osd.2:Stopped 2026-02-12T08:50:55.440 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-12T08:50:55.440 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T08:50:55.506 INFO:tasks.ceph.osd.3:Stopped 2026-02-12T08:50:55.506 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-12T08:50:55.506 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-12T08:50:55.506 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T08:50:55.539 INFO:tasks.ceph.mgr.x:Stopped 2026-02-12T08:50:55.539 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-12T08:50:55.539 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-12T08:50:55.539 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T08:50:55.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2026-02-12T08:50:55.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2026-02-12T08:50:55.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-12T08:50:55.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-12T08:50:55.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2026-02-12T08:50:55.552 INFO:tasks.ceph.mon.a:Stopped 2026-02-12T08:50:55.552 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-12T08:50:55.553 DEBUG:teuthology.orchestra.run.trial160:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v 'but it is still running' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(PG_' | grep -E -v '\(OSD_' | grep -E -v '\(OBJECT_' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | head -n 1 2026-02-12T08:50:55.618 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial160.front.sepia.ceph.com 2026-02-12T08:50:55.618 DEBUG:teuthology.orchestra.run.trial160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-12T08:50:55.691 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial160.front.sepia.ceph.com 2026-02-12T08:50:55.691 DEBUG:teuthology.orchestra.run.trial160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-12T08:50:55.757 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial181.front.sepia.ceph.com 2026-02-12T08:50:55.757 DEBUG:teuthology.orchestra.run.trial181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-12T08:50:55.842 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial181.front.sepia.ceph.com 2026-02-12T08:50:55.842 DEBUG:teuthology.orchestra.run.trial181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-12T08:50:55.869 INFO:tasks.ceph:Archiving mon data... 2026-02-12T08:50:55.871 DEBUG:teuthology.misc:Transferring archived files from trial160:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41539/data/mon.a.tgz 2026-02-12T08:50:55.871 DEBUG:teuthology.orchestra.run.trial160:> mktemp 2026-02-12T08:50:55.889 INFO:teuthology.orchestra.run.trial160.stdout:/tmp/tmp.bNvmMTmntB 2026-02-12T08:50:55.889 DEBUG:teuthology.orchestra.run.trial160:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.bNvmMTmntB 2026-02-12T08:50:56.002 DEBUG:teuthology.orchestra.run.trial160:> sudo chmod 0666 /tmp/tmp.bNvmMTmntB 2026-02-12T08:50:56.086 DEBUG:teuthology.orchestra.remote:trial160:/tmp/tmp.bNvmMTmntB is 409KB 2026-02-12T08:50:56.182 DEBUG:teuthology.orchestra.run.trial160:> rm -fr /tmp/tmp.bNvmMTmntB 2026-02-12T08:50:56.199 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-12T08:50:56.199 DEBUG:teuthology.orchestra.run.trial160:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T08:50:56.241 DEBUG:teuthology.orchestra.run.trial181:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T08:50:56.319 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T08:50:56.336 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T08:50:56.336 INFO:tasks.ceph:Archiving crash dumps... 2026-02-12T08:50:56.337 DEBUG:teuthology.misc:Transferring archived files from trial160:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41539/remote/trial160/crash 2026-02-12T08:50:56.338 DEBUG:teuthology.orchestra.run.trial160:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T08:50:56.385 DEBUG:teuthology.misc:Transferring archived files from trial181:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41539/remote/trial181/crash 2026-02-12T08:50:56.386 DEBUG:teuthology.orchestra.run.trial181:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T08:50:56.412 INFO:tasks.ceph:Compressing logs... 2026-02-12T08:50:56.412 DEBUG:teuthology.orchestra.run.trial160:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T08:50:56.430 DEBUG:teuthology.orchestra.run.trial181:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T08:50:56.452 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20196.log 2026-02-12T08:50:56.470 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20733.log 2026-02-12T08:50:56.470 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.20196.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-12T08:50:56.470 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.20196.log.gz 2026-02-12T08:50:56.470 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.20733.log: gzip 50.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.20733.log.gz --verbose 2026-02-12T08:50:56.470 INFO:teuthology.orchestra.run.trial160.stderr: -- /var/log/ceph/ceph-client.admin.20226.log 2026-02-12T08:50:56.470 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-12T08:50:56.470 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.20226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19753.log 2026-02-12T08:50:56.471 INFO:teuthology.orchestra.run.trial160.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.20226.log.gz 2026-02-12T08:50:56.471 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19593.log 2026-02-12T08:50:56.471 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.19753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22883.log 2026-02-12T08:50:56.471 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.19753.log.gz 2026-02-12T08:50:56.471 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.19593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22981.log 2026-02-12T08:50:56.471 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.19593.log.gz 2026-02-12T08:50:56.471 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.22883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20028.log 2026-02-12T08:50:56.471 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22883.log.gz 2026-02-12T08:50:56.471 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.22981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23324.log 2026-02-12T08:50:56.471 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22981.log.gz 2026-02-12T08:50:56.471 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.20028.log: gzip -5 --verbose -- 49.6% /var/log/ceph/ceph-client.admin.20393.log 2026-02-12T08:50:56.471 INFO:teuthology.orchestra.run.trial160.stderr: -- replaced with /var/log/ceph/ceph-client.admin.20028.log.gz 2026-02-12T08:50:56.472 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.23324.log: gzip 49.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.23324.log.gz --verbose 2026-02-12T08:50:56.472 INFO:teuthology.orchestra.run.trial160.stderr: -- /var/log/ceph/ceph-client.admin.20422.log 2026-02-12T08:50:56.472 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19688.log 2026-02-12T08:50:56.472 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.20393.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.20393.log.gz 2026-02-12T08:50:56.472 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.20422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20537.log 2026-02-12T08:50:56.472 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.20422.log.gz 2026-02-12T08:50:56.472 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.19688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23177.log 2026-02-12T08:50:56.472 INFO:teuthology.orchestra.run.trial160.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.19688.log.gz 2026-02-12T08:50:56.472 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.20537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19463.log 2026-02-12T08:50:56.472 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.20537.log.gz 2026-02-12T08:50:56.472 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.23177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21130.log 2026-02-12T08:50:56.472 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23177.log.gz 2026-02-12T08:50:56.473 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.19463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20027.log 2026-02-12T08:50:56.473 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.19463.log.gz 2026-02-12T08:50:56.473 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23469.log 2026-02-12T08:50:56.473 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.21130.log: /var/log/ceph/ceph-client.admin.20027.log: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.21130.log.gz 2026-02-12T08:50:56.473 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19229.log 2026-02-12T08:50:56.473 INFO:teuthology.orchestra.run.trial160.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.20027.log.gz 2026-02-12T08:50:56.473 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.23469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19182.log 2026-02-12T08:50:56.473 INFO:teuthology.orchestra.run.trial160.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23469.log.gz 2026-02-12T08:50:56.473 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.19229.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.19229.log.gz 2026-02-12T08:50:56.473 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23030.log 2026-02-12T08:50:56.473 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23275.log 2026-02-12T08:50:56.473 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.19182.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.19182.log.gz 2026-02-12T08:50:56.474 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.23030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19437.log 2026-02-12T08:50:56.474 INFO:teuthology.orchestra.run.trial160.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23030.log.gz 2026-02-12T08:50:56.474 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.23275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23226.log 2026-02-12T08:50:56.474 INFO:teuthology.orchestra.run.trial160.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23275.log.gz 2026-02-12T08:50:56.474 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20782.log 2026-02-12T08:50:56.474 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.19437.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.19437.log.gz 2026-02-12T08:50:56.474 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.23226.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23226.log.gz 2026-02-12T08:50:56.474 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23079.log 2026-02-12T08:50:56.474 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.20782.log: /var/log/ceph/ceph-client.admin.20618.log 2026-02-12T08:50:56.474 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.20782.log.gz 2026-02-12T08:50:56.474 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.23079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20394.log 2026-02-12T08:50:56.474 INFO:teuthology.orchestra.run.trial160.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23079.log.gz 2026-02-12T08:50:56.474 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.20618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23128.log 2026-02-12T08:50:56.475 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.20618.log.gz 2026-02-12T08:50:56.475 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.20394.log: /var/log/ceph/ceph-client.admin.22834.log 2026-02-12T08:50:56.475 INFO:teuthology.orchestra.run.trial160.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.20394.log.gz 2026-02-12T08:50:56.475 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.23128.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-12T08:50:56.475 INFO:teuthology.orchestra.run.trial160.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23128.log.gz 2026-02-12T08:50:56.475 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.22834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19900.log 2026-02-12T08:50:56.475 INFO:teuthology.orchestra.run.trial160.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22834.log.gz 2026-02-12T08:50:56.475 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19663.log 2026-02-12T08:50:56.475 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.19900.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.19900.log.gz 2026-02-12T08:50:56.475 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-12T08:50:56.475 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.19663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19096.log 2026-02-12T08:50:56.475 INFO:teuthology.orchestra.run.trial160.stderr: 88.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-12T08:50:56.475 INFO:teuthology.orchestra.run.trial160.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.19663.log.gz 2026-02-12T08:50:56.476 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20030.log 2026-02-12T08:50:56.476 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.19096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19802.log 2026-02-12T08:50:56.476 INFO:teuthology.orchestra.run.trial160.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.19096.log.gz 2026-02-12T08:50:56.476 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.20030.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.18038.log 2026-02-12T08:50:56.476 INFO:teuthology.orchestra.run.trial160.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.20030.log.gz 2026-02-12T08:50:56.476 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.19802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19537.log 2026-02-12T08:50:56.476 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.19802.log.gz 2026-02-12T08:50:56.476 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph.tmp-client.admin.18038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22932.log 2026-02-12T08:50:56.476 INFO:teuthology.orchestra.run.trial160.stderr: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.18038.log.gz 2026-02-12T08:50:56.476 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.19537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22785.log 2026-02-12T08:50:56.476 INFO:teuthology.orchestra.run.trial160.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.19537.log.gz 2026-02-12T08:50:56.476 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.22932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20619.log 2026-02-12T08:50:56.477 INFO:teuthology.orchestra.run.trial160.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22932.log.gz 2026-02-12T08:50:56.477 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.22785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19851.log 2026-02-12T08:50:56.477 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22785.log.gz 2026-02-12T08:50:56.477 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.20619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20831.log 2026-02-12T08:50:56.477 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.20619.log.gz 2026-02-12T08:50:56.477 INFO:teuthology.orchestra.run.trial160.stderr:gzip/var/log/ceph/ceph-client.admin.19851.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23422.log 2026-02-12T08:50:56.477 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.19851.log.gz 2026-02-12T08:50:56.477 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.20831.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.20831.log.gz 2026-02-12T08:50:56.477 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20199.log 2026-02-12T08:50:56.477 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.23422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21105.log 2026-02-12T08:50:56.477 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23422.log.gz 2026-02-12T08:50:56.477 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-12T08:50:56.478 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.20199.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.20199.log.gz 2026-02-12T08:50:56.478 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.21105.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.21105.log.gz 2026-02-12T08:50:56.478 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20615.log 2026-02-12T08:50:56.478 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20197.log 2026-02-12T08:50:56.478 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.20615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20029.log 2026-02-12T08:50:56.478 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.20615.log.gz 2026-02-12T08:50:56.478 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.20197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20395.log 2026-02-12T08:50:56.478 INFO:teuthology.orchestra.run.trial160.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.20197.log.gz 2026-02-12T08:50:56.478 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.20029.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.20029.log.gz 86.6% 2026-02-12T08:50:56.478 INFO:teuthology.orchestra.run.trial160.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2026-02-12T08:50:56.478 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23373.log 2026-02-12T08:50:56.478 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.20395.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.20395.log.gz 2026-02-12T08:50:56.479 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.23373.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23373.log.gz 2026-02-12T08:50:56.482 INFO:teuthology.orchestra.run.trial181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-12T08:50:56.485 INFO:teuthology.orchestra.run.trial181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-12T08:50:56.485 INFO:teuthology.orchestra.run.trial181.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18529.log 2026-02-12T08:50:56.485 INFO:teuthology.orchestra.run.trial181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18478.log 2026-02-12T08:50:56.485 INFO:teuthology.orchestra.run.trial181.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.18529.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-12T08:50:56.485 INFO:teuthology.orchestra.run.trial181.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.18529.log.gz 2026-02-12T08:50:56.485 INFO:teuthology.orchestra.run.trial181.stderr:/var/log/ceph/ceph-client.admin.18478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18431.log 2026-02-12T08:50:56.486 INFO:teuthology.orchestra.run.trial181.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.18478.log.gz 2026-02-12T08:50:56.486 INFO:teuthology.orchestra.run.trial181.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18583.log 2026-02-12T08:50:56.486 INFO:teuthology.orchestra.run.trial181.stderr:/var/log/ceph/ceph-client.admin.18431.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.18431.log.gz 2026-02-12T08:50:56.486 INFO:teuthology.orchestra.run.trial181.stderr:/var/log/ceph/ceph-client.admin.18583.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.18583.log.gz 2026-02-12T08:50:56.509 INFO:teuthology.orchestra.run.trial181.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-12T08:50:56.634 INFO:teuthology.orchestra.run.trial160.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-12T08:50:59.097 INFO:teuthology.orchestra.run.trial160.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-12T08:50:59.204 INFO:teuthology.orchestra.run.trial181.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-12T08:50:59.242 INFO:teuthology.orchestra.run.trial181.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-12T08:50:59.244 INFO:teuthology.orchestra.run.trial181.stderr: 2026-02-12T08:50:59.244 INFO:teuthology.orchestra.run.trial181.stderr:real 0m2.769s 2026-02-12T08:50:59.244 INFO:teuthology.orchestra.run.trial181.stderr:user 0m5.214s 2026-02-12T08:50:59.244 INFO:teuthology.orchestra.run.trial181.stderr:sys 0m0.302s 2026-02-12T08:50:59.272 INFO:teuthology.orchestra.run.trial160.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-12T08:50:59.274 INFO:teuthology.orchestra.run.trial160.stderr: 2026-02-12T08:50:59.274 INFO:teuthology.orchestra.run.trial160.stderr:real 0m2.829s 2026-02-12T08:50:59.274 INFO:teuthology.orchestra.run.trial160.stderr:user 0m5.365s 2026-02-12T08:50:59.274 INFO:teuthology.orchestra.run.trial160.stderr:sys 0m0.310s 2026-02-12T08:50:59.275 INFO:tasks.ceph:Archiving logs... 2026-02-12T08:50:59.275 DEBUG:teuthology.misc:Transferring archived files from trial160:/var/log/ceph to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41539/remote/trial160/log 2026-02-12T08:50:59.277 DEBUG:teuthology.orchestra.run.trial160:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T08:50:59.916 DEBUG:teuthology.misc:Transferring archived files from trial181:/var/log/ceph to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41539/remote/trial181/log 2026-02-12T08:50:59.916 DEBUG:teuthology.orchestra.run.trial181:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T08:51:00.428 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T08:51:00.552 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T08:51:00.564 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-12T08:51:00.564 DEBUG:teuthology.orchestra.run.trial160:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T08:51:00.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2026-02-12T08:51:00.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2026-02-12T08:51:00.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2026-02-12T08:51:00.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2026-02-12T08:51:00.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2026-02-12T08:51:00.566 DEBUG:teuthology.orchestra.run.trial181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T08:51:00.591 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-12T08:51:00.602 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-12T08:51:00.602 DEBUG:teuthology.orchestra.run.trial160:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T08:51:00.630 DEBUG:teuthology.orchestra.run.trial181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T08:51:00.644 INFO:teuthology.orchestra.run.trial160.stderr:bash: line 1: ntpq: command not found 2026-02-12T08:51:00.646 INFO:teuthology.orchestra.run.trial181.stderr:bash: line 1: ntpq: command not found 2026-02-12T08:51:00.681 INFO:teuthology.orchestra.run.trial181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T08:51:00.681 INFO:teuthology.orchestra.run.trial181.stdout:=============================================================================== 2026-02-12T08:51:00.681 INFO:teuthology.orchestra.run.trial181.stdout:^+ 144.202.41.38.vultruserc> 2 6 377 6 +916us[ +916us] +/- 31ms 2026-02-12T08:51:00.681 INFO:teuthology.orchestra.run.trial181.stdout:^* 96-19-94-82.cpe.sparklig> 1 6 377 7 -122us[ -114us] +/- 33ms 2026-02-12T08:51:00.681 INFO:teuthology.orchestra.run.trial181.stdout:^+ hou1.us.ntp.li 2 6 377 8 -335us[ -326us] +/- 75ms 2026-02-12T08:51:00.681 INFO:teuthology.orchestra.run.trial181.stdout:^+ 73.185.182.209 2 6 377 4 +2449us[+2449us] +/- 59ms 2026-02-12T08:51:00.681 INFO:teuthology.orchestra.run.trial160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T08:51:00.681 INFO:teuthology.orchestra.run.trial160.stdout:=============================================================================== 2026-02-12T08:51:00.681 INFO:teuthology.orchestra.run.trial160.stdout:^+ 144.202.41.38.vultruserc> 2 6 377 8 +1354us[+1252us] +/- 32ms 2026-02-12T08:51:00.682 INFO:teuthology.orchestra.run.trial160.stdout:^* 96-19-94-82.cpe.sparklig> 1 6 377 4 -437us[ -540us] +/- 32ms 2026-02-12T08:51:00.682 INFO:teuthology.orchestra.run.trial160.stdout:^+ hou1.us.ntp.li 2 6 377 8 -77us[ -180us] +/- 75ms 2026-02-12T08:51:00.682 INFO:teuthology.orchestra.run.trial160.stdout:^+ 73.185.182.209 2 6 377 6 -112us[ -215us] +/- 55ms 2026-02-12T08:51:00.683 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-12T08:51:00.695 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-12T08:51:00.695 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-12T08:51:00.711 DEBUG:teuthology.orchestra.run.trial160:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T08:51:00.765 DEBUG:teuthology.orchestra.run.trial181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T08:51:00.807 DEBUG:teuthology.orchestra.run.trial160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T08:51:00.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:51:00.832 DEBUG:teuthology.orchestra.run.trial181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T08:51:00.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:51:00.874 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-12T08:51:00.889 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-12T08:51:00.904 INFO:teuthology.task.internal:Duration was 989.449134 seconds 2026-02-12T08:51:00.905 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-12T08:51:00.920 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-12T08:51:00.920 DEBUG:teuthology.orchestra.run.trial160:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T08:51:00.923 DEBUG:teuthology.orchestra.run.trial181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T08:51:00.958 INFO:teuthology.orchestra.run.trial160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T08:51:00.960 INFO:teuthology.orchestra.run.trial181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T08:51:01.440 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-12T08:51:01.440 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial160.front.sepia.ceph.com 2026-02-12T08:51:01.441 DEBUG:teuthology.orchestra.run.trial160:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T08:51:01.500 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial181.front.sepia.ceph.com 2026-02-12T08:51:01.501 DEBUG:teuthology.orchestra.run.trial181:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T08:51:01.521 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-12T08:51:01.521 DEBUG:teuthology.orchestra.run.trial160:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T08:51:01.543 DEBUG:teuthology.orchestra.run.trial181:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T08:51:01.601 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-12T08:51:01.601 DEBUG:teuthology.orchestra.run.trial160:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T08:51:01.624 DEBUG:teuthology.orchestra.run.trial181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T08:51:01.646 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T08:51:01.648 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T08:51:01.648 INFO:teuthology.orchestra.run.trial160.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T08:51:01.648 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T08:51:01.648 INFO:teuthology.orchestra.run.trial160.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T08:51:01.651 INFO:teuthology.orchestra.run.trial160.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T08:51:01.663 INFO:teuthology.orchestra.run.trial181.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T08:51:01.665 INFO:teuthology.orchestra.run.trial181.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T08:51:01.665 INFO:teuthology.orchestra.run.trial181.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T08:51:01.665 INFO:teuthology.orchestra.run.trial181.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T08:51:01.665 INFO:teuthology.orchestra.run.trial181.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T08:51:01.668 INFO:teuthology.orchestra.run.trial181.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T08:51:01.670 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-12T08:51:01.687 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-12T08:51:01.687 DEBUG:teuthology.orchestra.run.trial160:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T08:51:01.717 DEBUG:teuthology.orchestra.run.trial181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T08:51:01.743 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-12T08:51:01.759 DEBUG:teuthology.orchestra.run.trial160:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T08:51:01.762 DEBUG:teuthology.orchestra.run.trial181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T08:51:01.783 INFO:teuthology.orchestra.run.trial160.stdout:kernel.core_pattern = core 2026-02-12T08:51:01.807 INFO:teuthology.orchestra.run.trial181.stdout:kernel.core_pattern = core 2026-02-12T08:51:01.818 DEBUG:teuthology.orchestra.run.trial160:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T08:51:01.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:51:01.851 DEBUG:teuthology.orchestra.run.trial181:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T08:51:01.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:51:01.874 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-12T08:51:01.891 INFO:teuthology.task.internal:Transferring archived files... 2026-02-12T08:51:01.893 DEBUG:teuthology.misc:Transferring archived files from trial160:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41539/remote/trial160 2026-02-12T08:51:01.893 DEBUG:teuthology.orchestra.run.trial160:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T08:51:01.924 DEBUG:teuthology.misc:Transferring archived files from trial181:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41539/remote/trial181 2026-02-12T08:51:01.924 DEBUG:teuthology.orchestra.run.trial181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T08:51:01.957 INFO:teuthology.task.internal:Removing archive directory... 2026-02-12T08:51:01.957 DEBUG:teuthology.orchestra.run.trial160:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T08:51:01.960 DEBUG:teuthology.orchestra.run.trial181:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T08:51:02.006 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-12T08:51:02.025 INFO:teuthology.task.internal:Not uploading archives. 2026-02-12T08:51:02.025 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-12T08:51:02.041 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-12T08:51:02.042 DEBUG:teuthology.orchestra.run.trial160:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T08:51:02.044 DEBUG:teuthology.orchestra.run.trial181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T08:51:02.059 INFO:teuthology.orchestra.run.trial160.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 08:51 /home/ubuntu/cephtest 2026-02-12T08:51:02.062 INFO:teuthology.orchestra.run.trial181.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 08:51 /home/ubuntu/cephtest 2026-02-12T08:51:02.063 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T08:51:02.081 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T08:51:02.120 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} tasks/rados_python} duration: 989.4491341114044 flavor: debug owner: scheduled_matan@soko04.front.sepia.ceph.com success: true 2026-02-12T08:51:02.120 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T08:51:02.250 INFO:teuthology.run:pass