2026-02-12T08:38:05.393 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062 2026-02-12T08:38:05.407 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T08:38:05.483 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41562 branch: main description: crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/cls} email: null first_in_suite: false flavor: debug job_id: '41562' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd pool default crimson: true osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug ms: 20 debug objclass: 20 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd objectstore: seastore osd shutdown pgref assert: true seastore cachepin size pershard: 64M seastore main device type: RANDOM_BLOCK_SSD seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) sha1: 2401a109e2ac85dfa20fc57328da663aa754c875 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: debug sha1: 2401a109e2ac85dfa20fc57328da663aa754c875 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c owner: scheduled_matan@soko04.front.sepia.ceph.com priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 9353 sha1: 2401a109e2ac85dfa20fc57328da663aa754c875 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c targets: trial042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIo/IyV2LdwkldGF5vlEBcXDFWUR2q1vmfG9YT77OGpgkjSOZ9L9WKsMP/yp/0JghdzLO9qJVJtbHRg5RT3tqRc= trial131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGEHtnyXlv3hRAOWiA7Vtk6wI1nZYHXOfHFdajLZRcWCQeDgMtXNHLop1UsdBGGYPTZexUryHAYakXmVHXmLGlg= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 - workunit: clients: client.0: - cls/test_cls_cmpomap.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: c433f1062990a0488dc29a553589bc609a460691 timestamp: 2026-02-09_15:50:17 tube: trial user: matan verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.2161924 2026-02-12T08:38:05.483 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c/qa; will attempt to use it 2026-02-12T08:38:05.483 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c/qa/tasks 2026-02-12T08:38:05.484 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T08:38:05.485 INFO:teuthology.task.internal:Checking packages... 2026-02-12T08:38:05.485 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash '2401a109e2ac85dfa20fc57328da663aa754c875' 2026-02-12T08:38:05.485 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T08:38:05.485 INFO:teuthology.packaging:ref: None 2026-02-12T08:38:05.485 INFO:teuthology.packaging:tag: None 2026-02-12T08:38:05.485 INFO:teuthology.packaging:branch: main 2026-02-12T08:38:05.485 INFO:teuthology.packaging:sha1: 2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:38:05.485 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=main 2026-02-12T08:38:05.638 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5271.gdbd7cb72 2026-02-12T08:38:05.639 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T08:38:05.651 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T08:38:05.651 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T08:38:05.665 INFO:teuthology.task.internal:Saving configuration 2026-02-12T08:38:05.681 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T08:38:05.694 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T08:38:05.783 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial042.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41562', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 08:34:46.744478', 'locked_by': 'scheduled_matan@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIo/IyV2LdwkldGF5vlEBcXDFWUR2q1vmfG9YT77OGpgkjSOZ9L9WKsMP/yp/0JghdzLO9qJVJtbHRg5RT3tqRc='} 2026-02-12T08:38:05.840 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial131.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41562', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 08:34:46.745087', 'locked_by': 'scheduled_matan@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGEHtnyXlv3hRAOWiA7Vtk6wI1nZYHXOfHFdajLZRcWCQeDgMtXNHLop1UsdBGGYPTZexUryHAYakXmVHXmLGlg='} 2026-02-12T08:38:05.840 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T08:38:05.851 INFO:teuthology.task.internal:roles: ubuntu@trial042.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2026-02-12T08:38:05.851 INFO:teuthology.task.internal:roles: ubuntu@trial131.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2026-02-12T08:38:05.851 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T08:38:05.984 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x76c33c208b80>, signals=[15]) 2026-02-12T08:38:05.984 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T08:38:05.995 INFO:teuthology.task.internal:Opening connections... 2026-02-12T08:38:05.995 DEBUG:teuthology.task.internal:connecting to ubuntu@trial042.front.sepia.ceph.com 2026-02-12T08:38:05.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:38:06.059 DEBUG:teuthology.task.internal:connecting to ubuntu@trial131.front.sepia.ceph.com 2026-02-12T08:38:06.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:38:06.122 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T08:38:06.135 DEBUG:teuthology.orchestra.run.trial042:> uname -m 2026-02-12T08:38:06.150 INFO:teuthology.orchestra.run.trial042.stdout:x86_64 2026-02-12T08:38:06.150 DEBUG:teuthology.orchestra.run.trial042:> cat /etc/os-release 2026-02-12T08:38:06.205 INFO:teuthology.orchestra.run.trial042.stdout:NAME="CentOS Stream" 2026-02-12T08:38:06.205 INFO:teuthology.orchestra.run.trial042.stdout:VERSION="9" 2026-02-12T08:38:06.205 INFO:teuthology.orchestra.run.trial042.stdout:ID="centos" 2026-02-12T08:38:06.205 INFO:teuthology.orchestra.run.trial042.stdout:ID_LIKE="rhel fedora" 2026-02-12T08:38:06.205 INFO:teuthology.orchestra.run.trial042.stdout:VERSION_ID="9" 2026-02-12T08:38:06.206 INFO:teuthology.orchestra.run.trial042.stdout:PLATFORM_ID="platform:el9" 2026-02-12T08:38:06.206 INFO:teuthology.orchestra.run.trial042.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T08:38:06.206 INFO:teuthology.orchestra.run.trial042.stdout:ANSI_COLOR="0;31" 2026-02-12T08:38:06.206 INFO:teuthology.orchestra.run.trial042.stdout:LOGO="fedora-logo-icon" 2026-02-12T08:38:06.206 INFO:teuthology.orchestra.run.trial042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T08:38:06.206 INFO:teuthology.orchestra.run.trial042.stdout:HOME_URL="https://centos.org/" 2026-02-12T08:38:06.206 INFO:teuthology.orchestra.run.trial042.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T08:38:06.206 INFO:teuthology.orchestra.run.trial042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T08:38:06.206 INFO:teuthology.orchestra.run.trial042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T08:38:06.206 INFO:teuthology.lock.ops:Updating trial042.front.sepia.ceph.com on lock server 2026-02-12T08:38:06.276 DEBUG:teuthology.orchestra.run.trial131:> uname -m 2026-02-12T08:38:06.291 INFO:teuthology.orchestra.run.trial131.stdout:x86_64 2026-02-12T08:38:06.292 DEBUG:teuthology.orchestra.run.trial131:> cat /etc/os-release 2026-02-12T08:38:06.347 INFO:teuthology.orchestra.run.trial131.stdout:NAME="CentOS Stream" 2026-02-12T08:38:06.347 INFO:teuthology.orchestra.run.trial131.stdout:VERSION="9" 2026-02-12T08:38:06.347 INFO:teuthology.orchestra.run.trial131.stdout:ID="centos" 2026-02-12T08:38:06.347 INFO:teuthology.orchestra.run.trial131.stdout:ID_LIKE="rhel fedora" 2026-02-12T08:38:06.347 INFO:teuthology.orchestra.run.trial131.stdout:VERSION_ID="9" 2026-02-12T08:38:06.347 INFO:teuthology.orchestra.run.trial131.stdout:PLATFORM_ID="platform:el9" 2026-02-12T08:38:06.347 INFO:teuthology.orchestra.run.trial131.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T08:38:06.347 INFO:teuthology.orchestra.run.trial131.stdout:ANSI_COLOR="0;31" 2026-02-12T08:38:06.347 INFO:teuthology.orchestra.run.trial131.stdout:LOGO="fedora-logo-icon" 2026-02-12T08:38:06.347 INFO:teuthology.orchestra.run.trial131.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T08:38:06.347 INFO:teuthology.orchestra.run.trial131.stdout:HOME_URL="https://centos.org/" 2026-02-12T08:38:06.347 INFO:teuthology.orchestra.run.trial131.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T08:38:06.347 INFO:teuthology.orchestra.run.trial131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T08:38:06.347 INFO:teuthology.orchestra.run.trial131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T08:38:06.347 INFO:teuthology.lock.ops:Updating trial131.front.sepia.ceph.com on lock server 2026-02-12T08:38:06.422 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T08:38:06.434 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T08:38:06.449 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T08:38:06.449 DEBUG:teuthology.orchestra.run.trial042:> test '!' -e /home/ubuntu/cephtest 2026-02-12T08:38:06.450 DEBUG:teuthology.orchestra.run.trial131:> test '!' -e /home/ubuntu/cephtest 2026-02-12T08:38:06.465 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T08:38:06.476 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T08:38:06.476 DEBUG:teuthology.orchestra.run.trial042:> test -z $(ls -A /var/lib/ceph) 2026-02-12T08:38:06.506 DEBUG:teuthology.orchestra.run.trial131:> test -z $(ls -A /var/lib/ceph) 2026-02-12T08:38:06.522 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T08:38:06.678 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T08:38:06.697 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-12T08:38:06.697 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-12T08:38:06.697 DEBUG:teuthology.orchestra.run.trial042:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T08:38:06.697 DEBUG:teuthology.orchestra.run.trial131:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T08:38:06.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:38:06.712 DEBUG:teuthology.orchestra.run.trial042:> uname -r 2026-02-12T08:38:06.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:38:06.712 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T08:38:06.768 INFO:teuthology.orchestra.run.trial042.stdout:5.14.0-645.el9.x86_64 2026-02-12T08:38:06.768 INFO:teuthology.task.kernel:Running kernel on trial042: 5.14.0-645.el9.x86_64 2026-02-12T08:38:06.768 DEBUG:teuthology.orchestra.run.trial042:> sudo yum install -y kernel 2026-02-12T08:38:06.768 INFO:teuthology.orchestra.run.trial131.stdout:5.14.0-645.el9.x86_64 2026-02-12T08:38:06.768 INFO:teuthology.task.kernel:Running kernel on trial131: 5.14.0-645.el9.x86_64 2026-02-12T08:38:06.768 DEBUG:teuthology.orchestra.run.trial131:> sudo yum install -y kernel 2026-02-12T08:38:07.989 INFO:teuthology.orchestra.run.trial042.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-12T08:38:08.003 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-12T08:38:11.642 INFO:teuthology.orchestra.run.trial042.stdout:CentOS Stream 9 - AppStream 8.6 MB/s | 27 MB 00:03 2026-02-12T08:38:15.294 INFO:teuthology.orchestra.run.trial042.stdout:CentOS Stream 9 - CRB 6.1 MB/s | 7.8 MB 00:01 2026-02-12T08:38:16.143 INFO:teuthology.orchestra.run.trial042.stdout:CentOS Stream 9 - Extras packages 150 kB/s | 20 kB 00:00 2026-02-12T08:38:16.559 INFO:teuthology.orchestra.run.trial042.stdout:Extra Packages for Enterprise Linux 59 MB/s | 20 MB 00:00 2026-02-12T08:38:19.796 INFO:teuthology.orchestra.run.trial042.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-12T08:38:20.858 INFO:teuthology.orchestra.run.trial042.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T08:38:20.878 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:38:20.879 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:38:20.879 INFO:teuthology.orchestra.run.trial042.stdout: Package Architecture Version Repository Size 2026-02-12T08:38:20.879 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:38:20.879 INFO:teuthology.orchestra.run.trial042.stdout:Installing: 2026-02-12T08:38:20.879 INFO:teuthology.orchestra.run.trial042.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T08:38:20.879 INFO:teuthology.orchestra.run.trial042.stdout:Installing dependencies: 2026-02-12T08:38:20.879 INFO:teuthology.orchestra.run.trial042.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T08:38:20.879 INFO:teuthology.orchestra.run.trial042.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T08:38:20.879 INFO:teuthology.orchestra.run.trial042.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T08:38:20.879 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:38:20.879 INFO:teuthology.orchestra.run.trial042.stdout:Transaction Summary 2026-02-12T08:38:20.879 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:38:20.879 INFO:teuthology.orchestra.run.trial042.stdout:Install 4 Packages 2026-02-12T08:38:20.879 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:38:20.879 INFO:teuthology.orchestra.run.trial042.stdout:Total download size: 88 M 2026-02-12T08:38:20.879 INFO:teuthology.orchestra.run.trial042.stdout:Installed size: 135 M 2026-02-12T08:38:20.879 INFO:teuthology.orchestra.run.trial042.stdout:Downloading Packages: 2026-02-12T08:38:21.475 INFO:teuthology.orchestra.run.trial042.stdout:[MIRROR] kernel-modules-5.14.0-677.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-677.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T08:38:21.477 INFO:teuthology.orchestra.run.trial042.stdout:[MIRROR] kernel-core-5.14.0-677.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-677.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T08:38:21.478 INFO:teuthology.orchestra.run.trial042.stdout:[MIRROR] kernel-5.14.0-677.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-677.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T08:38:21.864 INFO:teuthology.orchestra.run.trial042.stdout:[MIRROR] kernel-modules-5.14.0-677.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-677.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T08:38:21.870 INFO:teuthology.orchestra.run.trial042.stdout:[MIRROR] kernel-5.14.0-677.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-677.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T08:38:21.877 INFO:teuthology.orchestra.run.trial042.stdout:[MIRROR] kernel-core-5.14.0-677.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-677.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T08:38:21.997 INFO:teuthology.orchestra.run.trial042.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 877 kB/s | 768 kB 00:00 2026-02-12T08:38:22.148 INFO:teuthology.orchestra.run.trial042.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 17 MB/s | 17 MB 00:01 2026-02-12T08:38:22.324 INFO:teuthology.orchestra.run.trial042.stdout:(3/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 33 MB/s | 40 MB 00:01 2026-02-12T08:38:27.764 INFO:teuthology.orchestra.run.trial042.stdout:(4/4): kernel-modules-core-5.14.0-677.el9.x86_6 5.3 MB/s | 31 MB 00:05 2026-02-12T08:38:27.767 INFO:teuthology.orchestra.run.trial042.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:38:27.767 INFO:teuthology.orchestra.run.trial042.stdout:Total 13 MB/s | 88 MB 00:06 2026-02-12T08:38:27.958 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction check 2026-02-12T08:38:28.166 INFO:teuthology.orchestra.run.trial042.stdout:Transaction check succeeded. 2026-02-12T08:38:28.167 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction test 2026-02-12T08:38:28.513 INFO:teuthology.orchestra.run.trial042.stdout:Transaction test succeeded. 2026-02-12T08:38:28.513 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction 2026-02-12T08:38:29.606 INFO:teuthology.orchestra.run.trial042.stdout: Preparing : 1/1 2026-02-12T08:38:29.874 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 27 MB 00:21 2026-02-12T08:38:29.892 INFO:teuthology.orchestra.run.trial042.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T08:38:29.911 INFO:teuthology.orchestra.run.trial042.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T08:38:31.675 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T08:38:31.704 INFO:teuthology.orchestra.run.trial042.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T08:38:33.796 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 7.8 MB 00:01 2026-02-12T08:38:34.685 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - Extras packages 116 kB/s | 20 kB 00:00 2026-02-12T08:38:34.729 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T08:38:34.735 INFO:teuthology.orchestra.run.trial042.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:38:35.158 INFO:teuthology.orchestra.run.trial131.stdout:Extra Packages for Enterprise Linux 51 MB/s | 20 MB 00:00 2026-02-12T08:38:37.835 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:38:38.411 INFO:teuthology.orchestra.run.trial131.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-12T08:38:39.484 INFO:teuthology.orchestra.run.trial131.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T08:38:39.504 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:38:39.505 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:38:39.505 INFO:teuthology.orchestra.run.trial131.stdout: Package Architecture Version Repository Size 2026-02-12T08:38:39.505 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:38:39.506 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-12T08:38:39.506 INFO:teuthology.orchestra.run.trial131.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T08:38:39.506 INFO:teuthology.orchestra.run.trial131.stdout:Installing dependencies: 2026-02-12T08:38:39.506 INFO:teuthology.orchestra.run.trial131.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T08:38:39.506 INFO:teuthology.orchestra.run.trial131.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T08:38:39.506 INFO:teuthology.orchestra.run.trial131.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T08:38:39.506 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:38:39.506 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-12T08:38:39.506 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:38:39.507 INFO:teuthology.orchestra.run.trial131.stdout:Install 4 Packages 2026-02-12T08:38:39.507 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:38:39.507 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 88 M 2026-02-12T08:38:39.507 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 135 M 2026-02-12T08:38:39.507 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-12T08:38:39.617 INFO:teuthology.orchestra.run.trial131.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 29 MB/s | 768 kB 00:00 2026-02-12T08:38:39.691 INFO:teuthology.orchestra.run.trial131.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 171 MB/s | 17 MB 00:00 2026-02-12T08:38:39.762 INFO:teuthology.orchestra.run.trial131.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 213 MB/s | 31 MB 00:00 2026-02-12T08:38:39.822 INFO:teuthology.orchestra.run.trial131.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 171 MB/s | 40 MB 00:00 2026-02-12T08:38:39.823 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:38:39.823 INFO:teuthology.orchestra.run.trial131.stdout:Total 278 MB/s | 88 MB 00:00 2026-02-12T08:38:40.010 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-12T08:38:40.213 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-12T08:38:40.213 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-12T08:38:40.559 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-12T08:38:40.559 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-12T08:38:41.649 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-12T08:38:41.931 INFO:teuthology.orchestra.run.trial131.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T08:38:41.950 INFO:teuthology.orchestra.run.trial131.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T08:38:43.714 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T08:38:43.742 INFO:teuthology.orchestra.run.trial131.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T08:38:46.761 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T08:38:46.768 INFO:teuthology.orchestra.run.trial131.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:38:49.803 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:39:08.387 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:39:08.410 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:39:08.474 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:39:08.474 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T08:39:08.474 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T08:39:08.474 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T08:39:08.526 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:39:08.526 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:39:08.526 INFO:teuthology.orchestra.run.trial042.stdout:Installed: 2026-02-12T08:39:08.527 INFO:teuthology.orchestra.run.trial042.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T08:39:08.527 INFO:teuthology.orchestra.run.trial042.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T08:39:08.527 INFO:teuthology.orchestra.run.trial042.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T08:39:08.527 INFO:teuthology.orchestra.run.trial042.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T08:39:08.527 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:39:08.527 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:39:08.584 DEBUG:teuthology.orchestra.run.trial042:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T08:39:08.610 INFO:teuthology.orchestra.run.trial042.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T08:39:08.611 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T08:39:08.611 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T08:39:08.611 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T08:39:08.611 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T08:39:08.611 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T08:39:08.612 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial042.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T08:39:08.612 DEBUG:teuthology.orchestra.run.trial042:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T08:39:08.674 INFO:teuthology.orchestra.run.trial042.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T08:39:08.675 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T08:39:08.675 DEBUG:teuthology.orchestra.run.trial042:> sudo rpm -qi grub2-tools 2026-02-12T08:39:08.744 INFO:teuthology.orchestra.run.trial042.stdout:Name : grub2-tools 2026-02-12T08:39:08.744 INFO:teuthology.orchestra.run.trial042.stdout:Epoch : 1 2026-02-12T08:39:08.744 INFO:teuthology.orchestra.run.trial042.stdout:Version : 2.06 2026-02-12T08:39:08.744 INFO:teuthology.orchestra.run.trial042.stdout:Release : 118.el9 2026-02-12T08:39:08.744 INFO:teuthology.orchestra.run.trial042.stdout:Architecture: x86_64 2026-02-12T08:39:08.744 INFO:teuthology.orchestra.run.trial042.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T08:39:08.744 INFO:teuthology.orchestra.run.trial042.stdout:Group : Unspecified 2026-02-12T08:39:08.745 INFO:teuthology.orchestra.run.trial042.stdout:Size : 8393909 2026-02-12T08:39:08.745 INFO:teuthology.orchestra.run.trial042.stdout:License : GPLv3+ 2026-02-12T08:39:08.745 INFO:teuthology.orchestra.run.trial042.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T08:39:08.745 INFO:teuthology.orchestra.run.trial042.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T08:39:08.745 INFO:teuthology.orchestra.run.trial042.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T08:39:08.745 INFO:teuthology.orchestra.run.trial042.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T08:39:08.745 INFO:teuthology.orchestra.run.trial042.stdout:Packager : builder@centos.org 2026-02-12T08:39:08.745 INFO:teuthology.orchestra.run.trial042.stdout:Vendor : CentOS 2026-02-12T08:39:08.745 INFO:teuthology.orchestra.run.trial042.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T08:39:08.745 INFO:teuthology.orchestra.run.trial042.stdout:Summary : Support tools for GRUB. 2026-02-12T08:39:08.745 INFO:teuthology.orchestra.run.trial042.stdout:Description : 2026-02-12T08:39:08.745 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:39:08.746 INFO:teuthology.orchestra.run.trial042.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T08:39:08.746 INFO:teuthology.orchestra.run.trial042.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T08:39:08.746 INFO:teuthology.orchestra.run.trial042.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T08:39:08.746 INFO:teuthology.orchestra.run.trial042.stdout:hardware devices. 2026-02-12T08:39:08.746 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:39:08.746 INFO:teuthology.orchestra.run.trial042.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T08:39:08.747 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T08:39:08.747 INFO:teuthology.task.kernel:Updating grub on trial042 to boot 5.14.0-677.el9.x86_64 2026-02-12T08:39:08.747 DEBUG:teuthology.orchestra.run.trial042:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T08:39:08.812 INFO:teuthology.orchestra.run.trial042.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T08:39:08.814 DEBUG:teuthology.orchestra.run.trial042:> sudo command -v grubby && echo yes || echo no 2026-02-12T08:39:08.879 INFO:teuthology.orchestra.run.trial042.stdout:/sbin/grubby 2026-02-12T08:39:08.880 INFO:teuthology.orchestra.run.trial042.stdout:yes 2026-02-12T08:39:08.881 DEBUG:teuthology.orchestra.run.trial042:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T08:39:08.947 INFO:teuthology.orchestra.run.trial042.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T08:39:08.948 DEBUG:teuthology.orchestra.run.trial042:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T08:39:09.020 DEBUG:teuthology.orchestra.run.trial042:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T08:39:09.230 INFO:teuthology.orchestra.run.trial042.stderr:Generating grub configuration file ... 2026-02-12T08:39:09.294 INFO:teuthology.orchestra.run.trial042.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T08:39:09.300 INFO:teuthology.orchestra.run.trial042.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T08:39:09.552 INFO:teuthology.orchestra.run.trial042.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T08:39:09.559 INFO:teuthology.orchestra.run.trial042.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T08:39:09.589 INFO:teuthology.orchestra.run.trial042.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T08:39:09.595 INFO:teuthology.orchestra.run.trial042.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T08:39:09.619 INFO:teuthology.orchestra.run.trial042.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T08:39:09.625 INFO:teuthology.orchestra.run.trial042.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T08:39:09.707 INFO:teuthology.orchestra.run.trial042.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T08:39:09.716 INFO:teuthology.orchestra.run.trial042.stderr:done 2026-02-12T08:39:09.718 DEBUG:teuthology.orchestra.run.trial042:> test -d /sys/firmware/efi 2026-02-12T08:39:09.734 DEBUG:teuthology.orchestra.run.trial042:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T08:39:09.798 INFO:teuthology.orchestra.run.trial042.stdout:/boot/efi/EFI/BOOT 2026-02-12T08:39:09.798 INFO:teuthology.orchestra.run.trial042.stdout:/boot/efi/EFI/centos 2026-02-12T08:39:09.800 DEBUG:teuthology.orchestra.run.trial042:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T08:39:09.866 INFO:teuthology.orchestra.run.trial042.stdout:no 2026-02-12T08:39:09.866 DEBUG:teuthology.orchestra.run.trial042:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T08:39:09.933 INFO:teuthology.orchestra.run.trial042.stdout:yes 2026-02-12T08:39:09.933 DEBUG:teuthology.orchestra.run.trial042:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T08:39:09.997 DEBUG:teuthology.orchestra.run.trial042:> sudo shutdown -r now 2026-02-12T08:39:10.070 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T08:39:19.978 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:39:20.000 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:39:20.172 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:39:20.172 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T08:39:20.172 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T08:39:20.172 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T08:39:20.223 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:39:20.224 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:39:20.224 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-12T08:39:20.224 INFO:teuthology.orchestra.run.trial131.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T08:39:20.224 INFO:teuthology.orchestra.run.trial131.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T08:39:20.224 INFO:teuthology.orchestra.run.trial131.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T08:39:20.224 INFO:teuthology.orchestra.run.trial131.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T08:39:20.224 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:39:20.224 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:39:20.280 DEBUG:teuthology.orchestra.run.trial131:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T08:39:20.305 INFO:teuthology.orchestra.run.trial131.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T08:39:20.306 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T08:39:20.307 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T08:39:20.307 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T08:39:20.307 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T08:39:20.307 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2026-02-12T08:39:20.307 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial131.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T08:39:20.307 DEBUG:teuthology.orchestra.run.trial131:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T08:39:20.370 INFO:teuthology.orchestra.run.trial131.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T08:39:20.371 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T08:39:20.371 DEBUG:teuthology.orchestra.run.trial131:> sudo rpm -qi grub2-tools 2026-02-12T08:39:20.439 INFO:teuthology.orchestra.run.trial131.stdout:Name : grub2-tools 2026-02-12T08:39:20.439 INFO:teuthology.orchestra.run.trial131.stdout:Epoch : 1 2026-02-12T08:39:20.439 INFO:teuthology.orchestra.run.trial131.stdout:Version : 2.06 2026-02-12T08:39:20.439 INFO:teuthology.orchestra.run.trial131.stdout:Release : 118.el9 2026-02-12T08:39:20.440 INFO:teuthology.orchestra.run.trial131.stdout:Architecture: x86_64 2026-02-12T08:39:20.440 INFO:teuthology.orchestra.run.trial131.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T08:39:20.440 INFO:teuthology.orchestra.run.trial131.stdout:Group : Unspecified 2026-02-12T08:39:20.440 INFO:teuthology.orchestra.run.trial131.stdout:Size : 8393909 2026-02-12T08:39:20.440 INFO:teuthology.orchestra.run.trial131.stdout:License : GPLv3+ 2026-02-12T08:39:20.440 INFO:teuthology.orchestra.run.trial131.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T08:39:20.440 INFO:teuthology.orchestra.run.trial131.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T08:39:20.440 INFO:teuthology.orchestra.run.trial131.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T08:39:20.440 INFO:teuthology.orchestra.run.trial131.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T08:39:20.440 INFO:teuthology.orchestra.run.trial131.stdout:Packager : builder@centos.org 2026-02-12T08:39:20.441 INFO:teuthology.orchestra.run.trial131.stdout:Vendor : CentOS 2026-02-12T08:39:20.441 INFO:teuthology.orchestra.run.trial131.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T08:39:20.441 INFO:teuthology.orchestra.run.trial131.stdout:Summary : Support tools for GRUB. 2026-02-12T08:39:20.441 INFO:teuthology.orchestra.run.trial131.stdout:Description : 2026-02-12T08:39:20.441 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:39:20.441 INFO:teuthology.orchestra.run.trial131.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T08:39:20.441 INFO:teuthology.orchestra.run.trial131.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T08:39:20.441 INFO:teuthology.orchestra.run.trial131.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T08:39:20.441 INFO:teuthology.orchestra.run.trial131.stdout:hardware devices. 2026-02-12T08:39:20.441 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:39:20.442 INFO:teuthology.orchestra.run.trial131.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T08:39:20.443 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T08:39:20.443 INFO:teuthology.task.kernel:Updating grub on trial131 to boot 5.14.0-677.el9.x86_64 2026-02-12T08:39:20.443 DEBUG:teuthology.orchestra.run.trial131:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T08:39:20.507 INFO:teuthology.orchestra.run.trial131.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T08:39:20.509 DEBUG:teuthology.orchestra.run.trial131:> sudo command -v grubby && echo yes || echo no 2026-02-12T08:39:20.571 INFO:teuthology.orchestra.run.trial131.stdout:/sbin/grubby 2026-02-12T08:39:20.573 INFO:teuthology.orchestra.run.trial131.stdout:yes 2026-02-12T08:39:20.573 DEBUG:teuthology.orchestra.run.trial131:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T08:39:20.637 INFO:teuthology.orchestra.run.trial131.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T08:39:20.638 DEBUG:teuthology.orchestra.run.trial131:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T08:39:20.710 DEBUG:teuthology.orchestra.run.trial131:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T08:39:20.917 INFO:teuthology.orchestra.run.trial131.stderr:Generating grub configuration file ... 2026-02-12T08:39:20.978 INFO:teuthology.orchestra.run.trial131.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T08:39:20.985 INFO:teuthology.orchestra.run.trial131.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T08:39:21.232 INFO:teuthology.orchestra.run.trial131.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T08:39:21.238 INFO:teuthology.orchestra.run.trial131.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T08:39:21.270 INFO:teuthology.orchestra.run.trial131.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T08:39:21.277 INFO:teuthology.orchestra.run.trial131.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T08:39:21.300 INFO:teuthology.orchestra.run.trial131.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T08:39:21.306 INFO:teuthology.orchestra.run.trial131.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T08:39:21.387 INFO:teuthology.orchestra.run.trial131.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T08:39:21.396 INFO:teuthology.orchestra.run.trial131.stderr:done 2026-02-12T08:39:21.398 DEBUG:teuthology.orchestra.run.trial131:> test -d /sys/firmware/efi 2026-02-12T08:39:21.414 DEBUG:teuthology.orchestra.run.trial131:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T08:39:21.481 INFO:teuthology.orchestra.run.trial131.stdout:/boot/efi/EFI/BOOT 2026-02-12T08:39:21.481 INFO:teuthology.orchestra.run.trial131.stdout:/boot/efi/EFI/centos 2026-02-12T08:39:21.483 DEBUG:teuthology.orchestra.run.trial131:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T08:39:21.547 INFO:teuthology.orchestra.run.trial131.stdout:no 2026-02-12T08:39:21.548 DEBUG:teuthology.orchestra.run.trial131:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T08:39:21.611 INFO:teuthology.orchestra.run.trial131.stdout:yes 2026-02-12T08:39:21.612 DEBUG:teuthology.orchestra.run.trial131:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T08:39:21.677 DEBUG:teuthology.orchestra.run.trial131:> sudo shutdown -r now 2026-02-12T08:39:21.749 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T08:39:40.058 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T08:39:40.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial042.front.sepia.ceph.com' 2026-02-12T08:39:40.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:39:51.731 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2026-02-12T08:39:51.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T08:39:51.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:40:40.090 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T08:40:49.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial042.front.sepia.ceph.com' 2026-02-12T08:40:49.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:40:49.237 DEBUG:teuthology.orchestra.run.trial042:> true 2026-02-12T08:40:49.407 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial042.front.sepia.ceph.com' 2026-02-12T08:40:49.407 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T08:40:49.408 DEBUG:teuthology.orchestra.run.trial042:> uname -r 2026-02-12T08:40:49.464 INFO:teuthology.orchestra.run.trial042.stdout:5.14.0-677.el9.x86_64 2026-02-12T08:40:49.464 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T08:40:49.464 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T08:40:49.465 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T08:40:50.465 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-12T08:40:50.466 DEBUG:teuthology.orchestra.run.trial042:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T08:40:50.495 INFO:teuthology.orchestra.run.trial042.stdout:ttyS1 2026-02-12T08:40:50.525 DEBUG:teuthology.parallel:result is None 2026-02-12T08:40:51.734 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T08:41:00.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T08:41:00.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:41:00.869 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T08:41:01.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T08:41:01.034 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-677.el9.x86_64"... 2026-02-12T08:41:01.034 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T08:41:01.090 INFO:teuthology.orchestra.run.trial131.stdout:5.14.0-677.el9.x86_64 2026-02-12T08:41:01.090 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T08:41:01.090 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T08:41:01.090 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T08:41:02.091 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-12T08:41:02.091 DEBUG:teuthology.orchestra.run.trial131:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T08:41:02.121 INFO:teuthology.orchestra.run.trial131.stdout:ttyS1 2026-02-12T08:41:02.143 DEBUG:teuthology.parallel:result is None 2026-02-12T08:41:02.143 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-12T08:41:02.155 INFO:teuthology.task.internal:Creating test directory... 2026-02-12T08:41:02.156 DEBUG:teuthology.orchestra.run.trial042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T08:41:02.159 DEBUG:teuthology.orchestra.run.trial131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T08:41:02.201 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-12T08:41:02.212 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-12T08:41:02.228 INFO:teuthology.task.internal:Creating archive directory... 2026-02-12T08:41:02.228 DEBUG:teuthology.orchestra.run.trial042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T08:41:02.231 DEBUG:teuthology.orchestra.run.trial131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T08:41:02.265 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-12T08:41:02.277 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-12T08:41:02.277 DEBUG:teuthology.orchestra.run.trial042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T08:41:02.289 DEBUG:teuthology.orchestra.run.trial131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T08:41:02.312 INFO:teuthology.orchestra.run.trial042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T08:41:02.321 INFO:teuthology.orchestra.run.trial042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T08:41:02.323 INFO:teuthology.orchestra.run.trial131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T08:41:02.332 INFO:teuthology.orchestra.run.trial131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T08:41:02.333 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-12T08:41:02.346 INFO:teuthology.task.internal:Configuring sudo... 2026-02-12T08:41:02.346 DEBUG:teuthology.orchestra.run.trial042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T08:41:02.365 DEBUG:teuthology.orchestra.run.trial131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T08:41:02.398 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-12T08:41:02.422 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-12T08:41:02.422 DEBUG:teuthology.orchestra.run.trial042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T08:41:02.429 DEBUG:teuthology.orchestra.run.trial131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T08:41:02.455 DEBUG:teuthology.orchestra.run.trial042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T08:41:02.607 DEBUG:teuthology.orchestra.run.trial042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T08:41:02.632 DEBUG:teuthology.orchestra.run.trial042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T08:41:02.755 DEBUG:teuthology.orchestra.run.trial042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T08:41:02.780 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:41:02.780 DEBUG:teuthology.orchestra.run.trial042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T08:41:02.843 DEBUG:teuthology.orchestra.run.trial131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T08:41:02.931 DEBUG:teuthology.orchestra.run.trial131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T08:41:02.956 DEBUG:teuthology.orchestra.run.trial131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T08:41:03.082 DEBUG:teuthology.orchestra.run.trial131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T08:41:03.107 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-12T08:41:03.107 DEBUG:teuthology.orchestra.run.trial131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T08:41:03.172 DEBUG:teuthology.orchestra.run.trial042:> sudo service rsyslog restart 2026-02-12T08:41:03.174 DEBUG:teuthology.orchestra.run.trial131:> sudo service rsyslog restart 2026-02-12T08:41:03.201 INFO:teuthology.orchestra.run.trial042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T08:41:03.240 INFO:teuthology.orchestra.run.trial131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T08:41:03.672 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-12T08:41:03.683 INFO:teuthology.task.internal:Starting timer... 2026-02-12T08:41:03.683 INFO:teuthology.run_tasks:Running task pcp... 2026-02-12T08:41:03.701 INFO:teuthology.run_tasks:Running task selinux... 2026-02-12T08:41:03.714 DEBUG:teuthology.orchestra.run.trial042:> sudo service auditd rotate 2026-02-12T08:41:03.744 INFO:teuthology.orchestra.run.trial042.stdout:Rotating logs: 2026-02-12T08:41:03.745 DEBUG:teuthology.orchestra.run.trial131:> sudo service auditd rotate 2026-02-12T08:41:03.776 INFO:teuthology.orchestra.run.trial131.stdout:Rotating logs: 2026-02-12T08:41:03.778 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-12T08:41:03.778 DEBUG:teuthology.orchestra.run.trial042:> /usr/sbin/getenforce 2026-02-12T08:41:03.802 INFO:teuthology.orchestra.run.trial042.stdout:Permissive 2026-02-12T08:41:03.802 DEBUG:teuthology.orchestra.run.trial131:> /usr/sbin/getenforce 2026-02-12T08:41:03.834 INFO:teuthology.orchestra.run.trial131.stdout:Permissive 2026-02-12T08:41:03.834 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial042.front.sepia.ceph.com': 'permissive', 'ubuntu@trial131.front.sepia.ceph.com': 'permissive'} 2026-02-12T08:41:03.834 DEBUG:teuthology.orchestra.run.trial042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T08:41:03.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:41:03.869 DEBUG:teuthology.orchestra.run.trial131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T08:41:03.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:41:03.900 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-12T08:41:03.900 DEBUG:teuthology.orchestra.run.trial042:> sudo /usr/sbin/setenforce permissive 2026-02-12T08:41:03.934 DEBUG:teuthology.orchestra.run.trial131:> sudo /usr/sbin/setenforce permissive 2026-02-12T08:41:03.963 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-12T08:41:03.979 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-12T08:41:03.992 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-12T08:41:03.993 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial042.front.sepia.ceph.com,trial131.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-12T08:42:13.734 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial042.front.sepia.ceph.com'), Remote(name='ubuntu@trial131.front.sepia.ceph.com')] 2026-02-12T08:42:13.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial042.front.sepia.ceph.com' 2026-02-12T08:42:13.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:42:13.800 DEBUG:teuthology.orchestra.run.trial042:> true 2026-02-12T08:42:13.871 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial042.front.sepia.ceph.com' 2026-02-12T08:42:13.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T08:42:13.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:42:13.938 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T08:42:14.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T08:42:14.013 INFO:teuthology.run_tasks:Running task clock... 2026-02-12T08:42:14.025 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-12T08:42:14.025 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T08:42:14.026 DEBUG:teuthology.orchestra.run.trial042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T08:42:14.028 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T08:42:14.028 DEBUG:teuthology.orchestra.run.trial131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T08:42:14.053 INFO:teuthology.orchestra.run.trial042.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T08:42:14.065 INFO:teuthology.orchestra.run.trial042.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T08:42:14.080 INFO:teuthology.orchestra.run.trial131.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T08:42:14.086 INFO:teuthology.orchestra.run.trial042.stderr:sudo: ntpd: command not found 2026-02-12T08:42:14.091 INFO:teuthology.orchestra.run.trial131.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T08:42:14.096 INFO:teuthology.orchestra.run.trial042.stdout:506 Cannot talk to daemon 2026-02-12T08:42:14.108 INFO:teuthology.orchestra.run.trial042.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T08:42:14.112 INFO:teuthology.orchestra.run.trial131.stderr:sudo: ntpd: command not found 2026-02-12T08:42:14.120 INFO:teuthology.orchestra.run.trial042.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T08:42:14.122 INFO:teuthology.orchestra.run.trial131.stdout:506 Cannot talk to daemon 2026-02-12T08:42:14.133 INFO:teuthology.orchestra.run.trial131.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T08:42:14.145 INFO:teuthology.orchestra.run.trial131.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T08:42:14.166 INFO:teuthology.orchestra.run.trial042.stderr:bash: line 1: ntpq: command not found 2026-02-12T08:42:14.181 INFO:teuthology.orchestra.run.trial042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T08:42:14.181 INFO:teuthology.orchestra.run.trial042.stdout:=============================================================================== 2026-02-12T08:42:14.181 INFO:teuthology.orchestra.run.trial042.stdout:^? 23.186.168.130 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T08:42:14.181 INFO:teuthology.orchestra.run.trial042.stdout:^? s2-a.time.mci1.us.rozint> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T08:42:14.181 INFO:teuthology.orchestra.run.trial042.stdout:^? 66.42.71.197.vultruserco> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T08:42:14.181 INFO:teuthology.orchestra.run.trial042.stdout:^? 149.248.12.167.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T08:42:14.189 INFO:teuthology.orchestra.run.trial131.stderr:bash: line 1: ntpq: command not found 2026-02-12T08:42:14.211 INFO:teuthology.orchestra.run.trial131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T08:42:14.211 INFO:teuthology.orchestra.run.trial131.stdout:=============================================================================== 2026-02-12T08:42:14.211 INFO:teuthology.orchestra.run.trial131.stdout:^? arm1.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T08:42:14.211 INFO:teuthology.orchestra.run.trial131.stdout:^? 199.101.96.52 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T08:42:14.211 INFO:teuthology.orchestra.run.trial131.stdout:^? kc1cloud.147.72.155.23.m> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T08:42:14.212 INFO:teuthology.orchestra.run.trial131.stdout:^? pool-96-231-54-40.washdc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T08:42:14.213 INFO:teuthology.run_tasks:Running task install... 2026-02-12T08:42:14.227 DEBUG:teuthology.task.install:project ceph 2026-02-12T08:42:14.227 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'}} 2026-02-12T08:42:14.227 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'} 2026-02-12T08:42:14.228 INFO:teuthology.task.install:Using flavor: debug 2026-02-12T08:42:14.236 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-12T08:42:14.237 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-12T08:42:14.237 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875', 'tag': None, 'wait_for_package': False} 2026-02-12T08:42:14.238 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:42:14.240 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875', 'tag': None, 'wait_for_package': False} 2026-02-12T08:42:14.241 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:42:14.432 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/ 2026-02-12T08:42:14.432 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5161.g2401a109 2026-02-12T08:42:14.443 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/ 2026-02-12T08:42:14.443 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5161.g2401a109 2026-02-12T08:42:14.793 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T08:42:14.794 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:42:14.794 DEBUG:teuthology.orchestra.run.trial042:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T08:42:14.820 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-12T08:42:14.820 DEBUG:teuthology.orchestra.run.trial042:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2401a109e2ac85dfa20fc57328da663aa754c875/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T08:42:14.839 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T08:42:14.839 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-12T08:42:14.839 DEBUG:teuthology.orchestra.run.trial131:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T08:42:14.864 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-12T08:42:14.865 DEBUG:teuthology.orchestra.run.trial131:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2401a109e2ac85dfa20fc57328da663aa754c875/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T08:42:14.885 DEBUG:teuthology.orchestra.run.trial042:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T08:42:14.928 DEBUG:teuthology.orchestra.run.trial131:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T08:42:14.959 DEBUG:teuthology.orchestra.run.trial042:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T08:42:15.002 DEBUG:teuthology.orchestra.run.trial131:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T08:42:15.022 INFO:teuthology.orchestra.run.trial042.stdout:check_obsoletes = 1 2026-02-12T08:42:15.024 DEBUG:teuthology.orchestra.run.trial042:> sudo yum clean all 2026-02-12T08:42:15.064 INFO:teuthology.orchestra.run.trial131.stdout:check_obsoletes = 1 2026-02-12T08:42:15.066 DEBUG:teuthology.orchestra.run.trial131:> sudo yum clean all 2026-02-12T08:42:15.173 INFO:teuthology.orchestra.run.trial042.stdout:41 files removed 2026-02-12T08:42:15.188 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-radosgw 2026-02-12T08:42:15.214 INFO:teuthology.orchestra.run.trial131.stdout:41 files removed 2026-02-12T08:42:15.228 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-radosgw 2026-02-12T08:42:16.049 INFO:teuthology.orchestra.run.trial042.stdout:ceph packages for x86_64 131 kB/s | 94 kB 00:00 2026-02-12T08:42:16.081 INFO:teuthology.orchestra.run.trial131.stdout:ceph packages for x86_64 132 kB/s | 94 kB 00:00 2026-02-12T08:42:16.699 INFO:teuthology.orchestra.run.trial042.stdout:ceph noarch packages 39 kB/s | 24 kB 00:00 2026-02-12T08:42:16.728 INFO:teuthology.orchestra.run.trial131.stdout:ceph noarch packages 39 kB/s | 24 kB 00:00 2026-02-12T08:42:17.286 INFO:teuthology.orchestra.run.trial042.stdout:ceph source packages 3.7 kB/s | 2.1 kB 00:00 2026-02-12T08:42:17.316 INFO:teuthology.orchestra.run.trial131.stdout:ceph source packages 3.6 kB/s | 2.1 kB 00:00 2026-02-12T08:42:18.090 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-12T08:42:18.641 INFO:teuthology.orchestra.run.trial042.stdout:CentOS Stream 9 - BaseOS 6.7 MB/s | 8.9 MB 00:01 2026-02-12T08:42:19.568 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - AppStream 29 MB/s | 27 MB 00:00 2026-02-12T08:42:23.078 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - CRB 6.9 MB/s | 7.8 MB 00:01 2026-02-12T08:42:23.903 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - Extras packages 194 kB/s | 20 kB 00:00 2026-02-12T08:42:25.234 INFO:teuthology.orchestra.run.trial131.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2026-02-12T08:42:28.420 INFO:teuthology.orchestra.run.trial131.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-12T08:42:29.704 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:42:29.705 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:42:29.706 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repository Size 2026-02-12T08:42:29.706 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:42:29.706 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-12T08:42:29.706 INFO:teuthology.orchestra.run.trial131.stdout: ceph-radosgw x86_64 2:20.3.0-5161.g2401a109.el9 ceph 11 M 2026-02-12T08:42:29.706 INFO:teuthology.orchestra.run.trial131.stdout:Upgrading: 2026-02-12T08:42:29.706 INFO:teuthology.orchestra.run.trial131.stdout: librados2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 3.3 M 2026-02-12T08:42:29.706 INFO:teuthology.orchestra.run.trial131.stdout: librbd1 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 2.7 M 2026-02-12T08:42:29.706 INFO:teuthology.orchestra.run.trial131.stdout:Installing dependencies: 2026-02-12T08:42:29.706 INFO:teuthology.orchestra.run.trial131.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T08:42:29.706 INFO:teuthology.orchestra.run.trial131.stdout: ceph-base x86_64 2:20.3.0-5161.g2401a109.el9 ceph 5.1 M 2026-02-12T08:42:29.706 INFO:teuthology.orchestra.run.trial131.stdout: ceph-common x86_64 2:20.3.0-5161.g2401a109.el9 ceph 21 M 2026-02-12T08:42:29.706 INFO:teuthology.orchestra.run.trial131.stdout: ceph-selinux x86_64 2:20.3.0-5161.g2401a109.el9 ceph 25 k 2026-02-12T08:42:29.707 INFO:teuthology.orchestra.run.trial131.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T08:42:29.707 INFO:teuthology.orchestra.run.trial131.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T08:42:29.707 INFO:teuthology.orchestra.run.trial131.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T08:42:29.707 INFO:teuthology.orchestra.run.trial131.stdout: libcephfs2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 860 k 2026-02-12T08:42:29.707 INFO:teuthology.orchestra.run.trial131.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T08:42:29.707 INFO:teuthology.orchestra.run.trial131.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T08:42:29.707 INFO:teuthology.orchestra.run.trial131.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T08:42:29.707 INFO:teuthology.orchestra.run.trial131.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T08:42:29.707 INFO:teuthology.orchestra.run.trial131.stdout: libradosstriper1 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 263 k 2026-02-12T08:42:29.707 INFO:teuthology.orchestra.run.trial131.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T08:42:29.707 INFO:teuthology.orchestra.run.trial131.stdout: librgw2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 5.6 M 2026-02-12T08:42:29.707 INFO:teuthology.orchestra.run.trial131.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T08:42:29.708 INFO:teuthology.orchestra.run.trial131.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T08:42:29.708 INFO:teuthology.orchestra.run.trial131.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T08:42:29.708 INFO:teuthology.orchestra.run.trial131.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T08:42:29.708 INFO:teuthology.orchestra.run.trial131.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T08:42:29.708 INFO:teuthology.orchestra.run.trial131.stdout: python3-ceph-argparse x86_64 2:20.3.0-5161.g2401a109.el9 ceph 45 k 2026-02-12T08:42:29.708 INFO:teuthology.orchestra.run.trial131.stdout: python3-ceph-common x86_64 2:20.3.0-5161.g2401a109.el9 ceph 184 k 2026-02-12T08:42:29.708 INFO:teuthology.orchestra.run.trial131.stdout: python3-cephfs x86_64 2:20.3.0-5161.g2401a109.el9 ceph 204 k 2026-02-12T08:42:29.708 INFO:teuthology.orchestra.run.trial131.stdout: python3-rados x86_64 2:20.3.0-5161.g2401a109.el9 ceph 323 k 2026-02-12T08:42:29.708 INFO:teuthology.orchestra.run.trial131.stdout: python3-rbd x86_64 2:20.3.0-5161.g2401a109.el9 ceph 305 k 2026-02-12T08:42:29.708 INFO:teuthology.orchestra.run.trial131.stdout: python3-rgw x86_64 2:20.3.0-5161.g2401a109.el9 ceph 100 k 2026-02-12T08:42:29.708 INFO:teuthology.orchestra.run.trial131.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T08:42:29.708 INFO:teuthology.orchestra.run.trial131.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T08:42:29.708 INFO:teuthology.orchestra.run.trial131.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T08:42:29.709 INFO:teuthology.orchestra.run.trial131.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T08:42:29.709 INFO:teuthology.orchestra.run.trial131.stdout:Installing weak dependencies: 2026-02-12T08:42:29.709 INFO:teuthology.orchestra.run.trial131.stdout: libcephfs-daemon x86_64 2:20.3.0-5161.g2401a109.el9 ceph 35 k 2026-02-12T08:42:29.709 INFO:teuthology.orchestra.run.trial131.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 24 k 2026-02-12T08:42:29.709 INFO:teuthology.orchestra.run.trial131.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-12T08:42:29.709 INFO:teuthology.orchestra.run.trial131.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T08:42:29.709 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:42:29.709 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-12T08:42:29.709 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:42:29.709 INFO:teuthology.orchestra.run.trial131.stdout:Install 35 Packages 2026-02-12T08:42:29.709 INFO:teuthology.orchestra.run.trial131.stdout:Upgrade 2 Packages 2026-02-12T08:42:29.709 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:42:29.710 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 61 M 2026-02-12T08:42:29.710 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-12T08:42:32.251 INFO:teuthology.orchestra.run.trial131.stdout:(1/37): ceph-base-20.3.0-5161.g2401a109.el9.x86 2.2 MB/s | 5.1 MB 00:02 2026-02-12T08:42:32.315 INFO:teuthology.orchestra.run.trial131.stdout:(2/37): ceph-selinux-20.3.0-5161.g2401a109.el9. 390 kB/s | 25 kB 00:00 2026-02-12T08:42:32.381 INFO:teuthology.orchestra.run.trial131.stdout:(3/37): libcephfs-daemon-20.3.0-5161.g2401a109. 538 kB/s | 35 kB 00:00 2026-02-12T08:42:32.447 INFO:teuthology.orchestra.run.trial131.stdout:(4/37): libcephfs-proxy2-20.3.0-5161.g2401a109. 363 kB/s | 24 kB 00:00 2026-02-12T08:42:32.856 INFO:teuthology.orchestra.run.trial131.stdout:(5/37): libcephfs2-20.3.0-5161.g2401a109.el9.x8 2.1 MB/s | 860 kB 00:00 2026-02-12T08:42:32.990 INFO:teuthology.orchestra.run.trial131.stdout:(6/37): libradosstriper1-20.3.0-5161.g2401a109. 1.9 MB/s | 263 kB 00:00 2026-02-12T08:42:36.019 INFO:teuthology.orchestra.run.trial131.stdout:(7/37): librgw2-20.3.0-5161.g2401a109.el9.x86_6 1.9 MB/s | 5.6 MB 00:03 2026-02-12T08:42:36.086 INFO:teuthology.orchestra.run.trial131.stdout:(8/37): python3-ceph-argparse-20.3.0-5161.g2401 682 kB/s | 45 kB 00:00 2026-02-12T08:42:36.227 INFO:teuthology.orchestra.run.trial131.stdout:(9/37): ceph-radosgw-20.3.0-5161.g2401a109.el9. 1.8 MB/s | 11 MB 00:06 2026-02-12T08:42:36.228 INFO:teuthology.orchestra.run.trial131.stdout:(10/37): python3-ceph-common-20.3.0-5161.g2401a 1.3 MB/s | 184 kB 00:00 2026-02-12T08:42:36.438 INFO:teuthology.orchestra.run.trial131.stdout:(11/37): python3-cephfs-20.3.0-5161.g2401a109.e 965 kB/s | 204 kB 00:00 2026-02-12T08:42:36.503 INFO:teuthology.orchestra.run.trial131.stdout:(12/37): python3-rados-20.3.0-5161.g2401a109.el 1.1 MB/s | 323 kB 00:00 2026-02-12T08:42:36.517 INFO:teuthology.orchestra.run.trial042.stdout:CentOS Stream 9 - AppStream 1.5 MB/s | 27 MB 00:17 2026-02-12T08:42:36.572 INFO:teuthology.orchestra.run.trial131.stdout:(13/37): python3-rgw-20.3.0-5161.g2401a109.el9. 1.4 MB/s | 100 kB 00:00 2026-02-12T08:42:36.772 INFO:teuthology.orchestra.run.trial131.stdout:(14/37): python3-rbd-20.3.0-5161.g2401a109.el9. 913 kB/s | 305 kB 00:00 2026-02-12T08:42:36.969 INFO:teuthology.orchestra.run.trial131.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 83 kB/s | 33 kB 00:00 2026-02-12T08:42:37.127 INFO:teuthology.orchestra.run.trial131.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 591 kB/s | 93 kB 00:00 2026-02-12T08:42:37.285 INFO:teuthology.orchestra.run.trial131.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 657 kB/s | 104 kB 00:00 2026-02-12T08:42:37.414 INFO:teuthology.orchestra.run.trial131.stdout:(18/37): ceph-common-20.3.0-5161.g2401a109.el9. 2.8 MB/s | 21 MB 00:07 2026-02-12T08:42:37.520 INFO:teuthology.orchestra.run.trial131.stdout:(19/37): libnbd-1.20.3-4.el9.x86_64.rpm 699 kB/s | 164 kB 00:00 2026-02-12T08:42:37.601 INFO:teuthology.orchestra.run.trial131.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 558 kB/s | 45 kB 00:00 2026-02-12T08:42:38.036 INFO:teuthology.orchestra.run.trial131.stdout:(21/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 257 kB/s | 160 kB 00:00 2026-02-12T08:42:38.372 INFO:teuthology.orchestra.run.trial131.stdout:(22/37): librdkafka-1.6.1-102.el9.x86_64.rpm 859 kB/s | 662 kB 00:00 2026-02-12T08:42:38.424 INFO:teuthology.orchestra.run.trial131.stdout:(23/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 755 kB/s | 292 kB 00:00 2026-02-12T08:42:38.452 INFO:teuthology.orchestra.run.trial131.stdout:(24/37): nvme-cli-2.13-1.el9.x86_64.rpm 668 kB/s | 1.1 MB 00:01 2026-02-12T08:42:38.505 INFO:teuthology.orchestra.run.trial131.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 456 kB/s | 37 kB 00:00 2026-02-12T08:42:38.533 INFO:teuthology.orchestra.run.trial131.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 819 kB/s | 66 kB 00:00 2026-02-12T08:42:38.684 INFO:teuthology.orchestra.run.trial131.stdout:(27/37): qatlib-25.08.0-2.el9.x86_64.rpm 768 kB/s | 240 kB 00:00 2026-02-12T08:42:38.758 INFO:teuthology.orchestra.run.trial131.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 332 kB/s | 25 kB 00:00 2026-02-12T08:42:38.759 INFO:teuthology.orchestra.run.trial131.stdout:(29/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.2 MB/s | 308 kB 00:00 2026-02-12T08:42:38.804 INFO:teuthology.orchestra.run.trial131.stdout:(30/37): libarrow-9.0.0-15.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2026-02-12T08:42:38.804 INFO:teuthology.orchestra.run.trial131.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 1.5 MB/s | 67 kB 00:00 2026-02-12T08:42:38.808 INFO:teuthology.orchestra.run.trial131.stdout:(32/37): liboath-2.6.12-1.el9.x86_64.rpm 965 kB/s | 49 kB 00:00 2026-02-12T08:42:38.830 INFO:teuthology.orchestra.run.trial131.stdout:(33/37): re2-20211101-20.el9.x86_64.rpm 7.2 MB/s | 191 kB 00:00 2026-02-12T08:42:38.910 INFO:teuthology.orchestra.run.trial131.stdout:(34/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 7.7 MB/s | 838 kB 00:00 2026-02-12T08:42:38.945 INFO:teuthology.orchestra.run.trial131.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2026-02-12T08:42:40.429 INFO:teuthology.orchestra.run.trial042.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 7.8 MB 00:01 2026-02-12T08:42:41.292 INFO:teuthology.orchestra.run.trial042.stdout:CentOS Stream 9 - Extras packages 133 kB/s | 20 kB 00:00 2026-02-12T08:42:41.672 INFO:teuthology.orchestra.run.trial131.stdout:(36/37): librbd1-20.3.0-5161.g2401a109.el9.x86_ 996 kB/s | 2.7 MB 00:02 2026-02-12T08:42:41.913 INFO:teuthology.orchestra.run.trial042.stdout:Extra Packages for Enterprise Linux 37 MB/s | 20 MB 00:00 2026-02-12T08:42:41.959 INFO:teuthology.orchestra.run.trial131.stdout:(37/37): librados2-20.3.0-5161.g2401a109.el9.x8 1.1 MB/s | 3.3 MB 00:03 2026-02-12T08:42:41.964 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:42:41.964 INFO:teuthology.orchestra.run.trial131.stdout:Total 5.0 MB/s | 61 MB 00:12 2026-02-12T08:42:42.064 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-12T08:42:42.083 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-12T08:42:42.084 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-12T08:42:42.333 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-12T08:42:42.333 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-12T08:42:42.625 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-12T08:42:42.764 INFO:teuthology.orchestra.run.trial131.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-12T08:42:42.768 INFO:teuthology.orchestra.run.trial131.stdout: Upgrading : librados2-2:20.3.0-5161.g2401a109.el9.x86_64 2/39 2026-02-12T08:42:42.818 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: librados2-2:20.3.0-5161.g2401a109.el9.x86_64 2/39 2026-02-12T08:42:42.819 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 3/39 2026-02-12T08:42:42.832 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 3/39 2026-02-12T08:42:42.834 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libcephfs-daemon-2:20.3.0-5161.g2401a109.el9.x86_6 4/39 2026-02-12T08:42:42.835 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86_6 5/39 2026-02-12T08:42:42.863 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86_6 5/39 2026-02-12T08:42:42.867 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 6/39 2026-02-12T08:42:42.874 INFO:teuthology.orchestra.run.trial131.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-12T08:42:42.876 INFO:teuthology.orchestra.run.trial131.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-12T08:42:42.879 INFO:teuthology.orchestra.run.trial131.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-12T08:42:42.883 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-12T08:42:42.895 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-ceph-argparse-2:20.3.0-5161.g2401a109.el9. 11/39 2026-02-12T08:42:42.907 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 12/39 2026-02-12T08:42:42.908 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86_6 13/39 2026-02-12T08:42:42.929 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86_6 13/39 2026-02-12T08:42:42.933 INFO:teuthology.orchestra.run.trial131.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-12T08:42:42.962 INFO:teuthology.orchestra.run.trial131.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-12T08:42:42.966 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-12T08:42:42.972 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-12T08:42:42.974 INFO:teuthology.orchestra.run.trial131.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-12T08:42:42.978 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-12T08:42:43.094 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T08:42:43.095 INFO:teuthology.orchestra.run.trial131.stdout: Upgrading : librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 21/39 2026-02-12T08:42:43.121 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 21/39 2026-02-12T08:42:43.123 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 22/39 2026-02-12T08:42:43.129 INFO:teuthology.orchestra.run.trial131.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-12T08:42:43.378 INFO:teuthology.orchestra.run.trial131.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-12T08:42:43.379 INFO:teuthology.orchestra.run.trial131.stdout: Installing : librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 25/39 2026-02-12T08:42:43.396 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 25/39 2026-02-12T08:42:43.400 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 26/39 2026-02-12T08:42:43.405 INFO:teuthology.orchestra.run.trial131.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-12T08:42:43.407 INFO:teuthology.orchestra.run.trial131.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-12T08:42:43.408 INFO:teuthology.orchestra.run.trial131.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T08:42:43.426 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T08:42:43.540 INFO:teuthology.orchestra.run.trial131.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-12T08:42:43.543 INFO:teuthology.orchestra.run.trial131.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T08:42:43.822 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T08:42:43.822 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T08:42:43.822 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:42:43.868 INFO:teuthology.orchestra.run.trial131.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-12T08:42:43.870 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-ceph-common-2:20.3.0-5161.g2401a109.el9.x8 33/39 2026-02-12T08:42:44.813 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 34/39 2026-02-12T08:42:44.815 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 34/39 2026-02-12T08:42:45.077 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 34/39 2026-02-12T08:42:45.080 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 35/39 2026-02-12T08:42:45.093 INFO:teuthology.orchestra.run.trial042.stdout:lab-extras 2.3 MB/s | 50 kB 00:00 2026-02-12T08:42:45.121 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 35/39 2026-02-12T08:42:45.121 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T08:42:45.121 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T08:42:45.121 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:42:45.125 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 36/39 2026-02-12T08:42:46.384 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:42:46.385 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:42:46.386 INFO:teuthology.orchestra.run.trial042.stdout: Package Arch Version Repository Size 2026-02-12T08:42:46.386 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:42:46.386 INFO:teuthology.orchestra.run.trial042.stdout:Installing: 2026-02-12T08:42:46.386 INFO:teuthology.orchestra.run.trial042.stdout: ceph-radosgw x86_64 2:20.3.0-5161.g2401a109.el9 ceph 11 M 2026-02-12T08:42:46.386 INFO:teuthology.orchestra.run.trial042.stdout:Upgrading: 2026-02-12T08:42:46.386 INFO:teuthology.orchestra.run.trial042.stdout: librados2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 3.3 M 2026-02-12T08:42:46.386 INFO:teuthology.orchestra.run.trial042.stdout: librbd1 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 2.7 M 2026-02-12T08:42:46.386 INFO:teuthology.orchestra.run.trial042.stdout:Installing dependencies: 2026-02-12T08:42:46.386 INFO:teuthology.orchestra.run.trial042.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T08:42:46.386 INFO:teuthology.orchestra.run.trial042.stdout: ceph-base x86_64 2:20.3.0-5161.g2401a109.el9 ceph 5.1 M 2026-02-12T08:42:46.387 INFO:teuthology.orchestra.run.trial042.stdout: ceph-common x86_64 2:20.3.0-5161.g2401a109.el9 ceph 21 M 2026-02-12T08:42:46.387 INFO:teuthology.orchestra.run.trial042.stdout: ceph-selinux x86_64 2:20.3.0-5161.g2401a109.el9 ceph 25 k 2026-02-12T08:42:46.387 INFO:teuthology.orchestra.run.trial042.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T08:42:46.387 INFO:teuthology.orchestra.run.trial042.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T08:42:46.387 INFO:teuthology.orchestra.run.trial042.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T08:42:46.387 INFO:teuthology.orchestra.run.trial042.stdout: libcephfs2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 860 k 2026-02-12T08:42:46.387 INFO:teuthology.orchestra.run.trial042.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T08:42:46.387 INFO:teuthology.orchestra.run.trial042.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T08:42:46.387 INFO:teuthology.orchestra.run.trial042.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T08:42:46.387 INFO:teuthology.orchestra.run.trial042.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T08:42:46.387 INFO:teuthology.orchestra.run.trial042.stdout: libradosstriper1 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 263 k 2026-02-12T08:42:46.387 INFO:teuthology.orchestra.run.trial042.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T08:42:46.388 INFO:teuthology.orchestra.run.trial042.stdout: librgw2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 5.6 M 2026-02-12T08:42:46.388 INFO:teuthology.orchestra.run.trial042.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T08:42:46.388 INFO:teuthology.orchestra.run.trial042.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T08:42:46.388 INFO:teuthology.orchestra.run.trial042.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T08:42:46.388 INFO:teuthology.orchestra.run.trial042.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T08:42:46.388 INFO:teuthology.orchestra.run.trial042.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T08:42:46.388 INFO:teuthology.orchestra.run.trial042.stdout: python3-ceph-argparse x86_64 2:20.3.0-5161.g2401a109.el9 ceph 45 k 2026-02-12T08:42:46.388 INFO:teuthology.orchestra.run.trial042.stdout: python3-ceph-common x86_64 2:20.3.0-5161.g2401a109.el9 ceph 184 k 2026-02-12T08:42:46.388 INFO:teuthology.orchestra.run.trial042.stdout: python3-cephfs x86_64 2:20.3.0-5161.g2401a109.el9 ceph 204 k 2026-02-12T08:42:46.388 INFO:teuthology.orchestra.run.trial042.stdout: python3-rados x86_64 2:20.3.0-5161.g2401a109.el9 ceph 323 k 2026-02-12T08:42:46.388 INFO:teuthology.orchestra.run.trial042.stdout: python3-rbd x86_64 2:20.3.0-5161.g2401a109.el9 ceph 305 k 2026-02-12T08:42:46.388 INFO:teuthology.orchestra.run.trial042.stdout: python3-rgw x86_64 2:20.3.0-5161.g2401a109.el9 ceph 100 k 2026-02-12T08:42:46.389 INFO:teuthology.orchestra.run.trial042.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T08:42:46.389 INFO:teuthology.orchestra.run.trial042.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T08:42:46.389 INFO:teuthology.orchestra.run.trial042.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T08:42:46.389 INFO:teuthology.orchestra.run.trial042.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T08:42:46.389 INFO:teuthology.orchestra.run.trial042.stdout:Installing weak dependencies: 2026-02-12T08:42:46.389 INFO:teuthology.orchestra.run.trial042.stdout: libcephfs-daemon x86_64 2:20.3.0-5161.g2401a109.el9 ceph 35 k 2026-02-12T08:42:46.389 INFO:teuthology.orchestra.run.trial042.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 24 k 2026-02-12T08:42:46.389 INFO:teuthology.orchestra.run.trial042.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-12T08:42:46.389 INFO:teuthology.orchestra.run.trial042.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T08:42:46.389 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:42:46.389 INFO:teuthology.orchestra.run.trial042.stdout:Transaction Summary 2026-02-12T08:42:46.389 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:42:46.389 INFO:teuthology.orchestra.run.trial042.stdout:Install 35 Packages 2026-02-12T08:42:46.390 INFO:teuthology.orchestra.run.trial042.stdout:Upgrade 2 Packages 2026-02-12T08:42:46.390 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:42:46.390 INFO:teuthology.orchestra.run.trial042.stdout:Total download size: 61 M 2026-02-12T08:42:46.390 INFO:teuthology.orchestra.run.trial042.stdout:Downloading Packages: 2026-02-12T08:42:49.531 INFO:teuthology.orchestra.run.trial042.stdout:(1/37): ceph-radosgw-20.3.0-5161.g2401a109.el9. 3.8 MB/s | 11 MB 00:02 2026-02-12T08:42:49.596 INFO:teuthology.orchestra.run.trial042.stdout:(2/37): ceph-selinux-20.3.0-5161.g2401a109.el9. 387 kB/s | 25 kB 00:00 2026-02-12T08:42:49.660 INFO:teuthology.orchestra.run.trial042.stdout:(3/37): libcephfs-daemon-20.3.0-5161.g2401a109. 550 kB/s | 35 kB 00:00 2026-02-12T08:42:49.683 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 36/39 2026-02-12T08:42:49.683 INFO:teuthology.orchestra.run.trial131.stdout:skipping the directory /sys 2026-02-12T08:42:49.683 INFO:teuthology.orchestra.run.trial131.stdout:skipping the directory /proc 2026-02-12T08:42:49.683 INFO:teuthology.orchestra.run.trial131.stdout:skipping the directory /mnt 2026-02-12T08:42:49.683 INFO:teuthology.orchestra.run.trial131.stdout:skipping the directory /var/tmp 2026-02-12T08:42:49.683 INFO:teuthology.orchestra.run.trial131.stdout:skipping the directory /home 2026-02-12T08:42:49.683 INFO:teuthology.orchestra.run.trial131.stdout:skipping the directory /root 2026-02-12T08:42:49.683 INFO:teuthology.orchestra.run.trial131.stdout:skipping the directory /tmp 2026-02-12T08:42:49.683 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:42:49.724 INFO:teuthology.orchestra.run.trial042.stdout:(4/37): libcephfs-proxy2-20.3.0-5161.g2401a109. 377 kB/s | 24 kB 00:00 2026-02-12T08:42:49.931 INFO:teuthology.orchestra.run.trial042.stdout:(5/37): libcephfs2-20.3.0-5161.g2401a109.el9.x8 4.1 MB/s | 860 kB 00:00 2026-02-12T08:42:50.000 INFO:teuthology.orchestra.run.trial042.stdout:(6/37): libradosstriper1-20.3.0-5161.g2401a109. 3.7 MB/s | 263 kB 00:00 2026-02-12T08:42:50.176 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 37/39 2026-02-12T08:42:50.199 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 37/39 2026-02-12T08:42:50.200 INFO:teuthology.orchestra.run.trial131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:42:50.200 INFO:teuthology.orchestra.run.trial131.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T08:42:50.200 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T08:42:50.200 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T08:42:50.200 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:42:50.202 INFO:teuthology.orchestra.run.trial131.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T08:42:50.214 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T08:42:50.214 INFO:teuthology.orchestra.run.trial131.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T08:42:50.270 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T08:42:50.270 INFO:teuthology.orchestra.run.trial131.stdout:Creating group 'qat' with GID 992. 2026-02-12T08:42:50.270 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:42:50.564 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 1/39 2026-02-12T08:42:50.564 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 2/39 2026-02-12T08:42:50.564 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 3/39 2026-02-12T08:42:50.564 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 4/39 2026-02-12T08:42:50.564 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libcephfs-daemon-2:20.3.0-5161.g2401a109.el9.x86_6 5/39 2026-02-12T08:42:50.564 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86_6 6/39 2026-02-12T08:42:50.564 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 7/39 2026-02-12T08:42:50.564 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86_6 8/39 2026-02-12T08:42:50.564 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 9/39 2026-02-12T08:42:50.564 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5161.g2401a109.el9. 10/39 2026-02-12T08:42:50.565 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-ceph-common-2:20.3.0-5161.g2401a109.el9.x8 11/39 2026-02-12T08:42:50.565 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 12/39 2026-02-12T08:42:50.565 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 13/39 2026-02-12T08:42:50.565 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 14/39 2026-02-12T08:42:50.565 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 15/39 2026-02-12T08:42:50.565 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-12T08:42:50.565 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-12T08:42:50.565 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-12T08:42:50.565 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-12T08:42:50.565 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T08:42:50.565 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-12T08:42:50.565 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-12T08:42:50.565 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-12T08:42:50.566 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-12T08:42:50.566 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-12T08:42:50.566 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-12T08:42:50.566 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-12T08:42:50.566 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-12T08:42:50.566 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-12T08:42:50.566 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-12T08:42:50.566 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-12T08:42:50.566 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-12T08:42:50.566 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-12T08:42:50.566 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-12T08:42:50.566 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-12T08:42:50.566 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : librados2-2:20.3.0-5161.g2401a109.el9.x86_64 36/39 2026-02-12T08:42:50.567 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-12T08:42:50.567 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 38/39 2026-02-12T08:42:50.627 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T08:42:50.627 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:42:50.627 INFO:teuthology.orchestra.run.trial131.stdout:Upgraded: 2026-02-12T08:42:50.627 INFO:teuthology.orchestra.run.trial131.stdout: librados2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:50.627 INFO:teuthology.orchestra.run.trial131.stdout: librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:50.628 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-12T08:42:50.628 INFO:teuthology.orchestra.run.trial131.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T08:42:50.628 INFO:teuthology.orchestra.run.trial131.stdout: ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:50.628 INFO:teuthology.orchestra.run.trial131.stdout: ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:50.628 INFO:teuthology.orchestra.run.trial131.stdout: ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:50.628 INFO:teuthology.orchestra.run.trial131.stdout: ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:50.628 INFO:teuthology.orchestra.run.trial131.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T08:42:50.628 INFO:teuthology.orchestra.run.trial131.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T08:42:50.628 INFO:teuthology.orchestra.run.trial131.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T08:42:50.628 INFO:teuthology.orchestra.run.trial131.stdout: libcephfs-daemon-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:50.628 INFO:teuthology.orchestra.run.trial131.stdout: libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:50.629 INFO:teuthology.orchestra.run.trial131.stdout: libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:50.629 INFO:teuthology.orchestra.run.trial131.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T08:42:50.629 INFO:teuthology.orchestra.run.trial131.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T08:42:50.629 INFO:teuthology.orchestra.run.trial131.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T08:42:50.629 INFO:teuthology.orchestra.run.trial131.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T08:42:50.629 INFO:teuthology.orchestra.run.trial131.stdout: libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:50.629 INFO:teuthology.orchestra.run.trial131.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T08:42:50.629 INFO:teuthology.orchestra.run.trial131.stdout: librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:50.629 INFO:teuthology.orchestra.run.trial131.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T08:42:50.629 INFO:teuthology.orchestra.run.trial131.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T08:42:50.629 INFO:teuthology.orchestra.run.trial131.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T08:42:50.629 INFO:teuthology.orchestra.run.trial131.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-12T08:42:50.629 INFO:teuthology.orchestra.run.trial131.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T08:42:50.630 INFO:teuthology.orchestra.run.trial131.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T08:42:50.630 INFO:teuthology.orchestra.run.trial131.stdout: python3-ceph-argparse-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:50.630 INFO:teuthology.orchestra.run.trial131.stdout: python3-ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:50.630 INFO:teuthology.orchestra.run.trial131.stdout: python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:50.630 INFO:teuthology.orchestra.run.trial131.stdout: python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:50.630 INFO:teuthology.orchestra.run.trial131.stdout: python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:50.630 INFO:teuthology.orchestra.run.trial131.stdout: python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:50.630 INFO:teuthology.orchestra.run.trial131.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T08:42:50.630 INFO:teuthology.orchestra.run.trial131.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T08:42:50.630 INFO:teuthology.orchestra.run.trial131.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T08:42:50.630 INFO:teuthology.orchestra.run.trial131.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T08:42:50.630 INFO:teuthology.orchestra.run.trial131.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T08:42:50.630 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:42:50.631 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:42:50.673 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-test 2026-02-12T08:42:50.977 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:22 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:42:51.060 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:42:51.061 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:42:51.061 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repository Size 2026-02-12T08:42:51.061 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:42:51.061 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-12T08:42:51.062 INFO:teuthology.orchestra.run.trial131.stdout: ceph-test x86_64 2:20.3.0-5161.g2401a109.el9 ceph 126 M 2026-02-12T08:42:51.062 INFO:teuthology.orchestra.run.trial131.stdout:Installing dependencies: 2026-02-12T08:42:51.062 INFO:teuthology.orchestra.run.trial131.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-12T08:42:51.062 INFO:teuthology.orchestra.run.trial131.stdout: libasan8 x86_64 15.1.1-2.5.el9 appstream 523 k 2026-02-12T08:42:51.062 INFO:teuthology.orchestra.run.trial131.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-12T08:42:51.062 INFO:teuthology.orchestra.run.trial131.stdout: libcephsqlite x86_64 2:20.3.0-5161.g2401a109.el9 ceph 153 k 2026-02-12T08:42:51.062 INFO:teuthology.orchestra.run.trial131.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-12T08:42:51.062 INFO:teuthology.orchestra.run.trial131.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T08:42:51.062 INFO:teuthology.orchestra.run.trial131.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-12T08:42:51.062 INFO:teuthology.orchestra.run.trial131.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T08:42:51.062 INFO:teuthology.orchestra.run.trial131.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T08:42:51.062 INFO:teuthology.orchestra.run.trial131.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T08:42:51.063 INFO:teuthology.orchestra.run.trial131.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-12T08:42:51.063 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:42:51.063 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-12T08:42:51.063 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:42:51.063 INFO:teuthology.orchestra.run.trial131.stdout:Install 12 Packages 2026-02-12T08:42:51.063 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:42:51.064 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 131 M 2026-02-12T08:42:51.064 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 976 M 2026-02-12T08:42:51.064 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-12T08:42:51.642 INFO:teuthology.orchestra.run.trial042.stdout:(7/37): librgw2-20.3.0-5161.g2401a109.el9.x86_6 3.4 MB/s | 5.6 MB 00:01 2026-02-12T08:42:51.708 INFO:teuthology.orchestra.run.trial042.stdout:(8/37): python3-ceph-argparse-20.3.0-5161.g2401 687 kB/s | 45 kB 00:00 2026-02-12T08:42:51.842 INFO:teuthology.orchestra.run.trial042.stdout:(9/37): python3-ceph-common-20.3.0-5161.g2401a1 1.3 MB/s | 184 kB 00:00 2026-02-12T08:42:51.977 INFO:teuthology.orchestra.run.trial042.stdout:(10/37): python3-cephfs-20.3.0-5161.g2401a109.e 1.5 MB/s | 204 kB 00:00 2026-02-12T08:42:52.118 INFO:teuthology.orchestra.run.trial042.stdout:(11/37): python3-rados-20.3.0-5161.g2401a109.el 2.3 MB/s | 323 kB 00:00 2026-02-12T08:42:52.229 INFO:teuthology.orchestra.run.trial131.stdout:(1/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 63 MB/s | 2.1 MB 00:00 2026-02-12T08:42:52.233 INFO:teuthology.orchestra.run.trial131.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 5.4 MB/s | 23 kB 00:00 2026-02-12T08:42:52.238 INFO:teuthology.orchestra.run.trial131.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 19 MB/s | 94 kB 00:00 2026-02-12T08:42:52.322 INFO:teuthology.orchestra.run.trial042.stdout:(12/37): python3-rbd-20.3.0-5161.g2401a109.el9. 1.5 MB/s | 305 kB 00:00 2026-02-12T08:42:52.389 INFO:teuthology.orchestra.run.trial042.stdout:(13/37): python3-rgw-20.3.0-5161.g2401a109.el9. 1.5 MB/s | 100 kB 00:00 2026-02-12T08:42:52.419 INFO:teuthology.orchestra.run.trial131.stdout:(4/12): libasan8-15.1.1-2.5.el9.x86_64.rpm 2.8 MB/s | 523 kB 00:00 2026-02-12T08:42:52.470 INFO:teuthology.orchestra.run.trial042.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 409 kB/s | 33 kB 00:00 2026-02-12T08:42:52.473 INFO:teuthology.orchestra.run.trial131.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 3.2 MB/s | 176 kB 00:00 2026-02-12T08:42:52.527 INFO:teuthology.orchestra.run.trial131.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 4.2 MB/s | 233 kB 00:00 2026-02-12T08:42:52.603 INFO:teuthology.orchestra.run.trial131.stdout:(7/12): protobuf-3.14.0-17.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2026-02-12T08:42:52.620 INFO:teuthology.orchestra.run.trial042.stdout:(15/37): nvme-cli-2.13-1.el9.x86_64.rpm 7.3 MB/s | 1.1 MB 00:00 2026-02-12T08:42:52.646 INFO:teuthology.orchestra.run.trial042.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 3.5 MB/s | 93 kB 00:00 2026-02-12T08:42:52.690 INFO:teuthology.orchestra.run.trial131.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 3.4 MB/s | 303 kB 00:00 2026-02-12T08:42:52.761 INFO:teuthology.orchestra.run.trial131.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 898 kB/s | 64 kB 00:00 2026-02-12T08:42:52.766 INFO:teuthology.orchestra.run.trial042.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 867 kB/s | 104 kB 00:00 2026-02-12T08:42:52.812 INFO:teuthology.orchestra.run.trial042.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 3.5 MB/s | 164 kB 00:00 2026-02-12T08:42:52.834 INFO:teuthology.orchestra.run.trial131.stdout:(10/12): libcephsqlite-20.3.0-5161.g2401a109.el 240 kB/s | 153 kB 00:00 2026-02-12T08:42:52.875 INFO:teuthology.orchestra.run.trial042.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.5 MB/s | 160 kB 00:00 2026-02-12T08:42:52.898 INFO:teuthology.orchestra.run.trial042.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.9 MB/s | 45 kB 00:00 2026-02-12T08:42:52.946 INFO:teuthology.orchestra.run.trial042.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 14 MB/s | 662 kB 00:00 2026-02-12T08:42:52.972 INFO:teuthology.orchestra.run.trial042.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 11 MB/s | 292 kB 00:00 2026-02-12T08:42:53.011 INFO:teuthology.orchestra.run.trial042.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 5.9 MB/s | 240 kB 00:00 2026-02-12T08:42:53.035 INFO:teuthology.orchestra.run.trial042.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.6 MB/s | 37 kB 00:00 2026-02-12T08:42:53.058 INFO:teuthology.orchestra.run.trial042.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.7 MB/s | 66 kB 00:00 2026-02-12T08:42:53.086 INFO:teuthology.orchestra.run.trial042.stdout:(26/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 11 MB/s | 308 kB 00:00 2026-02-12T08:42:53.201 INFO:teuthology.orchestra.run.trial131.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 276 kB/s | 122 kB 00:00 2026-02-12T08:42:53.448 INFO:teuthology.orchestra.run.trial042.stdout:(27/37): libarrow-9.0.0-15.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2026-02-12T08:42:53.455 INFO:teuthology.orchestra.run.trial042.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 3.6 MB/s | 25 kB 00:00 2026-02-12T08:42:53.462 INFO:teuthology.orchestra.run.trial042.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 6.7 MB/s | 49 kB 00:00 2026-02-12T08:42:53.469 INFO:teuthology.orchestra.run.trial042.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 9.8 MB/s | 67 kB 00:00 2026-02-12T08:42:53.478 INFO:teuthology.orchestra.run.trial042.stdout:(31/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 89 MB/s | 838 kB 00:00 2026-02-12T08:42:53.485 INFO:teuthology.orchestra.run.trial042.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 28 MB/s | 191 kB 00:00 2026-02-12T08:42:53.496 INFO:teuthology.orchestra.run.trial042.stdout:(33/37): thrift-0.15.0-4.el9.x86_64.rpm 138 MB/s | 1.6 MB 00:00 2026-02-12T08:42:55.886 INFO:teuthology.orchestra.run.trial042.stdout:(34/37): ceph-base-20.3.0-5161.g2401a109.el9.x8 563 kB/s | 5.1 MB 00:09 2026-02-12T08:42:56.521 INFO:teuthology.orchestra.run.trial042.stdout:(35/37): librados2-20.3.0-5161.g2401a109.el9.x8 1.1 MB/s | 3.3 MB 00:03 2026-02-12T08:42:58.723 INFO:teuthology.orchestra.run.trial042.stdout:(36/37): librbd1-20.3.0-5161.g2401a109.el9.x86_ 970 kB/s | 2.7 MB 00:02 2026-02-12T08:43:08.427 INFO:teuthology.orchestra.run.trial042.stdout:(37/37): ceph-common-20.3.0-5161.g2401a109.el9. 976 kB/s | 21 MB 00:21 2026-02-12T08:43:08.429 INFO:teuthology.orchestra.run.trial042.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:43:08.429 INFO:teuthology.orchestra.run.trial042.stdout:Total 2.8 MB/s | 61 MB 00:22 2026-02-12T08:43:08.525 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction check 2026-02-12T08:43:08.543 INFO:teuthology.orchestra.run.trial042.stdout:Transaction check succeeded. 2026-02-12T08:43:08.543 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction test 2026-02-12T08:43:08.789 INFO:teuthology.orchestra.run.trial042.stdout:Transaction test succeeded. 2026-02-12T08:43:08.790 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction 2026-02-12T08:43:09.091 INFO:teuthology.orchestra.run.trial042.stdout: Preparing : 1/1 2026-02-12T08:43:09.232 INFO:teuthology.orchestra.run.trial042.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-12T08:43:09.237 INFO:teuthology.orchestra.run.trial042.stdout: Upgrading : librados2-2:20.3.0-5161.g2401a109.el9.x86_64 2/39 2026-02-12T08:43:09.286 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: librados2-2:20.3.0-5161.g2401a109.el9.x86_64 2/39 2026-02-12T08:43:09.287 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 3/39 2026-02-12T08:43:09.299 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 3/39 2026-02-12T08:43:09.302 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libcephfs-daemon-2:20.3.0-5161.g2401a109.el9.x86_6 4/39 2026-02-12T08:43:09.302 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86_6 5/39 2026-02-12T08:43:09.330 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86_6 5/39 2026-02-12T08:43:09.333 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 6/39 2026-02-12T08:43:09.341 INFO:teuthology.orchestra.run.trial042.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-12T08:43:09.343 INFO:teuthology.orchestra.run.trial042.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-12T08:43:09.346 INFO:teuthology.orchestra.run.trial042.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-12T08:43:09.350 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-12T08:43:09.363 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-ceph-argparse-2:20.3.0-5161.g2401a109.el9. 11/39 2026-02-12T08:43:09.376 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 12/39 2026-02-12T08:43:09.377 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86_6 13/39 2026-02-12T08:43:09.399 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86_6 13/39 2026-02-12T08:43:09.403 INFO:teuthology.orchestra.run.trial042.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-12T08:43:09.434 INFO:teuthology.orchestra.run.trial042.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-12T08:43:09.439 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-12T08:43:09.445 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-12T08:43:09.447 INFO:teuthology.orchestra.run.trial042.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-12T08:43:09.452 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-12T08:43:09.567 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T08:43:09.568 INFO:teuthology.orchestra.run.trial042.stdout: Upgrading : librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 21/39 2026-02-12T08:43:09.594 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 21/39 2026-02-12T08:43:09.598 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 22/39 2026-02-12T08:43:09.605 INFO:teuthology.orchestra.run.trial042.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-12T08:43:09.854 INFO:teuthology.orchestra.run.trial042.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-12T08:43:09.855 INFO:teuthology.orchestra.run.trial042.stdout: Installing : librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 25/39 2026-02-12T08:43:09.871 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 25/39 2026-02-12T08:43:09.875 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 26/39 2026-02-12T08:43:09.879 INFO:teuthology.orchestra.run.trial042.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-12T08:43:09.882 INFO:teuthology.orchestra.run.trial042.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-12T08:43:09.882 INFO:teuthology.orchestra.run.trial042.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T08:43:09.900 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T08:43:10.015 INFO:teuthology.orchestra.run.trial042.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-12T08:43:10.018 INFO:teuthology.orchestra.run.trial042.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T08:43:10.307 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T08:43:10.308 INFO:teuthology.orchestra.run.trial042.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T08:43:10.308 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:43:10.352 INFO:teuthology.orchestra.run.trial042.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-12T08:43:10.354 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-ceph-common-2:20.3.0-5161.g2401a109.el9.x8 33/39 2026-02-12T08:43:11.295 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 34/39 2026-02-12T08:43:11.298 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 34/39 2026-02-12T08:43:11.557 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 34/39 2026-02-12T08:43:11.561 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 35/39 2026-02-12T08:43:11.601 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 35/39 2026-02-12T08:43:11.601 INFO:teuthology.orchestra.run.trial042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T08:43:11.601 INFO:teuthology.orchestra.run.trial042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T08:43:11.601 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:43:11.605 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 36/39 2026-02-12T08:43:16.092 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 36/39 2026-02-12T08:43:16.092 INFO:teuthology.orchestra.run.trial042.stdout:skipping the directory /sys 2026-02-12T08:43:16.092 INFO:teuthology.orchestra.run.trial042.stdout:skipping the directory /proc 2026-02-12T08:43:16.093 INFO:teuthology.orchestra.run.trial042.stdout:skipping the directory /mnt 2026-02-12T08:43:16.093 INFO:teuthology.orchestra.run.trial042.stdout:skipping the directory /var/tmp 2026-02-12T08:43:16.093 INFO:teuthology.orchestra.run.trial042.stdout:skipping the directory /home 2026-02-12T08:43:16.093 INFO:teuthology.orchestra.run.trial042.stdout:skipping the directory /root 2026-02-12T08:43:16.093 INFO:teuthology.orchestra.run.trial042.stdout:skipping the directory /tmp 2026-02-12T08:43:16.093 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:43:16.585 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 37/39 2026-02-12T08:43:16.608 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 37/39 2026-02-12T08:43:16.608 INFO:teuthology.orchestra.run.trial042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:16.608 INFO:teuthology.orchestra.run.trial042.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T08:43:16.608 INFO:teuthology.orchestra.run.trial042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T08:43:16.608 INFO:teuthology.orchestra.run.trial042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T08:43:16.608 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:43:16.610 INFO:teuthology.orchestra.run.trial042.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T08:43:16.621 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T08:43:16.621 INFO:teuthology.orchestra.run.trial042.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T08:43:16.674 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T08:43:16.675 INFO:teuthology.orchestra.run.trial042.stdout:Creating group 'qat' with GID 992. 2026-02-12T08:43:16.675 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 1/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 2/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 3/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 4/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libcephfs-daemon-2:20.3.0-5161.g2401a109.el9.x86_6 5/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86_6 6/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 7/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86_6 8/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 9/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5161.g2401a109.el9. 10/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-ceph-common-2:20.3.0-5161.g2401a109.el9.x8 11/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 12/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 13/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 14/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 15/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-12T08:43:16.967 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-12T08:43:16.968 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-12T08:43:16.968 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-12T08:43:16.968 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-12T08:43:16.968 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-12T08:43:16.968 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-12T08:43:16.968 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-12T08:43:16.968 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : librados2-2:20.3.0-5161.g2401a109.el9.x86_64 36/39 2026-02-12T08:43:16.968 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-12T08:43:16.968 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 38/39 2026-02-12T08:43:17.030 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T08:43:17.031 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:43:17.031 INFO:teuthology.orchestra.run.trial042.stdout:Upgraded: 2026-02-12T08:43:17.031 INFO:teuthology.orchestra.run.trial042.stdout: librados2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:17.031 INFO:teuthology.orchestra.run.trial042.stdout: librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:17.031 INFO:teuthology.orchestra.run.trial042.stdout:Installed: 2026-02-12T08:43:17.031 INFO:teuthology.orchestra.run.trial042.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T08:43:17.031 INFO:teuthology.orchestra.run.trial042.stdout: ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:17.031 INFO:teuthology.orchestra.run.trial042.stdout: ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:17.031 INFO:teuthology.orchestra.run.trial042.stdout: ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:17.031 INFO:teuthology.orchestra.run.trial042.stdout: ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:17.031 INFO:teuthology.orchestra.run.trial042.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T08:43:17.032 INFO:teuthology.orchestra.run.trial042.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T08:43:17.032 INFO:teuthology.orchestra.run.trial042.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T08:43:17.032 INFO:teuthology.orchestra.run.trial042.stdout: libcephfs-daemon-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:17.032 INFO:teuthology.orchestra.run.trial042.stdout: libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:17.032 INFO:teuthology.orchestra.run.trial042.stdout: libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:17.032 INFO:teuthology.orchestra.run.trial042.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T08:43:17.032 INFO:teuthology.orchestra.run.trial042.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T08:43:17.032 INFO:teuthology.orchestra.run.trial042.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T08:43:17.032 INFO:teuthology.orchestra.run.trial042.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T08:43:17.032 INFO:teuthology.orchestra.run.trial042.stdout: libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:17.032 INFO:teuthology.orchestra.run.trial042.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T08:43:17.032 INFO:teuthology.orchestra.run.trial042.stdout: librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:17.033 INFO:teuthology.orchestra.run.trial042.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T08:43:17.033 INFO:teuthology.orchestra.run.trial042.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T08:43:17.033 INFO:teuthology.orchestra.run.trial042.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T08:43:17.033 INFO:teuthology.orchestra.run.trial042.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-12T08:43:17.033 INFO:teuthology.orchestra.run.trial042.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T08:43:17.033 INFO:teuthology.orchestra.run.trial042.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T08:43:17.033 INFO:teuthology.orchestra.run.trial042.stdout: python3-ceph-argparse-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:17.033 INFO:teuthology.orchestra.run.trial042.stdout: python3-ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:17.033 INFO:teuthology.orchestra.run.trial042.stdout: python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:17.033 INFO:teuthology.orchestra.run.trial042.stdout: python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:17.033 INFO:teuthology.orchestra.run.trial042.stdout: python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:17.033 INFO:teuthology.orchestra.run.trial042.stdout: python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:17.033 INFO:teuthology.orchestra.run.trial042.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T08:43:17.033 INFO:teuthology.orchestra.run.trial042.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T08:43:17.034 INFO:teuthology.orchestra.run.trial042.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T08:43:17.034 INFO:teuthology.orchestra.run.trial042.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T08:43:17.034 INFO:teuthology.orchestra.run.trial042.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T08:43:17.034 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:43:17.034 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:43:17.073 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-test 2026-02-12T08:43:17.383 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:32 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:43:17.466 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:43:17.467 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:43:17.467 INFO:teuthology.orchestra.run.trial042.stdout: Package Arch Version Repository Size 2026-02-12T08:43:17.467 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:43:17.467 INFO:teuthology.orchestra.run.trial042.stdout:Installing: 2026-02-12T08:43:17.467 INFO:teuthology.orchestra.run.trial042.stdout: ceph-test x86_64 2:20.3.0-5161.g2401a109.el9 ceph 126 M 2026-02-12T08:43:17.467 INFO:teuthology.orchestra.run.trial042.stdout:Installing dependencies: 2026-02-12T08:43:17.467 INFO:teuthology.orchestra.run.trial042.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-12T08:43:17.468 INFO:teuthology.orchestra.run.trial042.stdout: libasan8 x86_64 15.1.1-2.5.el9 appstream 523 k 2026-02-12T08:43:17.468 INFO:teuthology.orchestra.run.trial042.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-12T08:43:17.468 INFO:teuthology.orchestra.run.trial042.stdout: libcephsqlite x86_64 2:20.3.0-5161.g2401a109.el9 ceph 153 k 2026-02-12T08:43:17.468 INFO:teuthology.orchestra.run.trial042.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-12T08:43:17.468 INFO:teuthology.orchestra.run.trial042.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T08:43:17.468 INFO:teuthology.orchestra.run.trial042.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-12T08:43:17.468 INFO:teuthology.orchestra.run.trial042.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T08:43:17.468 INFO:teuthology.orchestra.run.trial042.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T08:43:17.468 INFO:teuthology.orchestra.run.trial042.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T08:43:17.468 INFO:teuthology.orchestra.run.trial042.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-12T08:43:17.468 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:43:17.469 INFO:teuthology.orchestra.run.trial042.stdout:Transaction Summary 2026-02-12T08:43:17.469 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:43:17.469 INFO:teuthology.orchestra.run.trial042.stdout:Install 12 Packages 2026-02-12T08:43:17.469 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:43:17.470 INFO:teuthology.orchestra.run.trial042.stdout:Total download size: 131 M 2026-02-12T08:43:17.470 INFO:teuthology.orchestra.run.trial042.stdout:Installed size: 976 M 2026-02-12T08:43:17.470 INFO:teuthology.orchestra.run.trial042.stdout:Downloading Packages: 2026-02-12T08:43:17.945 INFO:teuthology.orchestra.run.trial042.stdout:(1/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 64 MB/s | 2.1 MB 00:00 2026-02-12T08:43:17.949 INFO:teuthology.orchestra.run.trial042.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 5.4 MB/s | 23 kB 00:00 2026-02-12T08:43:17.954 INFO:teuthology.orchestra.run.trial042.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 18 MB/s | 94 kB 00:00 2026-02-12T08:43:18.061 INFO:teuthology.orchestra.run.trial042.stdout:(4/12): libasan8-15.1.1-2.5.el9.x86_64.rpm 4.8 MB/s | 523 kB 00:00 2026-02-12T08:43:18.084 INFO:teuthology.orchestra.run.trial042.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 7.3 MB/s | 176 kB 00:00 2026-02-12T08:43:18.108 INFO:teuthology.orchestra.run.trial042.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 9.6 MB/s | 233 kB 00:00 2026-02-12T08:43:18.163 INFO:teuthology.orchestra.run.trial042.stdout:(7/12): protobuf-3.14.0-17.el9.x86_64.rpm 18 MB/s | 1.0 MB 00:00 2026-02-12T08:43:18.187 INFO:teuthology.orchestra.run.trial042.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 12 MB/s | 303 kB 00:00 2026-02-12T08:43:18.209 INFO:teuthology.orchestra.run.trial042.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.8 MB/s | 64 kB 00:00 2026-02-12T08:43:18.480 INFO:teuthology.orchestra.run.trial042.stdout:(10/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 451 kB/s | 122 kB 00:00 2026-02-12T08:43:18.798 INFO:teuthology.orchestra.run.trial042.stdout:(11/12): libcephsqlite-20.3.0-5161.g2401a109.el 173 kB/s | 153 kB 00:00 2026-02-12T08:44:41.112 INFO:teuthology.orchestra.run.trial131.stdout:(12/12): ceph-test-20.3.0-5161.g2401a109.el9.x8 1.2 MB/s | 126 MB 01:48 2026-02-12T08:44:41.114 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:44:41.114 INFO:teuthology.orchestra.run.trial131.stdout:Total 1.2 MB/s | 131 MB 01:50 2026-02-12T08:44:41.183 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-12T08:44:41.194 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-12T08:44:41.194 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-12T08:44:41.620 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-12T08:44:41.620 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-12T08:44:42.074 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-12T08:44:42.082 INFO:teuthology.orchestra.run.trial131.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-12T08:44:42.091 INFO:teuthology.orchestra.run.trial131.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-12T08:44:42.096 INFO:teuthology.orchestra.run.trial131.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-12T08:44:42.100 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-12T08:44:42.103 INFO:teuthology.orchestra.run.trial131.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-12T08:44:42.107 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-12T08:44:42.108 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libasan8-15.1.1-2.5.el9.x86_64 7/12 2026-02-12T08:44:42.125 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: libasan8-15.1.1-2.5.el9.x86_64 7/12 2026-02-12T08:44:42.127 INFO:teuthology.orchestra.run.trial131.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-12T08:44:42.137 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-12T08:44:42.145 INFO:teuthology.orchestra.run.trial131.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-12T08:44:42.145 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 11/12 2026-02-12T08:44:49.010 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 11/12 2026-02-12T08:44:49.028 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 12/12 2026-02-12T08:44:49.822 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 12/12 2026-02-12T08:44:49.822 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 1/12 2026-02-12T08:44:49.822 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 2/12 2026-02-12T08:44:49.822 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-12T08:44:49.822 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-12T08:44:49.822 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-12T08:44:49.822 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libasan8-15.1.1-2.5.el9.x86_64 6/12 2026-02-12T08:44:49.822 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-12T08:44:49.822 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-12T08:44:49.822 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-12T08:44:49.822 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-12T08:44:49.822 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-12T08:44:49.875 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-12T08:44:49.875 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:44:49.875 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-12T08:44:49.875 INFO:teuthology.orchestra.run.trial131.stdout: ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:49.876 INFO:teuthology.orchestra.run.trial131.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-12T08:44:49.876 INFO:teuthology.orchestra.run.trial131.stdout: libasan8-15.1.1-2.5.el9.x86_64 2026-02-12T08:44:49.876 INFO:teuthology.orchestra.run.trial131.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-12T08:44:49.876 INFO:teuthology.orchestra.run.trial131.stdout: libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:49.876 INFO:teuthology.orchestra.run.trial131.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-12T08:44:49.876 INFO:teuthology.orchestra.run.trial131.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T08:44:49.876 INFO:teuthology.orchestra.run.trial131.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-12T08:44:49.876 INFO:teuthology.orchestra.run.trial131.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T08:44:49.876 INFO:teuthology.orchestra.run.trial131.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T08:44:49.876 INFO:teuthology.orchestra.run.trial131.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T08:44:49.877 INFO:teuthology.orchestra.run.trial131.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-12T08:44:49.877 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:44:49.877 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:44:49.917 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph 2026-02-12T08:44:50.216 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:02:22 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:44:50.301 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:44:50.304 INFO:teuthology.orchestra.run.trial131.stdout:======================================================================================= 2026-02-12T08:44:50.304 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repository Size 2026-02-12T08:44:50.305 INFO:teuthology.orchestra.run.trial131.stdout:======================================================================================= 2026-02-12T08:44:50.305 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-12T08:44:50.305 INFO:teuthology.orchestra.run.trial131.stdout: ceph x86_64 2:20.3.0-5161.g2401a109.el9 ceph 6.5 k 2026-02-12T08:44:50.305 INFO:teuthology.orchestra.run.trial131.stdout:Installing dependencies: 2026-02-12T08:44:50.305 INFO:teuthology.orchestra.run.trial131.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T08:44:50.305 INFO:teuthology.orchestra.run.trial131.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 57 k 2026-02-12T08:44:50.305 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mds x86_64 2:20.3.0-5161.g2401a109.el9 ceph 2.0 M 2026-02-12T08:44:50.305 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr x86_64 2:20.3.0-5161.g2401a109.el9 ceph 937 k 2026-02-12T08:44:50.305 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 297 k 2026-02-12T08:44:50.305 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mon x86_64 2:20.3.0-5161.g2401a109.el9 ceph 4.8 M 2026-02-12T08:44:50.306 INFO:teuthology.orchestra.run.trial131.stdout: ceph-osd x86_64 2:20.3.0-5161.g2401a109.el9 ceph 163 k 2026-02-12T08:44:50.306 INFO:teuthology.orchestra.run.trial131.stdout: ceph-osd-classic x86_64 2:20.3.0-5161.g2401a109.el9 ceph 15 M 2026-02-12T08:44:50.306 INFO:teuthology.orchestra.run.trial131.stdout: ceph-osd-crimson x86_64 2:20.3.0-5161.g2401a109.el9 ceph 87 M 2026-02-12T08:44:50.306 INFO:teuthology.orchestra.run.trial131.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 17 k 2026-02-12T08:44:50.306 INFO:teuthology.orchestra.run.trial131.stdout: cephadm noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 1.0 M 2026-02-12T08:44:50.306 INFO:teuthology.orchestra.run.trial131.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T08:44:50.306 INFO:teuthology.orchestra.run.trial131.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T08:44:50.306 INFO:teuthology.orchestra.run.trial131.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T08:44:50.306 INFO:teuthology.orchestra.run.trial131.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T08:44:50.306 INFO:teuthology.orchestra.run.trial131.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T08:44:50.306 INFO:teuthology.orchestra.run.trial131.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T08:44:50.307 INFO:teuthology.orchestra.run.trial131.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T08:44:50.307 INFO:teuthology.orchestra.run.trial131.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T08:44:50.307 INFO:teuthology.orchestra.run.trial131.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T08:44:50.307 INFO:teuthology.orchestra.run.trial131.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T08:44:50.307 INFO:teuthology.orchestra.run.trial131.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T08:44:50.307 INFO:teuthology.orchestra.run.trial131.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T08:44:50.307 INFO:teuthology.orchestra.run.trial131.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T08:44:50.307 INFO:teuthology.orchestra.run.trial131.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T08:44:50.307 INFO:teuthology.orchestra.run.trial131.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T08:44:50.307 INFO:teuthology.orchestra.run.trial131.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T08:44:50.307 INFO:teuthology.orchestra.run.trial131.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T08:44:50.307 INFO:teuthology.orchestra.run.trial131.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T08:44:50.308 INFO:teuthology.orchestra.run.trial131.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T08:44:50.308 INFO:teuthology.orchestra.run.trial131.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T08:44:50.308 INFO:teuthology.orchestra.run.trial131.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T08:44:50.308 INFO:teuthology.orchestra.run.trial131.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T08:44:50.308 INFO:teuthology.orchestra.run.trial131.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T08:44:50.308 INFO:teuthology.orchestra.run.trial131.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T08:44:50.308 INFO:teuthology.orchestra.run.trial131.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T08:44:50.308 INFO:teuthology.orchestra.run.trial131.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T08:44:50.308 INFO:teuthology.orchestra.run.trial131.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T08:44:50.308 INFO:teuthology.orchestra.run.trial131.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T08:44:50.308 INFO:teuthology.orchestra.run.trial131.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T08:44:50.309 INFO:teuthology.orchestra.run.trial131.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T08:44:50.309 INFO:teuthology.orchestra.run.trial131.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T08:44:50.309 INFO:teuthology.orchestra.run.trial131.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-12T08:44:50.309 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T08:44:50.309 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T08:44:50.309 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-12T08:44:50.309 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T08:44:50.309 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T08:44:50.309 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T08:44:50.309 INFO:teuthology.orchestra.run.trial131.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T08:44:50.309 INFO:teuthology.orchestra.run.trial131.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T08:44:50.309 INFO:teuthology.orchestra.run.trial131.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T08:44:50.310 INFO:teuthology.orchestra.run.trial131.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T08:44:50.310 INFO:teuthology.orchestra.run.trial131.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-12T08:44:50.310 INFO:teuthology.orchestra.run.trial131.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T08:44:50.310 INFO:teuthology.orchestra.run.trial131.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T08:44:50.310 INFO:teuthology.orchestra.run.trial131.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-12T08:44:50.310 INFO:teuthology.orchestra.run.trial131.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T08:44:50.310 INFO:teuthology.orchestra.run.trial131.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T08:44:50.310 INFO:teuthology.orchestra.run.trial131.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T08:44:50.310 INFO:teuthology.orchestra.run.trial131.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T08:44:50.310 INFO:teuthology.orchestra.run.trial131.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T08:44:50.310 INFO:teuthology.orchestra.run.trial131.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T08:44:50.310 INFO:teuthology.orchestra.run.trial131.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T08:44:50.310 INFO:teuthology.orchestra.run.trial131.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T08:44:50.311 INFO:teuthology.orchestra.run.trial131.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T08:44:50.311 INFO:teuthology.orchestra.run.trial131.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T08:44:50.311 INFO:teuthology.orchestra.run.trial131.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T08:44:50.311 INFO:teuthology.orchestra.run.trial131.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T08:44:50.311 INFO:teuthology.orchestra.run.trial131.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T08:44:50.311 INFO:teuthology.orchestra.run.trial131.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T08:44:50.311 INFO:teuthology.orchestra.run.trial131.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T08:44:50.311 INFO:teuthology.orchestra.run.trial131.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T08:44:50.311 INFO:teuthology.orchestra.run.trial131.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T08:44:50.311 INFO:teuthology.orchestra.run.trial131.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T08:44:50.311 INFO:teuthology.orchestra.run.trial131.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T08:44:50.311 INFO:teuthology.orchestra.run.trial131.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T08:44:50.312 INFO:teuthology.orchestra.run.trial131.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T08:44:50.312 INFO:teuthology.orchestra.run.trial131.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T08:44:50.312 INFO:teuthology.orchestra.run.trial131.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T08:44:50.312 INFO:teuthology.orchestra.run.trial131.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-12T08:44:50.312 INFO:teuthology.orchestra.run.trial131.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T08:44:50.312 INFO:teuthology.orchestra.run.trial131.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T08:44:50.312 INFO:teuthology.orchestra.run.trial131.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T08:44:50.312 INFO:teuthology.orchestra.run.trial131.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-12T08:44:50.312 INFO:teuthology.orchestra.run.trial131.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-12T08:44:50.312 INFO:teuthology.orchestra.run.trial131.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T08:44:50.312 INFO:teuthology.orchestra.run.trial131.stdout:Installing weak dependencies: 2026-02-12T08:44:50.312 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 183 k 2026-02-12T08:44:50.313 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 15 M 2026-02-12T08:44:50.313 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 7.4 M 2026-02-12T08:44:50.313 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 22 k 2026-02-12T08:44:50.313 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-rook noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 50 k 2026-02-12T08:44:50.313 INFO:teuthology.orchestra.run.trial131.stdout: ceph-volume noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 299 k 2026-02-12T08:44:50.313 INFO:teuthology.orchestra.run.trial131.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-12T08:44:50.313 INFO:teuthology.orchestra.run.trial131.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-12T08:44:50.313 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:44:50.313 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-12T08:44:50.313 INFO:teuthology.orchestra.run.trial131.stdout:======================================================================================= 2026-02-12T08:44:50.313 INFO:teuthology.orchestra.run.trial131.stdout:Install 96 Packages 2026-02-12T08:44:50.313 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:44:50.314 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 189 M 2026-02-12T08:44:50.314 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 1.4 G 2026-02-12T08:44:50.315 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-12T08:44:51.178 INFO:teuthology.orchestra.run.trial042.stdout:(12/12): ceph-test-20.3.0-5161.g2401a109.el9.x8 1.4 MB/s | 126 MB 01:33 2026-02-12T08:44:51.179 INFO:teuthology.orchestra.run.trial042.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:44:51.179 INFO:teuthology.orchestra.run.trial042.stdout:Total 1.4 MB/s | 131 MB 01:33 2026-02-12T08:44:51.249 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction check 2026-02-12T08:44:51.261 INFO:teuthology.orchestra.run.trial042.stdout:Transaction check succeeded. 2026-02-12T08:44:51.261 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction test 2026-02-12T08:44:51.365 INFO:teuthology.orchestra.run.trial131.stdout:(1/96): ceph-20.3.0-5161.g2401a109.el9.x86_64.r 25 kB/s | 6.5 kB 00:00 2026-02-12T08:44:51.688 INFO:teuthology.orchestra.run.trial042.stdout:Transaction test succeeded. 2026-02-12T08:44:51.689 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction 2026-02-12T08:44:52.019 INFO:teuthology.orchestra.run.trial131.stdout:(2/96): ceph-mgr-20.3.0-5161.g2401a109.el9.x86_ 1.0 MB/s | 937 kB 00:00 2026-02-12T08:44:52.145 INFO:teuthology.orchestra.run.trial042.stdout: Preparing : 1/1 2026-02-12T08:44:52.153 INFO:teuthology.orchestra.run.trial131.stdout:(3/96): ceph-osd-20.3.0-5161.g2401a109.el9.x86_ 1.2 MB/s | 163 kB 00:00 2026-02-12T08:44:52.154 INFO:teuthology.orchestra.run.trial042.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-12T08:44:52.163 INFO:teuthology.orchestra.run.trial042.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-12T08:44:52.168 INFO:teuthology.orchestra.run.trial042.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-12T08:44:52.172 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-12T08:44:52.175 INFO:teuthology.orchestra.run.trial042.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-12T08:44:52.179 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-12T08:44:52.180 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libasan8-15.1.1-2.5.el9.x86_64 7/12 2026-02-12T08:44:52.197 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: libasan8-15.1.1-2.5.el9.x86_64 7/12 2026-02-12T08:44:52.199 INFO:teuthology.orchestra.run.trial042.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-12T08:44:52.210 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-12T08:44:52.218 INFO:teuthology.orchestra.run.trial042.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-12T08:44:52.219 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 11/12 2026-02-12T08:44:52.242 INFO:teuthology.orchestra.run.trial131.stdout:(4/96): ceph-mds-20.3.0-5161.g2401a109.el9.x86_ 1.8 MB/s | 2.0 MB 00:01 2026-02-12T08:44:53.847 INFO:teuthology.orchestra.run.trial131.stdout:(5/96): ceph-mon-20.3.0-5161.g2401a109.el9.x86_ 2.0 MB/s | 4.8 MB 00:02 2026-02-12T08:44:53.915 INFO:teuthology.orchestra.run.trial131.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5161.g24 841 kB/s | 57 kB 00:00 2026-02-12T08:44:54.053 INFO:teuthology.orchestra.run.trial131.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5161.g2401a109. 1.3 MB/s | 183 kB 00:00 2026-02-12T08:44:59.089 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 11/12 2026-02-12T08:44:59.107 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 12/12 2026-02-12T08:44:59.881 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 12/12 2026-02-12T08:44:59.882 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 1/12 2026-02-12T08:44:59.882 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 2/12 2026-02-12T08:44:59.882 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-12T08:44:59.882 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-12T08:44:59.882 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-12T08:44:59.882 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libasan8-15.1.1-2.5.el9.x86_64 6/12 2026-02-12T08:44:59.882 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-12T08:44:59.882 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-12T08:44:59.882 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-12T08:44:59.882 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-12T08:44:59.882 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-12T08:44:59.936 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-12T08:44:59.936 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:44:59.936 INFO:teuthology.orchestra.run.trial042.stdout:Installed: 2026-02-12T08:44:59.936 INFO:teuthology.orchestra.run.trial042.stdout: ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:59.936 INFO:teuthology.orchestra.run.trial042.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-12T08:44:59.936 INFO:teuthology.orchestra.run.trial042.stdout: libasan8-15.1.1-2.5.el9.x86_64 2026-02-12T08:44:59.936 INFO:teuthology.orchestra.run.trial042.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-12T08:44:59.937 INFO:teuthology.orchestra.run.trial042.stdout: libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:59.937 INFO:teuthology.orchestra.run.trial042.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-12T08:44:59.937 INFO:teuthology.orchestra.run.trial042.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T08:44:59.937 INFO:teuthology.orchestra.run.trial042.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-12T08:44:59.937 INFO:teuthology.orchestra.run.trial042.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T08:44:59.937 INFO:teuthology.orchestra.run.trial042.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T08:44:59.937 INFO:teuthology.orchestra.run.trial042.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T08:44:59.937 INFO:teuthology.orchestra.run.trial042.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-12T08:44:59.937 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:44:59.937 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:44:59.977 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph 2026-02-12T08:45:00.271 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:02:15 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:45:00.357 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:45:00.360 INFO:teuthology.orchestra.run.trial042.stdout:======================================================================================= 2026-02-12T08:45:00.360 INFO:teuthology.orchestra.run.trial042.stdout: Package Arch Version Repository Size 2026-02-12T08:45:00.360 INFO:teuthology.orchestra.run.trial042.stdout:======================================================================================= 2026-02-12T08:45:00.360 INFO:teuthology.orchestra.run.trial042.stdout:Installing: 2026-02-12T08:45:00.361 INFO:teuthology.orchestra.run.trial042.stdout: ceph x86_64 2:20.3.0-5161.g2401a109.el9 ceph 6.5 k 2026-02-12T08:45:00.361 INFO:teuthology.orchestra.run.trial042.stdout:Installing dependencies: 2026-02-12T08:45:00.361 INFO:teuthology.orchestra.run.trial042.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T08:45:00.361 INFO:teuthology.orchestra.run.trial042.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 57 k 2026-02-12T08:45:00.361 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mds x86_64 2:20.3.0-5161.g2401a109.el9 ceph 2.0 M 2026-02-12T08:45:00.361 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mgr x86_64 2:20.3.0-5161.g2401a109.el9 ceph 937 k 2026-02-12T08:45:00.362 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 297 k 2026-02-12T08:45:00.362 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mon x86_64 2:20.3.0-5161.g2401a109.el9 ceph 4.8 M 2026-02-12T08:45:00.362 INFO:teuthology.orchestra.run.trial042.stdout: ceph-osd x86_64 2:20.3.0-5161.g2401a109.el9 ceph 163 k 2026-02-12T08:45:00.362 INFO:teuthology.orchestra.run.trial042.stdout: ceph-osd-classic x86_64 2:20.3.0-5161.g2401a109.el9 ceph 15 M 2026-02-12T08:45:00.362 INFO:teuthology.orchestra.run.trial042.stdout: ceph-osd-crimson x86_64 2:20.3.0-5161.g2401a109.el9 ceph 87 M 2026-02-12T08:45:00.362 INFO:teuthology.orchestra.run.trial042.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 17 k 2026-02-12T08:45:00.362 INFO:teuthology.orchestra.run.trial042.stdout: cephadm noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 1.0 M 2026-02-12T08:45:00.362 INFO:teuthology.orchestra.run.trial042.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T08:45:00.362 INFO:teuthology.orchestra.run.trial042.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T08:45:00.362 INFO:teuthology.orchestra.run.trial042.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T08:45:00.362 INFO:teuthology.orchestra.run.trial042.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T08:45:00.362 INFO:teuthology.orchestra.run.trial042.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T08:45:00.363 INFO:teuthology.orchestra.run.trial042.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T08:45:00.363 INFO:teuthology.orchestra.run.trial042.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T08:45:00.363 INFO:teuthology.orchestra.run.trial042.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T08:45:00.363 INFO:teuthology.orchestra.run.trial042.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T08:45:00.363 INFO:teuthology.orchestra.run.trial042.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T08:45:00.363 INFO:teuthology.orchestra.run.trial042.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T08:45:00.363 INFO:teuthology.orchestra.run.trial042.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T08:45:00.363 INFO:teuthology.orchestra.run.trial042.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T08:45:00.363 INFO:teuthology.orchestra.run.trial042.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T08:45:00.363 INFO:teuthology.orchestra.run.trial042.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T08:45:00.363 INFO:teuthology.orchestra.run.trial042.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T08:45:00.363 INFO:teuthology.orchestra.run.trial042.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T08:45:00.363 INFO:teuthology.orchestra.run.trial042.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T08:45:00.364 INFO:teuthology.orchestra.run.trial042.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T08:45:00.364 INFO:teuthology.orchestra.run.trial042.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T08:45:00.364 INFO:teuthology.orchestra.run.trial042.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T08:45:00.364 INFO:teuthology.orchestra.run.trial042.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T08:45:00.364 INFO:teuthology.orchestra.run.trial042.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T08:45:00.364 INFO:teuthology.orchestra.run.trial042.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T08:45:00.364 INFO:teuthology.orchestra.run.trial042.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T08:45:00.364 INFO:teuthology.orchestra.run.trial042.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T08:45:00.364 INFO:teuthology.orchestra.run.trial042.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T08:45:00.364 INFO:teuthology.orchestra.run.trial042.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T08:45:00.364 INFO:teuthology.orchestra.run.trial042.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T08:45:00.364 INFO:teuthology.orchestra.run.trial042.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T08:45:00.365 INFO:teuthology.orchestra.run.trial042.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T08:45:00.365 INFO:teuthology.orchestra.run.trial042.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-12T08:45:00.365 INFO:teuthology.orchestra.run.trial042.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T08:45:00.365 INFO:teuthology.orchestra.run.trial042.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T08:45:00.365 INFO:teuthology.orchestra.run.trial042.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-12T08:45:00.365 INFO:teuthology.orchestra.run.trial042.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T08:45:00.365 INFO:teuthology.orchestra.run.trial042.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T08:45:00.365 INFO:teuthology.orchestra.run.trial042.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T08:45:00.365 INFO:teuthology.orchestra.run.trial042.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T08:45:00.365 INFO:teuthology.orchestra.run.trial042.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T08:45:00.365 INFO:teuthology.orchestra.run.trial042.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T08:45:00.365 INFO:teuthology.orchestra.run.trial042.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T08:45:00.365 INFO:teuthology.orchestra.run.trial042.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-12T08:45:00.366 INFO:teuthology.orchestra.run.trial042.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T08:45:00.366 INFO:teuthology.orchestra.run.trial042.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T08:45:00.366 INFO:teuthology.orchestra.run.trial042.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-12T08:45:00.366 INFO:teuthology.orchestra.run.trial042.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T08:45:00.366 INFO:teuthology.orchestra.run.trial042.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T08:45:00.366 INFO:teuthology.orchestra.run.trial042.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T08:45:00.366 INFO:teuthology.orchestra.run.trial042.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T08:45:00.366 INFO:teuthology.orchestra.run.trial042.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T08:45:00.366 INFO:teuthology.orchestra.run.trial042.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T08:45:00.366 INFO:teuthology.orchestra.run.trial042.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T08:45:00.366 INFO:teuthology.orchestra.run.trial042.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T08:45:00.366 INFO:teuthology.orchestra.run.trial042.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T08:45:00.366 INFO:teuthology.orchestra.run.trial042.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T08:45:00.367 INFO:teuthology.orchestra.run.trial042.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T08:45:00.367 INFO:teuthology.orchestra.run.trial042.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T08:45:00.367 INFO:teuthology.orchestra.run.trial042.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T08:45:00.367 INFO:teuthology.orchestra.run.trial042.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T08:45:00.367 INFO:teuthology.orchestra.run.trial042.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T08:45:00.367 INFO:teuthology.orchestra.run.trial042.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T08:45:00.367 INFO:teuthology.orchestra.run.trial042.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T08:45:00.367 INFO:teuthology.orchestra.run.trial042.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T08:45:00.367 INFO:teuthology.orchestra.run.trial042.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T08:45:00.367 INFO:teuthology.orchestra.run.trial042.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T08:45:00.367 INFO:teuthology.orchestra.run.trial042.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T08:45:00.367 INFO:teuthology.orchestra.run.trial042.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T08:45:00.367 INFO:teuthology.orchestra.run.trial042.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T08:45:00.368 INFO:teuthology.orchestra.run.trial042.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-12T08:45:00.368 INFO:teuthology.orchestra.run.trial042.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T08:45:00.368 INFO:teuthology.orchestra.run.trial042.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T08:45:00.368 INFO:teuthology.orchestra.run.trial042.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T08:45:00.368 INFO:teuthology.orchestra.run.trial042.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-12T08:45:00.368 INFO:teuthology.orchestra.run.trial042.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-12T08:45:00.368 INFO:teuthology.orchestra.run.trial042.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T08:45:00.368 INFO:teuthology.orchestra.run.trial042.stdout:Installing weak dependencies: 2026-02-12T08:45:00.368 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 183 k 2026-02-12T08:45:00.368 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 15 M 2026-02-12T08:45:00.368 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 7.4 M 2026-02-12T08:45:00.368 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 22 k 2026-02-12T08:45:00.369 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mgr-rook noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 50 k 2026-02-12T08:45:00.369 INFO:teuthology.orchestra.run.trial042.stdout: ceph-volume noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 299 k 2026-02-12T08:45:00.369 INFO:teuthology.orchestra.run.trial042.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-12T08:45:00.369 INFO:teuthology.orchestra.run.trial042.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-12T08:45:00.369 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:45:00.369 INFO:teuthology.orchestra.run.trial042.stdout:Transaction Summary 2026-02-12T08:45:00.369 INFO:teuthology.orchestra.run.trial042.stdout:======================================================================================= 2026-02-12T08:45:00.369 INFO:teuthology.orchestra.run.trial042.stdout:Install 96 Packages 2026-02-12T08:45:00.369 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:45:00.370 INFO:teuthology.orchestra.run.trial042.stdout:Total download size: 189 M 2026-02-12T08:45:00.370 INFO:teuthology.orchestra.run.trial042.stdout:Installed size: 1.4 G 2026-02-12T08:45:00.370 INFO:teuthology.orchestra.run.trial042.stdout:Downloading Packages: 2026-02-12T08:45:00.701 INFO:teuthology.orchestra.run.trial131.stdout:(8/96): ceph-osd-classic-20.3.0-5161.g2401a109. 1.7 MB/s | 15 MB 00:08 2026-02-12T08:45:01.424 INFO:teuthology.orchestra.run.trial042.stdout:(1/96): ceph-20.3.0-5161.g2401a109.el9.x86_64.r 23 kB/s | 6.5 kB 00:00 2026-02-12T08:45:02.113 INFO:teuthology.orchestra.run.trial042.stdout:(2/96): ceph-mds-20.3.0-5161.g2401a109.el9.x86_ 2.1 MB/s | 2.0 MB 00:00 2026-02-12T08:45:02.181 INFO:teuthology.orchestra.run.trial042.stdout:(3/96): ceph-osd-20.3.0-5161.g2401a109.el9.x86_ 2.4 MB/s | 163 kB 00:00 2026-02-12T08:45:02.816 INFO:teuthology.orchestra.run.trial042.stdout:(4/96): ceph-mon-20.3.0-5161.g2401a109.el9.x86_ 3.5 MB/s | 4.8 MB 00:01 2026-02-12T08:45:03.466 INFO:teuthology.orchestra.run.trial042.stdout:(5/96): ceph-mgr-20.3.0-5161.g2401a109.el9.x86_ 404 kB/s | 937 kB 00:02 2026-02-12T08:45:03.588 INFO:teuthology.orchestra.run.trial042.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5161.g24 470 kB/s | 57 kB 00:00 2026-02-12T08:45:03.898 INFO:teuthology.orchestra.run.trial042.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5161.g2401a109. 591 kB/s | 183 kB 00:00 2026-02-12T08:45:05.492 INFO:teuthology.orchestra.run.trial042.stdout:(8/96): ceph-osd-classic-20.3.0-5161.g2401a109. 4.5 MB/s | 15 MB 00:03 2026-02-12T08:45:06.213 INFO:teuthology.orchestra.run.trial131.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-51 1.3 MB/s | 7.4 MB 00:05 2026-02-12T08:45:06.277 INFO:teuthology.orchestra.run.trial131.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5161.g2401a1 346 kB/s | 22 kB 00:00 2026-02-12T08:45:06.548 INFO:teuthology.orchestra.run.trial131.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5161.g240 1.1 MB/s | 297 kB 00:00 2026-02-12T08:45:06.619 INFO:teuthology.orchestra.run.trial131.stdout:(12/96): ceph-mgr-rook-20.3.0-5161.g2401a109.el 714 kB/s | 50 kB 00:00 2026-02-12T08:45:06.689 INFO:teuthology.orchestra.run.trial131.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5161.g24 248 kB/s | 17 kB 00:00 2026-02-12T08:45:07.029 INFO:teuthology.orchestra.run.trial131.stdout:(14/96): ceph-volume-20.3.0-5161.g2401a109.el9. 878 kB/s | 299 kB 00:00 2026-02-12T08:45:08.058 INFO:teuthology.orchestra.run.trial042.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-51 2.9 MB/s | 7.4 MB 00:02 2026-02-12T08:45:08.105 INFO:teuthology.orchestra.run.trial131.stdout:(15/96): cephadm-20.3.0-5161.g2401a109.el9.noar 967 kB/s | 1.0 MB 00:01 2026-02-12T08:45:08.125 INFO:teuthology.orchestra.run.trial042.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5161.g2401a1 333 kB/s | 22 kB 00:00 2026-02-12T08:45:08.127 INFO:teuthology.orchestra.run.trial131.stdout:(16/96): cryptsetup-2.8.1-2.el9.x86_64.rpm 15 MB/s | 350 kB 00:00 2026-02-12T08:45:08.132 INFO:teuthology.orchestra.run.trial131.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 9.4 MB/s | 40 kB 00:00 2026-02-12T08:45:08.136 INFO:teuthology.orchestra.run.trial131.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 16 MB/s | 72 kB 00:00 2026-02-12T08:45:08.145 INFO:teuthology.orchestra.run.trial131.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 87 MB/s | 794 kB 00:00 2026-02-12T08:45:08.152 INFO:teuthology.orchestra.run.trial131.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 26 MB/s | 184 kB 00:00 2026-02-12T08:45:08.160 INFO:teuthology.orchestra.run.trial131.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 36 MB/s | 253 kB 00:00 2026-02-12T08:45:08.191 INFO:teuthology.orchestra.run.trial131.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 40 MB/s | 1.2 MB 00:00 2026-02-12T08:45:08.197 INFO:teuthology.orchestra.run.trial131.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 18 MB/s | 106 kB 00:00 2026-02-12T08:45:08.203 INFO:teuthology.orchestra.run.trial131.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 22 MB/s | 135 kB 00:00 2026-02-12T08:45:08.209 INFO:teuthology.orchestra.run.trial131.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 24 MB/s | 150 kB 00:00 2026-02-12T08:45:08.216 INFO:teuthology.orchestra.run.trial131.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 19 MB/s | 126 kB 00:00 2026-02-12T08:45:08.223 INFO:teuthology.orchestra.run.trial131.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 32 MB/s | 218 kB 00:00 2026-02-12T08:45:08.230 INFO:teuthology.orchestra.run.trial131.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 25 MB/s | 182 kB 00:00 2026-02-12T08:45:08.236 INFO:teuthology.orchestra.run.trial131.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 42 MB/s | 266 kB 00:00 2026-02-12T08:45:08.262 INFO:teuthology.orchestra.run.trial131.stdout:(30/96): flexiblas-3.0.4-8.el9.x86_64.rpm 1.2 MB/s | 33 kB 00:00 2026-02-12T08:45:08.318 INFO:teuthology.orchestra.run.trial131.stdout:(31/96): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 54 MB/s | 3.0 MB 00:00 2026-02-12T08:45:08.325 INFO:teuthology.orchestra.run.trial042.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5161.g240 1.5 MB/s | 297 kB 00:00 2026-02-12T08:45:08.326 INFO:teuthology.orchestra.run.trial131.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-8.el9. 2.1 MB/s | 18 kB 00:00 2026-02-12T08:45:08.336 INFO:teuthology.orchestra.run.trial131.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 24 MB/s | 246 kB 00:00 2026-02-12T08:45:08.347 INFO:teuthology.orchestra.run.trial131.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 17 MB/s | 188 kB 00:00 2026-02-12T08:45:08.356 INFO:teuthology.orchestra.run.trial131.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 4.8 MB/s | 42 kB 00:00 2026-02-12T08:45:08.384 INFO:teuthology.orchestra.run.trial131.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 187 MB/s | 5.3 MB 00:00 2026-02-12T08:45:08.396 INFO:teuthology.orchestra.run.trial042.stdout:(12/96): ceph-mgr-rook-20.3.0-5161.g2401a109.el 706 kB/s | 50 kB 00:00 2026-02-12T08:45:08.420 INFO:teuthology.orchestra.run.trial131.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 169 MB/s | 6.0 MB 00:00 2026-02-12T08:45:08.431 INFO:teuthology.orchestra.run.trial131.stdout:(38/96): python3-devel-3.9.25-2.el9.x86_64.rpm 21 MB/s | 244 kB 00:00 2026-02-12T08:45:08.443 INFO:teuthology.orchestra.run.trial131.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 22 MB/s | 249 kB 00:00 2026-02-12T08:45:08.452 INFO:teuthology.orchestra.run.trial131.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 5.2 MB/s | 48 kB 00:00 2026-02-12T08:45:08.462 INFO:teuthology.orchestra.run.trial131.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 17 MB/s | 177 kB 00:00 2026-02-12T08:45:08.466 INFO:teuthology.orchestra.run.trial042.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5161.g24 248 kB/s | 17 kB 00:00 2026-02-12T08:45:08.476 INFO:teuthology.orchestra.run.trial131.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 87 MB/s | 1.2 MB 00:00 2026-02-12T08:45:08.485 INFO:teuthology.orchestra.run.trial131.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 3.8 MB/s | 35 kB 00:00 2026-02-12T08:45:08.519 INFO:teuthology.orchestra.run.trial131.stdout:(44/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 185 MB/s | 6.1 MB 00:00 2026-02-12T08:45:08.531 INFO:teuthology.orchestra.run.trial131.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 36 MB/s | 442 kB 00:00 2026-02-12T08:45:08.540 INFO:teuthology.orchestra.run.trial131.stdout:(46/96): python3-packaging-20.9-5.el9.noarch.rp 7.7 MB/s | 77 kB 00:00 2026-02-12T08:45:08.551 INFO:teuthology.orchestra.run.trial131.stdout:(47/96): python3-protobuf-3.14.0-17.el9.noarch. 26 MB/s | 267 kB 00:00 2026-02-12T08:45:08.562 INFO:teuthology.orchestra.run.trial131.stdout:(48/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 15 MB/s | 159 kB 00:00 2026-02-12T08:45:08.573 INFO:teuthology.orchestra.run.trial131.stdout:(49/96): python3-pyasn1-modules-0.4.8-6.el9.noa 24 MB/s | 279 kB 00:00 2026-02-12T08:45:08.582 INFO:teuthology.orchestra.run.trial131.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 5.7 MB/s | 54 kB 00:00 2026-02-12T08:45:08.669 INFO:teuthology.orchestra.run.trial042.stdout:(14/96): ceph-volume-20.3.0-5161.g2401a109.el9. 1.4 MB/s | 299 kB 00:00 2026-02-12T08:45:08.695 INFO:teuthology.orchestra.run.trial131.stdout:(51/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 172 MB/s | 19 MB 00:00 2026-02-12T08:45:08.703 INFO:teuthology.orchestra.run.trial131.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 5.3 MB/s | 42 kB 00:00 2026-02-12T08:45:08.711 INFO:teuthology.orchestra.run.trial131.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 22 MB/s | 189 kB 00:00 2026-02-12T08:45:08.719 INFO:teuthology.orchestra.run.trial131.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 11 MB/s | 90 kB 00:00 2026-02-12T08:45:09.138 INFO:teuthology.orchestra.run.trial131.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 53 kB/s | 22 kB 00:00 2026-02-12T08:45:09.208 INFO:teuthology.orchestra.run.trial042.stdout:(15/96): cephadm-20.3.0-5161.g2401a109.el9.noar 1.9 MB/s | 1.0 MB 00:00 2026-02-12T08:45:09.257 INFO:teuthology.orchestra.run.trial042.stdout:(16/96): cryptsetup-2.8.1-2.el9.x86_64.rpm 7.0 MB/s | 350 kB 00:00 2026-02-12T08:45:09.266 INFO:teuthology.orchestra.run.trial042.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 4.6 MB/s | 40 kB 00:00 2026-02-12T08:45:09.281 INFO:teuthology.orchestra.run.trial042.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 4.6 MB/s | 72 kB 00:00 2026-02-12T08:45:09.300 INFO:teuthology.orchestra.run.trial042.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 40 MB/s | 794 kB 00:00 2026-02-12T08:45:09.312 INFO:teuthology.orchestra.run.trial042.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 16 MB/s | 184 kB 00:00 2026-02-12T08:45:09.323 INFO:teuthology.orchestra.run.trial042.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 22 MB/s | 253 kB 00:00 2026-02-12T08:45:09.357 INFO:teuthology.orchestra.run.trial042.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 37 MB/s | 1.2 MB 00:00 2026-02-12T08:45:09.370 INFO:teuthology.orchestra.run.trial042.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 8.0 MB/s | 106 kB 00:00 2026-02-12T08:45:09.380 INFO:teuthology.orchestra.run.trial042.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 13 MB/s | 135 kB 00:00 2026-02-12T08:45:09.391 INFO:teuthology.orchestra.run.trial042.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 14 MB/s | 150 kB 00:00 2026-02-12T08:45:09.402 INFO:teuthology.orchestra.run.trial042.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 12 MB/s | 126 kB 00:00 2026-02-12T08:45:09.412 INFO:teuthology.orchestra.run.trial042.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 20 MB/s | 218 kB 00:00 2026-02-12T08:45:09.424 INFO:teuthology.orchestra.run.trial042.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 16 MB/s | 182 kB 00:00 2026-02-12T08:45:09.434 INFO:teuthology.orchestra.run.trial042.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 25 MB/s | 266 kB 00:00 2026-02-12T08:45:09.493 INFO:teuthology.orchestra.run.trial042.stdout:(30/96): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2026-02-12T08:45:09.637 INFO:teuthology.orchestra.run.trial042.stdout:(31/96): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 21 MB/s | 3.0 MB 00:00 2026-02-12T08:45:09.670 INFO:teuthology.orchestra.run.trial042.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-8.el9. 542 kB/s | 18 kB 00:00 2026-02-12T08:45:09.693 INFO:teuthology.orchestra.run.trial042.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 11 MB/s | 246 kB 00:00 2026-02-12T08:45:09.715 INFO:teuthology.orchestra.run.trial042.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 8.1 MB/s | 188 kB 00:00 2026-02-12T08:45:09.736 INFO:teuthology.orchestra.run.trial042.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 2.0 MB/s | 42 kB 00:00 2026-02-12T08:45:09.839 INFO:teuthology.orchestra.run.trial042.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 52 MB/s | 5.3 MB 00:00 2026-02-12T08:45:09.924 INFO:teuthology.orchestra.run.trial042.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 70 MB/s | 6.0 MB 00:00 2026-02-12T08:45:09.950 INFO:teuthology.orchestra.run.trial042.stdout:(38/96): python3-devel-3.9.25-2.el9.x86_64.rpm 9.2 MB/s | 244 kB 00:00 2026-02-12T08:45:09.974 INFO:teuthology.orchestra.run.trial042.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 10 MB/s | 249 kB 00:00 2026-02-12T08:45:09.996 INFO:teuthology.orchestra.run.trial042.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 2.1 MB/s | 48 kB 00:00 2026-02-12T08:45:10.022 INFO:teuthology.orchestra.run.trial042.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 6.6 MB/s | 177 kB 00:00 2026-02-12T08:45:10.061 INFO:teuthology.orchestra.run.trial042.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 32 MB/s | 1.2 MB 00:00 2026-02-12T08:45:10.082 INFO:teuthology.orchestra.run.trial042.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 1.6 MB/s | 35 kB 00:00 2026-02-12T08:45:10.136 INFO:teuthology.orchestra.run.trial131.stdout:(56/96): protobuf-compiler-3.14.0-17.el9.x86_64 863 kB/s | 862 kB 00:00 2026-02-12T08:45:10.369 INFO:teuthology.orchestra.run.trial042.stdout:(44/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 21 MB/s | 6.1 MB 00:00 2026-02-12T08:45:10.412 INFO:teuthology.orchestra.run.trial042.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 10 MB/s | 442 kB 00:00 2026-02-12T08:45:10.433 INFO:teuthology.orchestra.run.trial042.stdout:(46/96): python3-packaging-20.9-5.el9.noarch.rp 3.5 MB/s | 77 kB 00:00 2026-02-12T08:45:10.455 INFO:teuthology.orchestra.run.trial042.stdout:(47/96): python3-protobuf-3.14.0-17.el9.noarch. 12 MB/s | 267 kB 00:00 2026-02-12T08:45:10.489 INFO:teuthology.orchestra.run.trial042.stdout:(48/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 4.6 MB/s | 159 kB 00:00 2026-02-12T08:45:10.503 INFO:teuthology.orchestra.run.trial131.stdout:(57/96): ceph-mgr-dashboard-20.3.0-5161.g2401a1 930 kB/s | 15 MB 00:16 2026-02-12T08:45:10.513 INFO:teuthology.orchestra.run.trial042.stdout:(49/96): python3-pyasn1-modules-0.4.8-6.el9.noa 12 MB/s | 279 kB 00:00 2026-02-12T08:45:10.534 INFO:teuthology.orchestra.run.trial042.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 2.5 MB/s | 54 kB 00:00 2026-02-12T08:45:10.640 INFO:teuthology.orchestra.run.trial131.stdout:(58/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.1 MB/s | 551 kB 00:00 2026-02-12T08:45:10.708 INFO:teuthology.orchestra.run.trial131.stdout:(59/96): grpc-data-1.46.7-10.el9.noarch.rpm 95 kB/s | 19 kB 00:00 2026-02-12T08:45:10.712 INFO:teuthology.orchestra.run.trial131.stdout:(60/96): luarocks-3.9.2-5.el9.noarch.rpm 2.1 MB/s | 151 kB 00:00 2026-02-12T08:45:10.781 INFO:teuthology.orchestra.run.trial131.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 422 kB/s | 29 kB 00:00 2026-02-12T08:45:10.852 INFO:teuthology.orchestra.run.trial131.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 857 kB/s | 60 kB 00:00 2026-02-12T08:45:10.921 INFO:teuthology.orchestra.run.trial131.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 623 kB/s | 43 kB 00:00 2026-02-12T08:45:10.991 INFO:teuthology.orchestra.run.trial131.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 466 kB/s | 32 kB 00:00 2026-02-12T08:45:11.052 INFO:teuthology.orchestra.run.trial131.stdout:(65/96): python3-asyncssh-2.13.2-5.el9.noarch.r 1.6 MB/s | 548 kB 00:00 2026-02-12T08:45:11.060 INFO:teuthology.orchestra.run.trial131.stdout:(66/96): python3-certifi-2023.05.07-4.el9.noarc 203 kB/s | 14 kB 00:00 2026-02-12T08:45:11.124 INFO:teuthology.orchestra.run.trial131.stdout:(67/96): python3-cheroot-10.0.1-4.el9.noarch.rp 2.4 MB/s | 173 kB 00:00 2026-02-12T08:45:11.130 INFO:teuthology.orchestra.run.trial042.stdout:(51/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 32 MB/s | 19 MB 00:00 2026-02-12T08:45:11.136 INFO:teuthology.orchestra.run.trial131.stdout:(68/96): python3-cherrypy-18.6.1-2.el9.noarch.r 4.6 MB/s | 358 kB 00:00 2026-02-12T08:45:11.151 INFO:teuthology.orchestra.run.trial042.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 1.9 MB/s | 42 kB 00:00 2026-02-12T08:45:11.196 INFO:teuthology.orchestra.run.trial131.stdout:(69/96): python3-google-auth-2.45.0-1.el9.noarc 3.4 MB/s | 254 kB 00:00 2026-02-12T08:45:11.211 INFO:teuthology.orchestra.run.trial042.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 3.1 MB/s | 189 kB 00:00 2026-02-12T08:45:11.234 INFO:teuthology.orchestra.run.trial042.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.9 MB/s | 90 kB 00:00 2026-02-12T08:45:11.268 INFO:teuthology.orchestra.run.trial131.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 2.0 MB/s | 144 kB 00:00 2026-02-12T08:45:11.287 INFO:teuthology.orchestra.run.trial042.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 420 kB/s | 22 kB 00:00 2026-02-12T08:45:11.340 INFO:teuthology.orchestra.run.trial131.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 1.9 MB/s | 139 kB 00:00 2026-02-12T08:45:11.373 INFO:teuthology.orchestra.run.trial042.stdout:(56/96): protobuf-compiler-3.14.0-17.el9.x86_64 9.8 MB/s | 862 kB 00:00 2026-02-12T08:45:11.410 INFO:teuthology.orchestra.run.trial131.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 798 kB/s | 56 kB 00:00 2026-02-12T08:45:11.413 INFO:teuthology.orchestra.run.trial131.stdout:(73/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 7.3 MB/s | 2.0 MB 00:00 2026-02-12T08:45:11.431 INFO:teuthology.orchestra.run.trial042.stdout:(57/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 9.3 MB/s | 551 kB 00:00 2026-02-12T08:45:11.439 INFO:teuthology.orchestra.run.trial042.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 2.5 MB/s | 19 kB 00:00 2026-02-12T08:45:11.449 INFO:teuthology.orchestra.run.trial042.stdout:(59/96): luarocks-3.9.2-5.el9.noarch.rpm 15 MB/s | 151 kB 00:00 2026-02-12T08:45:11.460 INFO:teuthology.orchestra.run.trial042.stdout:(60/96): python3-asyncssh-2.13.2-5.el9.noarch.r 48 MB/s | 548 kB 00:00 2026-02-12T08:45:11.468 INFO:teuthology.orchestra.run.trial042.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 3.6 MB/s | 29 kB 00:00 2026-02-12T08:45:11.477 INFO:teuthology.orchestra.run.trial042.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 7.1 MB/s | 60 kB 00:00 2026-02-12T08:45:11.479 INFO:teuthology.orchestra.run.trial131.stdout:(74/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 154 kB/s | 11 kB 00:00 2026-02-12T08:45:11.483 INFO:teuthology.orchestra.run.trial131.stdout:(75/96): python3-jaraco-classes-3.2.1-5.el9.noa 255 kB/s | 18 kB 00:00 2026-02-12T08:45:11.486 INFO:teuthology.orchestra.run.trial042.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 4.7 MB/s | 43 kB 00:00 2026-02-12T08:45:11.495 INFO:teuthology.orchestra.run.trial042.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 3.6 MB/s | 32 kB 00:00 2026-02-12T08:45:11.503 INFO:teuthology.orchestra.run.trial042.stdout:(65/96): python3-certifi-2023.05.07-4.el9.noarc 1.7 MB/s | 14 kB 00:00 2026-02-12T08:45:11.513 INFO:teuthology.orchestra.run.trial042.stdout:(66/96): python3-cheroot-10.0.1-4.el9.noarch.rp 17 MB/s | 173 kB 00:00 2026-02-12T08:45:11.528 INFO:teuthology.orchestra.run.trial042.stdout:(67/96): python3-cherrypy-18.6.1-2.el9.noarch.r 24 MB/s | 358 kB 00:00 2026-02-12T08:45:11.538 INFO:teuthology.orchestra.run.trial042.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 24 MB/s | 254 kB 00:00 2026-02-12T08:45:11.554 INFO:teuthology.orchestra.run.trial131.stdout:(76/96): python3-jaraco-collections-3.0.0-8.el9 309 kB/s | 23 kB 00:00 2026-02-12T08:45:11.555 INFO:teuthology.orchestra.run.trial131.stdout:(77/96): python3-jaraco-context-6.0.1-3.el9.noa 274 kB/s | 20 kB 00:00 2026-02-12T08:45:11.592 INFO:teuthology.orchestra.run.trial042.stdout:(69/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 38 MB/s | 2.0 MB 00:00 2026-02-12T08:45:11.602 INFO:teuthology.orchestra.run.trial042.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 14 MB/s | 144 kB 00:00 2026-02-12T08:45:11.613 INFO:teuthology.orchestra.run.trial042.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 12 MB/s | 139 kB 00:00 2026-02-12T08:45:11.623 INFO:teuthology.orchestra.run.trial042.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 5.8 MB/s | 56 kB 00:00 2026-02-12T08:45:11.624 INFO:teuthology.orchestra.run.trial131.stdout:(78/96): python3-jaraco-functools-3.5.0-2.el9.n 281 kB/s | 19 kB 00:00 2026-02-12T08:45:11.624 INFO:teuthology.orchestra.run.trial131.stdout:(79/96): python3-jaraco-text-4.0.0-2.el9.noarch 378 kB/s | 26 kB 00:00 2026-02-12T08:45:11.631 INFO:teuthology.orchestra.run.trial042.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 1.3 MB/s | 11 kB 00:00 2026-02-12T08:45:11.639 INFO:teuthology.orchestra.run.trial042.stdout:(74/96): python3-jaraco-classes-3.2.1-5.el9.noa 2.1 MB/s | 18 kB 00:00 2026-02-12T08:45:11.647 INFO:teuthology.orchestra.run.trial042.stdout:(75/96): python3-jaraco-collections-3.0.0-8.el9 2.8 MB/s | 23 kB 00:00 2026-02-12T08:45:11.656 INFO:teuthology.orchestra.run.trial042.stdout:(76/96): python3-jaraco-context-6.0.1-3.el9.noa 2.3 MB/s | 20 kB 00:00 2026-02-12T08:45:11.664 INFO:teuthology.orchestra.run.trial042.stdout:(77/96): python3-jaraco-functools-3.5.0-2.el9.n 2.3 MB/s | 19 kB 00:00 2026-02-12T08:45:11.675 INFO:teuthology.orchestra.run.trial042.stdout:(78/96): python3-jaraco-text-4.0.0-2.el9.noarch 2.4 MB/s | 26 kB 00:00 2026-02-12T08:45:11.692 INFO:teuthology.orchestra.run.trial042.stdout:(79/96): python3-kubernetes-26.1.0-3.el9.noarch 63 MB/s | 1.0 MB 00:00 2026-02-12T08:45:11.695 INFO:teuthology.orchestra.run.trial131.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2026-02-12T08:45:11.702 INFO:teuthology.orchestra.run.trial042.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 7.9 MB/s | 79 kB 00:00 2026-02-12T08:45:11.712 INFO:teuthology.orchestra.run.trial042.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 8.1 MB/s | 86 kB 00:00 2026-02-12T08:45:11.724 INFO:teuthology.orchestra.run.trial042.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 4.8 MB/s | 58 kB 00:00 2026-02-12T08:45:11.733 INFO:teuthology.orchestra.run.trial042.stdout:(83/96): python3-portend-3.1.0-2.el9.noarch.rpm 1.7 MB/s | 16 kB 00:00 2026-02-12T08:45:11.742 INFO:teuthology.orchestra.run.trial042.stdout:(84/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 10 MB/s | 90 kB 00:00 2026-02-12T08:45:11.754 INFO:teuthology.orchestra.run.trial042.stdout:(85/96): python3-repoze-lru-0.7-16.el9.noarch.r 2.5 MB/s | 31 kB 00:00 2026-02-12T08:45:11.765 INFO:teuthology.orchestra.run.trial131.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.2 MB/s | 86 kB 00:00 2026-02-12T08:45:11.767 INFO:teuthology.orchestra.run.trial042.stdout:(86/96): python3-routes-2.5.1-5.el9.noarch.rpm 14 MB/s | 188 kB 00:00 2026-02-12T08:45:11.777 INFO:teuthology.orchestra.run.trial042.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 5.9 MB/s | 59 kB 00:00 2026-02-12T08:45:11.790 INFO:teuthology.orchestra.run.trial042.stdout:(88/96): python3-saml-1.16.0-1.el9.noarch.rpm 9.6 MB/s | 125 kB 00:00 2026-02-12T08:45:11.804 INFO:teuthology.orchestra.run.trial042.stdout:(89/96): python3-tempora-5.0.0-2.el9.noarch.rpm 2.4 MB/s | 36 kB 00:00 2026-02-12T08:45:11.817 INFO:teuthology.orchestra.run.trial042.stdout:(90/96): python3-typing-extensions-4.15.0-1.el9 6.8 MB/s | 86 kB 00:00 2026-02-12T08:45:11.826 INFO:teuthology.orchestra.run.trial042.stdout:(91/96): python3-websocket-client-1.2.3-2.el9.n 9.5 MB/s | 90 kB 00:00 2026-02-12T08:45:11.835 INFO:teuthology.orchestra.run.trial131.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 824 kB/s | 58 kB 00:00 2026-02-12T08:45:11.836 INFO:teuthology.orchestra.run.trial042.stdout:(92/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 4.9 MB/s | 48 kB 00:00 2026-02-12T08:45:11.846 INFO:teuthology.orchestra.run.trial042.stdout:(93/96): python3-xmltodict-0.12.0-15.el9.noarch 2.1 MB/s | 22 kB 00:00 2026-02-12T08:45:11.856 INFO:teuthology.orchestra.run.trial042.stdout:(94/96): python3-zc-lockfile-2.0-10.el9.noarch. 1.9 MB/s | 20 kB 00:00 2026-02-12T08:45:11.905 INFO:teuthology.orchestra.run.trial131.stdout:(83/96): python3-portend-3.1.0-2.el9.noarch.rpm 236 kB/s | 16 kB 00:00 2026-02-12T08:45:11.976 INFO:teuthology.orchestra.run.trial131.stdout:(84/96): python3-kubernetes-26.1.0-3.el9.noarch 2.9 MB/s | 1.0 MB 00:00 2026-02-12T08:45:12.044 INFO:teuthology.orchestra.run.trial131.stdout:(85/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 646 kB/s | 90 kB 00:00 2026-02-12T08:45:12.048 INFO:teuthology.orchestra.run.trial131.stdout:(86/96): python3-repoze-lru-0.7-16.el9.noarch.r 428 kB/s | 31 kB 00:00 2026-02-12T08:45:12.116 INFO:teuthology.orchestra.run.trial131.stdout:(87/96): python3-routes-2.5.1-5.el9.noarch.rpm 2.6 MB/s | 188 kB 00:00 2026-02-12T08:45:12.119 INFO:teuthology.orchestra.run.trial131.stdout:(88/96): python3-rsa-4.9-2.el9.noarch.rpm 828 kB/s | 59 kB 00:00 2026-02-12T08:45:12.235 INFO:teuthology.orchestra.run.trial131.stdout:(89/96): python3-saml-1.16.0-1.el9.noarch.rpm 1.0 MB/s | 125 kB 00:00 2026-02-12T08:45:12.236 INFO:teuthology.orchestra.run.trial131.stdout:(90/96): python3-tempora-5.0.0-2.el9.noarch.rpm 306 kB/s | 36 kB 00:00 2026-02-12T08:45:12.306 INFO:teuthology.orchestra.run.trial131.stdout:(91/96): python3-typing-extensions-4.15.0-1.el9 1.2 MB/s | 86 kB 00:00 2026-02-12T08:45:12.308 INFO:teuthology.orchestra.run.trial131.stdout:(92/96): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2026-02-12T08:45:12.391 INFO:teuthology.orchestra.run.trial131.stdout:(93/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 571 kB/s | 48 kB 00:00 2026-02-12T08:45:12.391 INFO:teuthology.orchestra.run.trial131.stdout:(94/96): python3-xmltodict-0.12.0-15.el9.noarch 266 kB/s | 22 kB 00:00 2026-02-12T08:45:12.520 INFO:teuthology.orchestra.run.trial131.stdout:(95/96): python3-zc-lockfile-2.0-10.el9.noarch. 155 kB/s | 20 kB 00:00 2026-02-12T08:45:16.291 INFO:teuthology.orchestra.run.trial042.stdout:(95/96): ceph-mgr-dashboard-20.3.0-5161.g2401a1 1.2 MB/s | 15 MB 00:12 2026-02-12T08:46:05.252 INFO:teuthology.orchestra.run.trial131.stdout:(96/96): ceph-osd-crimson-20.3.0-5161.g2401a109 1.2 MB/s | 87 MB 01:13 2026-02-12T08:46:05.254 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:46:05.255 INFO:teuthology.orchestra.run.trial131.stdout:Total 2.5 MB/s | 189 MB 01:14 2026-02-12T08:46:05.625 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-12T08:46:05.664 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-12T08:46:05.664 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-12T08:46:06.360 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-12T08:46:06.360 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-12T08:46:07.092 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-12T08:46:07.094 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-12T08:46:07.098 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-12T08:46:07.119 INFO:teuthology.orchestra.run.trial131.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-12T08:46:07.152 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-12T08:46:07.159 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-12T08:46:07.161 INFO:teuthology.orchestra.run.trial131.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-12T08:46:07.166 INFO:teuthology.orchestra.run.trial131.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 7/96 2026-02-12T08:46:07.189 INFO:teuthology.orchestra.run.trial131.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-12T08:46:07.202 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-12T08:46:07.205 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-12T08:46:07.211 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-12T08:46:07.214 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-12T08:46:07.226 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-12T08:46:07.231 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-12T08:46:07.256 INFO:teuthology.orchestra.run.trial131.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-12T08:46:07.259 INFO:teuthology.orchestra.run.trial131.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-12T08:46:07.309 INFO:teuthology.orchestra.run.trial131.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-12T08:46:07.322 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-12T08:46:07.325 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-12T08:46:07.329 INFO:teuthology.orchestra.run.trial131.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-12T08:46:07.335 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-12T08:46:07.339 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-12T08:46:07.342 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-12T08:46:07.357 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-12T08:46:07.361 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-12T08:46:07.366 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-12T08:46:07.378 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-12T08:46:07.387 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-12T08:46:07.393 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-12T08:46:07.412 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-12T08:46:07.423 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-12T08:46:07.439 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-12T08:46:07.444 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-12T08:46:07.451 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-12T08:46:07.491 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-12T08:46:07.816 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-12T08:46:07.826 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-12T08:46:07.829 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-12T08:46:07.835 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-12T08:46:07.837 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-12T08:46:07.865 INFO:teuthology.orchestra.run.trial131.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-12T08:46:07.908 INFO:teuthology.orchestra.run.trial131.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-12T08:46:07.916 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-12T08:46:07.922 INFO:teuthology.orchestra.run.trial131.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-12T08:46:07.926 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-12T08:46:07.932 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-12T08:46:07.935 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-12T08:46:07.942 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-12T08:46:07.945 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-12T08:46:07.973 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-12T08:46:07.983 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-12T08:46:07.991 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-12T08:46:07.998 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-12T08:46:08.033 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-12T08:46:08.257 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 55/96 2026-02-12T08:46:08.281 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-12T08:46:08.284 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-12T08:46:08.343 INFO:teuthology.orchestra.run.trial131.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-12T08:46:08.345 INFO:teuthology.orchestra.run.trial131.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-12T08:46:08.367 INFO:teuthology.orchestra.run.trial131.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 60/96 2026-02-12T08:46:08.693 INFO:teuthology.orchestra.run.trial131.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 61/96 2026-02-12T08:46:08.767 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-12T08:46:09.439 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-12T08:46:09.456 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-12T08:46:09.466 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-12T08:46:09.472 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-12T08:46:09.486 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-12T08:46:09.501 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-12T08:46:09.577 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-12T08:46:09.586 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-12T08:46:09.609 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-12T08:46:09.639 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-12T08:46:09.689 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-12T08:46:09.695 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-12T08:46:09.699 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-12T08:46:09.700 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-12T08:46:09.716 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T08:46:09.716 INFO:teuthology.orchestra.run.trial131.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T08:46:09.716 INFO:teuthology.orchestra.run.trial131.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T08:46:09.717 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:09.724 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T08:46:09.747 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T08:46:09.747 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T08:46:09.748 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:09.781 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-12T08:46:10.380 INFO:teuthology.orchestra.run.trial131.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 79/96 2026-02-12T08:46:14.028 INFO:teuthology.orchestra.run.trial042.stdout:(96/96): ceph-osd-crimson-20.3.0-5161.g2401a109 1.2 MB/s | 87 MB 01:11 2026-02-12T08:46:14.030 INFO:teuthology.orchestra.run.trial042.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:46:14.030 INFO:teuthology.orchestra.run.trial042.stdout:Total 2.6 MB/s | 189 MB 01:13 2026-02-12T08:46:14.401 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction check 2026-02-12T08:46:14.439 INFO:teuthology.orchestra.run.trial042.stdout:Transaction check succeeded. 2026-02-12T08:46:14.440 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction test 2026-02-12T08:46:15.129 INFO:teuthology.orchestra.run.trial042.stdout:Transaction test succeeded. 2026-02-12T08:46:15.130 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction 2026-02-12T08:46:15.788 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_6 80/96 2026-02-12T08:46:15.848 INFO:teuthology.orchestra.run.trial042.stdout: Preparing : 1/1 2026-02-12T08:46:15.850 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-12T08:46:15.852 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86_6 81/96 2026-02-12T08:46:15.854 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-12T08:46:15.854 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 82/96 2026-02-12T08:46:15.867 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 82/96 2026-02-12T08:46:15.867 INFO:teuthology.orchestra.run.trial131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:46:15.867 INFO:teuthology.orchestra.run.trial131.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T08:46:15.867 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:15.875 INFO:teuthology.orchestra.run.trial042.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-12T08:46:15.879 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 83/96 2026-02-12T08:46:15.903 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 83/96 2026-02-12T08:46:15.903 INFO:teuthology.orchestra.run.trial131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:46:15.903 INFO:teuthology.orchestra.run.trial131.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T08:46:15.903 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T08:46:15.903 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T08:46:15.903 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:15.908 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-12T08:46:15.915 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-12T08:46:15.917 INFO:teuthology.orchestra.run.trial042.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-12T08:46:15.922 INFO:teuthology.orchestra.run.trial042.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 7/96 2026-02-12T08:46:15.945 INFO:teuthology.orchestra.run.trial042.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-12T08:46:15.958 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-12T08:46:15.961 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-12T08:46:15.962 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: cephadm-2:20.3.0-5161.g2401a109.el9.noarch 84/96 2026-02-12T08:46:15.964 INFO:teuthology.orchestra.run.trial131.stdout: Installing : cephadm-2:20.3.0-5161.g2401a109.el9.noarch 84/96 2026-02-12T08:46:15.966 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-12T08:46:15.968 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-12T08:46:15.974 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5161.g2401a109.el9 85/96 2026-02-12T08:46:15.980 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-12T08:46:15.986 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-12T08:46:15.997 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5161.g2401a109.el 86/96 2026-02-12T08:46:15.999 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarc 87/96 2026-02-12T08:46:16.010 INFO:teuthology.orchestra.run.trial042.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-12T08:46:16.013 INFO:teuthology.orchestra.run.trial042.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-12T08:46:16.063 INFO:teuthology.orchestra.run.trial042.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-12T08:46:16.076 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-12T08:46:16.078 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-12T08:46:16.083 INFO:teuthology.orchestra.run.trial042.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-12T08:46:16.088 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-12T08:46:16.093 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-12T08:46:16.096 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-12T08:46:16.110 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-12T08:46:16.115 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-12T08:46:16.120 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-12T08:46:16.131 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-12T08:46:16.140 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-12T08:46:16.146 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-12T08:46:16.166 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-12T08:46:16.177 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-12T08:46:16.192 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-12T08:46:16.197 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-12T08:46:16.205 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-12T08:46:16.244 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-12T08:46:16.568 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-12T08:46:16.578 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-12T08:46:16.582 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-12T08:46:16.588 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-12T08:46:16.589 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-12T08:46:16.617 INFO:teuthology.orchestra.run.trial042.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-12T08:46:16.660 INFO:teuthology.orchestra.run.trial042.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-12T08:46:16.670 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-12T08:46:16.675 INFO:teuthology.orchestra.run.trial042.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-12T08:46:16.679 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-12T08:46:16.684 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-12T08:46:16.688 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-12T08:46:16.695 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-12T08:46:16.698 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-12T08:46:16.726 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-12T08:46:16.736 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-12T08:46:16.742 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-12T08:46:16.749 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-12T08:46:16.783 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-12T08:46:17.006 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 55/96 2026-02-12T08:46:17.030 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-12T08:46:17.034 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-12T08:46:17.093 INFO:teuthology.orchestra.run.trial042.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-12T08:46:17.095 INFO:teuthology.orchestra.run.trial042.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-12T08:46:17.116 INFO:teuthology.orchestra.run.trial042.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 60/96 2026-02-12T08:46:17.442 INFO:teuthology.orchestra.run.trial042.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 61/96 2026-02-12T08:46:17.514 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-12T08:46:17.598 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarc 87/96 2026-02-12T08:46:17.605 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noa 88/96 2026-02-12T08:46:18.060 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noa 88/96 2026-02-12T08:46:18.061 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a 89/96 2026-02-12T08:46:18.073 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a 89/96 2026-02-12T08:46:18.074 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.noa 90/96 2026-02-12T08:46:18.137 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.noa 90/96 2026-02-12T08:46:18.178 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5161.g2401a109.el9. 91/96 2026-02-12T08:46:18.179 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 92/96 2026-02-12T08:46:18.182 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-12T08:46:18.199 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-12T08:46:18.200 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 92/96 2026-02-12T08:46:18.200 INFO:teuthology.orchestra.run.trial131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:46:18.200 INFO:teuthology.orchestra.run.trial131.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T08:46:18.200 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T08:46:18.200 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T08:46:18.200 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:18.208 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-12T08:46:18.214 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 93/96 2026-02-12T08:46:18.215 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-12T08:46:18.228 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-12T08:46:18.244 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-12T08:46:18.319 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-12T08:46:18.327 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-12T08:46:18.351 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-12T08:46:18.380 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-12T08:46:18.430 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-12T08:46:18.431 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 93/96 2026-02-12T08:46:18.432 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 94/96 2026-02-12T08:46:18.436 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-12T08:46:18.440 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-12T08:46:18.441 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-12T08:46:18.453 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 94/96 2026-02-12T08:46:18.454 INFO:teuthology.orchestra.run.trial131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:46:18.454 INFO:teuthology.orchestra.run.trial131.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T08:46:18.454 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T08:46:18.454 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T08:46:18.454 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:18.457 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T08:46:18.458 INFO:teuthology.orchestra.run.trial042.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T08:46:18.458 INFO:teuthology.orchestra.run.trial042.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T08:46:18.458 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:18.465 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T08:46:18.489 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T08:46:18.490 INFO:teuthology.orchestra.run.trial042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T08:46:18.490 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:18.523 INFO:teuthology.orchestra.run.trial042.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-12T08:46:18.538 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 95/96 2026-02-12T08:46:18.558 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 95/96 2026-02-12T08:46:18.558 INFO:teuthology.orchestra.run.trial131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:46:18.558 INFO:teuthology.orchestra.run.trial131.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T08:46:18.558 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T08:46:18.559 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T08:46:18.559 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:18.560 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-2:20.3.0-5161.g2401a109.el9.x86_64 96/96 2026-02-12T08:46:18.566 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_6 96/96 2026-02-12T08:46:18.590 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86_6 96/96 2026-02-12T08:46:19.112 INFO:teuthology.orchestra.run.trial042.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 79/96 2026-02-12T08:46:19.918 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-2:20.3.0-5161.g2401a109.el9.x86_64 96/96 2026-02-12T08:46:19.918 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-2:20.3.0-5161.g2401a109.el9.x86_64 1/96 2026-02-12T08:46:19.918 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 2/96 2026-02-12T08:46:19.918 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 3/96 2026-02-12T08:46:19.919 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 4/96 2026-02-12T08:46:19.919 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 5/96 2026-02-12T08:46:19.919 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_6 6/96 2026-02-12T08:46:19.919 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86_6 7/96 2026-02-12T08:46:19.919 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5161.g2401a109.el 8/96 2026-02-12T08:46:19.919 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarc 9/96 2026-02-12T08:46:19.919 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noa 10/96 2026-02-12T08:46:19.919 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a 11/96 2026-02-12T08:46:19.919 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.noa 12/96 2026-02-12T08:46:19.919 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5161.g2401a109.el9. 13/96 2026-02-12T08:46:19.919 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 14/96 2026-02-12T08:46:19.920 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5161.g2401a109.el9 15/96 2026-02-12T08:46:19.920 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 16/96 2026-02-12T08:46:19.920 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : cephadm-2:20.3.0-5161.g2401a109.el9.noarch 17/96 2026-02-12T08:46:19.920 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 18/96 2026-02-12T08:46:19.920 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-12T08:46:19.920 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-12T08:46:19.920 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-12T08:46:19.920 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-12T08:46:19.920 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-12T08:46:19.920 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-12T08:46:19.920 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-12T08:46:19.920 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-12T08:46:19.921 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-12T08:46:19.921 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-12T08:46:19.921 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-12T08:46:19.921 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-12T08:46:19.921 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-12T08:46:19.921 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 32/96 2026-02-12T08:46:19.921 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 33/96 2026-02-12T08:46:19.921 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 34/96 2026-02-12T08:46:19.921 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-12T08:46:19.921 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-12T08:46:19.921 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-12T08:46:19.922 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-12T08:46:19.922 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-12T08:46:19.922 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 40/96 2026-02-12T08:46:19.922 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-12T08:46:19.922 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-12T08:46:19.922 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-12T08:46:19.922 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-12T08:46:19.922 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-12T08:46:19.922 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-12T08:46:19.922 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-12T08:46:19.922 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-12T08:46:19.922 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-12T08:46:19.922 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-12T08:46:19.923 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-12T08:46:19.923 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-12T08:46:19.923 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-12T08:46:19.923 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-12T08:46:19.923 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-12T08:46:19.923 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-12T08:46:19.923 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-12T08:46:19.923 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-12T08:46:19.923 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-12T08:46:19.923 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-12T08:46:19.923 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-12T08:46:19.923 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-12T08:46:19.923 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-12T08:46:19.924 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-12T08:46:19.924 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-12T08:46:19.924 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-12T08:46:19.924 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-12T08:46:19.924 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-12T08:46:19.924 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-12T08:46:19.924 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-12T08:46:19.924 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-12T08:46:19.924 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-12T08:46:19.924 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-12T08:46:19.924 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-12T08:46:19.924 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-12T08:46:19.924 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-12T08:46:19.925 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-12T08:46:19.925 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-12T08:46:19.925 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-12T08:46:19.925 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-12T08:46:19.925 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-12T08:46:19.925 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-12T08:46:19.925 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-12T08:46:19.925 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-12T08:46:19.925 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-12T08:46:19.925 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-12T08:46:19.925 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-12T08:46:19.925 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-12T08:46:19.925 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-12T08:46:19.926 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-12T08:46:19.926 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-12T08:46:19.926 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-12T08:46:19.926 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-12T08:46:19.926 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-12T08:46:19.926 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-12T08:46:19.980 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-12T08:46:19.980 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:19.981 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-12T08:46:19.981 INFO:teuthology.orchestra.run.trial131.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T08:46:19.981 INFO:teuthology.orchestra.run.trial131.stdout: ceph-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:19.981 INFO:teuthology.orchestra.run.trial131.stdout: ceph-grafana-dashboards-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:19.981 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:19.981 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:19.981 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:19.981 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:19.981 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:19.981 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:19.981 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-modules-core-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:19.981 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:19.982 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:19.982 INFO:teuthology.orchestra.run.trial131.stdout: ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:19.982 INFO:teuthology.orchestra.run.trial131.stdout: ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:19.982 INFO:teuthology.orchestra.run.trial131.stdout: ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:19.982 INFO:teuthology.orchestra.run.trial131.stdout: ceph-prometheus-alerts-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:19.982 INFO:teuthology.orchestra.run.trial131.stdout: ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:19.982 INFO:teuthology.orchestra.run.trial131.stdout: cephadm-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:19.982 INFO:teuthology.orchestra.run.trial131.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T08:46:19.982 INFO:teuthology.orchestra.run.trial131.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T08:46:19.982 INFO:teuthology.orchestra.run.trial131.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T08:46:19.982 INFO:teuthology.orchestra.run.trial131.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T08:46:19.983 INFO:teuthology.orchestra.run.trial131.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T08:46:19.983 INFO:teuthology.orchestra.run.trial131.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T08:46:19.983 INFO:teuthology.orchestra.run.trial131.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T08:46:19.983 INFO:teuthology.orchestra.run.trial131.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T08:46:19.983 INFO:teuthology.orchestra.run.trial131.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T08:46:19.983 INFO:teuthology.orchestra.run.trial131.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T08:46:19.983 INFO:teuthology.orchestra.run.trial131.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T08:46:19.983 INFO:teuthology.orchestra.run.trial131.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T08:46:19.983 INFO:teuthology.orchestra.run.trial131.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T08:46:19.983 INFO:teuthology.orchestra.run.trial131.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T08:46:19.983 INFO:teuthology.orchestra.run.trial131.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T08:46:19.983 INFO:teuthology.orchestra.run.trial131.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T08:46:19.983 INFO:teuthology.orchestra.run.trial131.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T08:46:19.984 INFO:teuthology.orchestra.run.trial131.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T08:46:19.984 INFO:teuthology.orchestra.run.trial131.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T08:46:19.984 INFO:teuthology.orchestra.run.trial131.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T08:46:19.984 INFO:teuthology.orchestra.run.trial131.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T08:46:19.984 INFO:teuthology.orchestra.run.trial131.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T08:46:19.984 INFO:teuthology.orchestra.run.trial131.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T08:46:19.984 INFO:teuthology.orchestra.run.trial131.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T08:46:19.984 INFO:teuthology.orchestra.run.trial131.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T08:46:19.984 INFO:teuthology.orchestra.run.trial131.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T08:46:19.984 INFO:teuthology.orchestra.run.trial131.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T08:46:19.984 INFO:teuthology.orchestra.run.trial131.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T08:46:19.984 INFO:teuthology.orchestra.run.trial131.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T08:46:19.985 INFO:teuthology.orchestra.run.trial131.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T08:46:19.985 INFO:teuthology.orchestra.run.trial131.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T08:46:19.985 INFO:teuthology.orchestra.run.trial131.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-12T08:46:19.985 INFO:teuthology.orchestra.run.trial131.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-12T08:46:19.985 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T08:46:19.985 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T08:46:19.985 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T08:46:19.985 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T08:46:19.985 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T08:46:19.985 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T08:46:19.985 INFO:teuthology.orchestra.run.trial131.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T08:46:19.985 INFO:teuthology.orchestra.run.trial131.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T08:46:19.985 INFO:teuthology.orchestra.run.trial131.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T08:46:19.986 INFO:teuthology.orchestra.run.trial131.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T08:46:19.986 INFO:teuthology.orchestra.run.trial131.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-12T08:46:19.986 INFO:teuthology.orchestra.run.trial131.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T08:46:19.986 INFO:teuthology.orchestra.run.trial131.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T08:46:19.986 INFO:teuthology.orchestra.run.trial131.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-12T08:46:19.986 INFO:teuthology.orchestra.run.trial131.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T08:46:19.986 INFO:teuthology.orchestra.run.trial131.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T08:46:19.986 INFO:teuthology.orchestra.run.trial131.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T08:46:19.986 INFO:teuthology.orchestra.run.trial131.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T08:46:19.986 INFO:teuthology.orchestra.run.trial131.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T08:46:19.986 INFO:teuthology.orchestra.run.trial131.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T08:46:19.986 INFO:teuthology.orchestra.run.trial131.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T08:46:19.986 INFO:teuthology.orchestra.run.trial131.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T08:46:19.987 INFO:teuthology.orchestra.run.trial131.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T08:46:19.987 INFO:teuthology.orchestra.run.trial131.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T08:46:19.987 INFO:teuthology.orchestra.run.trial131.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T08:46:19.987 INFO:teuthology.orchestra.run.trial131.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T08:46:19.987 INFO:teuthology.orchestra.run.trial131.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T08:46:19.987 INFO:teuthology.orchestra.run.trial131.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T08:46:19.987 INFO:teuthology.orchestra.run.trial131.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T08:46:19.987 INFO:teuthology.orchestra.run.trial131.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T08:46:19.987 INFO:teuthology.orchestra.run.trial131.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T08:46:19.987 INFO:teuthology.orchestra.run.trial131.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-12T08:46:19.987 INFO:teuthology.orchestra.run.trial131.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T08:46:19.987 INFO:teuthology.orchestra.run.trial131.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T08:46:19.987 INFO:teuthology.orchestra.run.trial131.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T08:46:19.988 INFO:teuthology.orchestra.run.trial131.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T08:46:19.988 INFO:teuthology.orchestra.run.trial131.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T08:46:19.988 INFO:teuthology.orchestra.run.trial131.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T08:46:19.988 INFO:teuthology.orchestra.run.trial131.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-12T08:46:19.988 INFO:teuthology.orchestra.run.trial131.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T08:46:19.988 INFO:teuthology.orchestra.run.trial131.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T08:46:19.988 INFO:teuthology.orchestra.run.trial131.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T08:46:19.988 INFO:teuthology.orchestra.run.trial131.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-12T08:46:19.988 INFO:teuthology.orchestra.run.trial131.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-12T08:46:19.988 INFO:teuthology.orchestra.run.trial131.stdout: zip-3.0-35.el9.x86_64 2026-02-12T08:46:19.988 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:19.988 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:20.045 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-base 2026-02-12T08:46:20.347 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:03:52 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:20.412 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:20.430 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:20.430 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:20.431 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:20.452 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install cephadm 2026-02-12T08:46:20.754 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:03:52 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:20.818 INFO:teuthology.orchestra.run.trial131.stdout:Package cephadm-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:46:20.837 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:20.838 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:20.838 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:20.860 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T08:46:21.165 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:03:53 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:21.249 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:21.249 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:21.249 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repo Size 2026-02-12T08:46:21.249 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:21.249 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-12T08:46:21.249 INFO:teuthology.orchestra.run.trial131.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5161.g2401a109.el9 ceph 149 k 2026-02-12T08:46:21.250 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:21.250 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-12T08:46:21.250 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:21.250 INFO:teuthology.orchestra.run.trial131.stdout:Install 1 Package 2026-02-12T08:46:21.250 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:21.250 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 149 k 2026-02-12T08:46:21.250 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 455 k 2026-02-12T08:46:21.250 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-12T08:46:21.760 INFO:teuthology.orchestra.run.trial131.stdout:ceph-immutable-object-cache-20.3.0-5161.g2401a1 292 kB/s | 149 kB 00:00 2026-02-12T08:46:21.762 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:46:21.762 INFO:teuthology.orchestra.run.trial131.stdout:Total 291 kB/s | 149 kB 00:00 2026-02-12T08:46:21.762 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-12T08:46:21.767 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-12T08:46:21.767 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-12T08:46:21.799 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-12T08:46:21.799 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-12T08:46:21.855 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-12T08:46:21.856 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5161.g2401a109. 1/1 2026-02-12T08:46:21.878 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5161.g2401a109. 1/1 2026-02-12T08:46:21.878 INFO:teuthology.orchestra.run.trial131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:46:21.879 INFO:teuthology.orchestra.run.trial131.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T08:46:21.879 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:22.171 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5161.g2401a109. 1/1 2026-02-12T08:46:22.171 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:22.171 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-12T08:46:22.172 INFO:teuthology.orchestra.run.trial131.stdout: ceph-immutable-object-cache-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:22.172 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:22.172 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:22.200 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-mgr 2026-02-12T08:46:22.505 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:03:54 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:22.569 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:22.588 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:22.588 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:22.589 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:22.611 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T08:46:22.918 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:03:54 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:22.982 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:46:23.000 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:23.001 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:23.001 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:23.023 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T08:46:23.326 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:03:55 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:23.390 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:46:23.408 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:23.409 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:23.409 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:23.430 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-mgr-rook 2026-02-12T08:46:23.729 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:03:55 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:23.793 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:46:23.811 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:23.812 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:23.812 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:23.834 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T08:46:24.133 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:03:56 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:24.199 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:46:24.217 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:24.218 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:24.218 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:24.239 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-osd 2026-02-12T08:46:24.462 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_6 80/96 2026-02-12T08:46:24.526 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86_6 81/96 2026-02-12T08:46:24.528 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 82/96 2026-02-12T08:46:24.541 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 82/96 2026-02-12T08:46:24.541 INFO:teuthology.orchestra.run.trial042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:46:24.541 INFO:teuthology.orchestra.run.trial042.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T08:46:24.541 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:24.545 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:03:56 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:24.552 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 83/96 2026-02-12T08:46:24.574 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 83/96 2026-02-12T08:46:24.574 INFO:teuthology.orchestra.run.trial042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:46:24.574 INFO:teuthology.orchestra.run.trial042.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T08:46:24.574 INFO:teuthology.orchestra.run.trial042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T08:46:24.574 INFO:teuthology.orchestra.run.trial042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T08:46:24.575 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:24.610 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:24.629 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:24.630 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:24.630 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:24.634 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: cephadm-2:20.3.0-5161.g2401a109.el9.noarch 84/96 2026-02-12T08:46:24.636 INFO:teuthology.orchestra.run.trial042.stdout: Installing : cephadm-2:20.3.0-5161.g2401a109.el9.noarch 84/96 2026-02-12T08:46:24.645 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5161.g2401a109.el9 85/96 2026-02-12T08:46:24.652 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-osd-classic 2026-02-12T08:46:24.669 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5161.g2401a109.el 86/96 2026-02-12T08:46:24.670 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarc 87/96 2026-02-12T08:46:24.950 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:03:56 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:25.016 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:25.035 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:25.036 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:25.036 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:25.057 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-fuse 2026-02-12T08:46:25.358 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:03:57 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:25.441 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:25.442 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:25.443 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repo Size 2026-02-12T08:46:25.443 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:25.443 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-12T08:46:25.443 INFO:teuthology.orchestra.run.trial131.stdout: ceph-fuse x86_64 2:20.3.0-5161.g2401a109.el9 ceph 914 k 2026-02-12T08:46:25.443 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:25.443 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-12T08:46:25.443 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:25.443 INFO:teuthology.orchestra.run.trial131.stdout:Install 1 Package 2026-02-12T08:46:25.443 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:25.443 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 914 k 2026-02-12T08:46:25.443 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 2.9 M 2026-02-12T08:46:25.444 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-12T08:46:26.243 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarc 87/96 2026-02-12T08:46:26.250 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noa 88/96 2026-02-12T08:46:26.376 INFO:teuthology.orchestra.run.trial131.stdout:ceph-fuse-20.3.0-5161.g2401a109.el9.x86_64.rpm 979 kB/s | 914 kB 00:00 2026-02-12T08:46:26.378 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:46:26.378 INFO:teuthology.orchestra.run.trial131.stdout:Total 978 kB/s | 914 kB 00:00 2026-02-12T08:46:26.378 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-12T08:46:26.382 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-12T08:46:26.382 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-12T08:46:26.417 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-12T08:46:26.417 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-12T08:46:26.509 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-12T08:46:26.527 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:26.703 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noa 88/96 2026-02-12T08:46:26.704 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a 89/96 2026-02-12T08:46:26.715 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a 89/96 2026-02-12T08:46:26.716 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.noa 90/96 2026-02-12T08:46:26.771 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:26.779 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.noa 90/96 2026-02-12T08:46:26.819 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5161.g2401a109.el9. 91/96 2026-02-12T08:46:26.820 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 92/96 2026-02-12T08:46:26.827 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:26.827 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:26.828 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-12T08:46:26.828 INFO:teuthology.orchestra.run.trial131.stdout: ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:26.828 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:26.828 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:26.841 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 92/96 2026-02-12T08:46:26.841 INFO:teuthology.orchestra.run.trial042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:46:26.841 INFO:teuthology.orchestra.run.trial042.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T08:46:26.841 INFO:teuthology.orchestra.run.trial042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T08:46:26.841 INFO:teuthology.orchestra.run.trial042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T08:46:26.841 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:26.852 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 93/96 2026-02-12T08:46:26.857 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-volume 2026-02-12T08:46:27.071 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 93/96 2026-02-12T08:46:27.072 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 94/96 2026-02-12T08:46:27.093 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 94/96 2026-02-12T08:46:27.093 INFO:teuthology.orchestra.run.trial042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:46:27.093 INFO:teuthology.orchestra.run.trial042.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T08:46:27.093 INFO:teuthology.orchestra.run.trial042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T08:46:27.093 INFO:teuthology.orchestra.run.trial042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T08:46:27.093 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:27.157 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:03:59 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:27.175 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 95/96 2026-02-12T08:46:27.194 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 95/96 2026-02-12T08:46:27.194 INFO:teuthology.orchestra.run.trial042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:46:27.194 INFO:teuthology.orchestra.run.trial042.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T08:46:27.194 INFO:teuthology.orchestra.run.trial042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T08:46:27.194 INFO:teuthology.orchestra.run.trial042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T08:46:27.194 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:27.195 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-2:20.3.0-5161.g2401a109.el9.x86_64 96/96 2026-02-12T08:46:27.201 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_6 96/96 2026-02-12T08:46:27.221 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:46:27.224 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86_6 96/96 2026-02-12T08:46:27.239 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:27.239 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:27.239 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:27.261 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install librados-devel 2026-02-12T08:46:27.562 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:03:59 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:27.646 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:27.646 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:27.646 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repo Size 2026-02-12T08:46:27.646 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:27.646 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-12T08:46:27.646 INFO:teuthology.orchestra.run.trial131.stdout: librados-devel x86_64 2:20.3.0-5161.g2401a109.el9 ceph 124 k 2026-02-12T08:46:27.646 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:27.646 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-12T08:46:27.646 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:27.647 INFO:teuthology.orchestra.run.trial131.stdout:Install 1 Package 2026-02-12T08:46:27.647 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:27.647 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 124 k 2026-02-12T08:46:27.647 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 434 k 2026-02-12T08:46:27.647 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-12T08:46:28.138 INFO:teuthology.orchestra.run.trial131.stdout:librados-devel-20.3.0-5161.g2401a109.el9.x86_64 251 kB/s | 124 kB 00:00 2026-02-12T08:46:28.139 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:46:28.139 INFO:teuthology.orchestra.run.trial131.stdout:Total 251 kB/s | 124 kB 00:00 2026-02-12T08:46:28.139 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-12T08:46:28.142 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-12T08:46:28.142 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-12T08:46:28.174 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-12T08:46:28.174 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-12T08:46:28.229 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-12T08:46:28.246 INFO:teuthology.orchestra.run.trial131.stdout: Installing : librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:28.329 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:28.386 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:28.386 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:28.386 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-12T08:46:28.387 INFO:teuthology.orchestra.run.trial131.stdout: librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:28.387 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:28.387 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:28.415 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install libcephfs2 2026-02-12T08:46:28.529 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-2:20.3.0-5161.g2401a109.el9.x86_64 96/96 2026-02-12T08:46:28.529 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-2:20.3.0-5161.g2401a109.el9.x86_64 1/96 2026-02-12T08:46:28.529 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 2/96 2026-02-12T08:46:28.529 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 3/96 2026-02-12T08:46:28.530 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 4/96 2026-02-12T08:46:28.530 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 5/96 2026-02-12T08:46:28.530 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_6 6/96 2026-02-12T08:46:28.530 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86_6 7/96 2026-02-12T08:46:28.530 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5161.g2401a109.el 8/96 2026-02-12T08:46:28.530 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarc 9/96 2026-02-12T08:46:28.530 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noa 10/96 2026-02-12T08:46:28.530 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a 11/96 2026-02-12T08:46:28.530 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.noa 12/96 2026-02-12T08:46:28.530 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5161.g2401a109.el9. 13/96 2026-02-12T08:46:28.530 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 14/96 2026-02-12T08:46:28.530 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5161.g2401a109.el9 15/96 2026-02-12T08:46:28.531 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 16/96 2026-02-12T08:46:28.531 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : cephadm-2:20.3.0-5161.g2401a109.el9.noarch 17/96 2026-02-12T08:46:28.531 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 18/96 2026-02-12T08:46:28.531 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-12T08:46:28.531 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-12T08:46:28.531 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-12T08:46:28.531 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-12T08:46:28.531 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-12T08:46:28.531 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-12T08:46:28.531 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-12T08:46:28.531 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-12T08:46:28.531 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-12T08:46:28.532 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-12T08:46:28.532 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-12T08:46:28.532 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-12T08:46:28.532 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-12T08:46:28.532 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 32/96 2026-02-12T08:46:28.532 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 33/96 2026-02-12T08:46:28.532 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 34/96 2026-02-12T08:46:28.532 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-12T08:46:28.532 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-12T08:46:28.532 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-12T08:46:28.532 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-12T08:46:28.532 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-12T08:46:28.532 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 40/96 2026-02-12T08:46:28.533 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-12T08:46:28.533 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-12T08:46:28.533 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-12T08:46:28.533 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-12T08:46:28.533 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-12T08:46:28.533 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-12T08:46:28.533 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-12T08:46:28.533 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-12T08:46:28.533 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-12T08:46:28.533 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-12T08:46:28.533 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-12T08:46:28.533 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-12T08:46:28.534 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-12T08:46:28.534 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-12T08:46:28.534 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-12T08:46:28.534 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-12T08:46:28.534 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-12T08:46:28.534 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-12T08:46:28.534 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-12T08:46:28.534 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-12T08:46:28.534 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-12T08:46:28.534 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-12T08:46:28.534 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-12T08:46:28.534 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-12T08:46:28.535 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-12T08:46:28.535 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-12T08:46:28.535 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-12T08:46:28.535 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-12T08:46:28.535 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-12T08:46:28.535 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-12T08:46:28.535 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-12T08:46:28.535 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-12T08:46:28.535 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-12T08:46:28.535 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-12T08:46:28.535 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-12T08:46:28.535 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-12T08:46:28.535 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-12T08:46:28.536 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-12T08:46:28.536 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-12T08:46:28.536 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-12T08:46:28.536 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-12T08:46:28.536 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-12T08:46:28.536 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-12T08:46:28.536 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-12T08:46:28.536 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-12T08:46:28.536 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-12T08:46:28.536 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-12T08:46:28.536 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-12T08:46:28.536 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-12T08:46:28.536 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-12T08:46:28.537 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-12T08:46:28.537 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-12T08:46:28.537 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-12T08:46:28.537 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-12T08:46:28.537 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-12T08:46:28.592 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-12T08:46:28.592 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:28.592 INFO:teuthology.orchestra.run.trial042.stdout:Installed: 2026-02-12T08:46:28.592 INFO:teuthology.orchestra.run.trial042.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T08:46:28.592 INFO:teuthology.orchestra.run.trial042.stdout: ceph-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:28.592 INFO:teuthology.orchestra.run.trial042.stdout: ceph-grafana-dashboards-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:28.593 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:28.593 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:28.593 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:28.593 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:28.593 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:28.593 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:28.593 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mgr-modules-core-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:28.593 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:28.593 INFO:teuthology.orchestra.run.trial042.stdout: ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:28.593 INFO:teuthology.orchestra.run.trial042.stdout: ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:28.593 INFO:teuthology.orchestra.run.trial042.stdout: ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:28.593 INFO:teuthology.orchestra.run.trial042.stdout: ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:28.594 INFO:teuthology.orchestra.run.trial042.stdout: ceph-prometheus-alerts-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:28.594 INFO:teuthology.orchestra.run.trial042.stdout: ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:28.594 INFO:teuthology.orchestra.run.trial042.stdout: cephadm-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:46:28.594 INFO:teuthology.orchestra.run.trial042.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T08:46:28.594 INFO:teuthology.orchestra.run.trial042.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T08:46:28.594 INFO:teuthology.orchestra.run.trial042.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T08:46:28.594 INFO:teuthology.orchestra.run.trial042.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T08:46:28.594 INFO:teuthology.orchestra.run.trial042.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T08:46:28.594 INFO:teuthology.orchestra.run.trial042.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T08:46:28.594 INFO:teuthology.orchestra.run.trial042.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T08:46:28.594 INFO:teuthology.orchestra.run.trial042.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T08:46:28.594 INFO:teuthology.orchestra.run.trial042.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T08:46:28.595 INFO:teuthology.orchestra.run.trial042.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T08:46:28.595 INFO:teuthology.orchestra.run.trial042.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T08:46:28.595 INFO:teuthology.orchestra.run.trial042.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T08:46:28.595 INFO:teuthology.orchestra.run.trial042.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T08:46:28.595 INFO:teuthology.orchestra.run.trial042.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T08:46:28.595 INFO:teuthology.orchestra.run.trial042.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T08:46:28.595 INFO:teuthology.orchestra.run.trial042.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T08:46:28.595 INFO:teuthology.orchestra.run.trial042.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T08:46:28.595 INFO:teuthology.orchestra.run.trial042.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T08:46:28.595 INFO:teuthology.orchestra.run.trial042.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T08:46:28.595 INFO:teuthology.orchestra.run.trial042.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T08:46:28.595 INFO:teuthology.orchestra.run.trial042.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T08:46:28.595 INFO:teuthology.orchestra.run.trial042.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T08:46:28.596 INFO:teuthology.orchestra.run.trial042.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T08:46:28.596 INFO:teuthology.orchestra.run.trial042.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T08:46:28.596 INFO:teuthology.orchestra.run.trial042.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T08:46:28.596 INFO:teuthology.orchestra.run.trial042.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T08:46:28.596 INFO:teuthology.orchestra.run.trial042.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T08:46:28.596 INFO:teuthology.orchestra.run.trial042.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T08:46:28.596 INFO:teuthology.orchestra.run.trial042.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T08:46:28.596 INFO:teuthology.orchestra.run.trial042.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T08:46:28.596 INFO:teuthology.orchestra.run.trial042.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T08:46:28.596 INFO:teuthology.orchestra.run.trial042.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-12T08:46:28.596 INFO:teuthology.orchestra.run.trial042.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-12T08:46:28.596 INFO:teuthology.orchestra.run.trial042.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T08:46:28.596 INFO:teuthology.orchestra.run.trial042.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T08:46:28.597 INFO:teuthology.orchestra.run.trial042.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T08:46:28.597 INFO:teuthology.orchestra.run.trial042.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T08:46:28.597 INFO:teuthology.orchestra.run.trial042.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T08:46:28.597 INFO:teuthology.orchestra.run.trial042.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T08:46:28.597 INFO:teuthology.orchestra.run.trial042.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T08:46:28.597 INFO:teuthology.orchestra.run.trial042.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T08:46:28.597 INFO:teuthology.orchestra.run.trial042.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T08:46:28.597 INFO:teuthology.orchestra.run.trial042.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T08:46:28.597 INFO:teuthology.orchestra.run.trial042.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-12T08:46:28.597 INFO:teuthology.orchestra.run.trial042.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T08:46:28.597 INFO:teuthology.orchestra.run.trial042.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T08:46:28.597 INFO:teuthology.orchestra.run.trial042.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-12T08:46:28.598 INFO:teuthology.orchestra.run.trial042.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T08:46:28.598 INFO:teuthology.orchestra.run.trial042.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T08:46:28.598 INFO:teuthology.orchestra.run.trial042.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T08:46:28.598 INFO:teuthology.orchestra.run.trial042.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T08:46:28.598 INFO:teuthology.orchestra.run.trial042.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T08:46:28.598 INFO:teuthology.orchestra.run.trial042.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T08:46:28.598 INFO:teuthology.orchestra.run.trial042.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T08:46:28.598 INFO:teuthology.orchestra.run.trial042.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T08:46:28.598 INFO:teuthology.orchestra.run.trial042.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T08:46:28.598 INFO:teuthology.orchestra.run.trial042.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T08:46:28.598 INFO:teuthology.orchestra.run.trial042.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T08:46:28.598 INFO:teuthology.orchestra.run.trial042.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T08:46:28.598 INFO:teuthology.orchestra.run.trial042.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T08:46:28.599 INFO:teuthology.orchestra.run.trial042.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T08:46:28.599 INFO:teuthology.orchestra.run.trial042.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T08:46:28.599 INFO:teuthology.orchestra.run.trial042.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T08:46:28.599 INFO:teuthology.orchestra.run.trial042.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T08:46:28.599 INFO:teuthology.orchestra.run.trial042.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-12T08:46:28.599 INFO:teuthology.orchestra.run.trial042.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T08:46:28.599 INFO:teuthology.orchestra.run.trial042.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T08:46:28.599 INFO:teuthology.orchestra.run.trial042.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T08:46:28.599 INFO:teuthology.orchestra.run.trial042.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T08:46:28.599 INFO:teuthology.orchestra.run.trial042.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T08:46:28.599 INFO:teuthology.orchestra.run.trial042.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T08:46:28.600 INFO:teuthology.orchestra.run.trial042.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-12T08:46:28.600 INFO:teuthology.orchestra.run.trial042.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T08:46:28.600 INFO:teuthology.orchestra.run.trial042.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T08:46:28.600 INFO:teuthology.orchestra.run.trial042.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T08:46:28.600 INFO:teuthology.orchestra.run.trial042.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-12T08:46:28.600 INFO:teuthology.orchestra.run.trial042.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-12T08:46:28.600 INFO:teuthology.orchestra.run.trial042.stdout: zip-3.0-35.el9.x86_64 2026-02-12T08:46:28.600 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:28.600 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:28.659 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-base 2026-02-12T08:46:28.730 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:04:00 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:28.795 INFO:teuthology.orchestra.run.trial131.stdout:Package libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:28.812 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:28.813 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:28.813 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:28.834 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install libcephfs-devel 2026-02-12T08:46:28.968 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:43 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:29.035 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:29.053 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:29.054 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:29.054 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:29.076 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install cephadm 2026-02-12T08:46:29.137 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:04:01 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:29.220 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:29.221 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:29.221 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repo Size 2026-02-12T08:46:29.221 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:29.221 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-12T08:46:29.221 INFO:teuthology.orchestra.run.trial131.stdout: libcephfs-devel x86_64 2:20.3.0-5161.g2401a109.el9 ceph 37 k 2026-02-12T08:46:29.221 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:29.221 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-12T08:46:29.221 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:29.221 INFO:teuthology.orchestra.run.trial131.stdout:Install 1 Package 2026-02-12T08:46:29.222 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:29.222 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 37 k 2026-02-12T08:46:29.222 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 171 k 2026-02-12T08:46:29.222 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-12T08:46:29.380 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:44 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:29.445 INFO:teuthology.orchestra.run.trial042.stdout:Package cephadm-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:46:29.463 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:29.464 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:29.464 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:29.485 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T08:46:29.553 INFO:teuthology.orchestra.run.trial131.stdout:libcephfs-devel-20.3.0-5161.g2401a109.el9.x86_6 113 kB/s | 37 kB 00:00 2026-02-12T08:46:29.553 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:46:29.553 INFO:teuthology.orchestra.run.trial131.stdout:Total 112 kB/s | 37 kB 00:00 2026-02-12T08:46:29.553 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-12T08:46:29.554 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-12T08:46:29.555 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-12T08:46:29.557 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-12T08:46:29.557 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-12T08:46:29.579 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-12T08:46:29.595 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:29.648 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:29.705 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:29.705 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:29.705 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-12T08:46:29.706 INFO:teuthology.orchestra.run.trial131.stdout: libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:29.706 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:29.706 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:29.731 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install librados2 2026-02-12T08:46:29.793 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:44 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:29.877 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:29.878 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:29.878 INFO:teuthology.orchestra.run.trial042.stdout: Package Arch Version Repo Size 2026-02-12T08:46:29.879 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:29.879 INFO:teuthology.orchestra.run.trial042.stdout:Installing: 2026-02-12T08:46:29.879 INFO:teuthology.orchestra.run.trial042.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5161.g2401a109.el9 ceph 149 k 2026-02-12T08:46:29.879 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:29.879 INFO:teuthology.orchestra.run.trial042.stdout:Transaction Summary 2026-02-12T08:46:29.879 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:29.879 INFO:teuthology.orchestra.run.trial042.stdout:Install 1 Package 2026-02-12T08:46:29.879 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:29.879 INFO:teuthology.orchestra.run.trial042.stdout:Total download size: 149 k 2026-02-12T08:46:29.879 INFO:teuthology.orchestra.run.trial042.stdout:Installed size: 455 k 2026-02-12T08:46:29.879 INFO:teuthology.orchestra.run.trial042.stdout:Downloading Packages: 2026-02-12T08:46:30.025 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:04:02 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:30.090 INFO:teuthology.orchestra.run.trial131.stdout:Package librados2-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:30.107 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:30.108 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:30.108 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:30.128 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install librbd1 2026-02-12T08:46:30.369 INFO:teuthology.orchestra.run.trial042.stdout:ceph-immutable-object-cache-20.3.0-5161.g2401a1 304 kB/s | 149 kB 00:00 2026-02-12T08:46:30.369 INFO:teuthology.orchestra.run.trial042.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:46:30.369 INFO:teuthology.orchestra.run.trial042.stdout:Total 304 kB/s | 149 kB 00:00 2026-02-12T08:46:30.370 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction check 2026-02-12T08:46:30.374 INFO:teuthology.orchestra.run.trial042.stdout:Transaction check succeeded. 2026-02-12T08:46:30.374 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction test 2026-02-12T08:46:30.406 INFO:teuthology.orchestra.run.trial042.stdout:Transaction test succeeded. 2026-02-12T08:46:30.406 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction 2026-02-12T08:46:30.431 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:04:02 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:30.461 INFO:teuthology.orchestra.run.trial042.stdout: Preparing : 1/1 2026-02-12T08:46:30.463 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5161.g2401a109. 1/1 2026-02-12T08:46:30.486 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5161.g2401a109. 1/1 2026-02-12T08:46:30.486 INFO:teuthology.orchestra.run.trial042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:46:30.487 INFO:teuthology.orchestra.run.trial042.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T08:46:30.487 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:30.496 INFO:teuthology.orchestra.run.trial131.stdout:Package librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:30.513 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:30.514 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:30.514 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:30.536 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install python3-rados 2026-02-12T08:46:30.799 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5161.g2401a109. 1/1 2026-02-12T08:46:30.799 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:30.799 INFO:teuthology.orchestra.run.trial042.stdout:Installed: 2026-02-12T08:46:30.800 INFO:teuthology.orchestra.run.trial042.stdout: ceph-immutable-object-cache-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:30.800 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:30.800 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:30.828 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-mgr 2026-02-12T08:46:30.834 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:04:02 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:30.898 INFO:teuthology.orchestra.run.trial131.stdout:Package python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:30.915 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:30.916 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:30.916 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:30.938 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install python3-rgw 2026-02-12T08:46:31.132 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:46 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:31.197 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:31.216 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:31.216 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:31.216 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:31.233 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:04:03 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:31.238 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T08:46:31.298 INFO:teuthology.orchestra.run.trial131.stdout:Package python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:31.315 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:31.315 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:31.315 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:31.337 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install python3-cephfs 2026-02-12T08:46:31.540 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:46 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:31.604 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:46:31.622 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:31.623 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:31.623 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:31.641 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:04:03 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:31.644 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T08:46:31.707 INFO:teuthology.orchestra.run.trial131.stdout:Package python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:31.724 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:31.725 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:31.725 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:31.746 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install python3-rbd 2026-02-12T08:46:31.953 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:46 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:32.018 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:46:32.037 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:32.037 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:32.037 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:32.051 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:04:04 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:32.060 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-mgr-rook 2026-02-12T08:46:32.115 INFO:teuthology.orchestra.run.trial131.stdout:Package python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:32.132 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:32.133 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:32.133 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:32.154 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install rbd-fuse 2026-02-12T08:46:32.360 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:47 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:32.426 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:46:32.445 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:32.445 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:32.446 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:32.458 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:04:04 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:32.467 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T08:46:32.540 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:32.541 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:32.541 INFO:teuthology.orchestra.run.trial131.stdout: Package Architecture Version Repository Size 2026-02-12T08:46:32.542 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:32.542 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-12T08:46:32.542 INFO:teuthology.orchestra.run.trial131.stdout: rbd-fuse x86_64 2:20.3.0-5161.g2401a109.el9 ceph 87 k 2026-02-12T08:46:32.542 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:32.542 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-12T08:46:32.542 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:32.542 INFO:teuthology.orchestra.run.trial131.stdout:Install 1 Package 2026-02-12T08:46:32.542 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:32.542 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 87 k 2026-02-12T08:46:32.543 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 236 k 2026-02-12T08:46:32.543 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-12T08:46:32.769 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:47 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:32.834 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:46:32.853 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:32.853 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:32.854 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:32.874 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-osd 2026-02-12T08:46:33.183 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:48 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:33.247 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:33.265 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:33.266 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:33.266 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:33.288 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-osd-classic 2026-02-12T08:46:33.591 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:48 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:33.635 INFO:teuthology.orchestra.run.trial131.stdout:rbd-fuse-20.3.0-5161.g2401a109.el9.x86_64.rpm 79 kB/s | 87 kB 00:01 2026-02-12T08:46:33.638 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:46:33.638 INFO:teuthology.orchestra.run.trial131.stdout:Total 79 kB/s | 87 kB 00:01 2026-02-12T08:46:33.638 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-12T08:46:33.641 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-12T08:46:33.641 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-12T08:46:33.656 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:33.673 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-12T08:46:33.673 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-12T08:46:33.675 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:33.675 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:33.675 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:33.698 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-fuse 2026-02-12T08:46:33.725 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-12T08:46:33.741 INFO:teuthology.orchestra.run.trial131.stdout: Installing : rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:33.819 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:33.877 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:33.877 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:33.877 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-12T08:46:33.877 INFO:teuthology.orchestra.run.trial131.stdout: rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:33.877 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:33.877 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:33.904 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install rbd-mirror 2026-02-12T08:46:34.007 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:49 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:34.091 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:34.092 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:34.092 INFO:teuthology.orchestra.run.trial042.stdout: Package Arch Version Repo Size 2026-02-12T08:46:34.092 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:34.092 INFO:teuthology.orchestra.run.trial042.stdout:Installing: 2026-02-12T08:46:34.093 INFO:teuthology.orchestra.run.trial042.stdout: ceph-fuse x86_64 2:20.3.0-5161.g2401a109.el9 ceph 914 k 2026-02-12T08:46:34.093 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:34.093 INFO:teuthology.orchestra.run.trial042.stdout:Transaction Summary 2026-02-12T08:46:34.093 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:34.093 INFO:teuthology.orchestra.run.trial042.stdout:Install 1 Package 2026-02-12T08:46:34.093 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:34.093 INFO:teuthology.orchestra.run.trial042.stdout:Total download size: 914 k 2026-02-12T08:46:34.093 INFO:teuthology.orchestra.run.trial042.stdout:Installed size: 2.9 M 2026-02-12T08:46:34.093 INFO:teuthology.orchestra.run.trial042.stdout:Downloading Packages: 2026-02-12T08:46:34.203 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:04:06 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:34.285 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:34.286 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:34.286 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repo Size 2026-02-12T08:46:34.286 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:34.286 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-12T08:46:34.286 INFO:teuthology.orchestra.run.trial131.stdout: rbd-mirror x86_64 2:20.3.0-5161.g2401a109.el9 ceph 2.6 M 2026-02-12T08:46:34.286 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:34.286 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-12T08:46:34.286 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:34.287 INFO:teuthology.orchestra.run.trial131.stdout:Install 1 Package 2026-02-12T08:46:34.287 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:34.287 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 2.6 M 2026-02-12T08:46:34.287 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 11 M 2026-02-12T08:46:34.287 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-12T08:46:34.936 INFO:teuthology.orchestra.run.trial042.stdout:ceph-fuse-20.3.0-5161.g2401a109.el9.x86_64.rpm 1.1 MB/s | 914 kB 00:00 2026-02-12T08:46:34.936 INFO:teuthology.orchestra.run.trial042.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:46:34.936 INFO:teuthology.orchestra.run.trial042.stdout:Total 1.1 MB/s | 914 kB 00:00 2026-02-12T08:46:34.936 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction check 2026-02-12T08:46:34.941 INFO:teuthology.orchestra.run.trial042.stdout:Transaction check succeeded. 2026-02-12T08:46:34.941 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction test 2026-02-12T08:46:34.976 INFO:teuthology.orchestra.run.trial042.stdout:Transaction test succeeded. 2026-02-12T08:46:34.976 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction 2026-02-12T08:46:35.066 INFO:teuthology.orchestra.run.trial042.stdout: Preparing : 1/1 2026-02-12T08:46:35.083 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:35.324 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:35.382 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:35.383 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:35.383 INFO:teuthology.orchestra.run.trial042.stdout:Installed: 2026-02-12T08:46:35.383 INFO:teuthology.orchestra.run.trial042.stdout: ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:35.383 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:35.383 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:35.412 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-volume 2026-02-12T08:46:35.720 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:50 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:35.785 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:46:35.802 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:35.803 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:35.803 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:35.824 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install librados-devel 2026-02-12T08:46:36.130 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:51 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:36.214 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:36.215 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:36.215 INFO:teuthology.orchestra.run.trial042.stdout: Package Arch Version Repo Size 2026-02-12T08:46:36.216 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:36.216 INFO:teuthology.orchestra.run.trial042.stdout:Installing: 2026-02-12T08:46:36.216 INFO:teuthology.orchestra.run.trial042.stdout: librados-devel x86_64 2:20.3.0-5161.g2401a109.el9 ceph 124 k 2026-02-12T08:46:36.216 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:36.216 INFO:teuthology.orchestra.run.trial042.stdout:Transaction Summary 2026-02-12T08:46:36.216 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:36.216 INFO:teuthology.orchestra.run.trial042.stdout:Install 1 Package 2026-02-12T08:46:36.216 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:36.216 INFO:teuthology.orchestra.run.trial042.stdout:Total download size: 124 k 2026-02-12T08:46:36.216 INFO:teuthology.orchestra.run.trial042.stdout:Installed size: 434 k 2026-02-12T08:46:36.216 INFO:teuthology.orchestra.run.trial042.stdout:Downloading Packages: 2026-02-12T08:46:36.714 INFO:teuthology.orchestra.run.trial042.stdout:librados-devel-20.3.0-5161.g2401a109.el9.x86_64 248 kB/s | 124 kB 00:00 2026-02-12T08:46:36.714 INFO:teuthology.orchestra.run.trial042.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:46:36.714 INFO:teuthology.orchestra.run.trial042.stdout:Total 248 kB/s | 124 kB 00:00 2026-02-12T08:46:36.714 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction check 2026-02-12T08:46:36.717 INFO:teuthology.orchestra.run.trial042.stdout:Transaction check succeeded. 2026-02-12T08:46:36.717 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction test 2026-02-12T08:46:36.750 INFO:teuthology.orchestra.run.trial042.stdout:Transaction test succeeded. 2026-02-12T08:46:36.750 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction 2026-02-12T08:46:36.804 INFO:teuthology.orchestra.run.trial042.stdout: Preparing : 1/1 2026-02-12T08:46:36.821 INFO:teuthology.orchestra.run.trial042.stdout: Installing : librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:36.897 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:36.955 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:36.955 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:36.955 INFO:teuthology.orchestra.run.trial042.stdout:Installed: 2026-02-12T08:46:36.955 INFO:teuthology.orchestra.run.trial042.stdout: librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:36.955 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:36.955 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:36.984 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install libcephfs2 2026-02-12T08:46:37.047 INFO:teuthology.orchestra.run.trial131.stdout:rbd-mirror-20.3.0-5161.g2401a109.el9.x86_64.rpm 961 kB/s | 2.6 MB 00:02 2026-02-12T08:46:37.048 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:46:37.048 INFO:teuthology.orchestra.run.trial131.stdout:Total 961 kB/s | 2.6 MB 00:02 2026-02-12T08:46:37.048 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-12T08:46:37.053 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-12T08:46:37.053 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-12T08:46:37.092 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-12T08:46:37.092 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-12T08:46:37.257 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-12T08:46:37.258 INFO:teuthology.orchestra.run.trial131.stdout: Installing : rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:37.282 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:37.282 INFO:teuthology.orchestra.run.trial131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:46:37.282 INFO:teuthology.orchestra.run.trial131.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T08:46:37.282 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T08:46:37.282 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T08:46:37.282 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:37.289 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:52 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:37.355 INFO:teuthology.orchestra.run.trial042.stdout:Package libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:37.372 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:37.373 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:37.373 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:37.395 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install libcephfs-devel 2026-02-12T08:46:37.604 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:37.605 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:37.605 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-12T08:46:37.605 INFO:teuthology.orchestra.run.trial131.stdout: rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:37.605 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:37.605 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:37.633 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install rbd-nbd 2026-02-12T08:46:37.702 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:52 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:37.786 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:37.787 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:37.787 INFO:teuthology.orchestra.run.trial042.stdout: Package Arch Version Repo Size 2026-02-12T08:46:37.787 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:37.788 INFO:teuthology.orchestra.run.trial042.stdout:Installing: 2026-02-12T08:46:37.788 INFO:teuthology.orchestra.run.trial042.stdout: libcephfs-devel x86_64 2:20.3.0-5161.g2401a109.el9 ceph 37 k 2026-02-12T08:46:37.788 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:37.788 INFO:teuthology.orchestra.run.trial042.stdout:Transaction Summary 2026-02-12T08:46:37.788 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:37.788 INFO:teuthology.orchestra.run.trial042.stdout:Install 1 Package 2026-02-12T08:46:37.788 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:37.788 INFO:teuthology.orchestra.run.trial042.stdout:Total download size: 37 k 2026-02-12T08:46:37.788 INFO:teuthology.orchestra.run.trial042.stdout:Installed size: 171 k 2026-02-12T08:46:37.788 INFO:teuthology.orchestra.run.trial042.stdout:Downloading Packages: 2026-02-12T08:46:37.939 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:04:09 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:38.022 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:38.023 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:38.023 INFO:teuthology.orchestra.run.trial131.stdout: Package Architecture Version Repository Size 2026-02-12T08:46:38.023 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:38.023 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-12T08:46:38.023 INFO:teuthology.orchestra.run.trial131.stdout: rbd-nbd x86_64 2:20.3.0-5161.g2401a109.el9 ceph 166 k 2026-02-12T08:46:38.023 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:38.024 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-12T08:46:38.024 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:38.024 INFO:teuthology.orchestra.run.trial131.stdout:Install 1 Package 2026-02-12T08:46:38.024 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:38.024 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 166 k 2026-02-12T08:46:38.024 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 496 k 2026-02-12T08:46:38.024 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-12T08:46:38.119 INFO:teuthology.orchestra.run.trial042.stdout:libcephfs-devel-20.3.0-5161.g2401a109.el9.x86_6 112 kB/s | 37 kB 00:00 2026-02-12T08:46:38.120 INFO:teuthology.orchestra.run.trial042.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:46:38.121 INFO:teuthology.orchestra.run.trial042.stdout:Total 112 kB/s | 37 kB 00:00 2026-02-12T08:46:38.121 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction check 2026-02-12T08:46:38.123 INFO:teuthology.orchestra.run.trial042.stdout:Transaction check succeeded. 2026-02-12T08:46:38.123 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction test 2026-02-12T08:46:38.126 INFO:teuthology.orchestra.run.trial042.stdout:Transaction test succeeded. 2026-02-12T08:46:38.126 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction 2026-02-12T08:46:38.148 INFO:teuthology.orchestra.run.trial042.stdout: Preparing : 1/1 2026-02-12T08:46:38.164 INFO:teuthology.orchestra.run.trial042.stdout: Installing : libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:38.220 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:38.277 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:38.277 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:38.277 INFO:teuthology.orchestra.run.trial042.stdout:Installed: 2026-02-12T08:46:38.278 INFO:teuthology.orchestra.run.trial042.stdout: libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:38.278 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:38.278 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:38.308 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install librados2 2026-02-12T08:46:38.619 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:53 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:38.684 INFO:teuthology.orchestra.run.trial042.stdout:Package librados2-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:38.701 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:38.702 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:38.702 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:38.724 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install librbd1 2026-02-12T08:46:38.809 INFO:teuthology.orchestra.run.trial131.stdout:rbd-nbd-20.3.0-5161.g2401a109.el9.x86_64.rpm 212 kB/s | 166 kB 00:00 2026-02-12T08:46:38.810 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:46:38.810 INFO:teuthology.orchestra.run.trial131.stdout:Total 211 kB/s | 166 kB 00:00 2026-02-12T08:46:38.810 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-12T08:46:38.815 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-12T08:46:38.816 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-12T08:46:38.848 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-12T08:46:38.848 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-12T08:46:38.904 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-12T08:46:38.921 INFO:teuthology.orchestra.run.trial131.stdout: Installing : rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:39.000 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:39.031 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:54 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:39.058 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:39.058 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:39.058 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-12T08:46:39.058 INFO:teuthology.orchestra.run.trial131.stdout: rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:39.059 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:39.059 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:39.086 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-osd-crimson 2026-02-12T08:46:39.095 INFO:teuthology.orchestra.run.trial042.stdout:Package librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:39.113 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:39.113 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:39.113 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:39.135 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install python3-rados 2026-02-12T08:46:39.389 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:04:11 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:39.443 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:54 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:39.453 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:39.471 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:39.471 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:46:39.471 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:46:39.493 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-12T08:46:39.509 INFO:teuthology.orchestra.run.trial042.stdout:Package python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:39.526 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:39.527 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:39.527 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:39.549 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install python3-rgw 2026-02-12T08:46:39.794 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:04:11 ago on Thu 12 Feb 2026 08:42:28 AM UTC. 2026-02-12T08:46:39.855 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:54 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:39.877 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:46:39.877 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:39.878 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repo Size 2026-02-12T08:46:39.878 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:39.878 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-12T08:46:39.878 INFO:teuthology.orchestra.run.trial131.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5161.g2401a109.el9 ceph 429 M 2026-02-12T08:46:39.878 INFO:teuthology.orchestra.run.trial131.stdout:Installing weak dependencies: 2026-02-12T08:46:39.878 INFO:teuthology.orchestra.run.trial131.stdout: ceph-debugsource x86_64 2:20.3.0-5161.g2401a109.el9 ceph 12 M 2026-02-12T08:46:39.878 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:39.878 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-12T08:46:39.878 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T08:46:39.878 INFO:teuthology.orchestra.run.trial131.stdout:Install 2 Packages 2026-02-12T08:46:39.879 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:46:39.879 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 441 M 2026-02-12T08:46:39.879 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 2.7 G 2026-02-12T08:46:39.879 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-12T08:46:39.920 INFO:teuthology.orchestra.run.trial042.stdout:Package python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:39.937 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:39.938 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:39.938 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:39.959 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install python3-cephfs 2026-02-12T08:46:40.261 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:55 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:40.327 INFO:teuthology.orchestra.run.trial042.stdout:Package python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:40.345 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:40.345 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:40.345 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:40.366 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install python3-rbd 2026-02-12T08:46:40.671 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:55 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:40.735 INFO:teuthology.orchestra.run.trial042.stdout:Package python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:40.752 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:40.753 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:40.753 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:40.775 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install rbd-fuse 2026-02-12T08:46:41.079 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:56 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:41.165 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:41.166 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:41.166 INFO:teuthology.orchestra.run.trial042.stdout: Package Architecture Version Repository Size 2026-02-12T08:46:41.166 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:41.166 INFO:teuthology.orchestra.run.trial042.stdout:Installing: 2026-02-12T08:46:41.167 INFO:teuthology.orchestra.run.trial042.stdout: rbd-fuse x86_64 2:20.3.0-5161.g2401a109.el9 ceph 87 k 2026-02-12T08:46:41.167 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:41.167 INFO:teuthology.orchestra.run.trial042.stdout:Transaction Summary 2026-02-12T08:46:41.167 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:41.167 INFO:teuthology.orchestra.run.trial042.stdout:Install 1 Package 2026-02-12T08:46:41.167 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:41.167 INFO:teuthology.orchestra.run.trial042.stdout:Total download size: 87 k 2026-02-12T08:46:41.167 INFO:teuthology.orchestra.run.trial042.stdout:Installed size: 236 k 2026-02-12T08:46:41.167 INFO:teuthology.orchestra.run.trial042.stdout:Downloading Packages: 2026-02-12T08:46:41.590 INFO:teuthology.orchestra.run.trial042.stdout:rbd-fuse-20.3.0-5161.g2401a109.el9.x86_64.rpm 204 kB/s | 87 kB 00:00 2026-02-12T08:46:41.591 INFO:teuthology.orchestra.run.trial042.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:46:41.591 INFO:teuthology.orchestra.run.trial042.stdout:Total 204 kB/s | 87 kB 00:00 2026-02-12T08:46:41.591 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction check 2026-02-12T08:46:41.595 INFO:teuthology.orchestra.run.trial042.stdout:Transaction check succeeded. 2026-02-12T08:46:41.596 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction test 2026-02-12T08:46:41.628 INFO:teuthology.orchestra.run.trial042.stdout:Transaction test succeeded. 2026-02-12T08:46:41.628 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction 2026-02-12T08:46:41.693 INFO:teuthology.orchestra.run.trial042.stdout: Preparing : 1/1 2026-02-12T08:46:41.725 INFO:teuthology.orchestra.run.trial042.stdout: Installing : rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:41.802 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:41.860 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:41.860 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:41.861 INFO:teuthology.orchestra.run.trial042.stdout:Installed: 2026-02-12T08:46:41.861 INFO:teuthology.orchestra.run.trial042.stdout: rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:41.861 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:41.861 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:41.891 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install rbd-mirror 2026-02-12T08:46:42.199 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:57 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:42.282 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:42.282 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:42.282 INFO:teuthology.orchestra.run.trial042.stdout: Package Arch Version Repo Size 2026-02-12T08:46:42.282 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:42.282 INFO:teuthology.orchestra.run.trial042.stdout:Installing: 2026-02-12T08:46:42.283 INFO:teuthology.orchestra.run.trial042.stdout: rbd-mirror x86_64 2:20.3.0-5161.g2401a109.el9 ceph 2.6 M 2026-02-12T08:46:42.283 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:42.283 INFO:teuthology.orchestra.run.trial042.stdout:Transaction Summary 2026-02-12T08:46:42.283 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:42.283 INFO:teuthology.orchestra.run.trial042.stdout:Install 1 Package 2026-02-12T08:46:42.283 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:42.283 INFO:teuthology.orchestra.run.trial042.stdout:Total download size: 2.6 M 2026-02-12T08:46:42.283 INFO:teuthology.orchestra.run.trial042.stdout:Installed size: 11 M 2026-02-12T08:46:42.283 INFO:teuthology.orchestra.run.trial042.stdout:Downloading Packages: 2026-02-12T08:46:43.641 INFO:teuthology.orchestra.run.trial042.stdout:rbd-mirror-20.3.0-5161.g2401a109.el9.x86_64.rpm 1.9 MB/s | 2.6 MB 00:01 2026-02-12T08:46:43.642 INFO:teuthology.orchestra.run.trial042.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:46:43.642 INFO:teuthology.orchestra.run.trial042.stdout:Total 1.9 MB/s | 2.6 MB 00:01 2026-02-12T08:46:43.642 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction check 2026-02-12T08:46:43.648 INFO:teuthology.orchestra.run.trial042.stdout:Transaction check succeeded. 2026-02-12T08:46:43.648 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction test 2026-02-12T08:46:43.687 INFO:teuthology.orchestra.run.trial042.stdout:Transaction test succeeded. 2026-02-12T08:46:43.687 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction 2026-02-12T08:46:43.852 INFO:teuthology.orchestra.run.trial042.stdout: Preparing : 1/1 2026-02-12T08:46:43.853 INFO:teuthology.orchestra.run.trial042.stdout: Installing : rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:43.876 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:43.877 INFO:teuthology.orchestra.run.trial042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:46:43.877 INFO:teuthology.orchestra.run.trial042.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T08:46:43.877 INFO:teuthology.orchestra.run.trial042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T08:46:43.877 INFO:teuthology.orchestra.run.trial042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T08:46:43.877 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:44.191 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:44.191 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:44.191 INFO:teuthology.orchestra.run.trial042.stdout:Installed: 2026-02-12T08:46:44.191 INFO:teuthology.orchestra.run.trial042.stdout: rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:44.192 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:44.192 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:44.221 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install rbd-nbd 2026-02-12T08:46:44.376 INFO:teuthology.orchestra.run.trial131.stdout:(1/2): ceph-debugsource-20.3.0-5161.g2401a109.e 2.7 MB/s | 12 MB 00:04 2026-02-12T08:46:44.534 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:03:59 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:44.617 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:44.618 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:44.618 INFO:teuthology.orchestra.run.trial042.stdout: Package Architecture Version Repository Size 2026-02-12T08:46:44.618 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:44.618 INFO:teuthology.orchestra.run.trial042.stdout:Installing: 2026-02-12T08:46:44.618 INFO:teuthology.orchestra.run.trial042.stdout: rbd-nbd x86_64 2:20.3.0-5161.g2401a109.el9 ceph 166 k 2026-02-12T08:46:44.618 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:44.618 INFO:teuthology.orchestra.run.trial042.stdout:Transaction Summary 2026-02-12T08:46:44.618 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:44.618 INFO:teuthology.orchestra.run.trial042.stdout:Install 1 Package 2026-02-12T08:46:44.619 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:44.619 INFO:teuthology.orchestra.run.trial042.stdout:Total download size: 166 k 2026-02-12T08:46:44.619 INFO:teuthology.orchestra.run.trial042.stdout:Installed size: 496 k 2026-02-12T08:46:44.619 INFO:teuthology.orchestra.run.trial042.stdout:Downloading Packages: 2026-02-12T08:46:45.080 INFO:teuthology.orchestra.run.trial042.stdout:rbd-nbd-20.3.0-5161.g2401a109.el9.x86_64.rpm 361 kB/s | 166 kB 00:00 2026-02-12T08:46:45.080 INFO:teuthology.orchestra.run.trial042.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:46:45.080 INFO:teuthology.orchestra.run.trial042.stdout:Total 360 kB/s | 166 kB 00:00 2026-02-12T08:46:45.080 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction check 2026-02-12T08:46:45.085 INFO:teuthology.orchestra.run.trial042.stdout:Transaction check succeeded. 2026-02-12T08:46:45.086 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction test 2026-02-12T08:46:45.118 INFO:teuthology.orchestra.run.trial042.stdout:Transaction test succeeded. 2026-02-12T08:46:45.118 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction 2026-02-12T08:46:45.174 INFO:teuthology.orchestra.run.trial042.stdout: Preparing : 1/1 2026-02-12T08:46:45.190 INFO:teuthology.orchestra.run.trial042.stdout: Installing : rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:45.276 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:45.334 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:46:45.335 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:45.335 INFO:teuthology.orchestra.run.trial042.stdout:Installed: 2026-02-12T08:46:45.335 INFO:teuthology.orchestra.run.trial042.stdout: rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:46:45.335 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:45.335 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:45.365 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-osd-crimson 2026-02-12T08:46:45.674 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:04:00 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:45.738 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:46:45.755 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:45.756 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:46:45.756 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:46:45.778 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-12T08:46:46.084 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:04:01 ago on Thu 12 Feb 2026 08:42:45 AM UTC. 2026-02-12T08:46:46.166 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:46:46.168 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:46.168 INFO:teuthology.orchestra.run.trial042.stdout: Package Arch Version Repo Size 2026-02-12T08:46:46.168 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:46.168 INFO:teuthology.orchestra.run.trial042.stdout:Installing: 2026-02-12T08:46:46.168 INFO:teuthology.orchestra.run.trial042.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5161.g2401a109.el9 ceph 429 M 2026-02-12T08:46:46.168 INFO:teuthology.orchestra.run.trial042.stdout:Installing weak dependencies: 2026-02-12T08:46:46.168 INFO:teuthology.orchestra.run.trial042.stdout: ceph-debugsource x86_64 2:20.3.0-5161.g2401a109.el9 ceph 12 M 2026-02-12T08:46:46.169 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:46.169 INFO:teuthology.orchestra.run.trial042.stdout:Transaction Summary 2026-02-12T08:46:46.169 INFO:teuthology.orchestra.run.trial042.stdout:================================================================================ 2026-02-12T08:46:46.169 INFO:teuthology.orchestra.run.trial042.stdout:Install 2 Packages 2026-02-12T08:46:46.169 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:46:46.169 INFO:teuthology.orchestra.run.trial042.stdout:Total download size: 441 M 2026-02-12T08:46:46.169 INFO:teuthology.orchestra.run.trial042.stdout:Installed size: 2.7 G 2026-02-12T08:46:46.169 INFO:teuthology.orchestra.run.trial042.stdout:Downloading Packages: 2026-02-12T08:46:57.423 INFO:teuthology.orchestra.run.trial042.stdout:(1/2): ceph-debugsource-20.3.0-5161.g2401a109.e 1.1 MB/s | 12 MB 00:11 2026-02-12T08:50:59.128 INFO:teuthology.orchestra.run.trial042.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5161.g 1.7 MB/s | 429 MB 04:12 2026-02-12T08:50:59.129 INFO:teuthology.orchestra.run.trial042.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:50:59.130 INFO:teuthology.orchestra.run.trial042.stdout:Total 1.7 MB/s | 441 MB 04:12 2026-02-12T08:50:59.130 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction check 2026-02-12T08:50:59.135 INFO:teuthology.orchestra.run.trial042.stdout:Transaction check succeeded. 2026-02-12T08:50:59.136 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction test 2026-02-12T08:51:00.499 INFO:teuthology.orchestra.run.trial042.stdout:Transaction test succeeded. 2026-02-12T08:51:00.499 INFO:teuthology.orchestra.run.trial042.stdout:Running transaction 2026-02-12T08:51:04.094 INFO:teuthology.orchestra.run.trial042.stdout: Preparing : 1/1 2026-02-12T08:51:26.131 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-debugsource-2:20.3.0-5161.g2401a109.el9.x86_64 1/2 2026-02-12T08:51:26.149 INFO:teuthology.orchestra.run.trial042.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a109.e 2/2 2026-02-12T08:51:28.064 INFO:teuthology.orchestra.run.trial042.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a109.e 2/2 2026-02-12T08:51:28.064 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-debugsource-2:20.3.0-5161.g2401a109.el9.x86_64 1/2 2026-02-12T08:51:28.124 INFO:teuthology.orchestra.run.trial042.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a109.e 2/2 2026-02-12T08:51:28.124 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:51:28.124 INFO:teuthology.orchestra.run.trial042.stdout:Installed: 2026-02-12T08:51:28.124 INFO:teuthology.orchestra.run.trial042.stdout: ceph-debugsource-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:51:28.124 INFO:teuthology.orchestra.run.trial042.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:51:28.124 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:51:28.124 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:51:28.207 DEBUG:teuthology.parallel:result is None 2026-02-12T08:52:30.026 INFO:teuthology.orchestra.run.trial131.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5161.g 1.2 MB/s | 429 MB 05:50 2026-02-12T08:52:30.027 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:52:30.028 INFO:teuthology.orchestra.run.trial131.stdout:Total 1.3 MB/s | 441 MB 05:50 2026-02-12T08:52:30.028 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-12T08:52:30.033 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-12T08:52:30.033 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-12T08:52:31.401 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-12T08:52:31.401 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-12T08:52:34.982 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-12T08:52:57.054 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-debugsource-2:20.3.0-5161.g2401a109.el9.x86_64 1/2 2026-02-12T08:52:57.071 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a109.e 2/2 2026-02-12T08:52:59.049 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a109.e 2/2 2026-02-12T08:52:59.050 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-debugsource-2:20.3.0-5161.g2401a109.el9.x86_64 1/2 2026-02-12T08:52:59.107 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a109.e 2/2 2026-02-12T08:52:59.108 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:52:59.108 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-12T08:52:59.108 INFO:teuthology.orchestra.run.trial131.stdout: ceph-debugsource-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:52:59.108 INFO:teuthology.orchestra.run.trial131.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:52:59.108 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:52:59.108 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:52:59.181 DEBUG:teuthology.parallel:result is None 2026-02-12T08:52:59.182 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:52:59.351 DEBUG:teuthology.orchestra.run.trial042:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T08:52:59.372 INFO:teuthology.orchestra.run.trial042.stdout:20.3.0-5161.g2401a109.el9 2026-02-12T08:52:59.373 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5161.g2401a109.el9 2026-02-12T08:52:59.373 INFO:teuthology.task.install:The correct ceph version 20.3.0-5161.g2401a109 is installed. 2026-02-12T08:52:59.375 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:52:59.533 DEBUG:teuthology.orchestra.run.trial131:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T08:52:59.552 INFO:teuthology.orchestra.run.trial131.stdout:20.3.0-5161.g2401a109.el9 2026-02-12T08:52:59.553 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5161.g2401a109.el9 2026-02-12T08:52:59.553 INFO:teuthology.task.install:The correct ceph version 20.3.0-5161.g2401a109 is installed. 2026-02-12T08:52:59.555 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-12T08:52:59.555 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:52:59.555 DEBUG:teuthology.orchestra.run.trial042:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T08:52:59.583 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-12T08:52:59.583 DEBUG:teuthology.orchestra.run.trial131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T08:52:59.619 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-12T08:52:59.620 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:52:59.620 DEBUG:teuthology.orchestra.run.trial042:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T08:52:59.646 DEBUG:teuthology.orchestra.run.trial042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T08:52:59.711 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-12T08:52:59.711 DEBUG:teuthology.orchestra.run.trial131:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T08:52:59.737 DEBUG:teuthology.orchestra.run.trial131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T08:52:59.799 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-12T08:52:59.800 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:52:59.800 DEBUG:teuthology.orchestra.run.trial042:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T08:52:59.825 DEBUG:teuthology.orchestra.run.trial042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T08:52:59.890 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-12T08:52:59.890 DEBUG:teuthology.orchestra.run.trial131:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T08:52:59.915 DEBUG:teuthology.orchestra.run.trial131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T08:52:59.982 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-12T08:52:59.982 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:52:59.982 DEBUG:teuthology.orchestra.run.trial042:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T08:53:00.008 DEBUG:teuthology.orchestra.run.trial042:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T08:53:00.073 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-12T08:53:00.073 DEBUG:teuthology.orchestra.run.trial131:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T08:53:00.099 DEBUG:teuthology.orchestra.run.trial131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T08:53:00.162 INFO:teuthology.run_tasks:Running task pexec... 2026-02-12T08:53:00.180 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-12T08:53:00.180 DEBUG:teuthology.orchestra.run.trial042:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-12T08:53:00.181 DEBUG:teuthology.orchestra.run.trial131:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-12T08:53:00.184 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial042.front.sepia.ceph.com 2026-02-12T08:53:00.184 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-12T08:53:00.204 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial131.front.sepia.ceph.com 2026-02-12T08:53:00.204 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-12T08:53:00.234 DEBUG:teuthology.parallel:result is None 2026-02-12T08:53:00.254 DEBUG:teuthology.parallel:result is None 2026-02-12T08:53:00.254 INFO:teuthology.run_tasks:Running task install... 2026-02-12T08:53:00.268 DEBUG:teuthology.task.install:project ceph 2026-02-12T08:53:00.268 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'}} 2026-02-12T08:53:00.268 DEBUG:teuthology.task.install:config {'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'} 2026-02-12T08:53:00.268 INFO:teuthology.task.install:Using flavor: debug 2026-02-12T08:53:00.277 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-12T08:53:00.277 INFO:teuthology.task.install:extra packages: [] 2026-02-12T08:53:00.277 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875', 'tag': None, 'wait_for_package': False} 2026-02-12T08:53:00.278 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:53:00.279 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875', 'tag': None, 'wait_for_package': False} 2026-02-12T08:53:00.280 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:53:00.469 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/ 2026-02-12T08:53:00.469 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5161.g2401a109 2026-02-12T08:53:00.480 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/ 2026-02-12T08:53:00.480 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5161.g2401a109 2026-02-12T08:53:00.845 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T08:53:00.845 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:53:00.845 DEBUG:teuthology.orchestra.run.trial042:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T08:53:00.870 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-12T08:53:00.870 DEBUG:teuthology.orchestra.run.trial042:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2401a109e2ac85dfa20fc57328da663aa754c875/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T08:53:00.887 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T08:53:00.887 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-12T08:53:00.887 DEBUG:teuthology.orchestra.run.trial131:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T08:53:00.913 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-12T08:53:00.914 DEBUG:teuthology.orchestra.run.trial131:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2401a109e2ac85dfa20fc57328da663aa754c875/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T08:53:00.934 DEBUG:teuthology.orchestra.run.trial042:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T08:53:00.978 DEBUG:teuthology.orchestra.run.trial131:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T08:53:00.999 DEBUG:teuthology.orchestra.run.trial042:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T08:53:01.042 DEBUG:teuthology.orchestra.run.trial131:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T08:53:01.054 INFO:teuthology.orchestra.run.trial042.stdout:check_obsoletes = 1 2026-02-12T08:53:01.064 DEBUG:teuthology.orchestra.run.trial042:> sudo yum clean all 2026-02-12T08:53:01.098 INFO:teuthology.orchestra.run.trial131.stdout:check_obsoletes = 1 2026-02-12T08:53:01.108 DEBUG:teuthology.orchestra.run.trial131:> sudo yum clean all 2026-02-12T08:53:01.228 INFO:teuthology.orchestra.run.trial042.stdout:56 files removed 2026-02-12T08:53:01.243 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-radosgw 2026-02-12T08:53:01.268 INFO:teuthology.orchestra.run.trial131.stdout:56 files removed 2026-02-12T08:53:01.285 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-radosgw 2026-02-12T08:53:02.111 INFO:teuthology.orchestra.run.trial042.stdout:ceph packages for x86_64 131 kB/s | 94 kB 00:00 2026-02-12T08:53:02.146 INFO:teuthology.orchestra.run.trial131.stdout:ceph packages for x86_64 132 kB/s | 94 kB 00:00 2026-02-12T08:53:02.759 INFO:teuthology.orchestra.run.trial042.stdout:ceph noarch packages 39 kB/s | 24 kB 00:00 2026-02-12T08:53:02.797 INFO:teuthology.orchestra.run.trial131.stdout:ceph noarch packages 39 kB/s | 24 kB 00:00 2026-02-12T08:53:03.340 INFO:teuthology.orchestra.run.trial042.stdout:ceph source packages 3.7 kB/s | 2.1 kB 00:00 2026-02-12T08:53:03.385 INFO:teuthology.orchestra.run.trial131.stdout:ceph source packages 3.7 kB/s | 2.1 kB 00:00 2026-02-12T08:53:04.093 INFO:teuthology.orchestra.run.trial042.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-12T08:53:04.247 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-12T08:53:07.163 INFO:teuthology.orchestra.run.trial042.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-12T08:53:07.342 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-12T08:53:10.780 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 7.8 MB 00:01 2026-02-12T08:53:11.216 INFO:teuthology.orchestra.run.trial042.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 7.8 MB 00:01 2026-02-12T08:53:12.128 INFO:teuthology.orchestra.run.trial042.stdout:CentOS Stream 9 - Extras packages 103 kB/s | 20 kB 00:00 2026-02-12T08:53:12.510 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-12T08:53:12.709 INFO:teuthology.orchestra.run.trial042.stdout:Extra Packages for Enterprise Linux 40 MB/s | 20 MB 00:00 2026-02-12T08:53:13.154 INFO:teuthology.orchestra.run.trial131.stdout:Extra Packages for Enterprise Linux 36 MB/s | 20 MB 00:00 2026-02-12T08:53:15.954 INFO:teuthology.orchestra.run.trial042.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-12T08:53:16.394 INFO:teuthology.orchestra.run.trial131.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-12T08:53:17.218 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:17.236 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:17.236 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:17.236 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:17.262 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-test 2026-02-12T08:53:17.566 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:02 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:17.633 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:17.645 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:17.652 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:17.652 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:17.653 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:17.663 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:17.663 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:17.663 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:17.674 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph 2026-02-12T08:53:17.687 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-test 2026-02-12T08:53:17.984 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:02 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:17.986 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:01 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:18.050 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:18.050 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:18.067 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:18.068 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:18.068 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:18.069 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:18.069 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:18.069 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:18.090 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph 2026-02-12T08:53:18.091 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-base 2026-02-12T08:53:18.393 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:02 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:18.394 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:03 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:18.458 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:18.462 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:18.475 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:18.476 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:18.476 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:18.479 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:18.480 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:18.480 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:18.498 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-base 2026-02-12T08:53:18.501 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install cephadm 2026-02-12T08:53:18.801 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:02 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:18.806 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:03 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:18.865 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:18.872 INFO:teuthology.orchestra.run.trial042.stdout:Package cephadm-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:53:18.883 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:18.884 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:18.884 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:18.889 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:18.890 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:18.890 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:18.905 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install cephadm 2026-02-12T08:53:18.912 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T08:53:19.208 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:03 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:19.222 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:19.273 INFO:teuthology.orchestra.run.trial131.stdout:Package cephadm-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:53:19.288 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-immutable-object-cache-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:19.291 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:19.291 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:19.291 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:19.306 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:19.306 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:19.306 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:19.314 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T08:53:19.328 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-mgr 2026-02-12T08:53:19.617 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:03 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:19.630 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:19.682 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-immutable-object-cache-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:19.696 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:19.699 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:19.700 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:19.700 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:19.714 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:19.714 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:19.715 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:19.722 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-mgr 2026-02-12T08:53:19.736 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T08:53:20.024 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:20.042 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:05 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:20.088 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:20.106 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:20.107 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:20.107 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:20.109 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:53:20.127 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:20.127 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:20.127 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:20.129 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T08:53:20.150 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T08:53:20.428 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:20.455 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:05 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:20.493 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:53:20.510 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:20.511 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:20.511 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:20.522 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:53:20.533 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T08:53:20.539 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:20.540 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:20.540 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:20.562 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-mgr-rook 2026-02-12T08:53:20.835 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:20.867 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:05 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:20.900 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:53:20.917 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:20.918 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:20.918 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:20.931 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:53:20.940 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-mgr-rook 2026-02-12T08:53:20.948 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:20.949 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:20.949 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:20.971 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T08:53:21.241 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:05 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:21.269 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:21.304 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:53:21.321 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:21.322 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:21.322 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:21.336 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:53:21.344 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T08:53:21.354 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:21.355 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:21.355 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:21.377 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-osd 2026-02-12T08:53:21.645 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:05 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:21.682 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:21.710 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:53:21.727 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:21.728 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:21.728 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:21.748 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:21.750 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-osd 2026-02-12T08:53:21.768 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:21.769 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:21.769 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:21.791 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-osd-classic 2026-02-12T08:53:22.049 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:22.094 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:07 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:22.114 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:22.132 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:22.132 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:22.132 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:22.154 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-osd-classic 2026-02-12T08:53:22.163 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:22.180 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:22.181 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:22.181 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:22.202 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-fuse 2026-02-12T08:53:22.456 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:22.507 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:07 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:22.520 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:22.538 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:22.538 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:22.538 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:22.560 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-fuse 2026-02-12T08:53:22.574 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:22.592 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:22.593 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:22.593 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:22.616 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install ceph-volume 2026-02-12T08:53:22.861 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:22.921 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:07 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:22.926 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:22.943 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:22.944 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:22.944 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:22.965 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-volume 2026-02-12T08:53:22.985 INFO:teuthology.orchestra.run.trial042.stdout:Package ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:53:23.002 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:23.003 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:23.003 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:23.025 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install librados-devel 2026-02-12T08:53:23.269 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:07 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:23.330 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:23.332 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:53:23.349 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:23.350 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:23.350 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:23.371 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install librados-devel 2026-02-12T08:53:23.395 INFO:teuthology.orchestra.run.trial042.stdout:Package librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:23.412 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:23.413 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:23.413 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:23.435 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install libcephfs2 2026-02-12T08:53:23.673 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:07 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:23.737 INFO:teuthology.orchestra.run.trial131.stdout:Package librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:23.739 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:23.755 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:23.756 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:23.756 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:23.778 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install libcephfs2 2026-02-12T08:53:23.805 INFO:teuthology.orchestra.run.trial042.stdout:Package libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:23.823 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:23.824 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:23.824 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:23.848 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install libcephfs-devel 2026-02-12T08:53:24.077 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:24.140 INFO:teuthology.orchestra.run.trial131.stdout:Package libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:24.151 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:09 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:24.158 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:24.158 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:24.158 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:24.180 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install libcephfs-devel 2026-02-12T08:53:24.216 INFO:teuthology.orchestra.run.trial042.stdout:Package libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:24.234 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:24.234 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:24.234 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:24.256 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install librados2 2026-02-12T08:53:24.483 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:24.547 INFO:teuthology.orchestra.run.trial131.stdout:Package libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:24.562 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:09 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:24.565 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:24.565 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:24.565 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:24.587 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install librados2 2026-02-12T08:53:24.631 INFO:teuthology.orchestra.run.trial042.stdout:Package librados2-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:24.648 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:24.649 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:24.649 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:24.670 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install librbd1 2026-02-12T08:53:24.886 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:24.951 INFO:teuthology.orchestra.run.trial131.stdout:Package librados2-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:24.968 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:24.969 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:24.969 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:24.975 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:09 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:24.990 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install librbd1 2026-02-12T08:53:25.041 INFO:teuthology.orchestra.run.trial042.stdout:Package librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:25.058 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:25.059 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:25.059 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:25.081 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install python3-rados 2026-02-12T08:53:25.289 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:09 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:25.354 INFO:teuthology.orchestra.run.trial131.stdout:Package librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:25.371 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:25.371 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:25.372 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:25.384 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:25.393 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install python3-rados 2026-02-12T08:53:25.448 INFO:teuthology.orchestra.run.trial042.stdout:Package python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:25.466 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:25.466 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:25.467 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:25.488 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install python3-rgw 2026-02-12T08:53:25.692 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:09 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:25.756 INFO:teuthology.orchestra.run.trial131.stdout:Package python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:25.773 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:25.774 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:25.774 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:25.795 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install python3-rgw 2026-02-12T08:53:25.798 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:25.864 INFO:teuthology.orchestra.run.trial042.stdout:Package python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:25.882 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:25.882 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:25.882 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:25.904 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install python3-cephfs 2026-02-12T08:53:26.098 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:26.162 INFO:teuthology.orchestra.run.trial131.stdout:Package python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:26.179 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:26.180 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:26.180 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:26.202 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install python3-cephfs 2026-02-12T08:53:26.209 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:11 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:26.274 INFO:teuthology.orchestra.run.trial042.stdout:Package python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:26.292 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:26.292 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:26.293 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:26.315 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install python3-rbd 2026-02-12T08:53:26.502 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:26.566 INFO:teuthology.orchestra.run.trial131.stdout:Package python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:26.584 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:26.584 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:26.584 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:26.606 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install python3-rbd 2026-02-12T08:53:26.615 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:11 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:26.679 INFO:teuthology.orchestra.run.trial042.stdout:Package python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:26.697 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:26.697 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:26.697 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:26.720 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install rbd-fuse 2026-02-12T08:53:26.907 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:26.971 INFO:teuthology.orchestra.run.trial131.stdout:Package python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:26.988 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:26.989 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:26.989 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:27.012 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install rbd-fuse 2026-02-12T08:53:27.021 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:12 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:27.086 INFO:teuthology.orchestra.run.trial042.stdout:Package rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:27.104 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:27.105 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:27.105 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:27.127 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install rbd-mirror 2026-02-12T08:53:27.311 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:11 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:27.376 INFO:teuthology.orchestra.run.trial131.stdout:Package rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:27.393 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:27.394 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:27.394 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:27.416 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install rbd-mirror 2026-02-12T08:53:27.431 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:12 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:27.495 INFO:teuthology.orchestra.run.trial042.stdout:Package rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:27.513 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:27.513 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:27.514 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:27.536 DEBUG:teuthology.orchestra.run.trial042:> sudo yum -y install rbd-nbd 2026-02-12T08:53:27.716 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:11 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:27.779 INFO:teuthology.orchestra.run.trial131.stdout:Package rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:27.796 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:27.797 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:27.797 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:27.819 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install rbd-nbd 2026-02-12T08:53:27.840 INFO:teuthology.orchestra.run.trial042.stdout:Last metadata expiration check: 0:00:12 ago on Thu 12 Feb 2026 08:53:15 AM UTC. 2026-02-12T08:53:27.905 INFO:teuthology.orchestra.run.trial042.stdout:Package rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:27.923 INFO:teuthology.orchestra.run.trial042.stdout:Dependencies resolved. 2026-02-12T08:53:27.923 INFO:teuthology.orchestra.run.trial042.stdout:Nothing to do. 2026-02-12T08:53:27.923 INFO:teuthology.orchestra.run.trial042.stdout:Complete! 2026-02-12T08:53:27.951 DEBUG:teuthology.parallel:result is None 2026-02-12T08:53:28.122 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:12 ago on Thu 12 Feb 2026 08:53:16 AM UTC. 2026-02-12T08:53:28.186 INFO:teuthology.orchestra.run.trial131.stdout:Package rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:53:28.204 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T08:53:28.204 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-12T08:53:28.204 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T08:53:28.230 DEBUG:teuthology.parallel:result is None 2026-02-12T08:53:28.231 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:53:28.392 DEBUG:teuthology.orchestra.run.trial042:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T08:53:28.414 INFO:teuthology.orchestra.run.trial042.stdout:20.3.0-5161.g2401a109.el9 2026-02-12T08:53:28.414 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5161.g2401a109.el9 2026-02-12T08:53:28.414 INFO:teuthology.task.install:The correct ceph version 20.3.0-5161.g2401a109 is installed. 2026-02-12T08:53:28.417 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:53:28.572 DEBUG:teuthology.orchestra.run.trial131:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T08:53:28.593 INFO:teuthology.orchestra.run.trial131.stdout:20.3.0-5161.g2401a109.el9 2026-02-12T08:53:28.593 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5161.g2401a109.el9 2026-02-12T08:53:28.593 INFO:teuthology.task.install:The correct ceph version 20.3.0-5161.g2401a109 is installed. 2026-02-12T08:53:28.596 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-12T08:53:28.596 INFO:teuthology.run_tasks:Running task ceph... 2026-02-12T08:53:28.696 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-12T08:53:28.696 DEBUG:teuthology.orchestra.run.trial042:> sudo chmod 777 /var/log/ceph 2026-02-12T08:53:28.698 DEBUG:teuthology.orchestra.run.trial131:> sudo chmod 777 /var/log/ceph 2026-02-12T08:53:28.723 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-12T08:53:28.723 DEBUG:teuthology.orchestra.run.trial042:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T08:53:28.763 DEBUG:teuthology.orchestra.run.trial131:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T08:53:28.787 INFO:tasks.ceph:Creating extra log directories... 2026-02-12T08:53:28.787 DEBUG:teuthology.orchestra.run.trial042:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T08:53:28.828 DEBUG:teuthology.orchestra.run.trial131:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T08:53:28.864 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-12T08:53:28.864 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug objclass': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-12T08:53:28.865 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41562', 'branch': 'main', 'description': 'crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/cls}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '41562', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug objclass': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'}}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c'}}, 'owner': 'scheduled_matan@soko04.front.sepia.ceph.com', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9353, 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c', 'targets': {'trial042.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIo/IyV2LdwkldGF5vlEBcXDFWUR2q1vmfG9YT77OGpgkjSOZ9L9WKsMP/yp/0JghdzLO9qJVJtbHRg5RT3tqRc=', 'trial131.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGEHtnyXlv3hRAOWiA7Vtk6wI1nZYHXOfHFdajLZRcWCQeDgMtXNHLop1UsdBGGYPTZexUryHAYakXmVHXmLGlg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug objclass': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_cmpomap.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'c433f1062990a0488dc29a553589bc609a460691', 'timestamp': '2026-02-09_15:50:17', 'tube': 'trial', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.2161924'} 2026-02-12T08:53:28.865 DEBUG:teuthology.orchestra.run.trial042:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T08:53:28.892 DEBUG:teuthology.orchestra.run.trial131:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T08:53:28.909 DEBUG:teuthology.orchestra.run.trial042:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T08:53:28.950 DEBUG:teuthology.orchestra.run.trial131:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T08:53:28.974 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:53:28.974 DEBUG:teuthology.orchestra.run.trial042:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T08:53:29.032 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T08:53:29.032 DEBUG:teuthology.orchestra.run.trial042:> stat /dev/vg_nvme/lv_1 2026-02-12T08:53:29.089 INFO:teuthology.orchestra.run.trial042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T08:53:29.090 INFO:teuthology.orchestra.run.trial042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:53:29.090 INFO:teuthology.orchestra.run.trial042.stdout:Device: 6h/6d Inode: 1308 Links: 1 2026-02-12T08:53:29.090 INFO:teuthology.orchestra.run.trial042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:53:29.090 INFO:teuthology.orchestra.run.trial042.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:53:29.090 INFO:teuthology.orchestra.run.trial042.stdout:Access: 2026-02-12 08:46:44.013759907 +0000 2026-02-12T08:53:29.090 INFO:teuthology.orchestra.run.trial042.stdout:Modify: 2026-02-12 08:43:10.334302795 +0000 2026-02-12T08:53:29.090 INFO:teuthology.orchestra.run.trial042.stdout:Change: 2026-02-12 08:43:10.334302795 +0000 2026-02-12T08:53:29.090 INFO:teuthology.orchestra.run.trial042.stdout: Birth: 2026-02-12 08:43:10.334302795 +0000 2026-02-12T08:53:29.091 DEBUG:teuthology.orchestra.run.trial042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T08:53:29.154 INFO:teuthology.orchestra.run.trial042.stderr:1+0 records in 2026-02-12T08:53:29.154 INFO:teuthology.orchestra.run.trial042.stderr:1+0 records out 2026-02-12T08:53:29.154 INFO:teuthology.orchestra.run.trial042.stderr:512 bytes copied, 0.000145811 s, 3.5 MB/s 2026-02-12T08:53:29.155 DEBUG:teuthology.orchestra.run.trial042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T08:53:29.212 DEBUG:teuthology.orchestra.run.trial042:> stat /dev/vg_nvme/lv_2 2026-02-12T08:53:29.269 INFO:teuthology.orchestra.run.trial042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T08:53:29.270 INFO:teuthology.orchestra.run.trial042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:53:29.270 INFO:teuthology.orchestra.run.trial042.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-12T08:53:29.270 INFO:teuthology.orchestra.run.trial042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:53:29.270 INFO:teuthology.orchestra.run.trial042.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:53:29.270 INFO:teuthology.orchestra.run.trial042.stdout:Access: 2026-02-12 08:46:44.013759907 +0000 2026-02-12T08:53:29.270 INFO:teuthology.orchestra.run.trial042.stdout:Modify: 2026-02-12 08:43:10.334302795 +0000 2026-02-12T08:53:29.270 INFO:teuthology.orchestra.run.trial042.stdout:Change: 2026-02-12 08:43:10.334302795 +0000 2026-02-12T08:53:29.270 INFO:teuthology.orchestra.run.trial042.stdout: Birth: 2026-02-12 08:43:10.334302795 +0000 2026-02-12T08:53:29.271 DEBUG:teuthology.orchestra.run.trial042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T08:53:29.333 INFO:teuthology.orchestra.run.trial042.stderr:1+0 records in 2026-02-12T08:53:29.333 INFO:teuthology.orchestra.run.trial042.stderr:1+0 records out 2026-02-12T08:53:29.333 INFO:teuthology.orchestra.run.trial042.stderr:512 bytes copied, 0.000133838 s, 3.8 MB/s 2026-02-12T08:53:29.334 DEBUG:teuthology.orchestra.run.trial042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T08:53:29.392 DEBUG:teuthology.orchestra.run.trial042:> stat /dev/vg_nvme/lv_3 2026-02-12T08:53:29.448 INFO:teuthology.orchestra.run.trial042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T08:53:29.449 INFO:teuthology.orchestra.run.trial042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:53:29.449 INFO:teuthology.orchestra.run.trial042.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-12T08:53:29.449 INFO:teuthology.orchestra.run.trial042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:53:29.449 INFO:teuthology.orchestra.run.trial042.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:53:29.449 INFO:teuthology.orchestra.run.trial042.stdout:Access: 2026-02-12 08:46:44.013759907 +0000 2026-02-12T08:53:29.449 INFO:teuthology.orchestra.run.trial042.stdout:Modify: 2026-02-12 08:43:10.333302811 +0000 2026-02-12T08:53:29.449 INFO:teuthology.orchestra.run.trial042.stdout:Change: 2026-02-12 08:43:10.333302811 +0000 2026-02-12T08:53:29.449 INFO:teuthology.orchestra.run.trial042.stdout: Birth: 2026-02-12 08:43:10.333302811 +0000 2026-02-12T08:53:29.450 DEBUG:teuthology.orchestra.run.trial042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T08:53:29.511 INFO:teuthology.orchestra.run.trial042.stderr:1+0 records in 2026-02-12T08:53:29.511 INFO:teuthology.orchestra.run.trial042.stderr:1+0 records out 2026-02-12T08:53:29.512 INFO:teuthology.orchestra.run.trial042.stderr:512 bytes copied, 0.000221722 s, 2.3 MB/s 2026-02-12T08:53:29.513 DEBUG:teuthology.orchestra.run.trial042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T08:53:29.570 DEBUG:teuthology.orchestra.run.trial042:> stat /dev/vg_nvme/lv_4 2026-02-12T08:53:29.626 INFO:teuthology.orchestra.run.trial042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T08:53:29.627 INFO:teuthology.orchestra.run.trial042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:53:29.627 INFO:teuthology.orchestra.run.trial042.stdout:Device: 6h/6d Inode: 1292 Links: 1 2026-02-12T08:53:29.627 INFO:teuthology.orchestra.run.trial042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:53:29.627 INFO:teuthology.orchestra.run.trial042.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:53:29.627 INFO:teuthology.orchestra.run.trial042.stdout:Access: 2026-02-12 08:46:44.014759891 +0000 2026-02-12T08:53:29.627 INFO:teuthology.orchestra.run.trial042.stdout:Modify: 2026-02-12 08:43:10.332302829 +0000 2026-02-12T08:53:29.627 INFO:teuthology.orchestra.run.trial042.stdout:Change: 2026-02-12 08:43:10.332302829 +0000 2026-02-12T08:53:29.627 INFO:teuthology.orchestra.run.trial042.stdout: Birth: 2026-02-12 08:43:10.332302829 +0000 2026-02-12T08:53:29.628 DEBUG:teuthology.orchestra.run.trial042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T08:53:29.690 INFO:teuthology.orchestra.run.trial042.stderr:1+0 records in 2026-02-12T08:53:29.690 INFO:teuthology.orchestra.run.trial042.stderr:1+0 records out 2026-02-12T08:53:29.690 INFO:teuthology.orchestra.run.trial042.stderr:512 bytes copied, 0.000211733 s, 2.4 MB/s 2026-02-12T08:53:29.691 DEBUG:teuthology.orchestra.run.trial042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T08:53:29.748 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-12T08:53:29.749 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-12T08:53:29.749 DEBUG:teuthology.orchestra.run.trial131:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T08:53:29.767 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T08:53:29.767 DEBUG:teuthology.orchestra.run.trial131:> stat /dev/vg_nvme/lv_1 2026-02-12T08:53:29.823 INFO:teuthology.orchestra.run.trial131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T08:53:29.824 INFO:teuthology.orchestra.run.trial131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:53:29.824 INFO:teuthology.orchestra.run.trial131.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-12T08:53:29.824 INFO:teuthology.orchestra.run.trial131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:53:29.824 INFO:teuthology.orchestra.run.trial131.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:53:29.824 INFO:teuthology.orchestra.run.trial131.stdout:Access: 2026-02-12 08:46:37.418596315 +0000 2026-02-12T08:53:29.824 INFO:teuthology.orchestra.run.trial131.stdout:Modify: 2026-02-12 08:42:43.846282934 +0000 2026-02-12T08:53:29.824 INFO:teuthology.orchestra.run.trial131.stdout:Change: 2026-02-12 08:42:43.846282934 +0000 2026-02-12T08:53:29.824 INFO:teuthology.orchestra.run.trial131.stdout: Birth: 2026-02-12 08:42:43.846282934 +0000 2026-02-12T08:53:29.825 DEBUG:teuthology.orchestra.run.trial131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T08:53:29.888 INFO:teuthology.orchestra.run.trial131.stderr:1+0 records in 2026-02-12T08:53:29.888 INFO:teuthology.orchestra.run.trial131.stderr:1+0 records out 2026-02-12T08:53:29.888 INFO:teuthology.orchestra.run.trial131.stderr:512 bytes copied, 0.000160991 s, 3.2 MB/s 2026-02-12T08:53:29.889 DEBUG:teuthology.orchestra.run.trial131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T08:53:29.947 DEBUG:teuthology.orchestra.run.trial131:> stat /dev/vg_nvme/lv_2 2026-02-12T08:53:30.002 INFO:teuthology.orchestra.run.trial131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T08:53:30.002 INFO:teuthology.orchestra.run.trial131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:53:30.002 INFO:teuthology.orchestra.run.trial131.stdout:Device: 6h/6d Inode: 1289 Links: 1 2026-02-12T08:53:30.003 INFO:teuthology.orchestra.run.trial131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:53:30.003 INFO:teuthology.orchestra.run.trial131.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:53:30.003 INFO:teuthology.orchestra.run.trial131.stdout:Access: 2026-02-12 08:46:37.418596315 +0000 2026-02-12T08:53:30.003 INFO:teuthology.orchestra.run.trial131.stdout:Modify: 2026-02-12 08:42:43.845282951 +0000 2026-02-12T08:53:30.003 INFO:teuthology.orchestra.run.trial131.stdout:Change: 2026-02-12 08:42:43.845282951 +0000 2026-02-12T08:53:30.003 INFO:teuthology.orchestra.run.trial131.stdout: Birth: 2026-02-12 08:42:43.845282951 +0000 2026-02-12T08:53:30.003 DEBUG:teuthology.orchestra.run.trial131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T08:53:30.065 INFO:teuthology.orchestra.run.trial131.stderr:1+0 records in 2026-02-12T08:53:30.065 INFO:teuthology.orchestra.run.trial131.stderr:1+0 records out 2026-02-12T08:53:30.065 INFO:teuthology.orchestra.run.trial131.stderr:512 bytes copied, 0.000132799 s, 3.9 MB/s 2026-02-12T08:53:30.066 DEBUG:teuthology.orchestra.run.trial131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T08:53:30.123 DEBUG:teuthology.orchestra.run.trial131:> stat /dev/vg_nvme/lv_3 2026-02-12T08:53:30.180 INFO:teuthology.orchestra.run.trial131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T08:53:30.180 INFO:teuthology.orchestra.run.trial131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:53:30.180 INFO:teuthology.orchestra.run.trial131.stdout:Device: 6h/6d Inode: 1307 Links: 1 2026-02-12T08:53:30.180 INFO:teuthology.orchestra.run.trial131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:53:30.180 INFO:teuthology.orchestra.run.trial131.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:53:30.181 INFO:teuthology.orchestra.run.trial131.stdout:Access: 2026-02-12 08:46:37.418596315 +0000 2026-02-12T08:53:30.181 INFO:teuthology.orchestra.run.trial131.stdout:Modify: 2026-02-12 08:42:43.846282934 +0000 2026-02-12T08:53:30.181 INFO:teuthology.orchestra.run.trial131.stdout:Change: 2026-02-12 08:42:43.846282934 +0000 2026-02-12T08:53:30.181 INFO:teuthology.orchestra.run.trial131.stdout: Birth: 2026-02-12 08:42:43.846282934 +0000 2026-02-12T08:53:30.181 DEBUG:teuthology.orchestra.run.trial131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T08:53:30.243 INFO:teuthology.orchestra.run.trial131.stderr:1+0 records in 2026-02-12T08:53:30.243 INFO:teuthology.orchestra.run.trial131.stderr:1+0 records out 2026-02-12T08:53:30.243 INFO:teuthology.orchestra.run.trial131.stderr:512 bytes copied, 0.000148748 s, 3.4 MB/s 2026-02-12T08:53:30.245 DEBUG:teuthology.orchestra.run.trial131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T08:53:30.302 DEBUG:teuthology.orchestra.run.trial131:> stat /dev/vg_nvme/lv_4 2026-02-12T08:53:30.357 INFO:teuthology.orchestra.run.trial131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T08:53:30.358 INFO:teuthology.orchestra.run.trial131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:53:30.358 INFO:teuthology.orchestra.run.trial131.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-12T08:53:30.358 INFO:teuthology.orchestra.run.trial131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:53:30.358 INFO:teuthology.orchestra.run.trial131.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:53:30.358 INFO:teuthology.orchestra.run.trial131.stdout:Access: 2026-02-12 08:46:37.419596313 +0000 2026-02-12T08:53:30.358 INFO:teuthology.orchestra.run.trial131.stdout:Modify: 2026-02-12 08:42:43.846282934 +0000 2026-02-12T08:53:30.358 INFO:teuthology.orchestra.run.trial131.stdout:Change: 2026-02-12 08:42:43.846282934 +0000 2026-02-12T08:53:30.358 INFO:teuthology.orchestra.run.trial131.stdout: Birth: 2026-02-12 08:42:43.846282934 +0000 2026-02-12T08:53:30.359 DEBUG:teuthology.orchestra.run.trial131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T08:53:30.421 INFO:teuthology.orchestra.run.trial131.stderr:1+0 records in 2026-02-12T08:53:30.421 INFO:teuthology.orchestra.run.trial131.stderr:1+0 records out 2026-02-12T08:53:30.421 INFO:teuthology.orchestra.run.trial131.stderr:512 bytes copied, 0.000134101 s, 3.8 MB/s 2026-02-12T08:53:30.422 DEBUG:teuthology.orchestra.run.trial131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T08:53:30.481 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-12T08:53:30.481 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial131.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-12T08:53:30.481 INFO:tasks.ceph:Generating config... 2026-02-12T08:53:30.484 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-12T08:53:30.484 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-12T08:53:30.484 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-12T08:53:30.484 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-12T08:53:30.484 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-12T08:53:30.485 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-12T08:53:30.485 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-12T08:53:30.485 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-12T08:53:30.485 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-12T08:53:30.485 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-12T08:53:30.485 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-12T08:53:30.485 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-12T08:53:30.485 INFO:tasks.ceph:[osd] debug ms = 20 2026-02-12T08:53:30.485 INFO:tasks.ceph:[osd] debug objclass = 20 2026-02-12T08:53:30.485 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-12T08:53:30.485 INFO:tasks.ceph:[osd] debug seastore = 20 2026-02-12T08:53:30.485 INFO:tasks.ceph:[osd] debug seastore backref = 20 2026-02-12T08:53:30.486 INFO:tasks.ceph:[osd] debug seastore cache = 20 2026-02-12T08:53:30.486 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2026-02-12T08:53:30.486 INFO:tasks.ceph:[osd] debug seastore device = 20 2026-02-12T08:53:30.486 INFO:tasks.ceph:[osd] debug seastore epm = 20 2026-02-12T08:53:30.486 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2026-02-12T08:53:30.486 INFO:tasks.ceph:[osd] debug seastore journal = 20 2026-02-12T08:53:30.486 INFO:tasks.ceph:[osd] debug seastore lba = 20 2026-02-12T08:53:30.486 INFO:tasks.ceph:[osd] debug seastore odata = 20 2026-02-12T08:53:30.486 INFO:tasks.ceph:[osd] debug seastore omap = 20 2026-02-12T08:53:30.486 INFO:tasks.ceph:[osd] debug seastore onode = 20 2026-02-12T08:53:30.486 INFO:tasks.ceph:[osd] debug seastore t = 20 2026-02-12T08:53:30.486 INFO:tasks.ceph:[osd] debug seastore tm = 20 2026-02-12T08:53:30.486 INFO:tasks.ceph:[osd] osd objectstore = seastore 2026-02-12T08:53:30.487 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-12T08:53:30.487 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-12T08:53:30.487 INFO:tasks.ceph:[osd] seastore main device type = RANDOM_BLOCK_SSD 2026-02-12T08:53:30.487 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-12T08:53:30.487 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-12T08:53:30.487 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-12T08:53:30.487 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-12T08:53:30.487 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-12T08:53:30.487 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-12T08:53:30.487 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-12T08:53:30.487 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-12T08:53:30.487 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-12T08:53:30.487 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-12T08:53:30.488 INFO:tasks.ceph:Setting up mon.a... 2026-02-12T08:53:30.488 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-12T08:53:30.530 INFO:teuthology.orchestra.run.trial042.stdout:creating /etc/ceph/ceph.keyring 2026-02-12T08:53:30.533 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-12T08:53:30.616 DEBUG:teuthology.orchestra.run.trial042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T08:53:30.683 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.42')] 2026-02-12T08:53:30.684 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.42', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug objclass': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-12T08:53:30.685 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:53:30.685 DEBUG:teuthology.orchestra.run.trial042:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T08:53:30.739 DEBUG:teuthology.orchestra.run.trial042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.42 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:53:30.820 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:53:30.817+0000 7fb1fee34f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:30.820 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:53:30.818+0000 7fb1fee34f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:30.820 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:53:30.818+0000 7fb1fee34f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:30.821 INFO:teuthology.orchestra.run.trial042.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:53:30.821 INFO:teuthology.orchestra.run.trial042.stdout:monmaptool: generated fsid 7e2c0a58-c4ab-4cae-b59c-95ee35636f28 2026-02-12T08:53:30.822 INFO:teuthology.orchestra.run.trial042.stdout:setting min_mon_release = tentacle 2026-02-12T08:53:30.822 INFO:teuthology.orchestra.run.trial042.stdout:epoch 0 2026-02-12T08:53:30.822 INFO:teuthology.orchestra.run.trial042.stdout:fsid 7e2c0a58-c4ab-4cae-b59c-95ee35636f28 2026-02-12T08:53:30.822 INFO:teuthology.orchestra.run.trial042.stdout:last_changed 2026-02-12T08:53:30.819652+0000 2026-02-12T08:53:30.822 INFO:teuthology.orchestra.run.trial042.stdout:created 2026-02-12T08:53:30.819652+0000 2026-02-12T08:53:30.822 INFO:teuthology.orchestra.run.trial042.stdout:min_mon_release 20 (tentacle) 2026-02-12T08:53:30.822 INFO:teuthology.orchestra.run.trial042.stdout:election_strategy: 1 2026-02-12T08:53:30.822 INFO:teuthology.orchestra.run.trial042.stdout:0: [v2:10.20.193.42:3300/0,v1:10.20.193.42:6789/0] mon.a 2026-02-12T08:53:30.822 INFO:teuthology.orchestra.run.trial042.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-12T08:53:30.823 DEBUG:teuthology.orchestra.run.trial042:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T08:53:30.880 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7e2c0a58-c4ab-4cae-b59c-95ee35636f28... 2026-02-12T08:53:30.881 DEBUG:teuthology.orchestra.run.trial042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T08:53:30.922 DEBUG:teuthology.orchestra.run.trial131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T08:53:30.962 INFO:teuthology.orchestra.run.trial042.stdout:[global] 2026-02-12T08:53:30.963 INFO:teuthology.orchestra.run.trial042.stdout: chdir = "" 2026-02-12T08:53:30.963 INFO:teuthology.orchestra.run.trial042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T08:53:30.963 INFO:teuthology.orchestra.run.trial042.stdout: auth supported = cephx 2026-02-12T08:53:30.963 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.963 INFO:teuthology.orchestra.run.trial042.stdout: filestore xattr use omap = true 2026-02-12T08:53:30.963 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.963 INFO:teuthology.orchestra.run.trial042.stdout: mon clock drift allowed = 1.000 2026-02-12T08:53:30.963 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.963 INFO:teuthology.orchestra.run.trial042.stdout: osd crush chooseleaf type = 0 2026-02-12T08:53:30.963 INFO:teuthology.orchestra.run.trial042.stdout: auth debug = true 2026-02-12T08:53:30.964 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.964 INFO:teuthology.orchestra.run.trial042.stdout: ms die on old message = true 2026-02-12T08:53:30.964 INFO:teuthology.orchestra.run.trial042.stdout: ms die on bug = true 2026-02-12T08:53:30.964 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.964 INFO:teuthology.orchestra.run.trial042.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T08:53:30.964 INFO:teuthology.orchestra.run.trial042.stdout: mon pg warn max object skew = 0 2026-02-12T08:53:30.964 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.964 INFO:teuthology.orchestra.run.trial042.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T08:53:30.964 INFO:teuthology.orchestra.run.trial042.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T08:53:30.964 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.964 INFO:teuthology.orchestra.run.trial042.stdout: osd pool default size = 2 2026-02-12T08:53:30.964 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.965 INFO:teuthology.orchestra.run.trial042.stdout: mon osd allow primary affinity = true 2026-02-12T08:53:30.965 INFO:teuthology.orchestra.run.trial042.stdout: mon osd allow pg remap = true 2026-02-12T08:53:30.965 INFO:teuthology.orchestra.run.trial042.stdout: mon warn on legacy crush tunables = false 2026-02-12T08:53:30.965 INFO:teuthology.orchestra.run.trial042.stdout: mon warn on crush straw calc version zero = false 2026-02-12T08:53:30.965 INFO:teuthology.orchestra.run.trial042.stdout: mon warn on no sortbitwise = false 2026-02-12T08:53:30.965 INFO:teuthology.orchestra.run.trial042.stdout: mon warn on osd down out interval zero = false 2026-02-12T08:53:30.965 INFO:teuthology.orchestra.run.trial042.stdout: mon warn on too few osds = false 2026-02-12T08:53:30.965 INFO:teuthology.orchestra.run.trial042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T08:53:30.965 INFO:teuthology.orchestra.run.trial042.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T08:53:30.965 INFO:teuthology.orchestra.run.trial042.stdout: mon_allow_pool_size_one = true 2026-02-12T08:53:30.965 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.965 INFO:teuthology.orchestra.run.trial042.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T08:53:30.965 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.966 INFO:teuthology.orchestra.run.trial042.stdout: osd default data pool replay window = 5 2026-02-12T08:53:30.966 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.966 INFO:teuthology.orchestra.run.trial042.stdout: mon allow pool delete = true 2026-02-12T08:53:30.966 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.966 INFO:teuthology.orchestra.run.trial042.stdout: mon cluster log file level = debug 2026-02-12T08:53:30.966 INFO:teuthology.orchestra.run.trial042.stdout: debug asserts on shutdown = true 2026-02-12T08:53:30.966 INFO:teuthology.orchestra.run.trial042.stdout: mon health detail to clog = false 2026-02-12T08:53:30.966 INFO:teuthology.orchestra.run.trial042.stdout: mon host = 10.20.193.42 2026-02-12T08:53:30.966 INFO:teuthology.orchestra.run.trial042.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-12T08:53:30.966 INFO:teuthology.orchestra.run.trial042.stdout: ms client mode = crc 2026-02-12T08:53:30.966 INFO:teuthology.orchestra.run.trial042.stdout: ms cluster mode = crc 2026-02-12T08:53:30.966 INFO:teuthology.orchestra.run.trial042.stdout: ms mon client mode = crc 2026-02-12T08:53:30.967 INFO:teuthology.orchestra.run.trial042.stdout: ms mon cluster mode = crc 2026-02-12T08:53:30.967 INFO:teuthology.orchestra.run.trial042.stdout: ms mon service mode = crc 2026-02-12T08:53:30.967 INFO:teuthology.orchestra.run.trial042.stdout: ms service mode = crc 2026-02-12T08:53:30.967 INFO:teuthology.orchestra.run.trial042.stdout: fsid = 7e2c0a58-c4ab-4cae-b59c-95ee35636f28 2026-02-12T08:53:30.967 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.967 INFO:teuthology.orchestra.run.trial042.stdout:[osd] 2026-02-12T08:53:30.967 INFO:teuthology.orchestra.run.trial042.stdout: osd journal size = 100 2026-02-12T08:53:30.967 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.967 INFO:teuthology.orchestra.run.trial042.stdout: osd scrub load threshold = 5.0 2026-02-12T08:53:30.967 INFO:teuthology.orchestra.run.trial042.stdout: osd scrub max interval = 600 2026-02-12T08:53:30.967 INFO:teuthology.orchestra.run.trial042.stdout: osd mclock profile = high_recovery_ops 2026-02-12T08:53:30.967 INFO:teuthology.orchestra.run.trial042.stdout: osd mclock skip benchmark = true 2026-02-12T08:53:30.968 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.968 INFO:teuthology.orchestra.run.trial042.stdout: osd recover clone overlap = true 2026-02-12T08:53:30.968 INFO:teuthology.orchestra.run.trial042.stdout: osd recovery max chunk = 1048576 2026-02-12T08:53:30.968 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.968 INFO:teuthology.orchestra.run.trial042.stdout: osd debug shutdown = true 2026-02-12T08:53:30.968 INFO:teuthology.orchestra.run.trial042.stdout: osd debug op order = true 2026-02-12T08:53:30.968 INFO:teuthology.orchestra.run.trial042.stdout: osd debug verify stray on activate = true 2026-02-12T08:53:30.968 INFO:teuthology.orchestra.run.trial042.stdout: osd debug trim objects = true 2026-02-12T08:53:30.968 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.968 INFO:teuthology.orchestra.run.trial042.stdout: osd open classes on start = true 2026-02-12T08:53:30.968 INFO:teuthology.orchestra.run.trial042.stdout: osd debug pg log writeout = true 2026-02-12T08:53:30.968 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.969 INFO:teuthology.orchestra.run.trial042.stdout: osd deep scrub update digest min age = 30 2026-02-12T08:53:30.969 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.969 INFO:teuthology.orchestra.run.trial042.stdout: osd map max advance = 10 2026-02-12T08:53:30.969 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.969 INFO:teuthology.orchestra.run.trial042.stdout: journal zero on create = true 2026-02-12T08:53:30.969 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.969 INFO:teuthology.orchestra.run.trial042.stdout: filestore ondisk finisher threads = 3 2026-02-12T08:53:30.969 INFO:teuthology.orchestra.run.trial042.stdout: filestore apply finisher threads = 3 2026-02-12T08:53:30.969 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.969 INFO:teuthology.orchestra.run.trial042.stdout: bdev debug aio = true 2026-02-12T08:53:30.969 INFO:teuthology.orchestra.run.trial042.stdout: osd debug misdirected ops = true 2026-02-12T08:53:30.970 INFO:teuthology.orchestra.run.trial042.stdout: debug monc = 20 2026-02-12T08:53:30.970 INFO:teuthology.orchestra.run.trial042.stdout: crimson cpu num = 4 2026-02-12T08:53:30.970 INFO:teuthology.orchestra.run.trial042.stdout: crimson osd obc lru size = 10 2026-02-12T08:53:30.970 INFO:teuthology.orchestra.run.trial042.stdout: debug ms = 20 2026-02-12T08:53:30.970 INFO:teuthology.orchestra.run.trial042.stdout: debug objclass = 20 2026-02-12T08:53:30.970 INFO:teuthology.orchestra.run.trial042.stdout: debug osd = 20 2026-02-12T08:53:30.970 INFO:teuthology.orchestra.run.trial042.stdout: debug seastore = 20 2026-02-12T08:53:30.970 INFO:teuthology.orchestra.run.trial042.stdout: debug seastore backref = 20 2026-02-12T08:53:30.970 INFO:teuthology.orchestra.run.trial042.stdout: debug seastore cache = 20 2026-02-12T08:53:30.970 INFO:teuthology.orchestra.run.trial042.stdout: debug seastore cleaner = 20 2026-02-12T08:53:30.970 INFO:teuthology.orchestra.run.trial042.stdout: debug seastore device = 20 2026-02-12T08:53:30.970 INFO:teuthology.orchestra.run.trial042.stdout: debug seastore epm = 20 2026-02-12T08:53:30.970 INFO:teuthology.orchestra.run.trial042.stdout: debug seastore fixedkv tree = 20 2026-02-12T08:53:30.971 INFO:teuthology.orchestra.run.trial042.stdout: debug seastore journal = 20 2026-02-12T08:53:30.971 INFO:teuthology.orchestra.run.trial042.stdout: debug seastore lba = 20 2026-02-12T08:53:30.971 INFO:teuthology.orchestra.run.trial042.stdout: debug seastore odata = 20 2026-02-12T08:53:30.971 INFO:teuthology.orchestra.run.trial042.stdout: debug seastore omap = 20 2026-02-12T08:53:30.971 INFO:teuthology.orchestra.run.trial042.stdout: debug seastore onode = 20 2026-02-12T08:53:30.971 INFO:teuthology.orchestra.run.trial042.stdout: debug seastore t = 20 2026-02-12T08:53:30.971 INFO:teuthology.orchestra.run.trial042.stdout: debug seastore tm = 20 2026-02-12T08:53:30.971 INFO:teuthology.orchestra.run.trial042.stdout: osd objectstore = seastore 2026-02-12T08:53:30.971 INFO:teuthology.orchestra.run.trial042.stdout: osd shutdown pgref assert = True 2026-02-12T08:53:30.971 INFO:teuthology.orchestra.run.trial042.stdout: seastore cachepin size pershard = 64M 2026-02-12T08:53:30.971 INFO:teuthology.orchestra.run.trial042.stdout: seastore main device type = RANDOM_BLOCK_SSD 2026-02-12T08:53:30.971 INFO:teuthology.orchestra.run.trial042.stdout: seastore max concurrent transactions = 8 2026-02-12T08:53:30.971 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.972 INFO:teuthology.orchestra.run.trial042.stdout:[mgr] 2026-02-12T08:53:30.972 INFO:teuthology.orchestra.run.trial042.stdout: debug ms = 1 2026-02-12T08:53:30.972 INFO:teuthology.orchestra.run.trial042.stdout: debug mgr = 20 2026-02-12T08:53:30.972 INFO:teuthology.orchestra.run.trial042.stdout: debug mon = 20 2026-02-12T08:53:30.972 INFO:teuthology.orchestra.run.trial042.stdout: debug auth = 20 2026-02-12T08:53:30.972 INFO:teuthology.orchestra.run.trial042.stdout: mon reweight min pgs per osd = 4 2026-02-12T08:53:30.972 INFO:teuthology.orchestra.run.trial042.stdout: mon reweight min bytes per osd = 10 2026-02-12T08:53:30.972 INFO:teuthology.orchestra.run.trial042.stdout: mgr/telemetry/nag = false 2026-02-12T08:53:30.972 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.972 INFO:teuthology.orchestra.run.trial042.stdout:[mon] 2026-02-12T08:53:30.972 INFO:teuthology.orchestra.run.trial042.stdout: debug ms = 1 2026-02-12T08:53:30.972 INFO:teuthology.orchestra.run.trial042.stdout: debug mon = 20 2026-02-12T08:53:30.973 INFO:teuthology.orchestra.run.trial042.stdout: debug paxos = 20 2026-02-12T08:53:30.973 INFO:teuthology.orchestra.run.trial042.stdout: debug auth = 20 2026-02-12T08:53:30.973 INFO:teuthology.orchestra.run.trial042.stdout: mon data avail warn = 5 2026-02-12T08:53:30.973 INFO:teuthology.orchestra.run.trial042.stdout: mon mgr mkfs grace = 240 2026-02-12T08:53:30.973 INFO:teuthology.orchestra.run.trial042.stdout: mon reweight min pgs per osd = 4 2026-02-12T08:53:30.973 INFO:teuthology.orchestra.run.trial042.stdout: mon osd reporter subtree level = osd 2026-02-12T08:53:30.973 INFO:teuthology.orchestra.run.trial042.stdout: mon osd prime pg temp = true 2026-02-12T08:53:30.973 INFO:teuthology.orchestra.run.trial042.stdout: mon reweight min bytes per osd = 10 2026-02-12T08:53:30.973 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.973 INFO:teuthology.orchestra.run.trial042.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T08:53:30.973 INFO:teuthology.orchestra.run.trial042.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T08:53:30.973 INFO:teuthology.orchestra.run.trial042.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T08:53:30.973 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.974 INFO:teuthology.orchestra.run.trial042.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T08:53:30.974 INFO:teuthology.orchestra.run.trial042.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T08:53:30.974 INFO:teuthology.orchestra.run.trial042.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T08:53:30.974 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.974 INFO:teuthology.orchestra.run.trial042.stdout: # 1m isn't quite enough 2026-02-12T08:53:30.974 INFO:teuthology.orchestra.run.trial042.stdout: mon_down_mkfs_grace = 2m 2026-02-12T08:53:30.974 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.974 INFO:teuthology.orchestra.run.trial042.stdout: mon_warn_on_filestore_osds = false 2026-02-12T08:53:30.974 INFO:teuthology.orchestra.run.trial042.stdout: mon min osdmap epochs = 50 2026-02-12T08:53:30.974 INFO:teuthology.orchestra.run.trial042.stdout: mon osdmap full prune interval = 2 2026-02-12T08:53:30.974 INFO:teuthology.orchestra.run.trial042.stdout: mon osdmap full prune min = 15 2026-02-12T08:53:30.974 INFO:teuthology.orchestra.run.trial042.stdout: mon osdmap full prune txsize = 2 2026-02-12T08:53:30.975 INFO:teuthology.orchestra.run.trial042.stdout: paxos service trim min = 10 2026-02-12T08:53:30.975 INFO:teuthology.orchestra.run.trial042.stdout: osd pool default crimson = True 2026-02-12T08:53:30.975 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:30.975 INFO:teuthology.orchestra.run.trial042.stdout:[client] 2026-02-12T08:53:30.975 INFO:teuthology.orchestra.run.trial042.stdout: rgw cache enabled = true 2026-02-12T08:53:30.975 INFO:teuthology.orchestra.run.trial042.stdout: rgw enable ops log = true 2026-02-12T08:53:30.975 INFO:teuthology.orchestra.run.trial042.stdout: rgw enable usage log = true 2026-02-12T08:53:30.975 INFO:teuthology.orchestra.run.trial042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T08:53:30.975 INFO:teuthology.orchestra.run.trial042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T08:53:30.975 INFO:teuthology.orchestra.run.trial042.stdout:[mon.a] 2026-02-12T08:53:30.977 INFO:teuthology.orchestra.run.trial131.stdout:[global] 2026-02-12T08:53:30.977 INFO:teuthology.orchestra.run.trial131.stdout: chdir = "" 2026-02-12T08:53:30.977 INFO:teuthology.orchestra.run.trial131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T08:53:30.977 INFO:teuthology.orchestra.run.trial131.stdout: auth supported = cephx 2026-02-12T08:53:30.978 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.978 INFO:teuthology.orchestra.run.trial131.stdout: filestore xattr use omap = true 2026-02-12T08:53:30.978 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.978 INFO:teuthology.orchestra.run.trial131.stdout: mon clock drift allowed = 1.000 2026-02-12T08:53:30.978 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.978 INFO:teuthology.orchestra.run.trial131.stdout: osd crush chooseleaf type = 0 2026-02-12T08:53:30.978 INFO:teuthology.orchestra.run.trial131.stdout: auth debug = true 2026-02-12T08:53:30.978 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.978 INFO:teuthology.orchestra.run.trial131.stdout: ms die on old message = true 2026-02-12T08:53:30.978 INFO:teuthology.orchestra.run.trial131.stdout: ms die on bug = true 2026-02-12T08:53:30.978 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.979 INFO:teuthology.orchestra.run.trial131.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T08:53:30.979 INFO:teuthology.orchestra.run.trial131.stdout: mon pg warn max object skew = 0 2026-02-12T08:53:30.979 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.979 INFO:teuthology.orchestra.run.trial131.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T08:53:30.979 INFO:teuthology.orchestra.run.trial131.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T08:53:30.979 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.979 INFO:teuthology.orchestra.run.trial131.stdout: osd pool default size = 2 2026-02-12T08:53:30.979 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.979 INFO:teuthology.orchestra.run.trial131.stdout: mon osd allow primary affinity = true 2026-02-12T08:53:30.979 INFO:teuthology.orchestra.run.trial131.stdout: mon osd allow pg remap = true 2026-02-12T08:53:30.979 INFO:teuthology.orchestra.run.trial131.stdout: mon warn on legacy crush tunables = false 2026-02-12T08:53:30.979 INFO:teuthology.orchestra.run.trial131.stdout: mon warn on crush straw calc version zero = false 2026-02-12T08:53:30.980 INFO:teuthology.orchestra.run.trial131.stdout: mon warn on no sortbitwise = false 2026-02-12T08:53:30.980 INFO:teuthology.orchestra.run.trial131.stdout: mon warn on osd down out interval zero = false 2026-02-12T08:53:30.980 INFO:teuthology.orchestra.run.trial131.stdout: mon warn on too few osds = false 2026-02-12T08:53:30.980 INFO:teuthology.orchestra.run.trial131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T08:53:30.980 INFO:teuthology.orchestra.run.trial131.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T08:53:30.980 INFO:teuthology.orchestra.run.trial131.stdout: mon_allow_pool_size_one = true 2026-02-12T08:53:30.980 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.980 INFO:teuthology.orchestra.run.trial131.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T08:53:30.980 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.980 INFO:teuthology.orchestra.run.trial131.stdout: osd default data pool replay window = 5 2026-02-12T08:53:30.980 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.981 INFO:teuthology.orchestra.run.trial131.stdout: mon allow pool delete = true 2026-02-12T08:53:30.981 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.981 INFO:teuthology.orchestra.run.trial131.stdout: mon cluster log file level = debug 2026-02-12T08:53:30.981 INFO:teuthology.orchestra.run.trial131.stdout: debug asserts on shutdown = true 2026-02-12T08:53:30.981 INFO:teuthology.orchestra.run.trial131.stdout: mon health detail to clog = false 2026-02-12T08:53:30.981 INFO:teuthology.orchestra.run.trial131.stdout: mon host = 10.20.193.42 2026-02-12T08:53:30.981 INFO:teuthology.orchestra.run.trial131.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-12T08:53:30.981 INFO:teuthology.orchestra.run.trial131.stdout: ms client mode = crc 2026-02-12T08:53:30.981 INFO:teuthology.orchestra.run.trial131.stdout: ms cluster mode = crc 2026-02-12T08:53:30.981 INFO:teuthology.orchestra.run.trial131.stdout: ms mon client mode = crc 2026-02-12T08:53:30.981 INFO:teuthology.orchestra.run.trial131.stdout: ms mon cluster mode = crc 2026-02-12T08:53:30.981 INFO:teuthology.orchestra.run.trial131.stdout: ms mon service mode = crc 2026-02-12T08:53:30.982 INFO:teuthology.orchestra.run.trial131.stdout: ms service mode = crc 2026-02-12T08:53:30.982 INFO:teuthology.orchestra.run.trial131.stdout: fsid = 7e2c0a58-c4ab-4cae-b59c-95ee35636f28 2026-02-12T08:53:30.982 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.982 INFO:teuthology.orchestra.run.trial131.stdout:[osd] 2026-02-12T08:53:30.982 INFO:teuthology.orchestra.run.trial131.stdout: osd journal size = 100 2026-02-12T08:53:30.982 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.982 INFO:teuthology.orchestra.run.trial131.stdout: osd scrub load threshold = 5.0 2026-02-12T08:53:30.982 INFO:teuthology.orchestra.run.trial131.stdout: osd scrub max interval = 600 2026-02-12T08:53:30.982 INFO:teuthology.orchestra.run.trial131.stdout: osd mclock profile = high_recovery_ops 2026-02-12T08:53:30.982 INFO:teuthology.orchestra.run.trial131.stdout: osd mclock skip benchmark = true 2026-02-12T08:53:30.983 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.983 INFO:teuthology.orchestra.run.trial131.stdout: osd recover clone overlap = true 2026-02-12T08:53:30.983 INFO:teuthology.orchestra.run.trial131.stdout: osd recovery max chunk = 1048576 2026-02-12T08:53:30.983 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.983 INFO:teuthology.orchestra.run.trial131.stdout: osd debug shutdown = true 2026-02-12T08:53:30.983 INFO:teuthology.orchestra.run.trial131.stdout: osd debug op order = true 2026-02-12T08:53:30.983 INFO:teuthology.orchestra.run.trial131.stdout: osd debug verify stray on activate = true 2026-02-12T08:53:30.983 INFO:teuthology.orchestra.run.trial131.stdout: osd debug trim objects = true 2026-02-12T08:53:30.983 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.983 INFO:teuthology.orchestra.run.trial131.stdout: osd open classes on start = true 2026-02-12T08:53:30.983 INFO:teuthology.orchestra.run.trial131.stdout: osd debug pg log writeout = true 2026-02-12T08:53:30.983 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.983 INFO:teuthology.orchestra.run.trial131.stdout: osd deep scrub update digest min age = 30 2026-02-12T08:53:30.984 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.984 INFO:teuthology.orchestra.run.trial131.stdout: osd map max advance = 10 2026-02-12T08:53:30.984 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.984 INFO:teuthology.orchestra.run.trial131.stdout: journal zero on create = true 2026-02-12T08:53:30.984 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.984 INFO:teuthology.orchestra.run.trial131.stdout: filestore ondisk finisher threads = 3 2026-02-12T08:53:30.984 INFO:teuthology.orchestra.run.trial131.stdout: filestore apply finisher threads = 3 2026-02-12T08:53:30.984 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.984 INFO:teuthology.orchestra.run.trial131.stdout: bdev debug aio = true 2026-02-12T08:53:30.984 INFO:teuthology.orchestra.run.trial131.stdout: osd debug misdirected ops = true 2026-02-12T08:53:30.984 INFO:teuthology.orchestra.run.trial131.stdout: debug monc = 20 2026-02-12T08:53:30.984 INFO:teuthology.orchestra.run.trial131.stdout: crimson cpu num = 4 2026-02-12T08:53:30.984 INFO:teuthology.orchestra.run.trial131.stdout: crimson osd obc lru size = 10 2026-02-12T08:53:30.985 INFO:teuthology.orchestra.run.trial131.stdout: debug ms = 20 2026-02-12T08:53:30.985 INFO:teuthology.orchestra.run.trial131.stdout: debug objclass = 20 2026-02-12T08:53:30.985 INFO:teuthology.orchestra.run.trial131.stdout: debug osd = 20 2026-02-12T08:53:30.985 INFO:teuthology.orchestra.run.trial131.stdout: debug seastore = 20 2026-02-12T08:53:30.985 INFO:teuthology.orchestra.run.trial131.stdout: debug seastore backref = 20 2026-02-12T08:53:30.985 INFO:teuthology.orchestra.run.trial131.stdout: debug seastore cache = 20 2026-02-12T08:53:30.985 INFO:teuthology.orchestra.run.trial131.stdout: debug seastore cleaner = 20 2026-02-12T08:53:30.985 INFO:teuthology.orchestra.run.trial131.stdout: debug seastore device = 20 2026-02-12T08:53:30.985 INFO:teuthology.orchestra.run.trial131.stdout: debug seastore epm = 20 2026-02-12T08:53:30.985 INFO:teuthology.orchestra.run.trial131.stdout: debug seastore fixedkv tree = 20 2026-02-12T08:53:30.985 INFO:teuthology.orchestra.run.trial131.stdout: debug seastore journal = 20 2026-02-12T08:53:30.985 INFO:teuthology.orchestra.run.trial131.stdout: debug seastore lba = 20 2026-02-12T08:53:30.985 INFO:teuthology.orchestra.run.trial131.stdout: debug seastore odata = 20 2026-02-12T08:53:30.985 INFO:teuthology.orchestra.run.trial131.stdout: debug seastore omap = 20 2026-02-12T08:53:30.986 INFO:teuthology.orchestra.run.trial131.stdout: debug seastore onode = 20 2026-02-12T08:53:30.986 INFO:teuthology.orchestra.run.trial131.stdout: debug seastore t = 20 2026-02-12T08:53:30.986 INFO:teuthology.orchestra.run.trial131.stdout: debug seastore tm = 20 2026-02-12T08:53:30.986 INFO:teuthology.orchestra.run.trial131.stdout: osd objectstore = seastore 2026-02-12T08:53:30.986 INFO:teuthology.orchestra.run.trial131.stdout: osd shutdown pgref assert = True 2026-02-12T08:53:30.986 INFO:teuthology.orchestra.run.trial131.stdout: seastore cachepin size pershard = 64M 2026-02-12T08:53:30.986 INFO:teuthology.orchestra.run.trial131.stdout: seastore main device type = RANDOM_BLOCK_SSD 2026-02-12T08:53:30.986 INFO:teuthology.orchestra.run.trial131.stdout: seastore max concurrent transactions = 8 2026-02-12T08:53:30.986 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.986 INFO:teuthology.orchestra.run.trial131.stdout:[mgr] 2026-02-12T08:53:30.986 INFO:teuthology.orchestra.run.trial131.stdout: debug ms = 1 2026-02-12T08:53:30.986 INFO:teuthology.orchestra.run.trial131.stdout: debug mgr = 20 2026-02-12T08:53:30.986 INFO:teuthology.orchestra.run.trial131.stdout: debug mon = 20 2026-02-12T08:53:30.987 INFO:teuthology.orchestra.run.trial131.stdout: debug auth = 20 2026-02-12T08:53:30.987 INFO:teuthology.orchestra.run.trial131.stdout: mon reweight min pgs per osd = 4 2026-02-12T08:53:30.987 INFO:teuthology.orchestra.run.trial131.stdout: mon reweight min bytes per osd = 10 2026-02-12T08:53:30.987 INFO:teuthology.orchestra.run.trial131.stdout: mgr/telemetry/nag = false 2026-02-12T08:53:30.987 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.987 INFO:teuthology.orchestra.run.trial131.stdout:[mon] 2026-02-12T08:53:30.987 INFO:teuthology.orchestra.run.trial131.stdout: debug ms = 1 2026-02-12T08:53:30.987 INFO:teuthology.orchestra.run.trial131.stdout: debug mon = 20 2026-02-12T08:53:30.987 INFO:teuthology.orchestra.run.trial131.stdout: debug paxos = 20 2026-02-12T08:53:30.987 INFO:teuthology.orchestra.run.trial131.stdout: debug auth = 20 2026-02-12T08:53:30.987 INFO:teuthology.orchestra.run.trial131.stdout: mon data avail warn = 5 2026-02-12T08:53:30.987 INFO:teuthology.orchestra.run.trial131.stdout: mon mgr mkfs grace = 240 2026-02-12T08:53:30.987 INFO:teuthology.orchestra.run.trial131.stdout: mon reweight min pgs per osd = 4 2026-02-12T08:53:30.988 INFO:teuthology.orchestra.run.trial131.stdout: mon osd reporter subtree level = osd 2026-02-12T08:53:30.988 INFO:teuthology.orchestra.run.trial131.stdout: mon osd prime pg temp = true 2026-02-12T08:53:30.988 INFO:teuthology.orchestra.run.trial131.stdout: mon reweight min bytes per osd = 10 2026-02-12T08:53:30.988 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.988 INFO:teuthology.orchestra.run.trial131.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T08:53:30.988 INFO:teuthology.orchestra.run.trial131.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T08:53:30.988 INFO:teuthology.orchestra.run.trial131.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T08:53:30.988 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.988 INFO:teuthology.orchestra.run.trial131.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T08:53:30.988 INFO:teuthology.orchestra.run.trial131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T08:53:30.988 INFO:teuthology.orchestra.run.trial131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T08:53:30.988 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.989 INFO:teuthology.orchestra.run.trial131.stdout: # 1m isn't quite enough 2026-02-12T08:53:30.989 INFO:teuthology.orchestra.run.trial131.stdout: mon_down_mkfs_grace = 2m 2026-02-12T08:53:30.989 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.989 INFO:teuthology.orchestra.run.trial131.stdout: mon_warn_on_filestore_osds = false 2026-02-12T08:53:30.989 INFO:teuthology.orchestra.run.trial131.stdout: mon min osdmap epochs = 50 2026-02-12T08:53:30.989 INFO:teuthology.orchestra.run.trial131.stdout: mon osdmap full prune interval = 2 2026-02-12T08:53:30.989 INFO:teuthology.orchestra.run.trial131.stdout: mon osdmap full prune min = 15 2026-02-12T08:53:30.989 INFO:teuthology.orchestra.run.trial131.stdout: mon osdmap full prune txsize = 2 2026-02-12T08:53:30.989 INFO:teuthology.orchestra.run.trial131.stdout: paxos service trim min = 10 2026-02-12T08:53:30.989 INFO:teuthology.orchestra.run.trial131.stdout: osd pool default crimson = True 2026-02-12T08:53:30.989 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T08:53:30.989 INFO:teuthology.orchestra.run.trial131.stdout:[client] 2026-02-12T08:53:30.989 INFO:teuthology.orchestra.run.trial131.stdout: rgw cache enabled = true 2026-02-12T08:53:30.989 INFO:teuthology.orchestra.run.trial131.stdout: rgw enable ops log = true 2026-02-12T08:53:30.990 INFO:teuthology.orchestra.run.trial131.stdout: rgw enable usage log = true 2026-02-12T08:53:30.990 INFO:teuthology.orchestra.run.trial131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T08:53:30.990 INFO:teuthology.orchestra.run.trial131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T08:53:30.990 INFO:teuthology.orchestra.run.trial131.stdout:[mon.a] 2026-02-12T08:53:30.990 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-12T08:53:30.990 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-12T08:53:31.066 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-12T08:53:31.067 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:53:31.067 DEBUG:teuthology.orchestra.run.trial042:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-12T08:53:31.083 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:53:31.083 DEBUG:teuthology.orchestra.run.trial042:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-12T08:53:31.140 INFO:tasks.ceph:Sending monmap to node ubuntu@trial042.front.sepia.ceph.com 2026-02-12T08:53:31.140 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:53:31.141 DEBUG:teuthology.orchestra.run.trial042:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T08:53:31.141 DEBUG:teuthology.orchestra.run.trial042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T08:53:31.213 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:53:31.213 DEBUG:teuthology.orchestra.run.trial042:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:53:31.270 INFO:tasks.ceph:Sending monmap to node ubuntu@trial131.front.sepia.ceph.com 2026-02-12T08:53:31.270 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-12T08:53:31.270 DEBUG:teuthology.orchestra.run.trial131:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T08:53:31.270 DEBUG:teuthology.orchestra.run.trial131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T08:53:31.302 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-12T08:53:31.302 DEBUG:teuthology.orchestra.run.trial131:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:53:31.359 INFO:tasks.ceph:Setting up mon nodes... 2026-02-12T08:53:31.359 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-12T08:53:31.359 DEBUG:teuthology.orchestra.run.trial131:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T08:53:31.451 INFO:teuthology.orchestra.run.trial131.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T08:53:31.454 INFO:tasks.ceph:Setting up mds nodes... 2026-02-12T08:53:31.454 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-12T08:53:31.455 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-12T08:53:31.497 INFO:teuthology.orchestra.run.trial042.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-12T08:53:31.509 DEBUG:teuthology.orchestra.run.trial131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-12T08:53:31.552 INFO:teuthology.orchestra.run.trial131.stdout:creating /etc/ceph/ceph.client.1.keyring 2026-02-12T08:53:31.564 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-12T08:53:31.564 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial131.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-12T08:53:31.564 DEBUG:teuthology.orchestra.run.trial042:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-12T08:53:31.589 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-12T08:53:31.589 INFO:tasks.ceph:role: osd.0 2026-02-12T08:53:31.589 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial042.front.sepia.ceph.com 2026-02-12T08:53:31.589 DEBUG:teuthology.orchestra.run.trial042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T08:53:31.654 INFO:teuthology.orchestra.run.trial042.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T08:53:31.654 INFO:teuthology.orchestra.run.trial042.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T08:53:31.654 INFO:teuthology.orchestra.run.trial042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T08:53:31.654 INFO:teuthology.orchestra.run.trial042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T08:53:31.654 INFO:teuthology.orchestra.run.trial042.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T08:53:31.655 INFO:teuthology.orchestra.run.trial042.stdout: = sunit=0 swidth=0 blks 2026-02-12T08:53:31.655 INFO:teuthology.orchestra.run.trial042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T08:53:31.655 INFO:teuthology.orchestra.run.trial042.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T08:53:31.655 INFO:teuthology.orchestra.run.trial042.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T08:53:31.655 INFO:teuthology.orchestra.run.trial042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T08:53:32.235 INFO:teuthology.orchestra.run.trial042.stdout:Discarding blocks...Done. 2026-02-12T08:53:32.237 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial042.front.sepia.ceph.com -o noatime 2026-02-12T08:53:32.237 DEBUG:teuthology.orchestra.run.trial042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-12T08:53:32.305 DEBUG:teuthology.orchestra.run.trial042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-12T08:53:32.373 DEBUG:teuthology.orchestra.run.trial042:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-12T08:53:32.438 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-12T08:53:32.438 INFO:tasks.ceph:role: osd.1 2026-02-12T08:53:32.439 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial042.front.sepia.ceph.com 2026-02-12T08:53:32.439 DEBUG:teuthology.orchestra.run.trial042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T08:53:32.503 INFO:teuthology.orchestra.run.trial042.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T08:53:32.503 INFO:teuthology.orchestra.run.trial042.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T08:53:32.503 INFO:teuthology.orchestra.run.trial042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T08:53:32.504 INFO:teuthology.orchestra.run.trial042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T08:53:32.504 INFO:teuthology.orchestra.run.trial042.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T08:53:32.504 INFO:teuthology.orchestra.run.trial042.stdout: = sunit=0 swidth=0 blks 2026-02-12T08:53:32.504 INFO:teuthology.orchestra.run.trial042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T08:53:32.504 INFO:teuthology.orchestra.run.trial042.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T08:53:32.504 INFO:teuthology.orchestra.run.trial042.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T08:53:32.504 INFO:teuthology.orchestra.run.trial042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T08:53:33.066 INFO:teuthology.orchestra.run.trial042.stdout:Discarding blocks...Done. 2026-02-12T08:53:33.068 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial042.front.sepia.ceph.com -o noatime 2026-02-12T08:53:33.068 DEBUG:teuthology.orchestra.run.trial042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-12T08:53:33.137 DEBUG:teuthology.orchestra.run.trial042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-12T08:53:33.205 DEBUG:teuthology.orchestra.run.trial042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:53:33.355 INFO:teuthology.orchestra.run.trial042.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T08:53:33.412 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:33,411 seastar - Reactor backend: linux-aio 2026-02-12T08:53:33.429 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:33,429 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:53:33.429 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:33,429 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:53:33.431 INFO:teuthology.orchestra.run.trial042.stderr:==20385==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:53:33.487 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:33,486 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-12T08:53:33.488 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:33,486 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-12T08:53:33.488 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:33,486 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-12T08:53:33.488 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:33,486 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-12T08:53:33.488 INFO:teuthology.orchestra.run.trial042.stderr:DEBUG 2026-02-12 08:53:33,487 [shard 0:main] seastar - reactor::drain 2026-02-12T08:53:35.587 INFO:teuthology.orchestra.run.trial042.stderr:----------------------------------------------------- 2026-02-12T08:53:35.588 INFO:teuthology.orchestra.run.trial042.stderr:Suppressions used: 2026-02-12T08:53:35.588 INFO:teuthology.orchestra.run.trial042.stderr: count bytes template 2026-02-12T08:53:35.588 INFO:teuthology.orchestra.run.trial042.stderr: 1 8 MallocExtension::Register 2026-02-12T08:53:35.588 INFO:teuthology.orchestra.run.trial042.stderr:----------------------------------------------------- 2026-02-12T08:53:35.588 INFO:teuthology.orchestra.run.trial042.stderr: 2026-02-12T08:53:35.607 INFO:teuthology.orchestra.run.trial042.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T08:53:35.607 INFO:teuthology.orchestra.run.trial042.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T08:53:35.650 INFO:teuthology.orchestra.run.trial042.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T08:53:35.650 INFO:teuthology.orchestra.run.trial042.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T08:53:35.657 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:35,656 seastar - Reactor backend: linux-aio 2026-02-12T08:53:35.669 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:35,668 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:53:35.669 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:35,668 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:53:35.672 INFO:teuthology.orchestra.run.trial042.stderr:==20383==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:53:35.672 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:35,672 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T08:53:35.731 INFO:teuthology.orchestra.run.trial042.stderr:DEBUG 2026-02-12 08:53:35,731 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-12T08:53:35.810 INFO:teuthology.orchestra.run.trial042.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x9c4c515 0x9d127a7 0x9d1296f 0x9d12ad0 0x9d12fc4 0x9d2f84f 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:35.810 INFO:teuthology.orchestra.run.trial042.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7fc 0x9b1228b 0x9b8fa26 0x9b8fb3c 0x9b8fc18 0x9b902d4 0x9b8ff4d 0x9b9043b 0x9b9083f 0x9b90afc 0x9b91944 0x9d08598 0x9d08691 0x7bd7317 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:35.810 INFO:teuthology.orchestra.run.trial042.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff83875c69 0xffffffff83a1f917 0xffffffff83a1fb70 0xffffffff8389525e 0xffffffff83be6239 0xffffffff83bc97a5 0xffffffff83bd3b7b 0xffffffff83bd3fdb 0xffffffff838910d2 0xffffffff8454d451 0xffffffff84600ba2 2026-02-12T08:53:35.811 INFO:teuthology.orchestra.run.trial042.stderr:Reactor stalled for 33 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x8eea /lib64/libasan.so.8+0xedc65 0xe1d15b 0x9d35c7b 0x788188f 0x7bd6cd5 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:35.811 INFO:teuthology.orchestra.run.trial042.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff83875c69 0xffffffff83a1f917 0xffffffff83a1fb70 0xffffffff8389525e 0xffffffff83be6239 0xffffffff83bc97a5 0xffffffff83bd3b7b 0xffffffff83bd3fdb 0xffffffff838910d2 0xffffffff8454d451 0xffffffff84600ba2 2026-02-12T08:53:35.957 INFO:teuthology.orchestra.run.trial042.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x1090433 0xf2dc9c 0x9c3d9d0 0x9c3dccd 0x9c3df40 0x9c3e1f6 0x9c3eca5 0x9c3f1a3 0x9c3f7d3 0x9c3f93d 0x9d1fcad 0x9d32ab0 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:35.957 INFO:teuthology.orchestra.run.trial042.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x109034b 0xf2dc9c 0x9c3d803 0x9c3dccd 0x9c3df40 0x9c3e1f6 0x9c3e7b8 0x9c46c5f 0x9c4733f 0x9d2fe8c 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:35.957 INFO:teuthology.orchestra.run.trial042.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x9c3daaa 0x9c3dccd 0x9c3df40 0x9c3fc67 0x9c401b4 0x9c403b3 0x9d256d5 0x9d25e30 0x9d300be 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:38.149 INFO:teuthology.orchestra.run.trial042.stderr:----------------------------------------------------- 2026-02-12T08:53:38.150 INFO:teuthology.orchestra.run.trial042.stderr:Suppressions used: 2026-02-12T08:53:38.150 INFO:teuthology.orchestra.run.trial042.stderr: count bytes template 2026-02-12T08:53:38.150 INFO:teuthology.orchestra.run.trial042.stderr: 1 8 MallocExtension::Register 2026-02-12T08:53:38.150 INFO:teuthology.orchestra.run.trial042.stderr:----------------------------------------------------- 2026-02-12T08:53:38.150 INFO:teuthology.orchestra.run.trial042.stderr: 2026-02-12T08:53:38.181 DEBUG:teuthology.orchestra.run.trial042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-12T08:53:38.206 DEBUG:teuthology.orchestra.run.trial042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:53:38.356 INFO:teuthology.orchestra.run.trial042.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T08:53:38.411 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:38,411 seastar - Reactor backend: linux-aio 2026-02-12T08:53:38.421 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:38,421 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:53:38.421 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:38,421 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:53:38.423 INFO:teuthology.orchestra.run.trial042.stderr:==20455==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:53:38.479 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:38,478 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-12T08:53:38.479 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:38,478 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-12T08:53:38.479 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:38,478 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-12T08:53:38.479 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:38,478 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-12T08:53:38.479 INFO:teuthology.orchestra.run.trial042.stderr:DEBUG 2026-02-12 08:53:38,478 [shard 0:main] seastar - reactor::drain 2026-02-12T08:53:40.583 INFO:teuthology.orchestra.run.trial042.stderr:----------------------------------------------------- 2026-02-12T08:53:40.584 INFO:teuthology.orchestra.run.trial042.stderr:Suppressions used: 2026-02-12T08:53:40.584 INFO:teuthology.orchestra.run.trial042.stderr: count bytes template 2026-02-12T08:53:40.584 INFO:teuthology.orchestra.run.trial042.stderr: 1 8 MallocExtension::Register 2026-02-12T08:53:40.584 INFO:teuthology.orchestra.run.trial042.stderr:----------------------------------------------------- 2026-02-12T08:53:40.584 INFO:teuthology.orchestra.run.trial042.stderr: 2026-02-12T08:53:40.604 INFO:teuthology.orchestra.run.trial042.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T08:53:40.604 INFO:teuthology.orchestra.run.trial042.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T08:53:40.654 INFO:teuthology.orchestra.run.trial042.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T08:53:40.654 INFO:teuthology.orchestra.run.trial042.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T08:53:40.661 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:40,660 seastar - Reactor backend: linux-aio 2026-02-12T08:53:40.668 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:40,668 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:53:40.668 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:40,668 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:53:40.672 INFO:teuthology.orchestra.run.trial042.stderr:==20453==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:53:40.672 INFO:teuthology.orchestra.run.trial042.stderr:INFO 2026-02-12 08:53:40,671 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T08:53:40.731 INFO:teuthology.orchestra.run.trial042.stderr:DEBUG 2026-02-12 08:53:40,731 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-12T08:53:40.812 INFO:teuthology.orchestra.run.trial042.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6638 /lib64/libasan.so.8+0x157e7 0x9d2100c 0x9d310d4 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:40.812 INFO:teuthology.orchestra.run.trial042.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65e3 /lib64/libasan.so.8+0x151b7 0x1124fe8 0xf2dc91 0x9d2060d 0x9d20bfa 0x9d20f7d 0x9d310d4 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:40.812 INFO:teuthology.orchestra.run.trial042.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x119122 /lib64/libasan.so.8+0xc5f4 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7fc 0x9b1228b 0x9b8fa26 0x9b8fb3c 0x9b8fc18 0x9b8fe94 0x9b8ff4d 0x9b9043b 0x9b9083f 0x9b90afc 0x9d32705 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:40.958 INFO:teuthology.orchestra.run.trial042.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x3169337 0x9d3102b 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:40.959 INFO:teuthology.orchestra.run.trial042.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x129764 /lib64/libasan.so.8+0xc6631 /lib64/libasan.so.8+0x157e7 0x10904af 0xf2dc9c 0x9c3d9d0 0x9c3dccd 0x9c3df40 0x9c3e1f6 0x9c3eca5 0x9c3f1a3 0x9c3f7d3 0x9c3f93d 0x9d1fcad 0x9d32ab0 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:40.959 INFO:teuthology.orchestra.run.trial042.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x129747 /lib64/libasan.so.8+0xc6631 /lib64/libasan.so.8+0x157e7 0x10904af 0xf2dc9c 0x9c3d9d0 0x9c3dccd 0x9c3df40 0x9c3fc67 0x9c401b4 0x9c403b3 0x9d256d5 0x9d25e30 0x9d300be 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:43.135 INFO:teuthology.orchestra.run.trial042.stderr:----------------------------------------------------- 2026-02-12T08:53:43.136 INFO:teuthology.orchestra.run.trial042.stderr:Suppressions used: 2026-02-12T08:53:43.136 INFO:teuthology.orchestra.run.trial042.stderr: count bytes template 2026-02-12T08:53:43.136 INFO:teuthology.orchestra.run.trial042.stderr: 1 8 MallocExtension::Register 2026-02-12T08:53:43.136 INFO:teuthology.orchestra.run.trial042.stderr:----------------------------------------------------- 2026-02-12T08:53:43.136 INFO:teuthology.orchestra.run.trial042.stderr: 2026-02-12T08:53:43.167 DEBUG:teuthology.orchestra.run.trial042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-12T08:53:43.192 DEBUG:teuthology.orchestra.run.trial131:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-12T08:53:43.218 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-12T08:53:43.219 INFO:tasks.ceph:role: osd.2 2026-02-12T08:53:43.219 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial131.front.sepia.ceph.com 2026-02-12T08:53:43.219 DEBUG:teuthology.orchestra.run.trial131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T08:53:43.283 INFO:teuthology.orchestra.run.trial131.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T08:53:43.283 INFO:teuthology.orchestra.run.trial131.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T08:53:43.284 INFO:teuthology.orchestra.run.trial131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T08:53:43.284 INFO:teuthology.orchestra.run.trial131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T08:53:43.284 INFO:teuthology.orchestra.run.trial131.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T08:53:43.284 INFO:teuthology.orchestra.run.trial131.stdout: = sunit=0 swidth=0 blks 2026-02-12T08:53:43.284 INFO:teuthology.orchestra.run.trial131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T08:53:43.284 INFO:teuthology.orchestra.run.trial131.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T08:53:43.284 INFO:teuthology.orchestra.run.trial131.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T08:53:43.284 INFO:teuthology.orchestra.run.trial131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T08:53:43.859 INFO:teuthology.orchestra.run.trial131.stdout:Discarding blocks...Done. 2026-02-12T08:53:43.861 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial131.front.sepia.ceph.com -o noatime 2026-02-12T08:53:43.862 DEBUG:teuthology.orchestra.run.trial131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-12T08:53:43.929 DEBUG:teuthology.orchestra.run.trial131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-12T08:53:43.996 DEBUG:teuthology.orchestra.run.trial131:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-12T08:53:44.062 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-12T08:53:44.062 INFO:tasks.ceph:role: osd.3 2026-02-12T08:53:44.062 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial131.front.sepia.ceph.com 2026-02-12T08:53:44.062 DEBUG:teuthology.orchestra.run.trial131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T08:53:44.126 INFO:teuthology.orchestra.run.trial131.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T08:53:44.127 INFO:teuthology.orchestra.run.trial131.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T08:53:44.127 INFO:teuthology.orchestra.run.trial131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T08:53:44.127 INFO:teuthology.orchestra.run.trial131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T08:53:44.127 INFO:teuthology.orchestra.run.trial131.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T08:53:44.127 INFO:teuthology.orchestra.run.trial131.stdout: = sunit=0 swidth=0 blks 2026-02-12T08:53:44.127 INFO:teuthology.orchestra.run.trial131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T08:53:44.127 INFO:teuthology.orchestra.run.trial131.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T08:53:44.127 INFO:teuthology.orchestra.run.trial131.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T08:53:44.127 INFO:teuthology.orchestra.run.trial131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T08:53:44.684 INFO:teuthology.orchestra.run.trial131.stdout:Discarding blocks...Done. 2026-02-12T08:53:44.686 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial131.front.sepia.ceph.com -o noatime 2026-02-12T08:53:44.687 DEBUG:teuthology.orchestra.run.trial131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2026-02-12T08:53:44.754 DEBUG:teuthology.orchestra.run.trial131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-12T08:53:44.821 DEBUG:teuthology.orchestra.run.trial131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:53:44.970 INFO:teuthology.orchestra.run.trial131.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T08:53:45.027 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:45,024 seastar - Reactor backend: linux-aio 2026-02-12T08:53:45.036 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:45,034 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:53:45.036 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:45,034 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:53:45.038 INFO:teuthology.orchestra.run.trial131.stderr:==20980==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:53:45.094 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:45,091 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-12T08:53:45.094 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:45,091 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-12T08:53:45.094 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:45,091 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-12T08:53:45.094 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:45,091 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-12T08:53:45.094 INFO:teuthology.orchestra.run.trial131.stderr:DEBUG 2026-02-12 08:53:45,092 [shard 0:main] seastar - reactor::drain 2026-02-12T08:53:47.138 INFO:teuthology.orchestra.run.trial131.stderr:----------------------------------------------------- 2026-02-12T08:53:47.138 INFO:teuthology.orchestra.run.trial131.stderr:Suppressions used: 2026-02-12T08:53:47.138 INFO:teuthology.orchestra.run.trial131.stderr: count bytes template 2026-02-12T08:53:47.139 INFO:teuthology.orchestra.run.trial131.stderr: 1 8 MallocExtension::Register 2026-02-12T08:53:47.139 INFO:teuthology.orchestra.run.trial131.stderr:----------------------------------------------------- 2026-02-12T08:53:47.139 INFO:teuthology.orchestra.run.trial131.stderr: 2026-02-12T08:53:47.158 INFO:teuthology.orchestra.run.trial131.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T08:53:47.158 INFO:teuthology.orchestra.run.trial131.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T08:53:47.200 INFO:teuthology.orchestra.run.trial131.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T08:53:47.200 INFO:teuthology.orchestra.run.trial131.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T08:53:47.207 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:47,205 seastar - Reactor backend: linux-aio 2026-02-12T08:53:47.217 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:47,215 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:53:47.217 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:47,215 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:53:47.221 INFO:teuthology.orchestra.run.trial131.stderr:==20978==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:53:47.221 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:47,219 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T08:53:47.279 INFO:teuthology.orchestra.run.trial131.stderr:DEBUG 2026-02-12 08:53:47,277 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-12T08:53:47.358 INFO:teuthology.orchestra.run.trial131.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/ld-linux-x86-64.so.2+0x16ebc /lib64/libasan.so.8+0xc6611 /lib64/libasan.so.8+0x151b7 0x1124fe8 0xf2dc91 0x9c3d803 0x9c3dccd 0x9c3df40 0x9c3fc67 0x9c401b4 0x9c403b3 0x9d256d5 0x9d25e30 0x9d300be 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:47.358 INFO:teuthology.orchestra.run.trial131.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x9c3f864 0x9c3f93d 0x9d1fcad 0x9d32ab0 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:47.358 INFO:teuthology.orchestra.run.trial131.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/ld-linux-x86-64.so.2+0x16ed3 /lib64/libasan.so.8+0xc6611 /lib64/libasan.so.8+0x16527 0x9d1f76e 0x9d1fa96 0x9d1fe29 0x9d32ab0 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:47.505 INFO:teuthology.orchestra.run.trial131.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0xe1d15e 0x78816dd 0x7bd6cd5 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:47.505 INFO:teuthology.orchestra.run.trial131.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0xb6cef2 0xa5c3f53 0x9cbc906 0x9cbcbc7 0x9d35753 0x9d358a0 0x9d35933 0x9d36778 0x788188f 0x7bd72da 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:47.505 INFO:teuthology.orchestra.run.trial131.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xe99a /lib64/libasan.so.8+0xec796 0xcb00b1 0x9d12c4b 0x9d12fc4 0x9d2f84f 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:47.505 INFO:teuthology.orchestra.run.trial131.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffa5f47e23 0xffffffffa6454e21 0xffffffffa620f62b 0xffffffffa61cb8e8 0xffffffffa61d3b7b 0xffffffffa61d3fdb 0xffffffffa5e910d2 0xffffffffa6b4d451 0xffffffffa6c00ba2 2026-02-12T08:53:49.682 INFO:teuthology.orchestra.run.trial131.stderr:----------------------------------------------------- 2026-02-12T08:53:49.682 INFO:teuthology.orchestra.run.trial131.stderr:Suppressions used: 2026-02-12T08:53:49.682 INFO:teuthology.orchestra.run.trial131.stderr: count bytes template 2026-02-12T08:53:49.682 INFO:teuthology.orchestra.run.trial131.stderr: 1 8 MallocExtension::Register 2026-02-12T08:53:49.682 INFO:teuthology.orchestra.run.trial131.stderr:----------------------------------------------------- 2026-02-12T08:53:49.682 INFO:teuthology.orchestra.run.trial131.stderr: 2026-02-12T08:53:49.713 DEBUG:teuthology.orchestra.run.trial131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-12T08:53:49.738 DEBUG:teuthology.orchestra.run.trial131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:53:49.889 INFO:teuthology.orchestra.run.trial131.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T08:53:49.943 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:49,940 seastar - Reactor backend: linux-aio 2026-02-12T08:53:49.950 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:49,948 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:53:49.950 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:49,948 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:53:49.952 INFO:teuthology.orchestra.run.trial131.stderr:==21049==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:53:50.008 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:50,005 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-12T08:53:50.008 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:50,005 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-12T08:53:50.008 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:50,005 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-12T08:53:50.008 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:50,005 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-12T08:53:50.008 INFO:teuthology.orchestra.run.trial131.stderr:DEBUG 2026-02-12 08:53:50,005 [shard 0:main] seastar - reactor::drain 2026-02-12T08:53:52.095 INFO:teuthology.orchestra.run.trial131.stderr:----------------------------------------------------- 2026-02-12T08:53:52.095 INFO:teuthology.orchestra.run.trial131.stderr:Suppressions used: 2026-02-12T08:53:52.095 INFO:teuthology.orchestra.run.trial131.stderr: count bytes template 2026-02-12T08:53:52.095 INFO:teuthology.orchestra.run.trial131.stderr: 1 8 MallocExtension::Register 2026-02-12T08:53:52.095 INFO:teuthology.orchestra.run.trial131.stderr:----------------------------------------------------- 2026-02-12T08:53:52.095 INFO:teuthology.orchestra.run.trial131.stderr: 2026-02-12T08:53:52.115 INFO:teuthology.orchestra.run.trial131.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T08:53:52.115 INFO:teuthology.orchestra.run.trial131.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T08:53:52.157 INFO:teuthology.orchestra.run.trial131.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T08:53:52.157 INFO:teuthology.orchestra.run.trial131.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T08:53:52.164 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:52,162 seastar - Reactor backend: linux-aio 2026-02-12T08:53:52.179 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:52,177 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:53:52.179 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:52,177 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:53:52.183 INFO:teuthology.orchestra.run.trial131.stderr:==21047==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:53:52.183 INFO:teuthology.orchestra.run.trial131.stderr:INFO 2026-02-12 08:53:52,181 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T08:53:52.243 INFO:teuthology.orchestra.run.trial131.stderr:DEBUG 2026-02-12 08:53:52,241 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-12T08:53:52.322 INFO:teuthology.orchestra.run.trial131.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x9d0fe4e 0x9d102a2 0x9d11889 0x9d12ba4 0x9d12fc4 0x9d2f84f 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:52.323 INFO:teuthology.orchestra.run.trial131.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x129793 /lib64/libasan.so.8+0xc6631 /lib64/libasan.so.8+0x151b7 0x1124fe8 0xf2dc91 0x9c3d9d0 0x9c3dccd 0x9c3df40 0x9c3fc67 0x9c401b4 0x9c403b3 0x9d256d5 0x9d25e30 0x9d300be 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:52.323 INFO:teuthology.orchestra.run.trial131.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x9d3488b 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:52.467 INFO:teuthology.orchestra.run.trial131.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1006b7 /lib64/libasan.so.8+0xc6619 /lib64/libasan.so.8+0x151b7 0x9c3d86c 0x9c3dccd 0x9c3df40 0x9c3fc67 0x9c401b4 0x9c403b3 0x9d256d5 0x9d25e30 0x9d300be 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:52.467 INFO:teuthology.orchestra.run.trial131.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x119823 /lib64/libasan.so.8+0xfd269 /lib64/libasan.so.8+0xef999 0x316d7be 0x316d998 0x316dc4f 0x316dd44 0x6f6047a 0x7bd7420 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:52.467 INFO:teuthology.orchestra.run.trial131.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0xcb01fb 0x9bdcf77 0x9d12eb3 0x9d2f84f 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:53:54.607 INFO:teuthology.orchestra.run.trial131.stderr:----------------------------------------------------- 2026-02-12T08:53:54.607 INFO:teuthology.orchestra.run.trial131.stderr:Suppressions used: 2026-02-12T08:53:54.607 INFO:teuthology.orchestra.run.trial131.stderr: count bytes template 2026-02-12T08:53:54.607 INFO:teuthology.orchestra.run.trial131.stderr: 1 8 MallocExtension::Register 2026-02-12T08:53:54.607 INFO:teuthology.orchestra.run.trial131.stderr:----------------------------------------------------- 2026-02-12T08:53:54.607 INFO:teuthology.orchestra.run.trial131.stderr: 2026-02-12T08:53:54.638 DEBUG:teuthology.orchestra.run.trial131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-12T08:53:54.664 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-12T08:53:54.664 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:53:54.664 DEBUG:teuthology.orchestra.run.trial042:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-12T08:53:54.690 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:53:54.690 DEBUG:teuthology.orchestra.run.trial042:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-12T08:53:54.754 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-12T08:53:54.754 DEBUG:teuthology.orchestra.run.trial131:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-12T08:53:54.780 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-12T08:53:54.780 DEBUG:teuthology.orchestra.run.trial131:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-12T08:53:54.845 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-12T08:53:54.845 DEBUG:teuthology.orchestra.run.trial131:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-12T08:53:54.908 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:53:54.909 DEBUG:teuthology.orchestra.run.trial042:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-12T08:53:54.927 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-12T08:53:54.927 DEBUG:teuthology.orchestra.run.trial131:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2026-02-12T08:53:54.965 INFO:tasks.ceph:Adding keys to all mons... 2026-02-12T08:53:54.965 DEBUG:teuthology.orchestra.run.trial042:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-12T08:53:54.991 INFO:teuthology.orchestra.run.trial042.stdout:[osd.0] 2026-02-12T08:53:54.991 INFO:teuthology.orchestra.run.trial042.stdout: key = AQAPlY1pnATRKxAAT706VV6P/A+b9VyCOkH+Yg== 2026-02-12T08:53:54.991 INFO:teuthology.orchestra.run.trial042.stdout:[osd.1] 2026-02-12T08:53:54.991 INFO:teuthology.orchestra.run.trial042.stdout: key = AQAUlY1pfj3SKxAA/kodfWGzo4I7VTX17GrnUA== 2026-02-12T08:53:54.991 INFO:teuthology.orchestra.run.trial042.stdout:[mgr.x] 2026-02-12T08:53:54.991 INFO:teuthology.orchestra.run.trial042.stdout: key = AQALlY1pBdLIGhAA+Mkv4IGYUeJMJMogiPkYtg== 2026-02-12T08:53:54.991 INFO:teuthology.orchestra.run.trial042.stdout:[osd.2] 2026-02-12T08:53:54.992 INFO:teuthology.orchestra.run.trial042.stdout: key = AQAblY1pg6e+EBAA6Qe1zADpaNmDW/8sGA9s2w== 2026-02-12T08:53:54.992 INFO:teuthology.orchestra.run.trial042.stdout:[osd.3] 2026-02-12T08:53:54.992 INFO:teuthology.orchestra.run.trial042.stdout: key = AQAglY1p6jidDhAAu/3yE6kSEAC7yIjf3V0HyQ== 2026-02-12T08:53:54.992 INFO:teuthology.orchestra.run.trial042.stdout:[client.0] 2026-02-12T08:53:54.992 INFO:teuthology.orchestra.run.trial042.stdout: key = AQALlY1p/12kHRAAoAAlaVkfsJOVHsAk1LPPMA== 2026-02-12T08:53:54.992 INFO:teuthology.orchestra.run.trial042.stdout:[client.1] 2026-02-12T08:53:54.992 INFO:teuthology.orchestra.run.trial042.stdout: key = AQALlY1pcxvIIBAA8HHhmpSAJUWtXlavFA6Nmg== 2026-02-12T08:53:54.993 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T08:53:55.082 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T08:53:55.131 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-12T08:53:55.179 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T08:53:55.227 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T08:53:55.276 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-12T08:53:55.326 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-12T08:53:55.376 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-12T08:53:55.376 DEBUG:teuthology.orchestra.run.trial042:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-12T08:53:55.401 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T08:53:55.487 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:53:55.485+0000 7f9e9fc2fc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:55.487 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:53:55.485+0000 7f9e9fc2fc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:55.499 DEBUG:teuthology.orchestra.run.trial042:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-12T08:53:55.524 DEBUG:teuthology.orchestra.run.trial042:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:53:55.580 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-12T08:53:55.580 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-12T08:53:55.580 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-12T08:53:55.622 INFO:tasks.ceph.mon.a:Started 2026-02-12T08:53:55.622 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-12T08:53:55.623 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-12T08:53:55.623 DEBUG:teuthology.orchestra.run.trial131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-12T08:53:55.625 INFO:tasks.ceph.mgr.x:Started 2026-02-12T08:53:55.626 DEBUG:tasks.ceph:set 0 configs 2026-02-12T08:53:55.626 DEBUG:teuthology.orchestra.run.trial042:> sudo ceph --cluster ceph config dump 2026-02-12T08:53:55.682 INFO:tasks.ceph.mon.a.trial042.stderr:2026-02-12T08:53:55.680+0000 7f8253e61c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:55.682 INFO:tasks.ceph.mon.a.trial042.stderr:2026-02-12T08:53:55.680+0000 7f8253e61c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:55.682 INFO:tasks.ceph.mon.a.trial042.stderr:2026-02-12T08:53:55.680+0000 7f8253e61c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:55.685 INFO:tasks.ceph.mgr.x.trial131.stderr:2026-02-12T08:53:55.681+0000 7fe06442dfc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:55.700 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:53:55.696+0000 7fbb6d246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:55.704 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:53:55.702+0000 7fbb6d246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:55.737 INFO:teuthology.orchestra.run.trial042.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-12T08:53:55.745 INFO:tasks.ceph:Setting crush tunables to default 2026-02-12T08:53:55.745 DEBUG:teuthology.orchestra.run.trial042:> sudo ceph --cluster ceph osd crush tunables default 2026-02-12T08:53:55.750 INFO:tasks.ceph.mgr.x.trial131.stderr:2026-02-12T08:53:55.746+0000 7fe06442dfc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:55.750 INFO:tasks.ceph.mgr.x.trial131.stderr:2026-02-12T08:53:55.747+0000 7fe06442dfc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:55.819 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:53:55.814+0000 7ff8f570b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:55.821 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:53:55.819+0000 7ff8f570b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:55.857 INFO:teuthology.orchestra.run.trial042.stderr:adjusted tunables profile to default 2026-02-12T08:53:55.865 INFO:tasks.ceph:check_enable_crimson: True 2026-02-12T08:53:55.865 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-12T08:53:55.865 DEBUG:teuthology.orchestra.run.trial042:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-12T08:53:55.939 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:53:55.934+0000 7f94d7ec2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:55.942 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:53:55.941+0000 7f94d7ec2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:55.982 INFO:tasks.ceph.mon.a.trial042.stderr:2026-02-12T08:53:55.981+0000 7f824b1f1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-12T08:53:55.983 INFO:tasks.ceph.mon.a.trial042.stderr:Please be aware that this feature is experimental, untested, 2026-02-12T08:53:55.983 INFO:tasks.ceph.mon.a.trial042.stderr:unsupported, and may result in data corruption, data loss, 2026-02-12T08:53:55.983 INFO:tasks.ceph.mon.a.trial042.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-12T08:53:55.983 INFO:tasks.ceph.mon.a.trial042.stderr:feature with important data. 2026-02-12T08:53:55.983 INFO:tasks.ceph.mon.a.trial042.stderr: 2026-02-12T08:53:56.586 INFO:tasks.ceph.mgr.x.trial131.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-12T08:53:56.586 INFO:tasks.ceph.mgr.x.trial131.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-12T08:53:56.586 INFO:tasks.ceph.mgr.x.trial131.stderr: from numpy import show_config as show_numpy_config 2026-02-12T08:53:56.869 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-12T08:53:56.869 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:53:56.869 DEBUG:teuthology.orchestra.run.trial042:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-12T08:53:56.895 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:53:56.895 DEBUG:teuthology.orchestra.run.trial042:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-12T08:53:56.959 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-12T08:53:56.959 DEBUG:teuthology.orchestra.run.trial131:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-12T08:53:56.985 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-12T08:53:56.986 DEBUG:teuthology.orchestra.run.trial131:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-12T08:53:57.050 DEBUG:teuthology.orchestra.run.trial131:> sudo ceph --cluster ceph osd new d14ad9ee-a102-4963-a699-0aa928add173 0 2026-02-12T08:53:57.161 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-12T08:53:57.154+0000 7f52bafd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:57.163 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-12T08:53:57.160+0000 7f52bafd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:57.202 INFO:teuthology.orchestra.run.trial131.stdout:0 2026-02-12T08:53:57.209 DEBUG:teuthology.orchestra.run.trial131:> sudo ceph --cluster ceph osd new 667f4c53-2714-416e-8b1f-f6c5e84237e9 1 2026-02-12T08:53:57.283 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-12T08:53:57.276+0000 7ff250acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:57.285 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-12T08:53:57.281+0000 7ff250acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:57.323 INFO:teuthology.orchestra.run.trial131.stdout:1 2026-02-12T08:53:57.331 DEBUG:teuthology.orchestra.run.trial131:> sudo ceph --cluster ceph osd new d3b78f0c-bf81-452e-8bcc-4898958de0c4 2 2026-02-12T08:53:57.404 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-12T08:53:57.397+0000 7fcd633b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:57.406 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-12T08:53:57.403+0000 7fcd633b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:57.444 INFO:teuthology.orchestra.run.trial131.stdout:2 2026-02-12T08:53:57.452 DEBUG:teuthology.orchestra.run.trial131:> sudo ceph --cluster ceph osd new 7a506618-fa1c-4f91-b2c2-059143827d5b 3 2026-02-12T08:53:57.525 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-12T08:53:57.518+0000 7f31b78cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:57.528 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-12T08:53:57.524+0000 7f31b78cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:57.565 INFO:teuthology.orchestra.run.trial131.stdout:3 2026-02-12T08:53:57.573 DEBUG:teuthology.orchestra.run.trial042:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-12T08:53:57.600 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-12T08:53:57.601 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-12T08:53:57.643 INFO:tasks.ceph.osd.0:Started 2026-02-12T08:53:57.643 DEBUG:teuthology.orchestra.run.trial042:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-12T08:53:57.670 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-12T08:53:57.671 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-12T08:53:57.713 INFO:tasks.ceph.osd.1:Started 2026-02-12T08:53:57.713 DEBUG:teuthology.orchestra.run.trial131:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-12T08:53:57.742 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-12T08:53:57.742 DEBUG:teuthology.orchestra.run.trial131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-12T08:53:57.783 INFO:tasks.ceph.osd.2:Started 2026-02-12T08:53:57.783 DEBUG:teuthology.orchestra.run.trial131:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2026-02-12T08:53:57.810 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-12T08:53:57.810 DEBUG:teuthology.orchestra.run.trial131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2026-02-12T08:53:57.851 INFO:tasks.ceph.osd.3:Started 2026-02-12T08:53:57.852 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T08:53:57.929 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:53:57.925+0000 7f659825a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:57.931 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:53:57.930+0000 7f659825a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:57.966 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:53:57.966 INFO:teuthology.orchestra.run.trial042.stdout:{"epoch":7,"fsid":"7e2c0a58-c4ab-4cae-b59c-95ee35636f28","created":"2026-02-12T08:53:55.693856+0000","modified":"2026-02-12T08:53:57.564434+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T08:53:57.564434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"d14ad9ee-a102-4963-a699-0aa928add173","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"667f4c53-2714-416e-8b1f-f6c5e84237e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d3b78f0c-bf81-452e-8bcc-4898958de0c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7a506618-fa1c-4f91-b2c2-059143827d5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:53:57.974 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-12T08:53:57.974 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-12T08:53:58.376 DEBUG:teuthology.orchestra.run.trial042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T08:53:58.443 INFO:teuthology.misc.health.trial042.stderr:2026-02-12T08:53:58.439+0000 7f0ae8fdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:58.445 INFO:teuthology.misc.health.trial042.stderr:2026-02-12T08:53:58.444+0000 7f0ae8fdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:53:58.479 INFO:teuthology.misc.health.trial042.stdout: 2026-02-12T08:53:58.479 INFO:teuthology.misc.health.trial042.stdout:{"epoch":7,"fsid":"7e2c0a58-c4ab-4cae-b59c-95ee35636f28","created":"2026-02-12T08:53:55.693856+0000","modified":"2026-02-12T08:53:57.564434+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T08:53:57.564434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"d14ad9ee-a102-4963-a699-0aa928add173","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"667f4c53-2714-416e-8b1f-f6c5e84237e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d3b78f0c-bf81-452e-8bcc-4898958de0c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7a506618-fa1c-4f91-b2c2-059143827d5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:53:58.486 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-12T08:53:58.956 INFO:tasks.ceph.mgr.x.trial131.stderr:2026-02-12T08:53:58.953+0000 7fdf7f02c640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-12T08:54:04.889 DEBUG:teuthology.orchestra.run.trial042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T08:54:04.960 INFO:teuthology.misc.health.trial042.stderr:2026-02-12T08:54:04.957+0000 7f58aa5dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:04.962 INFO:teuthology.misc.health.trial042.stderr:2026-02-12T08:54:04.962+0000 7f58aa5dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:05.075 INFO:teuthology.misc.health.trial042.stdout: 2026-02-12T08:54:05.075 INFO:teuthology.misc.health.trial042.stdout:{"epoch":11,"fsid":"7e2c0a58-c4ab-4cae-b59c-95ee35636f28","created":"2026-02-12T08:53:55.693856+0000","modified":"2026-02-12T08:54:04.969156+0000","last_up_change":"2026-02-12T08:54:04.969156+0000","last_in_change":"2026-02-12T08:53:57.564434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"d14ad9ee-a102-4963-a699-0aa928add173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6803","nonce":3549050663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6802","nonce":3549050663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6800","nonce":3549050663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6801","nonce":3549050663}]},"public_addr":"10.20.193.42:6803/3549050663","cluster_addr":"10.20.193.42:6802/3549050663","heartbeat_back_addr":"10.20.193.42:6800/3549050663","heartbeat_front_addr":"10.20.193.42:6801/3549050663","state":["exists","up"]},{"osd":1,"uuid":"667f4c53-2714-416e-8b1f-f6c5e84237e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6804","nonce":389981876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6805","nonce":389981876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6806","nonce":389981876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6807","nonce":389981876}]},"public_addr":"10.20.193.42:6804/389981876","cluster_addr":"10.20.193.42:6805/389981876","heartbeat_back_addr":"10.20.193.42:6806/389981876","heartbeat_front_addr":"10.20.193.42:6807/389981876","state":["exists","up"]},{"osd":2,"uuid":"d3b78f0c-bf81-452e-8bcc-4898958de0c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6805","nonce":685904287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6806","nonce":685904287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6807","nonce":685904287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6808","nonce":685904287}]},"public_addr":"10.20.193.131:6805/685904287","cluster_addr":"10.20.193.131:6806/685904287","heartbeat_back_addr":"10.20.193.131:6807/685904287","heartbeat_front_addr":"10.20.193.131:6808/685904287","state":["exists","up"]},{"osd":3,"uuid":"7a506618-fa1c-4f91-b2c2-059143827d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6803","nonce":4106838147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6804","nonce":4106838147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6813","nonce":4106838147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6812","nonce":4106838147}]},"public_addr":"10.20.193.131:6803/4106838147","cluster_addr":"10.20.193.131:6804/4106838147","heartbeat_back_addr":"10.20.193.131:6813/4106838147","heartbeat_front_addr":"10.20.193.131:6812/4106838147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:54:05.084 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-12T08:54:05.085 INFO:tasks.ceph:Creating RBD pool 2026-02-12T08:54:05.085 DEBUG:teuthology.orchestra.run.trial042:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-12T08:54:05.161 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:05.156+0000 7f5143983640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:05.163 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:05.162+0000 7f5143983640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:05.977 INFO:teuthology.orchestra.run.trial042.stderr:pool 'rbd' created 2026-02-12T08:54:05.990 DEBUG:teuthology.orchestra.run.trial042:> rbd --cluster ceph pool init rbd 2026-02-12T08:54:06.034 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:06.033+0000 7fc6f70df240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:06.034 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:06.033+0000 7fc6f70df240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:06.037 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:06.037+0000 7fc6f70df240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:09.009 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-12T08:54:09.010 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-12T08:54:09.010 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-12T08:54:09.127 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:09.123+0000 7f8449a06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:09.129 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:09.128+0000 7f8449a06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:09.241 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:54:09.251 INFO:teuthology.orchestra.run.trial042.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-12T08:54:09.251 INFO:tasks.ceph_manager:config epoch is 1 2026-02-12T08:54:09.251 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-12T08:54:09.251 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-12T08:54:09.251 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-12T08:54:09.326 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:09.323+0000 7f9e0730b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:09.329 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:09.328+0000 7f9e0730b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:09.474 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:54:09.484 INFO:teuthology.orchestra.run.trial042.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6800","nonce":83231074},{"type":"v1","addr":"10.20.193.131:6801","nonce":83231074}]},"active_addr":"10.20.193.131:6801/83231074","active_change":"2026-02-12T08:53:57.949733+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.131:0","nonce":3986427454}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.131:0","nonce":1989639229}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.131:0","nonce":3612528475}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.131:0","nonce":3900215821}]}]} 2026-02-12T08:54:09.485 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-12T08:54:09.486 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-12T08:54:09.486 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T08:54:09.562 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:09.559+0000 7fef5865a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:09.565 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:09.564+0000 7fef5865a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:09.677 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:54:09.678 INFO:teuthology.orchestra.run.trial042.stdout:{"epoch":15,"fsid":"7e2c0a58-c4ab-4cae-b59c-95ee35636f28","created":"2026-02-12T08:53:55.693856+0000","modified":"2026-02-12T08:54:08.982391+0000","last_up_change":"2026-02-12T08:54:04.969156+0000","last_in_change":"2026-02-12T08:53:57.564434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-12T08:54:05.281968+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-12T08:54:05.973138+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d14ad9ee-a102-4963-a699-0aa928add173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6803","nonce":3549050663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6802","nonce":3549050663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6800","nonce":3549050663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6801","nonce":3549050663}]},"public_addr":"10.20.193.42:6803/3549050663","cluster_addr":"10.20.193.42:6802/3549050663","heartbeat_back_addr":"10.20.193.42:6800/3549050663","heartbeat_front_addr":"10.20.193.42:6801/3549050663","state":["exists","up"]},{"osd":1,"uuid":"667f4c53-2714-416e-8b1f-f6c5e84237e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6804","nonce":389981876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6805","nonce":389981876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6806","nonce":389981876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6807","nonce":389981876}]},"public_addr":"10.20.193.42:6804/389981876","cluster_addr":"10.20.193.42:6805/389981876","heartbeat_back_addr":"10.20.193.42:6806/389981876","heartbeat_front_addr":"10.20.193.42:6807/389981876","state":["exists","up"]},{"osd":2,"uuid":"d3b78f0c-bf81-452e-8bcc-4898958de0c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6805","nonce":685904287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6806","nonce":685904287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6807","nonce":685904287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6808","nonce":685904287}]},"public_addr":"10.20.193.131:6805/685904287","cluster_addr":"10.20.193.131:6806/685904287","heartbeat_back_addr":"10.20.193.131:6807/685904287","heartbeat_front_addr":"10.20.193.131:6808/685904287","state":["exists","up"]},{"osd":3,"uuid":"7a506618-fa1c-4f91-b2c2-059143827d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6803","nonce":4106838147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6804","nonce":4106838147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6813","nonce":4106838147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6812","nonce":4106838147}]},"public_addr":"10.20.193.131:6803/4106838147","cluster_addr":"10.20.193.131:6804/4106838147","heartbeat_back_addr":"10.20.193.131:6813/4106838147","heartbeat_front_addr":"10.20.193.131:6812/4106838147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:54:09.688 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-12T08:54:09.688 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T08:54:09.765 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:09.762+0000 7f82ba593640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:09.767 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:09.767+0000 7f82ba593640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:09.878 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:54:09.879 INFO:teuthology.orchestra.run.trial042.stdout:{"epoch":15,"fsid":"7e2c0a58-c4ab-4cae-b59c-95ee35636f28","created":"2026-02-12T08:53:55.693856+0000","modified":"2026-02-12T08:54:08.982391+0000","last_up_change":"2026-02-12T08:54:04.969156+0000","last_in_change":"2026-02-12T08:53:57.564434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-12T08:54:05.281968+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-12T08:54:05.973138+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d14ad9ee-a102-4963-a699-0aa928add173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6803","nonce":3549050663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6802","nonce":3549050663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6800","nonce":3549050663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6801","nonce":3549050663}]},"public_addr":"10.20.193.42:6803/3549050663","cluster_addr":"10.20.193.42:6802/3549050663","heartbeat_back_addr":"10.20.193.42:6800/3549050663","heartbeat_front_addr":"10.20.193.42:6801/3549050663","state":["exists","up"]},{"osd":1,"uuid":"667f4c53-2714-416e-8b1f-f6c5e84237e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6804","nonce":389981876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6805","nonce":389981876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6806","nonce":389981876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6807","nonce":389981876}]},"public_addr":"10.20.193.42:6804/389981876","cluster_addr":"10.20.193.42:6805/389981876","heartbeat_back_addr":"10.20.193.42:6806/389981876","heartbeat_front_addr":"10.20.193.42:6807/389981876","state":["exists","up"]},{"osd":2,"uuid":"d3b78f0c-bf81-452e-8bcc-4898958de0c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6805","nonce":685904287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6806","nonce":685904287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6807","nonce":685904287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6808","nonce":685904287}]},"public_addr":"10.20.193.131:6805/685904287","cluster_addr":"10.20.193.131:6806/685904287","heartbeat_back_addr":"10.20.193.131:6807/685904287","heartbeat_front_addr":"10.20.193.131:6808/685904287","state":["exists","up"]},{"osd":3,"uuid":"7a506618-fa1c-4f91-b2c2-059143827d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6803","nonce":4106838147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6804","nonce":4106838147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6813","nonce":4106838147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6812","nonce":4106838147}]},"public_addr":"10.20.193.131:6803/4106838147","cluster_addr":"10.20.193.131:6804/4106838147","heartbeat_back_addr":"10.20.193.131:6813/4106838147","heartbeat_front_addr":"10.20.193.131:6812/4106838147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:54:09.889 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-12T08:54:09.889 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-12T08:54:09.889 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-12T08:54:09.889 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-12T08:54:09.972 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:09.969+0000 7f0c4028b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:09.972 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:09.969+0000 7fe5c221a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:09.973 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:09.969+0000 7f778f6cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:09.973 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:09.970+0000 7f8f14ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:09.975 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:09.974+0000 7f0c4028b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:09.975 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:09.975+0000 7fe5c221a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:09.975 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:09.975+0000 7f778f6cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:09.976 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:09.975+0000 7f8f14ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:09.993 INFO:teuthology.orchestra.run.trial042.stdout:42949672966 2026-02-12T08:54:09.994 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T08:54:09.994 INFO:teuthology.orchestra.run.trial042.stdout:42949672966 2026-02-12T08:54:09.994 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T08:54:09.995 INFO:teuthology.orchestra.run.trial042.stdout:47244640261 2026-02-12T08:54:09.995 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T08:54:09.995 INFO:teuthology.orchestra.run.trial042.stdout:47244640260 2026-02-12T08:54:09.996 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-12T08:54:10.078 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:10.074+0000 7f98fb10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:10.078 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:10.074+0000 7fe1a650b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:10.079 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:10.075+0000 7f400afe4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:10.079 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:10.076+0000 7f9528a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:10.080 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:10.079+0000 7f98fb10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:10.081 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:10.080+0000 7f400afe4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:10.081 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:10.081+0000 7fe1a650b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:10.082 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:10.081+0000 7f9528a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:10.196 INFO:teuthology.orchestra.run.trial042.stdout:42949672966 2026-02-12T08:54:10.199 INFO:teuthology.orchestra.run.trial042.stdout:47244640260 2026-02-12T08:54:10.205 INFO:teuthology.orchestra.run.trial042.stdout:42949672966 2026-02-12T08:54:10.207 INFO:teuthology.orchestra.run.trial042.stdout:47244640261 2026-02-12T08:54:10.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.0 2026-02-12T08:54:10.209 DEBUG:teuthology.parallel:result is None 2026-02-12T08:54:10.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.3 2026-02-12T08:54:10.211 DEBUG:teuthology.parallel:result is None 2026-02-12T08:54:10.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.2 2026-02-12T08:54:10.217 DEBUG:teuthology.parallel:result is None 2026-02-12T08:54:10.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.1 2026-02-12T08:54:10.220 DEBUG:teuthology.parallel:result is None 2026-02-12T08:54:10.220 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-12T08:54:10.220 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T08:54:10.336 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:10.333+0000 7f54eab64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:10.338 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:10.338+0000 7f54eab64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:10.454 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:54:10.454 INFO:teuthology.orchestra.run.trial042.stderr:dumped all 2026-02-12T08:54:10.463 INFO:teuthology.orchestra.run.trial042.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-12T08:54:09.986436+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83888736,"kb_used_data":83888736,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125826400,"statfs":{"total":214748299264,"available":128846233600,"internally_reserved":0,"allocated":85902065664,"data_stored":85902065664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991895+0000","last_change":"2026-02-12T08:54:08.996415+0000","last_active":"2026-02-12T08:54:08.991895+0000","last_peered":"2026-02-12T08:54:08.991895+0000","last_clean":"2026-02-12T08:54:08.991895+0000","last_became_active":"2026-02-12T08:54:07.029382+0000","last_became_peered":"2026-02-12T08:54:07.029382+0000","last_unstale":"2026-02-12T08:54:08.991895+0000","last_undegraded":"2026-02-12T08:54:08.991895+0000","last_fullsized":"2026-02-12T08:54:08.991895+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.994855+0000","last_change":"2026-02-12T08:54:08.997232+0000","last_active":"2026-02-12T08:54:08.994855+0000","last_peered":"2026-02-12T08:54:08.994855+0000","last_clean":"2026-02-12T08:54:08.994855+0000","last_became_active":"2026-02-12T08:54:07.023327+0000","last_became_peered":"2026-02-12T08:54:07.023327+0000","last_unstale":"2026-02-12T08:54:08.994855+0000","last_undegraded":"2026-02-12T08:54:08.994855+0000","last_fullsized":"2026-02-12T08:54:08.994855+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.992307+0000","last_change":"2026-02-12T08:54:08.994109+0000","last_active":"2026-02-12T08:54:08.992307+0000","last_peered":"2026-02-12T08:54:08.992307+0000","last_clean":"2026-02-12T08:54:08.992307+0000","last_became_active":"2026-02-12T08:54:07.013851+0000","last_became_peered":"2026-02-12T08:54:07.013851+0000","last_unstale":"2026-02-12T08:54:08.992307+0000","last_undegraded":"2026-02-12T08:54:08.992307+0000","last_fullsized":"2026-02-12T08:54:08.992307+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991583+0000","last_change":"2026-02-12T08:54:08.996126+0000","last_active":"2026-02-12T08:54:08.991583+0000","last_peered":"2026-02-12T08:54:08.991583+0000","last_clean":"2026-02-12T08:54:08.991583+0000","last_became_active":"2026-02-12T08:54:07.015881+0000","last_became_peered":"2026-02-12T08:54:07.015881+0000","last_unstale":"2026-02-12T08:54:08.991583+0000","last_undegraded":"2026-02-12T08:54:08.991583+0000","last_fullsized":"2026-02-12T08:54:08.991583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":81,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.993069+0000","last_change":"2026-02-12T08:54:07.029990+0000","last_active":"2026-02-12T08:54:08.993069+0000","last_peered":"2026-02-12T08:54:08.993069+0000","last_clean":"2026-02-12T08:54:08.993069+0000","last_became_active":"2026-02-12T08:54:07.019218+0000","last_became_peered":"2026-02-12T08:54:07.019218+0000","last_unstale":"2026-02-12T08:54:08.993069+0000","last_undegraded":"2026-02-12T08:54:08.993069+0000","last_fullsized":"2026-02-12T08:54:08.993069+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991264+0000","last_change":"2026-02-12T08:54:08.993164+0000","last_active":"2026-02-12T08:54:08.991264+0000","last_peered":"2026-02-12T08:54:08.991264+0000","last_clean":"2026-02-12T08:54:08.991264+0000","last_became_active":"2026-02-12T08:54:07.034037+0000","last_became_peered":"2026-02-12T08:54:07.034037+0000","last_unstale":"2026-02-12T08:54:08.991264+0000","last_undegraded":"2026-02-12T08:54:08.991264+0000","last_fullsized":"2026-02-12T08:54:08.991264+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.992713+0000","last_change":"2026-02-12T08:54:08.992713+0000","last_active":"2026-02-12T08:54:08.992713+0000","last_peered":"2026-02-12T08:54:08.992713+0000","last_clean":"2026-02-12T08:54:08.992713+0000","last_became_active":"2026-02-12T08:54:07.019674+0000","last_became_peered":"2026-02-12T08:54:07.019674+0000","last_unstale":"2026-02-12T08:54:08.992713+0000","last_undegraded":"2026-02-12T08:54:08.992713+0000","last_fullsized":"2026-02-12T08:54:08.992713+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991244+0000","last_change":"2026-02-12T08:54:08.994901+0000","last_active":"2026-02-12T08:54:08.991244+0000","last_peered":"2026-02-12T08:54:08.991244+0000","last_clean":"2026-02-12T08:54:08.991244+0000","last_became_active":"2026-02-12T08:54:07.027290+0000","last_became_peered":"2026-02-12T08:54:07.027290+0000","last_unstale":"2026-02-12T08:54:08.991244+0000","last_undegraded":"2026-02-12T08:54:08.991244+0000","last_fullsized":"2026-02-12T08:54:08.991244+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.990020+0000","last_change":"2026-02-12T08:54:08.992653+0000","last_active":"2026-02-12T08:54:08.990020+0000","last_peered":"2026-02-12T08:54:08.990020+0000","last_clean":"2026-02-12T08:54:08.990020+0000","last_became_active":"2026-02-12T08:54:07.016697+0000","last_became_peered":"2026-02-12T08:54:07.016697+0000","last_unstale":"2026-02-12T08:54:08.990020+0000","last_undegraded":"2026-02-12T08:54:08.990020+0000","last_fullsized":"2026-02-12T08:54:08.990020+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214748299264,"available":128846233600,"internally_reserved":0,"allocated":85902065664,"data_stored":85902065664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971840,"kb_used_data":20971840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456944,"statfs":{"total":53687074816,"available":32211910656,"internally_reserved":0,"allocated":21475164160,"data_stored":21475164160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971792,"kb_used_data":20971792,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456992,"statfs":{"total":53687074816,"available":32211959808,"internally_reserved":0,"allocated":21475115008,"data_stored":21475115008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972560,"kb_used_data":20972560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456224,"statfs":{"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972544,"kb_used_data":20972544,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456240,"statfs":{"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211959808,"internally_reserved":0,"allocated":21475115008,"data_stored":21475115008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32211910656,"internally_reserved":0,"allocated":21475164160,"data_stored":21475164160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T08:54:10.465 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T08:54:10.542 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:10.539+0000 7fa68fbc1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:10.544 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:10.544+0000 7fa68fbc1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:10.656 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:54:10.656 INFO:teuthology.orchestra.run.trial042.stderr:dumped all 2026-02-12T08:54:10.665 INFO:teuthology.orchestra.run.trial042.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-12T08:54:09.986436+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83888736,"kb_used_data":83888736,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125826400,"statfs":{"total":214748299264,"available":128846233600,"internally_reserved":0,"allocated":85902065664,"data_stored":85902065664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991895+0000","last_change":"2026-02-12T08:54:08.996415+0000","last_active":"2026-02-12T08:54:08.991895+0000","last_peered":"2026-02-12T08:54:08.991895+0000","last_clean":"2026-02-12T08:54:08.991895+0000","last_became_active":"2026-02-12T08:54:07.029382+0000","last_became_peered":"2026-02-12T08:54:07.029382+0000","last_unstale":"2026-02-12T08:54:08.991895+0000","last_undegraded":"2026-02-12T08:54:08.991895+0000","last_fullsized":"2026-02-12T08:54:08.991895+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.994855+0000","last_change":"2026-02-12T08:54:08.997232+0000","last_active":"2026-02-12T08:54:08.994855+0000","last_peered":"2026-02-12T08:54:08.994855+0000","last_clean":"2026-02-12T08:54:08.994855+0000","last_became_active":"2026-02-12T08:54:07.023327+0000","last_became_peered":"2026-02-12T08:54:07.023327+0000","last_unstale":"2026-02-12T08:54:08.994855+0000","last_undegraded":"2026-02-12T08:54:08.994855+0000","last_fullsized":"2026-02-12T08:54:08.994855+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.992307+0000","last_change":"2026-02-12T08:54:08.994109+0000","last_active":"2026-02-12T08:54:08.992307+0000","last_peered":"2026-02-12T08:54:08.992307+0000","last_clean":"2026-02-12T08:54:08.992307+0000","last_became_active":"2026-02-12T08:54:07.013851+0000","last_became_peered":"2026-02-12T08:54:07.013851+0000","last_unstale":"2026-02-12T08:54:08.992307+0000","last_undegraded":"2026-02-12T08:54:08.992307+0000","last_fullsized":"2026-02-12T08:54:08.992307+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991583+0000","last_change":"2026-02-12T08:54:08.996126+0000","last_active":"2026-02-12T08:54:08.991583+0000","last_peered":"2026-02-12T08:54:08.991583+0000","last_clean":"2026-02-12T08:54:08.991583+0000","last_became_active":"2026-02-12T08:54:07.015881+0000","last_became_peered":"2026-02-12T08:54:07.015881+0000","last_unstale":"2026-02-12T08:54:08.991583+0000","last_undegraded":"2026-02-12T08:54:08.991583+0000","last_fullsized":"2026-02-12T08:54:08.991583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":81,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.993069+0000","last_change":"2026-02-12T08:54:07.029990+0000","last_active":"2026-02-12T08:54:08.993069+0000","last_peered":"2026-02-12T08:54:08.993069+0000","last_clean":"2026-02-12T08:54:08.993069+0000","last_became_active":"2026-02-12T08:54:07.019218+0000","last_became_peered":"2026-02-12T08:54:07.019218+0000","last_unstale":"2026-02-12T08:54:08.993069+0000","last_undegraded":"2026-02-12T08:54:08.993069+0000","last_fullsized":"2026-02-12T08:54:08.993069+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991264+0000","last_change":"2026-02-12T08:54:08.993164+0000","last_active":"2026-02-12T08:54:08.991264+0000","last_peered":"2026-02-12T08:54:08.991264+0000","last_clean":"2026-02-12T08:54:08.991264+0000","last_became_active":"2026-02-12T08:54:07.034037+0000","last_became_peered":"2026-02-12T08:54:07.034037+0000","last_unstale":"2026-02-12T08:54:08.991264+0000","last_undegraded":"2026-02-12T08:54:08.991264+0000","last_fullsized":"2026-02-12T08:54:08.991264+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.992713+0000","last_change":"2026-02-12T08:54:08.992713+0000","last_active":"2026-02-12T08:54:08.992713+0000","last_peered":"2026-02-12T08:54:08.992713+0000","last_clean":"2026-02-12T08:54:08.992713+0000","last_became_active":"2026-02-12T08:54:07.019674+0000","last_became_peered":"2026-02-12T08:54:07.019674+0000","last_unstale":"2026-02-12T08:54:08.992713+0000","last_undegraded":"2026-02-12T08:54:08.992713+0000","last_fullsized":"2026-02-12T08:54:08.992713+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991244+0000","last_change":"2026-02-12T08:54:08.994901+0000","last_active":"2026-02-12T08:54:08.991244+0000","last_peered":"2026-02-12T08:54:08.991244+0000","last_clean":"2026-02-12T08:54:08.991244+0000","last_became_active":"2026-02-12T08:54:07.027290+0000","last_became_peered":"2026-02-12T08:54:07.027290+0000","last_unstale":"2026-02-12T08:54:08.991244+0000","last_undegraded":"2026-02-12T08:54:08.991244+0000","last_fullsized":"2026-02-12T08:54:08.991244+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.990020+0000","last_change":"2026-02-12T08:54:08.992653+0000","last_active":"2026-02-12T08:54:08.990020+0000","last_peered":"2026-02-12T08:54:08.990020+0000","last_clean":"2026-02-12T08:54:08.990020+0000","last_became_active":"2026-02-12T08:54:07.016697+0000","last_became_peered":"2026-02-12T08:54:07.016697+0000","last_unstale":"2026-02-12T08:54:08.990020+0000","last_undegraded":"2026-02-12T08:54:08.990020+0000","last_fullsized":"2026-02-12T08:54:08.990020+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214748299264,"available":128846233600,"internally_reserved":0,"allocated":85902065664,"data_stored":85902065664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971840,"kb_used_data":20971840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456944,"statfs":{"total":53687074816,"available":32211910656,"internally_reserved":0,"allocated":21475164160,"data_stored":21475164160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971792,"kb_used_data":20971792,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456992,"statfs":{"total":53687074816,"available":32211959808,"internally_reserved":0,"allocated":21475115008,"data_stored":21475115008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972560,"kb_used_data":20972560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456224,"statfs":{"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972544,"kb_used_data":20972544,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456240,"statfs":{"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211959808,"internally_reserved":0,"allocated":21475115008,"data_stored":21475115008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32211910656,"internally_reserved":0,"allocated":21475164160,"data_stored":21475164160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T08:54:10.666 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-12T08:54:10.666 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-12T08:54:10.667 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-12T08:54:10.667 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-12T08:54:10.742 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:10.740+0000 7f65cdb8a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:10.744 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:10.744+0000 7f65cdb8a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:10.885 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:54:10.885 INFO:teuthology.orchestra.run.trial042.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-12T08:54:10.894 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-12T08:54:10.894 INFO:teuthology.run_tasks:Running task workunit... 2026-02-12T08:54:10.913 INFO:tasks.workunit:Pulling workunits from ref 6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c 2026-02-12T08:54:10.913 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-12T08:54:10.913 DEBUG:teuthology.orchestra.run.trial042:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-12T08:54:10.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:54:10.930 INFO:teuthology.orchestra.run.trial042.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-12T08:54:10.930 DEBUG:teuthology.orchestra.run.trial042:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-12T08:54:10.985 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-12T08:54:10.985 DEBUG:teuthology.orchestra.run.trial042:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-12T08:54:11.041 INFO:tasks.workunit:timeout=3h 2026-02-12T08:54:11.041 INFO:tasks.workunit:cleanup=True 2026-02-12T08:54:11.042 DEBUG:teuthology.orchestra.run.trial042:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c 2026-02-12T08:54:11.105 INFO:tasks.workunit.client.0.trial042.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-12T08:54:34.024 INFO:tasks.workunit.client.0.trial042.stderr:Note: switching to '6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c'. 2026-02-12T08:54:34.024 INFO:tasks.workunit.client.0.trial042.stderr: 2026-02-12T08:54:34.024 INFO:tasks.workunit.client.0.trial042.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-12T08:54:34.024 INFO:tasks.workunit.client.0.trial042.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-12T08:54:34.024 INFO:tasks.workunit.client.0.trial042.stderr:state without impacting any branches by switching back to a branch. 2026-02-12T08:54:34.024 INFO:tasks.workunit.client.0.trial042.stderr: 2026-02-12T08:54:34.024 INFO:tasks.workunit.client.0.trial042.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-12T08:54:34.025 INFO:tasks.workunit.client.0.trial042.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-12T08:54:34.025 INFO:tasks.workunit.client.0.trial042.stderr: 2026-02-12T08:54:34.025 INFO:tasks.workunit.client.0.trial042.stderr: git switch -c 2026-02-12T08:54:34.025 INFO:tasks.workunit.client.0.trial042.stderr: 2026-02-12T08:54:34.025 INFO:tasks.workunit.client.0.trial042.stderr:Or undo this operation with: 2026-02-12T08:54:34.025 INFO:tasks.workunit.client.0.trial042.stderr: 2026-02-12T08:54:34.025 INFO:tasks.workunit.client.0.trial042.stderr: git switch - 2026-02-12T08:54:34.025 INFO:tasks.workunit.client.0.trial042.stderr: 2026-02-12T08:54:34.025 INFO:tasks.workunit.client.0.trial042.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-12T08:54:34.025 INFO:tasks.workunit.client.0.trial042.stderr: 2026-02-12T08:54:34.025 INFO:tasks.workunit.client.0.trial042.stderr:HEAD is now at 6bf51b64d77 Merge pull request #67261 from Matan-B/wip-matanb-crimson-66488-revert 2026-02-12T08:54:34.027 DEBUG:teuthology.orchestra.run.trial042:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-12T08:54:34.084 INFO:tasks.workunit.client.0.trial042.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-12T08:54:34.086 INFO:tasks.workunit.client.0.trial042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-12T08:54:34.086 INFO:tasks.workunit.client.0.trial042.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-12T08:54:34.183 INFO:tasks.workunit.client.0.trial042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-12T08:54:34.213 INFO:tasks.workunit.client.0.trial042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-12T08:54:34.237 INFO:tasks.workunit.client.0.trial042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-12T08:54:34.239 INFO:tasks.workunit.client.0.trial042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-12T08:54:34.239 INFO:tasks.workunit.client.0.trial042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-12T08:54:34.263 INFO:tasks.workunit.client.0.trial042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-12T08:54:34.267 DEBUG:teuthology.orchestra.run.trial042:> set -ex 2026-02-12T08:54:34.267 DEBUG:teuthology.orchestra.run.trial042:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-12T08:54:34.324 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2026-02-12T08:54:34.326 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2026-02-12T08:54:34.327 DEBUG:teuthology.orchestra.run.trial042:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2026-02-12T08:54:34.397 INFO:tasks.workunit.client.0.trial042.stdout:Running main() from gmock_main.cc 2026-02-12T08:54:34.398 INFO:tasks.workunit.client.0.trial042.stdout:[==========] Running 31 tests from 1 test suite. 2026-02-12T08:54:34.398 INFO:tasks.workunit.client.0.trial042.stdout:[----------] Global test environment set-up. 2026-02-12T08:54:36.017 INFO:tasks.workunit.client.0.trial042.stdout:[----------] 31 tests from CmpOmap 2026-02-12T08:54:36.017 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2026-02-12T08:54:36.161 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (144 ms) 2026-02-12T08:54:36.161 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2026-02-12T08:54:36.181 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (20 ms) 2026-02-12T08:54:36.181 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2026-02-12T08:54:36.206 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (24 ms) 2026-02-12T08:54:36.206 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2026-02-12T08:54:36.231 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (25 ms) 2026-02-12T08:54:36.231 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_vals_str 2026-02-12T08:54:36.293 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_vals_str (61 ms) 2026-02-12T08:54:36.293 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2026-02-12T08:54:36.354 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_vals_u64 (60 ms) 2026-02-12T08:54:36.354 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2026-02-12T08:54:36.376 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (21 ms) 2026-02-12T08:54:36.376 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2026-02-12T08:54:36.397 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (21 ms) 2026-02-12T08:54:36.397 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2026-02-12T08:54:36.417 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (19 ms) 2026-02-12T08:54:36.417 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2026-02-12T08:54:36.457 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (40 ms) 2026-02-12T08:54:36.457 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2026-02-12T08:54:36.458 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2026-02-12T08:54:36.458 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2026-02-12T08:54:36.459 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (0 ms) 2026-02-12T08:54:36.459 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2026-02-12T08:54:36.472 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (13 ms) 2026-02-12T08:54:36.472 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2026-02-12T08:54:36.518 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (46 ms) 2026-02-12T08:54:36.518 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2026-02-12T08:54:36.532 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (14 ms) 2026-02-12T08:54:36.532 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2026-02-12T08:54:36.574 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (42 ms) 2026-02-12T08:54:36.574 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2026-02-12T08:54:36.628 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_set_vals_str (53 ms) 2026-02-12T08:54:36.628 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2026-02-12T08:54:36.679 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (51 ms) 2026-02-12T08:54:36.679 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2026-02-12T08:54:36.700 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (20 ms) 2026-02-12T08:54:36.700 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2026-02-12T08:54:36.715 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (15 ms) 2026-02-12T08:54:36.715 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2026-02-12T08:54:36.716 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2026-02-12T08:54:36.716 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2026-02-12T08:54:36.717 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2026-02-12T08:54:36.717 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2026-02-12T08:54:36.732 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (15 ms) 2026-02-12T08:54:36.732 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2026-02-12T08:54:36.747 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (14 ms) 2026-02-12T08:54:36.747 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2026-02-12T08:54:36.796 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (49 ms) 2026-02-12T08:54:36.796 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2026-02-12T08:54:36.847 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (50 ms) 2026-02-12T08:54:36.847 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2026-02-12T08:54:36.867 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (20 ms) 2026-02-12T08:54:36.867 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2026-02-12T08:54:36.884 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (16 ms) 2026-02-12T08:54:36.884 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2026-02-12T08:54:36.885 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2026-02-12T08:54:36.885 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2026-02-12T08:54:36.885 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2026-02-12T08:54:36.885 INFO:tasks.workunit.client.0.trial042.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2026-02-12T08:54:36.935 INFO:tasks.workunit.client.0.trial042.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (49 ms) 2026-02-12T08:54:36.935 INFO:tasks.workunit.client.0.trial042.stdout:[----------] 31 tests from CmpOmap (918 ms total) 2026-02-12T08:54:36.936 INFO:tasks.workunit.client.0.trial042.stdout: 2026-02-12T08:54:36.936 INFO:tasks.workunit.client.0.trial042.stdout:[----------] Global test environment tear-down 2026-02-12T08:54:37.020 INFO:tasks.workunit.client.0.trial042.stdout:[==========] 31 tests from 1 test suite ran. (2622 ms total) 2026-02-12T08:54:37.020 INFO:tasks.workunit.client.0.trial042.stdout:[ PASSED ] 31 tests. 2026-02-12T08:54:37.022 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-12T08:54:37.022 DEBUG:teuthology.orchestra.run.trial042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-12T08:54:37.088 INFO:tasks.workunit:Stopping ['cls/test_cls_cmpomap.sh'] on client.0... 2026-02-12T08:54:37.088 DEBUG:teuthology.orchestra.run.trial042:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-12T08:54:37.450 DEBUG:teuthology.parallel:result is None 2026-02-12T08:54:37.451 DEBUG:teuthology.orchestra.run.trial042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-12T08:54:37.475 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-12T08:54:37.475 DEBUG:teuthology.orchestra.run.trial042:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-12T08:54:37.532 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-12T08:54:37.532 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-12T08:54:37.544 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-12T08:54:37.544 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T08:54:37.648 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:37.643+0000 7fcac505a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:37.650 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:37.648+0000 7fcac505a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:37.762 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:54:37.763 INFO:teuthology.orchestra.run.trial042.stderr:dumped all 2026-02-12T08:54:37.771 INFO:teuthology.orchestra.run.trial042.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2026-02-12T08:54:37.015242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83888736,"kb_used_data":83888736,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125826400,"statfs":{"total":214748299264,"available":128846233600,"internally_reserved":0,"allocated":85902065664,"data_stored":85902065664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.060070"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991895+0000","last_change":"2026-02-12T08:54:08.996415+0000","last_active":"2026-02-12T08:54:08.991895+0000","last_peered":"2026-02-12T08:54:08.991895+0000","last_clean":"2026-02-12T08:54:08.991895+0000","last_became_active":"2026-02-12T08:54:07.029382+0000","last_became_peered":"2026-02-12T08:54:07.029382+0000","last_unstale":"2026-02-12T08:54:08.991895+0000","last_undegraded":"2026-02-12T08:54:08.991895+0000","last_fullsized":"2026-02-12T08:54:08.991895+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.994855+0000","last_change":"2026-02-12T08:54:08.997232+0000","last_active":"2026-02-12T08:54:08.994855+0000","last_peered":"2026-02-12T08:54:08.994855+0000","last_clean":"2026-02-12T08:54:08.994855+0000","last_became_active":"2026-02-12T08:54:07.023327+0000","last_became_peered":"2026-02-12T08:54:07.023327+0000","last_unstale":"2026-02-12T08:54:08.994855+0000","last_undegraded":"2026-02-12T08:54:08.994855+0000","last_fullsized":"2026-02-12T08:54:08.994855+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.992307+0000","last_change":"2026-02-12T08:54:08.994109+0000","last_active":"2026-02-12T08:54:08.992307+0000","last_peered":"2026-02-12T08:54:08.992307+0000","last_clean":"2026-02-12T08:54:08.992307+0000","last_became_active":"2026-02-12T08:54:07.013851+0000","last_became_peered":"2026-02-12T08:54:07.013851+0000","last_unstale":"2026-02-12T08:54:08.992307+0000","last_undegraded":"2026-02-12T08:54:08.992307+0000","last_fullsized":"2026-02-12T08:54:08.992307+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991583+0000","last_change":"2026-02-12T08:54:08.996126+0000","last_active":"2026-02-12T08:54:08.991583+0000","last_peered":"2026-02-12T08:54:08.991583+0000","last_clean":"2026-02-12T08:54:08.991583+0000","last_became_active":"2026-02-12T08:54:07.015881+0000","last_became_peered":"2026-02-12T08:54:07.015881+0000","last_unstale":"2026-02-12T08:54:08.991583+0000","last_undegraded":"2026-02-12T08:54:08.991583+0000","last_fullsized":"2026-02-12T08:54:08.991583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":81,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.993069+0000","last_change":"2026-02-12T08:54:07.029990+0000","last_active":"2026-02-12T08:54:08.993069+0000","last_peered":"2026-02-12T08:54:08.993069+0000","last_clean":"2026-02-12T08:54:08.993069+0000","last_became_active":"2026-02-12T08:54:07.019218+0000","last_became_peered":"2026-02-12T08:54:07.019218+0000","last_unstale":"2026-02-12T08:54:08.993069+0000","last_undegraded":"2026-02-12T08:54:08.993069+0000","last_fullsized":"2026-02-12T08:54:08.993069+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991264+0000","last_change":"2026-02-12T08:54:08.993164+0000","last_active":"2026-02-12T08:54:08.991264+0000","last_peered":"2026-02-12T08:54:08.991264+0000","last_clean":"2026-02-12T08:54:08.991264+0000","last_became_active":"2026-02-12T08:54:07.034037+0000","last_became_peered":"2026-02-12T08:54:07.034037+0000","last_unstale":"2026-02-12T08:54:08.991264+0000","last_undegraded":"2026-02-12T08:54:08.991264+0000","last_fullsized":"2026-02-12T08:54:08.991264+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.992713+0000","last_change":"2026-02-12T08:54:08.992713+0000","last_active":"2026-02-12T08:54:08.992713+0000","last_peered":"2026-02-12T08:54:08.992713+0000","last_clean":"2026-02-12T08:54:08.992713+0000","last_became_active":"2026-02-12T08:54:07.019674+0000","last_became_peered":"2026-02-12T08:54:07.019674+0000","last_unstale":"2026-02-12T08:54:08.992713+0000","last_undegraded":"2026-02-12T08:54:08.992713+0000","last_fullsized":"2026-02-12T08:54:08.992713+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991244+0000","last_change":"2026-02-12T08:54:08.994901+0000","last_active":"2026-02-12T08:54:08.991244+0000","last_peered":"2026-02-12T08:54:08.991244+0000","last_clean":"2026-02-12T08:54:08.991244+0000","last_became_active":"2026-02-12T08:54:07.027290+0000","last_became_peered":"2026-02-12T08:54:07.027290+0000","last_unstale":"2026-02-12T08:54:08.991244+0000","last_undegraded":"2026-02-12T08:54:08.991244+0000","last_fullsized":"2026-02-12T08:54:08.991244+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.990020+0000","last_change":"2026-02-12T08:54:08.992653+0000","last_active":"2026-02-12T08:54:08.990020+0000","last_peered":"2026-02-12T08:54:08.990020+0000","last_clean":"2026-02-12T08:54:08.990020+0000","last_became_active":"2026-02-12T08:54:07.016697+0000","last_became_peered":"2026-02-12T08:54:07.016697+0000","last_unstale":"2026-02-12T08:54:08.990020+0000","last_undegraded":"2026-02-12T08:54:08.990020+0000","last_fullsized":"2026-02-12T08:54:08.990020+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214748299264,"available":128846233600,"internally_reserved":0,"allocated":85902065664,"data_stored":85902065664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971840,"kb_used_data":20971840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456944,"statfs":{"total":53687074816,"available":32211910656,"internally_reserved":0,"allocated":21475164160,"data_stored":21475164160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971792,"kb_used_data":20971792,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456992,"statfs":{"total":53687074816,"available":32211959808,"internally_reserved":0,"allocated":21475115008,"data_stored":21475115008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640286,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972560,"kb_used_data":20972560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456224,"statfs":{"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972544,"kb_used_data":20972544,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456240,"statfs":{"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211959808,"internally_reserved":0,"allocated":21475115008,"data_stored":21475115008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32211910656,"internally_reserved":0,"allocated":21475164160,"data_stored":21475164160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T08:54:37.773 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T08:54:37.849 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:37.845+0000 7f93f4a11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:37.852 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:37.850+0000 7f93f4a11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:37.965 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:54:37.965 INFO:teuthology.orchestra.run.trial042.stderr:dumped all 2026-02-12T08:54:37.974 INFO:teuthology.orchestra.run.trial042.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2026-02-12T08:54:37.956894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83888736,"kb_used_data":83888736,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125826400,"statfs":{"total":214748299264,"available":128846233600,"internally_reserved":0,"allocated":85902065664,"data_stored":85902065664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001301"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991895+0000","last_change":"2026-02-12T08:54:08.996415+0000","last_active":"2026-02-12T08:54:08.991895+0000","last_peered":"2026-02-12T08:54:08.991895+0000","last_clean":"2026-02-12T08:54:08.991895+0000","last_became_active":"2026-02-12T08:54:07.029382+0000","last_became_peered":"2026-02-12T08:54:07.029382+0000","last_unstale":"2026-02-12T08:54:08.991895+0000","last_undegraded":"2026-02-12T08:54:08.991895+0000","last_fullsized":"2026-02-12T08:54:08.991895+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.994855+0000","last_change":"2026-02-12T08:54:08.997232+0000","last_active":"2026-02-12T08:54:08.994855+0000","last_peered":"2026-02-12T08:54:08.994855+0000","last_clean":"2026-02-12T08:54:08.994855+0000","last_became_active":"2026-02-12T08:54:07.023327+0000","last_became_peered":"2026-02-12T08:54:07.023327+0000","last_unstale":"2026-02-12T08:54:08.994855+0000","last_undegraded":"2026-02-12T08:54:08.994855+0000","last_fullsized":"2026-02-12T08:54:08.994855+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.992307+0000","last_change":"2026-02-12T08:54:08.994109+0000","last_active":"2026-02-12T08:54:08.992307+0000","last_peered":"2026-02-12T08:54:08.992307+0000","last_clean":"2026-02-12T08:54:08.992307+0000","last_became_active":"2026-02-12T08:54:07.013851+0000","last_became_peered":"2026-02-12T08:54:07.013851+0000","last_unstale":"2026-02-12T08:54:08.992307+0000","last_undegraded":"2026-02-12T08:54:08.992307+0000","last_fullsized":"2026-02-12T08:54:08.992307+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991583+0000","last_change":"2026-02-12T08:54:08.996126+0000","last_active":"2026-02-12T08:54:08.991583+0000","last_peered":"2026-02-12T08:54:08.991583+0000","last_clean":"2026-02-12T08:54:08.991583+0000","last_became_active":"2026-02-12T08:54:07.015881+0000","last_became_peered":"2026-02-12T08:54:07.015881+0000","last_unstale":"2026-02-12T08:54:08.991583+0000","last_undegraded":"2026-02-12T08:54:08.991583+0000","last_fullsized":"2026-02-12T08:54:08.991583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":81,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.993069+0000","last_change":"2026-02-12T08:54:07.029990+0000","last_active":"2026-02-12T08:54:08.993069+0000","last_peered":"2026-02-12T08:54:08.993069+0000","last_clean":"2026-02-12T08:54:08.993069+0000","last_became_active":"2026-02-12T08:54:07.019218+0000","last_became_peered":"2026-02-12T08:54:07.019218+0000","last_unstale":"2026-02-12T08:54:08.993069+0000","last_undegraded":"2026-02-12T08:54:08.993069+0000","last_fullsized":"2026-02-12T08:54:08.993069+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991264+0000","last_change":"2026-02-12T08:54:08.993164+0000","last_active":"2026-02-12T08:54:08.991264+0000","last_peered":"2026-02-12T08:54:08.991264+0000","last_clean":"2026-02-12T08:54:08.991264+0000","last_became_active":"2026-02-12T08:54:07.034037+0000","last_became_peered":"2026-02-12T08:54:07.034037+0000","last_unstale":"2026-02-12T08:54:08.991264+0000","last_undegraded":"2026-02-12T08:54:08.991264+0000","last_fullsized":"2026-02-12T08:54:08.991264+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.992713+0000","last_change":"2026-02-12T08:54:08.992713+0000","last_active":"2026-02-12T08:54:08.992713+0000","last_peered":"2026-02-12T08:54:08.992713+0000","last_clean":"2026-02-12T08:54:08.992713+0000","last_became_active":"2026-02-12T08:54:07.019674+0000","last_became_peered":"2026-02-12T08:54:07.019674+0000","last_unstale":"2026-02-12T08:54:08.992713+0000","last_undegraded":"2026-02-12T08:54:08.992713+0000","last_fullsized":"2026-02-12T08:54:08.992713+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991244+0000","last_change":"2026-02-12T08:54:08.994901+0000","last_active":"2026-02-12T08:54:08.991244+0000","last_peered":"2026-02-12T08:54:08.991244+0000","last_clean":"2026-02-12T08:54:08.991244+0000","last_became_active":"2026-02-12T08:54:07.027290+0000","last_became_peered":"2026-02-12T08:54:07.027290+0000","last_unstale":"2026-02-12T08:54:08.991244+0000","last_undegraded":"2026-02-12T08:54:08.991244+0000","last_fullsized":"2026-02-12T08:54:08.991244+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.990020+0000","last_change":"2026-02-12T08:54:08.992653+0000","last_active":"2026-02-12T08:54:08.990020+0000","last_peered":"2026-02-12T08:54:08.990020+0000","last_clean":"2026-02-12T08:54:08.990020+0000","last_became_active":"2026-02-12T08:54:07.016697+0000","last_became_peered":"2026-02-12T08:54:07.016697+0000","last_unstale":"2026-02-12T08:54:08.990020+0000","last_undegraded":"2026-02-12T08:54:08.990020+0000","last_fullsized":"2026-02-12T08:54:08.990020+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214748299264,"available":128846233600,"internally_reserved":0,"allocated":85902065664,"data_stored":85902065664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971840,"kb_used_data":20971840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456944,"statfs":{"total":53687074816,"available":32211910656,"internally_reserved":0,"allocated":21475164160,"data_stored":21475164160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971792,"kb_used_data":20971792,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456992,"statfs":{"total":53687074816,"available":32211959808,"internally_reserved":0,"allocated":21475115008,"data_stored":21475115008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640286,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972560,"kb_used_data":20972560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456224,"statfs":{"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972544,"kb_used_data":20972544,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456240,"statfs":{"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211959808,"internally_reserved":0,"allocated":21475115008,"data_stored":21475115008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32211910656,"internally_reserved":0,"allocated":21475164160,"data_stored":21475164160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T08:54:37.975 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-12T08:54:37.975 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T08:54:38.050 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:38.046+0000 7ff5e63a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:38.053 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:38.051+0000 7ff5e63a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:38.165 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:54:38.166 INFO:teuthology.orchestra.run.trial042.stderr:dumped all 2026-02-12T08:54:38.174 INFO:teuthology.orchestra.run.trial042.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2026-02-12T08:54:37.956894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83888736,"kb_used_data":83888736,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125826400,"statfs":{"total":214748299264,"available":128846233600,"internally_reserved":0,"allocated":85902065664,"data_stored":85902065664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001301"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991895+0000","last_change":"2026-02-12T08:54:08.996415+0000","last_active":"2026-02-12T08:54:08.991895+0000","last_peered":"2026-02-12T08:54:08.991895+0000","last_clean":"2026-02-12T08:54:08.991895+0000","last_became_active":"2026-02-12T08:54:07.029382+0000","last_became_peered":"2026-02-12T08:54:07.029382+0000","last_unstale":"2026-02-12T08:54:08.991895+0000","last_undegraded":"2026-02-12T08:54:08.991895+0000","last_fullsized":"2026-02-12T08:54:08.991895+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.994855+0000","last_change":"2026-02-12T08:54:08.997232+0000","last_active":"2026-02-12T08:54:08.994855+0000","last_peered":"2026-02-12T08:54:08.994855+0000","last_clean":"2026-02-12T08:54:08.994855+0000","last_became_active":"2026-02-12T08:54:07.023327+0000","last_became_peered":"2026-02-12T08:54:07.023327+0000","last_unstale":"2026-02-12T08:54:08.994855+0000","last_undegraded":"2026-02-12T08:54:08.994855+0000","last_fullsized":"2026-02-12T08:54:08.994855+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.992307+0000","last_change":"2026-02-12T08:54:08.994109+0000","last_active":"2026-02-12T08:54:08.992307+0000","last_peered":"2026-02-12T08:54:08.992307+0000","last_clean":"2026-02-12T08:54:08.992307+0000","last_became_active":"2026-02-12T08:54:07.013851+0000","last_became_peered":"2026-02-12T08:54:07.013851+0000","last_unstale":"2026-02-12T08:54:08.992307+0000","last_undegraded":"2026-02-12T08:54:08.992307+0000","last_fullsized":"2026-02-12T08:54:08.992307+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991583+0000","last_change":"2026-02-12T08:54:08.996126+0000","last_active":"2026-02-12T08:54:08.991583+0000","last_peered":"2026-02-12T08:54:08.991583+0000","last_clean":"2026-02-12T08:54:08.991583+0000","last_became_active":"2026-02-12T08:54:07.015881+0000","last_became_peered":"2026-02-12T08:54:07.015881+0000","last_unstale":"2026-02-12T08:54:08.991583+0000","last_undegraded":"2026-02-12T08:54:08.991583+0000","last_fullsized":"2026-02-12T08:54:08.991583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":81,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.993069+0000","last_change":"2026-02-12T08:54:07.029990+0000","last_active":"2026-02-12T08:54:08.993069+0000","last_peered":"2026-02-12T08:54:08.993069+0000","last_clean":"2026-02-12T08:54:08.993069+0000","last_became_active":"2026-02-12T08:54:07.019218+0000","last_became_peered":"2026-02-12T08:54:07.019218+0000","last_unstale":"2026-02-12T08:54:08.993069+0000","last_undegraded":"2026-02-12T08:54:08.993069+0000","last_fullsized":"2026-02-12T08:54:08.993069+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991264+0000","last_change":"2026-02-12T08:54:08.993164+0000","last_active":"2026-02-12T08:54:08.991264+0000","last_peered":"2026-02-12T08:54:08.991264+0000","last_clean":"2026-02-12T08:54:08.991264+0000","last_became_active":"2026-02-12T08:54:07.034037+0000","last_became_peered":"2026-02-12T08:54:07.034037+0000","last_unstale":"2026-02-12T08:54:08.991264+0000","last_undegraded":"2026-02-12T08:54:08.991264+0000","last_fullsized":"2026-02-12T08:54:08.991264+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.992713+0000","last_change":"2026-02-12T08:54:08.992713+0000","last_active":"2026-02-12T08:54:08.992713+0000","last_peered":"2026-02-12T08:54:08.992713+0000","last_clean":"2026-02-12T08:54:08.992713+0000","last_became_active":"2026-02-12T08:54:07.019674+0000","last_became_peered":"2026-02-12T08:54:07.019674+0000","last_unstale":"2026-02-12T08:54:08.992713+0000","last_undegraded":"2026-02-12T08:54:08.992713+0000","last_fullsized":"2026-02-12T08:54:08.992713+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991244+0000","last_change":"2026-02-12T08:54:08.994901+0000","last_active":"2026-02-12T08:54:08.991244+0000","last_peered":"2026-02-12T08:54:08.991244+0000","last_clean":"2026-02-12T08:54:08.991244+0000","last_became_active":"2026-02-12T08:54:07.027290+0000","last_became_peered":"2026-02-12T08:54:07.027290+0000","last_unstale":"2026-02-12T08:54:08.991244+0000","last_undegraded":"2026-02-12T08:54:08.991244+0000","last_fullsized":"2026-02-12T08:54:08.991244+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.990020+0000","last_change":"2026-02-12T08:54:08.992653+0000","last_active":"2026-02-12T08:54:08.990020+0000","last_peered":"2026-02-12T08:54:08.990020+0000","last_clean":"2026-02-12T08:54:08.990020+0000","last_became_active":"2026-02-12T08:54:07.016697+0000","last_became_peered":"2026-02-12T08:54:07.016697+0000","last_unstale":"2026-02-12T08:54:08.990020+0000","last_undegraded":"2026-02-12T08:54:08.990020+0000","last_fullsized":"2026-02-12T08:54:08.990020+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214748299264,"available":128846233600,"internally_reserved":0,"allocated":85902065664,"data_stored":85902065664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971840,"kb_used_data":20971840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456944,"statfs":{"total":53687074816,"available":32211910656,"internally_reserved":0,"allocated":21475164160,"data_stored":21475164160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971792,"kb_used_data":20971792,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456992,"statfs":{"total":53687074816,"available":32211959808,"internally_reserved":0,"allocated":21475115008,"data_stored":21475115008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640286,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972560,"kb_used_data":20972560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456224,"statfs":{"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972544,"kb_used_data":20972544,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456240,"statfs":{"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211959808,"internally_reserved":0,"allocated":21475115008,"data_stored":21475115008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32211910656,"internally_reserved":0,"allocated":21475164160,"data_stored":21475164160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53687074816,"available":32211189760,"internally_reserved":0,"allocated":21475885056,"data_stored":21475885056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T08:54:38.176 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T08:54:38.251 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:38.247+0000 7f6558164640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:38.254 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:38.252+0000 7f6558164640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:38.367 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:54:38.367 INFO:teuthology.orchestra.run.trial042.stdout:{"epoch":18,"fsid":"7e2c0a58-c4ab-4cae-b59c-95ee35636f28","created":"2026-02-12T08:53:55.693856+0000","modified":"2026-02-12T08:54:37.014432+0000","last_up_change":"2026-02-12T08:54:04.969156+0000","last_in_change":"2026-02-12T08:53:57.564434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-12T08:54:05.281968+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-12T08:54:05.973138+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d14ad9ee-a102-4963-a699-0aa928add173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6803","nonce":3549050663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6802","nonce":3549050663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6800","nonce":3549050663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6801","nonce":3549050663}]},"public_addr":"10.20.193.42:6803/3549050663","cluster_addr":"10.20.193.42:6802/3549050663","heartbeat_back_addr":"10.20.193.42:6800/3549050663","heartbeat_front_addr":"10.20.193.42:6801/3549050663","state":["exists","up"]},{"osd":1,"uuid":"667f4c53-2714-416e-8b1f-f6c5e84237e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6804","nonce":389981876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6805","nonce":389981876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6806","nonce":389981876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.42:6807","nonce":389981876}]},"public_addr":"10.20.193.42:6804/389981876","cluster_addr":"10.20.193.42:6805/389981876","heartbeat_back_addr":"10.20.193.42:6806/389981876","heartbeat_front_addr":"10.20.193.42:6807/389981876","state":["exists","up"]},{"osd":2,"uuid":"d3b78f0c-bf81-452e-8bcc-4898958de0c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6805","nonce":685904287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6806","nonce":685904287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6807","nonce":685904287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6808","nonce":685904287}]},"public_addr":"10.20.193.131:6805/685904287","cluster_addr":"10.20.193.131:6806/685904287","heartbeat_back_addr":"10.20.193.131:6807/685904287","heartbeat_front_addr":"10.20.193.131:6808/685904287","state":["exists","up"]},{"osd":3,"uuid":"7a506618-fa1c-4f91-b2c2-059143827d5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6803","nonce":4106838147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6804","nonce":4106838147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6813","nonce":4106838147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6812","nonce":4106838147}]},"public_addr":"10.20.193.131:6803/4106838147","cluster_addr":"10.20.193.131:6804/4106838147","heartbeat_back_addr":"10.20.193.131:6813/4106838147","heartbeat_front_addr":"10.20.193.131:6812/4106838147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:54:39.378 INFO:tasks.ceph:Scrubbing osd.0 2026-02-12T08:54:39.378 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-12T08:54:39.460 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:39.453+0000 7fe5781b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:39.462 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:39.460+0000 7fe5781b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:39.471 INFO:teuthology.orchestra.run.trial042.stdout:{ 2026-02-12T08:54:39.471 INFO:teuthology.orchestra.run.trial042.stdout: "success": "" 2026-02-12T08:54:39.471 INFO:teuthology.orchestra.run.trial042.stdout:} 2026-02-12T08:54:39.479 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-12T08:54:39.554 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:39.549+0000 7fbb5a4b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:39.557 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:39.555+0000 7fbb5a4b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:39.672 INFO:teuthology.orchestra.run.trial042.stderr:instructed osd(s) 0 to deep-scrub 2026-02-12T08:54:39.684 INFO:tasks.ceph:Scrubbing osd.1 2026-02-12T08:54:39.684 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-12T08:54:39.761 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:39.755+0000 7fd7900cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:39.764 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:39.762+0000 7fd7900cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:39.774 INFO:teuthology.orchestra.run.trial042.stdout:{ 2026-02-12T08:54:39.774 INFO:teuthology.orchestra.run.trial042.stdout: "success": "" 2026-02-12T08:54:39.774 INFO:teuthology.orchestra.run.trial042.stdout:} 2026-02-12T08:54:39.781 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-12T08:54:39.859 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:39.854+0000 7f160125a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:39.861 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:39.860+0000 7f160125a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:39.975 INFO:teuthology.orchestra.run.trial042.stderr:instructed osd(s) 1 to deep-scrub 2026-02-12T08:54:39.988 INFO:tasks.ceph:Scrubbing osd.2 2026-02-12T08:54:39.988 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-12T08:54:40.067 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:40.060+0000 7f6ee145a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:40.069 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:40.067+0000 7f6ee145a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:40.081 INFO:teuthology.orchestra.run.trial042.stdout:{ 2026-02-12T08:54:40.081 INFO:teuthology.orchestra.run.trial042.stdout: "success": "" 2026-02-12T08:54:40.081 INFO:teuthology.orchestra.run.trial042.stdout:} 2026-02-12T08:54:40.087 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-12T08:54:40.164 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:40.159+0000 7f349cdd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:40.166 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:40.164+0000 7f349cdd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:40.279 INFO:teuthology.orchestra.run.trial042.stderr:instructed osd(s) 2 to deep-scrub 2026-02-12T08:54:40.292 INFO:tasks.ceph:Scrubbing osd.3 2026-02-12T08:54:40.292 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-12T08:54:40.371 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:40.365+0000 7fe64fc06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:40.373 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:40.372+0000 7fe64fc06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:40.384 INFO:teuthology.orchestra.run.trial042.stdout:{ 2026-02-12T08:54:40.384 INFO:teuthology.orchestra.run.trial042.stdout: "success": "" 2026-02-12T08:54:40.384 INFO:teuthology.orchestra.run.trial042.stdout:} 2026-02-12T08:54:40.390 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-12T08:54:40.466 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:40.461+0000 7f9752f9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:40.468 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:40.467+0000 7f9752f9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:40.581 INFO:teuthology.orchestra.run.trial042.stderr:instructed osd(s) 3 to deep-scrub 2026-02-12T08:54:40.591 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T08:54:40.667 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:40.663+0000 7f5f6eb6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:40.670 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:54:40.668+0000 7f5f6eb6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:54:40.780 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:54:40.780 INFO:teuthology.orchestra.run.trial042.stderr:dumped all 2026-02-12T08:54:40.790 INFO:teuthology.orchestra.run.trial042.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2026-02-12T08:54:39.957309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83888840,"kb_used_data":83888840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125826296,"statfs":{"total":214748299264,"available":128846127104,"internally_reserved":0,"allocated":85902172160,"data_stored":85902172160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001309"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991895+0000","last_change":"2026-02-12T08:54:08.996415+0000","last_active":"2026-02-12T08:54:08.991895+0000","last_peered":"2026-02-12T08:54:08.991895+0000","last_clean":"2026-02-12T08:54:08.991895+0000","last_became_active":"2026-02-12T08:54:07.029382+0000","last_became_peered":"2026-02-12T08:54:07.029382+0000","last_unstale":"2026-02-12T08:54:08.991895+0000","last_undegraded":"2026-02-12T08:54:08.991895+0000","last_fullsized":"2026-02-12T08:54:08.991895+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.994855+0000","last_change":"2026-02-12T08:54:08.997232+0000","last_active":"2026-02-12T08:54:08.994855+0000","last_peered":"2026-02-12T08:54:08.994855+0000","last_clean":"2026-02-12T08:54:08.994855+0000","last_became_active":"2026-02-12T08:54:07.023327+0000","last_became_peered":"2026-02-12T08:54:07.023327+0000","last_unstale":"2026-02-12T08:54:08.994855+0000","last_undegraded":"2026-02-12T08:54:08.994855+0000","last_fullsized":"2026-02-12T08:54:08.994855+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:54:37.031279+0000","last_change":"2026-02-12T08:54:08.994109+0000","last_active":"2026-02-12T08:54:37.031279+0000","last_peered":"2026-02-12T08:54:37.031279+0000","last_clean":"2026-02-12T08:54:37.031279+0000","last_became_active":"2026-02-12T08:54:07.013851+0000","last_became_peered":"2026-02-12T08:54:07.013851+0000","last_unstale":"2026-02-12T08:54:37.031279+0000","last_undegraded":"2026-02-12T08:54:37.031279+0000","last_fullsized":"2026-02-12T08:54:37.031279+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991583+0000","last_change":"2026-02-12T08:54:08.996126+0000","last_active":"2026-02-12T08:54:08.991583+0000","last_peered":"2026-02-12T08:54:08.991583+0000","last_clean":"2026-02-12T08:54:08.991583+0000","last_became_active":"2026-02-12T08:54:07.015881+0000","last_became_peered":"2026-02-12T08:54:07.015881+0000","last_unstale":"2026-02-12T08:54:08.991583+0000","last_undegraded":"2026-02-12T08:54:08.991583+0000","last_fullsized":"2026-02-12T08:54:08.991583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":90,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:54:37.040007+0000","last_change":"2026-02-12T08:54:07.029990+0000","last_active":"2026-02-12T08:54:37.040007+0000","last_peered":"2026-02-12T08:54:37.040007+0000","last_clean":"2026-02-12T08:54:37.040007+0000","last_became_active":"2026-02-12T08:54:07.019218+0000","last_became_peered":"2026-02-12T08:54:07.019218+0000","last_unstale":"2026-02-12T08:54:37.040007+0000","last_undegraded":"2026-02-12T08:54:37.040007+0000","last_fullsized":"2026-02-12T08:54:37.040007+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.991264+0000","last_change":"2026-02-12T08:54:08.993164+0000","last_active":"2026-02-12T08:54:08.991264+0000","last_peered":"2026-02-12T08:54:08.991264+0000","last_clean":"2026-02-12T08:54:08.991264+0000","last_became_active":"2026-02-12T08:54:07.034037+0000","last_became_peered":"2026-02-12T08:54:07.034037+0000","last_unstale":"2026-02-12T08:54:08.991264+0000","last_undegraded":"2026-02-12T08:54:08.991264+0000","last_fullsized":"2026-02-12T08:54:08.991264+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:54:37.031956+0000","last_change":"2026-02-12T08:54:08.992713+0000","last_active":"2026-02-12T08:54:37.031956+0000","last_peered":"2026-02-12T08:54:37.031956+0000","last_clean":"2026-02-12T08:54:37.031956+0000","last_became_active":"2026-02-12T08:54:07.019674+0000","last_became_peered":"2026-02-12T08:54:07.019674+0000","last_unstale":"2026-02-12T08:54:37.031956+0000","last_undegraded":"2026-02-12T08:54:37.031956+0000","last_fullsized":"2026-02-12T08:54:37.031956+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:54:37.035076+0000","last_change":"2026-02-12T08:54:08.994901+0000","last_active":"2026-02-12T08:54:37.035076+0000","last_peered":"2026-02-12T08:54:37.035076+0000","last_clean":"2026-02-12T08:54:37.035076+0000","last_became_active":"2026-02-12T08:54:07.027290+0000","last_became_peered":"2026-02-12T08:54:07.027290+0000","last_unstale":"2026-02-12T08:54:37.035076+0000","last_undegraded":"2026-02-12T08:54:37.035076+0000","last_fullsized":"2026-02-12T08:54:37.035076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T08:54:08.990020+0000","last_change":"2026-02-12T08:54:08.992653+0000","last_active":"2026-02-12T08:54:08.990020+0000","last_peered":"2026-02-12T08:54:08.990020+0000","last_clean":"2026-02-12T08:54:08.990020+0000","last_became_active":"2026-02-12T08:54:07.016697+0000","last_became_peered":"2026-02-12T08:54:07.016697+0000","last_unstale":"2026-02-12T08:54:08.990020+0000","last_undegraded":"2026-02-12T08:54:08.990020+0000","last_fullsized":"2026-02-12T08:54:08.990020+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:05.973646+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211136512,"internally_reserved":0,"allocated":21475938304,"data_stored":21475938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214748299264,"available":128846127104,"internally_reserved":0,"allocated":85902172160,"data_stored":85902172160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971840,"kb_used_data":20971840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456944,"statfs":{"total":53687074816,"available":32211910656,"internally_reserved":0,"allocated":21475164160,"data_stored":21475164160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971844,"kb_used_data":20971844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456940,"statfs":{"total":53687074816,"available":32211906560,"internally_reserved":0,"allocated":21475168256,"data_stored":21475168256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640286,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972560,"kb_used_data":20972560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456224,"statfs":{"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972596,"kb_used_data":20972596,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456188,"statfs":{"total":53687074816,"available":32211136512,"internally_reserved":0,"allocated":21475938304,"data_stored":21475938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53687074816,"available":32211136512,"internally_reserved":0,"allocated":21475938304,"data_stored":21475938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211906560,"internally_reserved":0,"allocated":21475168256,"data_stored":21475168256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32211910656,"internally_reserved":0,"allocated":21475164160,"data_stored":21475164160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53687074816,"available":32211136512,"internally_reserved":0,"allocated":21475938304,"data_stored":21475938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T08:54:40.792 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-12T08:54:05.973646+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=5, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=38, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:54:40.792 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-12T08:54:05.973646+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=5, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=38, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:54:40.792 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-12T08:54:05.973646+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=5, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=38, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:54:40.792 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-12T08:54:05.973646+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=5, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=38, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:54:40.792 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-12T08:54:05.973646+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=5, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=38, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:54:40.792 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-12T08:54:05.973646+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=5, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=38, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:54:40.792 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-12T08:54:05.973646+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=5, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=38, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:54:40.792 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-12T08:54:05.973646+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=5, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=38, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:54:40.792 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-12T08:54:05.973646+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=5, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=8, tm_min=54, tm_sec=38, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T08:54:40.792 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-12T08:55:00.794 DEBUG:teuthology.orchestra.run.trial042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T08:55:00.874 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:55:00.871+0000 7f2a4f85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:55:00.876 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:55:00.876+0000 7f2a4f85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:55:00.988 INFO:teuthology.orchestra.run.trial042.stdout: 2026-02-12T08:55:00.988 INFO:teuthology.orchestra.run.trial042.stderr:dumped all 2026-02-12T08:55:00.997 INFO:teuthology.orchestra.run.trial042.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2026-02-12T08:54:59.961188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83888944,"kb_used_data":83888944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125826192,"statfs":{"total":214748299264,"available":128846020608,"internally_reserved":0,"allocated":85902278656,"data_stored":85902278656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002306"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:54:39.977061+0000","last_change":"2026-02-12T08:54:39.986073+0000","last_active":"2026-02-12T08:54:39.977061+0000","last_peered":"2026-02-12T08:54:39.977061+0000","last_clean":"2026-02-12T08:54:39.977061+0000","last_became_active":"2026-02-12T08:54:07.029382+0000","last_became_peered":"2026-02-12T08:54:07.029382+0000","last_unstale":"2026-02-12T08:54:39.977061+0000","last_undegraded":"2026-02-12T08:54:39.977061+0000","last_fullsized":"2026-02-12T08:54:39.977061+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:39.986022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:39.986022+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:54:39.976803+0000","last_change":"2026-02-12T08:54:39.985241+0000","last_active":"2026-02-12T08:54:39.976803+0000","last_peered":"2026-02-12T08:54:39.976803+0000","last_clean":"2026-02-12T08:54:39.976803+0000","last_became_active":"2026-02-12T08:54:07.023327+0000","last_became_peered":"2026-02-12T08:54:07.023327+0000","last_unstale":"2026-02-12T08:54:39.976803+0000","last_undegraded":"2026-02-12T08:54:39.976803+0000","last_fullsized":"2026-02-12T08:54:39.976803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:39.985134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:39.985134+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:54:40.279106+0000","last_change":"2026-02-12T08:54:40.288733+0000","last_active":"2026-02-12T08:54:40.279106+0000","last_peered":"2026-02-12T08:54:40.279106+0000","last_clean":"2026-02-12T08:54:40.279106+0000","last_became_active":"2026-02-12T08:54:07.013851+0000","last_became_peered":"2026-02-12T08:54:07.013851+0000","last_unstale":"2026-02-12T08:54:40.279106+0000","last_undegraded":"2026-02-12T08:54:40.279106+0000","last_fullsized":"2026-02-12T08:54:40.279106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:40.288660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:40.288660+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:54:39.976080+0000","last_change":"2026-02-12T08:54:39.987004+0000","last_active":"2026-02-12T08:54:39.976080+0000","last_peered":"2026-02-12T08:54:39.976080+0000","last_clean":"2026-02-12T08:54:39.976080+0000","last_became_active":"2026-02-12T08:54:07.015881+0000","last_became_peered":"2026-02-12T08:54:07.015881+0000","last_unstale":"2026-02-12T08:54:39.976080+0000","last_undegraded":"2026-02-12T08:54:39.976080+0000","last_fullsized":"2026-02-12T08:54:39.976080+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:39.986956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:39.986956+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":92,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:54:39.672830+0000","last_change":"2026-02-12T08:54:39.688184+0000","last_active":"2026-02-12T08:54:39.672830+0000","last_peered":"2026-02-12T08:54:39.672830+0000","last_clean":"2026-02-12T08:54:39.672830+0000","last_became_active":"2026-02-12T08:54:07.019218+0000","last_became_peered":"2026-02-12T08:54:07.019218+0000","last_unstale":"2026-02-12T08:54:39.672830+0000","last_undegraded":"2026-02-12T08:54:39.672830+0000","last_fullsized":"2026-02-12T08:54:39.672830+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'52","last_scrub_stamp":"2026-02-12T08:54:39.688117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:39.688117+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:54:40.580632+0000","last_change":"2026-02-12T08:54:40.591515+0000","last_active":"2026-02-12T08:54:40.580632+0000","last_peered":"2026-02-12T08:54:40.580632+0000","last_clean":"2026-02-12T08:54:40.580632+0000","last_became_active":"2026-02-12T08:54:07.034037+0000","last_became_peered":"2026-02-12T08:54:07.034037+0000","last_unstale":"2026-02-12T08:54:40.580632+0000","last_undegraded":"2026-02-12T08:54:40.580632+0000","last_fullsized":"2026-02-12T08:54:40.580632+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2026-02-12T08:54:40.591457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:40.591457+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":28,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:54:40.278543+0000","last_change":"2026-02-12T08:54:40.289952+0000","last_active":"2026-02-12T08:54:40.278543+0000","last_peered":"2026-02-12T08:54:40.278543+0000","last_clean":"2026-02-12T08:54:40.278543+0000","last_became_active":"2026-02-12T08:54:07.019674+0000","last_became_peered":"2026-02-12T08:54:07.019674+0000","last_unstale":"2026-02-12T08:54:40.278543+0000","last_undegraded":"2026-02-12T08:54:40.278543+0000","last_fullsized":"2026-02-12T08:54:40.278543+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2026-02-12T08:54:40.289897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:40.289897+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:54:39.672729+0000","last_change":"2026-02-12T08:54:39.679698+0000","last_active":"2026-02-12T08:54:39.672729+0000","last_peered":"2026-02-12T08:54:39.672729+0000","last_clean":"2026-02-12T08:54:39.672729+0000","last_became_active":"2026-02-12T08:54:07.027290+0000","last_became_peered":"2026-02-12T08:54:07.027290+0000","last_unstale":"2026-02-12T08:54:39.672729+0000","last_undegraded":"2026-02-12T08:54:39.672729+0000","last_fullsized":"2026-02-12T08:54:39.672729+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:39.679634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:39.679634+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:54:40.580082+0000","last_change":"2026-02-12T08:54:40.588433+0000","last_active":"2026-02-12T08:54:40.580082+0000","last_peered":"2026-02-12T08:54:40.580082+0000","last_clean":"2026-02-12T08:54:40.580082+0000","last_became_active":"2026-02-12T08:54:07.016697+0000","last_became_peered":"2026-02-12T08:54:07.016697+0000","last_unstale":"2026-02-12T08:54:40.580082+0000","last_undegraded":"2026-02-12T08:54:40.580082+0000","last_fullsized":"2026-02-12T08:54:40.580082+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:54:40.588375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:54:40.588375+0000","last_clean_scrub_stamp":"2026-02-12T08:54:05.973646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211136512,"internally_reserved":0,"allocated":21475938304,"data_stored":21475938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214748299264,"available":128846020608,"internally_reserved":0,"allocated":85902278656,"data_stored":85902278656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640305,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971892,"kb_used_data":20971892,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456892,"statfs":{"total":53687074816,"available":32211857408,"internally_reserved":0,"allocated":21475217408,"data_stored":21475217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673014,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971844,"kb_used_data":20971844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456940,"statfs":{"total":53687074816,"available":32211906560,"internally_reserved":0,"allocated":21475168256,"data_stored":21475168256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640305,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972612,"kb_used_data":20972612,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456172,"statfs":{"total":53687074816,"available":32211120128,"internally_reserved":0,"allocated":21475954688,"data_stored":21475954688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673014,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972596,"kb_used_data":20972596,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456188,"statfs":{"total":53687074816,"available":32211136512,"internally_reserved":0,"allocated":21475938304,"data_stored":21475938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53687074816,"available":32211136512,"internally_reserved":0,"allocated":21475938304,"data_stored":21475938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53687074816,"available":32211120128,"internally_reserved":0,"allocated":21475954688,"data_stored":21475954688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211906560,"internally_reserved":0,"allocated":21475168256,"data_stored":21475168256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32211857408,"internally_reserved":0,"allocated":21475217408,"data_stored":21475217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53687074816,"available":32211136512,"internally_reserved":0,"allocated":21475938304,"data_stored":21475938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T08:55:00.998 DEBUG:teuthology.orchestra.run.trial042:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-12T08:55:01.072 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:55:01.068+0000 7f9a9d63d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:55:01.075 INFO:teuthology.orchestra.run.trial042.stderr:2026-02-12T08:55:01.074+0000 7f9a9d63d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:55:01.206 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-12T08:55:01.206 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-12T08:55:01.206 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-12T08:55:01.206 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T08:55:01.269 INFO:tasks.ceph.osd.0:Stopped 2026-02-12T08:55:01.270 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-12T08:55:01.270 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T08:55:01.326 INFO:tasks.ceph.osd.1:Stopped 2026-02-12T08:55:01.326 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-12T08:55:01.326 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T08:55:01.370 INFO:tasks.ceph.osd.2:Stopped 2026-02-12T08:55:01.371 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-12T08:55:01.371 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T08:55:01.430 INFO:tasks.ceph.osd.3:Stopped 2026-02-12T08:55:01.430 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-12T08:55:01.430 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-12T08:55:01.431 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T08:55:01.465 INFO:tasks.ceph.mgr.x:Stopped 2026-02-12T08:55:01.465 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-12T08:55:01.465 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-12T08:55:01.466 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T08:55:01.478 INFO:tasks.ceph.mon.a:Stopped 2026-02-12T08:55:01.478 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-12T08:55:01.478 DEBUG:teuthology.orchestra.run.trial042:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | head -n 1 2026-02-12T08:55:01.544 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial042.front.sepia.ceph.com 2026-02-12T08:55:01.544 DEBUG:teuthology.orchestra.run.trial042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-12T08:55:01.624 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial042.front.sepia.ceph.com 2026-02-12T08:55:01.625 DEBUG:teuthology.orchestra.run.trial042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-12T08:55:01.692 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial131.front.sepia.ceph.com 2026-02-12T08:55:01.692 DEBUG:teuthology.orchestra.run.trial131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-12T08:55:01.721 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial131.front.sepia.ceph.com 2026-02-12T08:55:01.722 DEBUG:teuthology.orchestra.run.trial131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-12T08:55:01.839 INFO:tasks.ceph:Archiving mon data... 2026-02-12T08:55:01.840 DEBUG:teuthology.misc:Transferring archived files from trial042:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41562/data/mon.a.tgz 2026-02-12T08:55:01.840 DEBUG:teuthology.orchestra.run.trial042:> mktemp 2026-02-12T08:55:01.858 INFO:teuthology.orchestra.run.trial042.stdout:/tmp/tmp.xq4aNy2343 2026-02-12T08:55:01.858 DEBUG:teuthology.orchestra.run.trial042:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.xq4aNy2343 2026-02-12T08:55:01.943 DEBUG:teuthology.orchestra.run.trial042:> sudo chmod 0666 /tmp/tmp.xq4aNy2343 2026-02-12T08:55:02.025 DEBUG:teuthology.orchestra.remote:trial042:/tmp/tmp.xq4aNy2343 is 172KB 2026-02-12T08:55:02.076 DEBUG:teuthology.orchestra.run.trial042:> rm -fr /tmp/tmp.xq4aNy2343 2026-02-12T08:55:02.092 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-12T08:55:02.093 DEBUG:teuthology.orchestra.run.trial042:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T08:55:02.135 DEBUG:teuthology.orchestra.run.trial131:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T08:55:02.213 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T08:55:02.229 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T08:55:02.229 INFO:tasks.ceph:Archiving crash dumps... 2026-02-12T08:55:02.231 DEBUG:teuthology.misc:Transferring archived files from trial042:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41562/remote/trial042/crash 2026-02-12T08:55:02.232 DEBUG:teuthology.orchestra.run.trial042:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T08:55:02.279 DEBUG:teuthology.misc:Transferring archived files from trial131:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41562/remote/trial131/crash 2026-02-12T08:55:02.280 DEBUG:teuthology.orchestra.run.trial131:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T08:55:02.307 INFO:tasks.ceph:Compressing logs... 2026-02-12T08:55:02.307 DEBUG:teuthology.orchestra.run.trial042:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T08:55:02.324 DEBUG:teuthology.orchestra.run.trial131:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T08:55:02.346 INFO:teuthology.orchestra.run.trial042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22245.log 2026-02-12T08:55:02.359 INFO:teuthology.orchestra.run.trial042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23069.log 2026-02-12T08:55:02.359 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.22245.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-12T08:55:02.359 INFO:teuthology.orchestra.run.trial042.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22245.log.gz 2026-02-12T08:55:02.359 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.23069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21836.log 2026-02-12T08:55:02.359 INFO:teuthology.orchestra.run.trial042.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23069.log.gz 2026-02-12T08:55:02.359 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-12T08:55:02.360 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.21836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23118.log 2026-02-12T08:55:02.360 INFO:teuthology.orchestra.run.trial042.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.21836.log.gz 2026-02-12T08:55:02.360 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21327.log 2026-02-12T08:55:02.360 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.23118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23216.log 2026-02-12T08:55:02.360 INFO:teuthology.orchestra.run.trial042.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23118.log.gz 2026-02-12T08:55:02.360 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.21327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22031.log 2026-02-12T08:55:02.360 INFO:teuthology.orchestra.run.trial042.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.21327.log.gz 2026-02-12T08:55:02.360 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.23216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22775.log 2026-02-12T08:55:02.360 INFO:teuthology.orchestra.run.trial042.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23216.log.gz 2026-02-12T08:55:02.360 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.22031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21657.log 2026-02-12T08:55:02.360 INFO:teuthology.orchestra.run.trial042.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22031.log.gz 2026-02-12T08:55:02.361 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.22775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23363.log 50.0% 2026-02-12T08:55:02.361 INFO:teuthology.orchestra.run.trial042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.22775.log.gz 2026-02-12T08:55:02.361 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.21657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22677.log 2026-02-12T08:55:02.361 INFO:teuthology.orchestra.run.trial042.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.21657.log.gz 2026-02-12T08:55:02.361 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.23363.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23363.log.gz 2026-02-12T08:55:02.361 INFO:teuthology.orchestra.run.trial042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21459.log 2026-02-12T08:55:02.361 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.22677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23167.log 2026-02-12T08:55:02.361 INFO:teuthology.orchestra.run.trial042.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22677.log.gz 2026-02-12T08:55:02.361 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.21459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21486.log 2026-02-12T08:55:02.361 INFO:teuthology.orchestra.run.trial042.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.21459.log.gz 2026-02-12T08:55:02.361 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.23167.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23167.log.gz 2026-02-12T08:55:02.361 INFO:teuthology.orchestra.run.trial042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22147.log 2026-02-12T08:55:02.361 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.21486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21301.log 2026-02-12T08:55:02.362 INFO:teuthology.orchestra.run.trial042.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.21486.log.gz 2026-02-12T08:55:02.362 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.22147.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22147.log.gz 2026-02-12T08:55:02.362 INFO:teuthology.orchestra.run.trial042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21835.log 2026-02-12T08:55:02.362 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.21301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22922.log 2026-02-12T08:55:02.362 INFO:teuthology.orchestra.run.trial042.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.21301.log.gz 2026-02-12T08:55:02.362 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.21835.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.21835.log.gz 2026-02-12T08:55:02.362 INFO:teuthology.orchestra.run.trial042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23265.log 2026-02-12T08:55:02.362 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.22922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22519.log 2026-02-12T08:55:02.362 INFO:teuthology.orchestra.run.trial042.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22922.log.gz 2026-02-12T08:55:02.362 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.23265.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23265.log.gz 2026-02-12T08:55:02.362 INFO:teuthology.orchestra.run.trial042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21608.log 2026-02-12T08:55:02.362 INFO:teuthology.orchestra.run.trial042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22873.log 2026-02-12T08:55:02.362 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.22519.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22519.log.gz 2026-02-12T08:55:02.363 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.21608.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.21608.log.gz 2026-02-12T08:55:02.363 INFO:teuthology.orchestra.run.trial042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22824.log 2026-02-12T08:55:02.363 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.22873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21389.log 2026-02-12T08:55:02.363 INFO:teuthology.orchestra.run.trial042.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22873.log.gz 2026-02-12T08:55:02.363 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.22824.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22824.log.gz 2026-02-12T08:55:02.363 INFO:teuthology.orchestra.run.trial042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-12T08:55:02.363 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.21389.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.21389.log.gz 2026-02-12T08:55:02.363 INFO:teuthology.orchestra.run.trial042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22971.log 2026-02-12T08:55:02.363 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21834.log 2026-02-12T08:55:02.363 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.22971.log: 86.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-12T08:55:02.363 INFO:teuthology.orchestra.run.trial042.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22971.log.gz 2026-02-12T08:55:02.363 INFO:teuthology.orchestra.run.trial042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-12T08:55:02.363 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.21834.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.21834.log.gz 2026-02-12T08:55:02.364 INFO:teuthology.orchestra.run.trial042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22030.log 2026-02-12T08:55:02.364 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23020.log 2026-02-12T08:55:02.364 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.22030.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22030.log.gz 2026-02-12T08:55:02.364 INFO:teuthology.orchestra.run.trial042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21706.log 2026-02-12T08:55:02.364 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.23020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22726.log 2026-02-12T08:55:02.364 INFO:teuthology.orchestra.run.trial042.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23020.log.gz 2026-02-12T08:55:02.364 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.21706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21046.log 2026-02-12T08:55:02.364 INFO:teuthology.orchestra.run.trial042.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.21706.log.gz 2026-02-12T08:55:02.364 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.22726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21832.log 2026-02-12T08:55:02.364 INFO:teuthology.orchestra.run.trial042.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22726.log.gz 2026-02-12T08:55:02.364 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.21046.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.19893.log 2026-02-12T08:55:02.364 INFO:teuthology.orchestra.run.trial042.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.21046.log.gz 2026-02-12T08:55:02.365 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.21832.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-12T08:55:02.365 INFO:teuthology.orchestra.run.trial042.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.21832.log.gz 2026-02-12T08:55:02.365 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph.tmp-client.admin.19893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23316.log 2026-02-12T08:55:02.365 INFO:teuthology.orchestra.run.trial042.stderr: 66.4% -- replaced with /var/log/ceph/ceph.tmp-client.admin.19893.log.gz 2026-02-12T08:55:02.365 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22196.log 2026-02-12T08:55:02.365 INFO:teuthology.orchestra.run.trial042.stderr: 83.1% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-12T08:55:02.365 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.23316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21559.log 2026-02-12T08:55:02.365 INFO:teuthology.orchestra.run.trial042.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23316.log.gz 2026-02-12T08:55:02.365 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.22196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22032.log 2026-02-12T08:55:02.365 INFO:teuthology.orchestra.run.trial042.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22196.log.gz 2026-02-12T08:55:02.365 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.21559.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.21559.log.gz 2026-02-12T08:55:02.365 INFO:teuthology.orchestra.run.trial042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22028.log 2026-02-12T08:55:02.365 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.22032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21093.log 2026-02-12T08:55:02.365 INFO:teuthology.orchestra.run.trial042.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22032.log.gz 2026-02-12T08:55:02.366 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.22028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20960.log 2026-02-12T08:55:02.366 INFO:teuthology.orchestra.run.trial042.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22028.log.gz 2026-02-12T08:55:02.366 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.21093.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.21093.log.gz 2026-02-12T08:55:02.366 INFO:teuthology.orchestra.run.trial042.stderr:/var/log/ceph/ceph-client.admin.20960.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.20960.log.gz 2026-02-12T08:55:02.371 INFO:teuthology.orchestra.run.trial042.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-12T08:55:02.378 INFO:teuthology.orchestra.run.trial131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-12T08:55:02.380 INFO:teuthology.orchestra.run.trial131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-12T08:55:02.380 INFO:teuthology.orchestra.run.trial131.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21312.log 2026-02-12T08:55:02.380 INFO:teuthology.orchestra.run.trial131.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21464.log 2026-02-12T08:55:02.380 INFO:teuthology.orchestra.run.trial131.stderr:/var/log/ceph/ceph-client.admin.21312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21359.log 2026-02-12T08:55:02.380 INFO:teuthology.orchestra.run.trial131.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.21312.log.gz 2026-02-12T08:55:02.381 INFO:teuthology.orchestra.run.trial131.stderr:/var/log/ceph/ceph-client.admin.21464.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-12T08:55:02.381 INFO:teuthology.orchestra.run.trial131.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.21464.log.gz 2026-02-12T08:55:02.381 INFO:teuthology.orchestra.run.trial131.stderr:/var/log/ceph/ceph-client.admin.21359.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.21359.log.gz 2026-02-12T08:55:02.381 INFO:teuthology.orchestra.run.trial131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21406.log 2026-02-12T08:55:02.381 INFO:teuthology.orchestra.run.trial131.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.21406.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.21406.log.gz 2026-02-12T08:55:02.387 INFO:teuthology.orchestra.run.trial131.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-12T08:55:02.425 INFO:teuthology.orchestra.run.trial131.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-12T08:55:02.432 INFO:teuthology.orchestra.run.trial042.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-12T08:55:02.436 INFO:teuthology.orchestra.run.trial042.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-12T08:55:02.438 INFO:teuthology.orchestra.run.trial042.stderr: 2026-02-12T08:55:02.438 INFO:teuthology.orchestra.run.trial042.stderr:real 0m0.100s 2026-02-12T08:55:02.438 INFO:teuthology.orchestra.run.trial042.stderr:user 0m0.202s 2026-02-12T08:55:02.439 INFO:teuthology.orchestra.run.trial042.stderr:sys 0m0.036s 2026-02-12T08:55:02.449 INFO:teuthology.orchestra.run.trial131.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-12T08:55:02.450 INFO:teuthology.orchestra.run.trial131.stderr: 2026-02-12T08:55:02.451 INFO:teuthology.orchestra.run.trial131.stderr:real 0m0.081s 2026-02-12T08:55:02.451 INFO:teuthology.orchestra.run.trial131.stderr:user 0m0.125s 2026-02-12T08:55:02.451 INFO:teuthology.orchestra.run.trial131.stderr:sys 0m0.022s 2026-02-12T08:55:02.451 INFO:tasks.ceph:Archiving logs... 2026-02-12T08:55:02.451 DEBUG:teuthology.misc:Transferring archived files from trial042:/var/log/ceph to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41562/remote/trial042/log 2026-02-12T08:55:02.453 DEBUG:teuthology.orchestra.run.trial042:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T08:55:02.609 DEBUG:teuthology.misc:Transferring archived files from trial131:/var/log/ceph to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41562/remote/trial131/log 2026-02-12T08:55:02.610 DEBUG:teuthology.orchestra.run.trial131:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T08:55:02.691 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T08:55:02.842 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T08:55:02.853 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-12T08:55:02.853 DEBUG:teuthology.orchestra.run.trial042:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T08:55:02.855 DEBUG:teuthology.orchestra.run.trial131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T08:55:02.880 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-12T08:55:02.894 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-12T08:55:02.894 DEBUG:teuthology.orchestra.run.trial042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T08:55:02.920 DEBUG:teuthology.orchestra.run.trial131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T08:55:02.933 INFO:teuthology.orchestra.run.trial042.stderr:bash: line 1: ntpq: command not found 2026-02-12T08:55:02.937 INFO:teuthology.orchestra.run.trial131.stderr:bash: line 1: ntpq: command not found 2026-02-12T08:55:02.949 INFO:teuthology.orchestra.run.trial042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T08:55:02.949 INFO:teuthology.orchestra.run.trial042.stdout:=============================================================================== 2026-02-12T08:55:02.949 INFO:teuthology.orchestra.run.trial042.stdout:^+ 23.186.168.130 2 6 375 48 -2415us[-2415us] +/- 64ms 2026-02-12T08:55:02.949 INFO:teuthology.orchestra.run.trial042.stdout:^* s2-a.time.mci1.us.rozint> 2 6 377 49 +1325us[+1393us] +/- 24ms 2026-02-12T08:55:02.949 INFO:teuthology.orchestra.run.trial042.stdout:^+ 66.42.71.197.vultruserco> 3 6 377 49 -959us[ -890us] +/- 43ms 2026-02-12T08:55:02.949 INFO:teuthology.orchestra.run.trial042.stdout:^+ 149.248.12.167.vultruser> 3 6 377 52 +435us[ +503us] +/- 32ms 2026-02-12T08:55:02.968 INFO:teuthology.orchestra.run.trial131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T08:55:02.968 INFO:teuthology.orchestra.run.trial131.stdout:=============================================================================== 2026-02-12T08:55:02.968 INFO:teuthology.orchestra.run.trial131.stdout:^- arm1.maxhost.io 2 6 377 116 -1540us[-1491us] +/- 54ms 2026-02-12T08:55:02.968 INFO:teuthology.orchestra.run.trial131.stdout:^- 199.101.96.52 2 6 377 51 -949us[ -929us] +/- 52ms 2026-02-12T08:55:02.968 INFO:teuthology.orchestra.run.trial131.stdout:^- kc1cloud.147.72.155.23.m> 3 6 377 52 -1600us[-1580us] +/- 47ms 2026-02-12T08:55:02.968 INFO:teuthology.orchestra.run.trial131.stdout:^* pool-96-231-54-40.washdc> 1 6 377 49 +73us[ +93us] +/- 6999us 2026-02-12T08:55:02.969 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-12T08:55:02.983 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-12T08:55:02.984 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-12T08:55:02.998 DEBUG:teuthology.orchestra.run.trial042:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T08:55:03.041 DEBUG:teuthology.orchestra.run.trial131:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T08:55:03.083 DEBUG:teuthology.orchestra.run.trial042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T08:55:03.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:55:03.108 DEBUG:teuthology.orchestra.run.trial131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T08:55:03.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:55:03.149 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-12T08:55:03.166 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-12T08:55:03.181 INFO:teuthology.task.internal:Duration was 839.497498 seconds 2026-02-12T08:55:03.181 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-12T08:55:03.196 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-12T08:55:03.197 DEBUG:teuthology.orchestra.run.trial042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T08:55:03.199 DEBUG:teuthology.orchestra.run.trial131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T08:55:03.236 INFO:teuthology.orchestra.run.trial042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T08:55:03.238 INFO:teuthology.orchestra.run.trial131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T08:55:03.582 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-12T08:55:03.582 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial042.front.sepia.ceph.com 2026-02-12T08:55:03.582 DEBUG:teuthology.orchestra.run.trial042:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T08:55:03.640 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial131.front.sepia.ceph.com 2026-02-12T08:55:03.641 DEBUG:teuthology.orchestra.run.trial131:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T08:55:03.662 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-12T08:55:03.662 DEBUG:teuthology.orchestra.run.trial042:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T08:55:03.683 DEBUG:teuthology.orchestra.run.trial131:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T08:55:03.745 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-12T08:55:03.745 DEBUG:teuthology.orchestra.run.trial042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T08:55:03.766 DEBUG:teuthology.orchestra.run.trial131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T08:55:03.787 INFO:teuthology.orchestra.run.trial042.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T08:55:03.790 INFO:teuthology.orchestra.run.trial042.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T08:55:03.790 INFO:teuthology.orchestra.run.trial042.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T08:55:03.790 INFO:teuthology.orchestra.run.trial042.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T08:55:03.790 INFO:teuthology.orchestra.run.trial042.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T08:55:03.792 INFO:teuthology.orchestra.run.trial042.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T08:55:03.809 INFO:teuthology.orchestra.run.trial131.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T08:55:03.810 INFO:teuthology.orchestra.run.trial131.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T08:55:03.810 INFO:teuthology.orchestra.run.trial131.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T08:55:03.810 INFO:teuthology.orchestra.run.trial131.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T08:55:03.810 INFO:teuthology.orchestra.run.trial131.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T08:55:03.813 INFO:teuthology.orchestra.run.trial131.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T08:55:03.815 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-12T08:55:03.831 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-12T08:55:03.831 DEBUG:teuthology.orchestra.run.trial042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T08:55:03.859 DEBUG:teuthology.orchestra.run.trial131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T08:55:03.882 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-12T08:55:03.899 DEBUG:teuthology.orchestra.run.trial042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T08:55:03.901 DEBUG:teuthology.orchestra.run.trial131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T08:55:03.922 INFO:teuthology.orchestra.run.trial042.stdout:kernel.core_pattern = core 2026-02-12T08:55:03.946 INFO:teuthology.orchestra.run.trial131.stdout:kernel.core_pattern = core 2026-02-12T08:55:03.964 DEBUG:teuthology.orchestra.run.trial042:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T08:55:03.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:55:03.989 DEBUG:teuthology.orchestra.run.trial131:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T08:55:04.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:55:04.019 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-12T08:55:04.036 INFO:teuthology.task.internal:Transferring archived files... 2026-02-12T08:55:04.037 DEBUG:teuthology.misc:Transferring archived files from trial042:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41562/remote/trial042 2026-02-12T08:55:04.038 DEBUG:teuthology.orchestra.run.trial042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T08:55:04.068 DEBUG:teuthology.misc:Transferring archived files from trial131:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41562/remote/trial131 2026-02-12T08:55:04.068 DEBUG:teuthology.orchestra.run.trial131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T08:55:04.099 INFO:teuthology.task.internal:Removing archive directory... 2026-02-12T08:55:04.099 DEBUG:teuthology.orchestra.run.trial042:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T08:55:04.104 DEBUG:teuthology.orchestra.run.trial131:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T08:55:04.151 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-12T08:55:04.169 INFO:teuthology.task.internal:Not uploading archives. 2026-02-12T08:55:04.169 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-12T08:55:04.186 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-12T08:55:04.186 DEBUG:teuthology.orchestra.run.trial042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T08:55:04.188 DEBUG:teuthology.orchestra.run.trial131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T08:55:04.202 INFO:teuthology.orchestra.run.trial042.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 08:55 /home/ubuntu/cephtest 2026-02-12T08:55:04.208 INFO:teuthology.orchestra.run.trial131.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 08:55 /home/ubuntu/cephtest 2026-02-12T08:55:04.209 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T08:55:04.227 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T08:55:04.264 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/cls} duration: 839.4974982738495 flavor: debug owner: scheduled_matan@soko04.front.sepia.ceph.com success: true 2026-02-12T08:55:04.264 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T08:55:04.397 INFO:teuthology.run:pass