2026-02-12T12:45:06.702 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-12T12:45:06.721 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:45:06.802 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial/45942 branch: main description: crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} perf_ignorelist settings/optimized workloads/fio_4K_rand_read} email: null first_in_suite: false flavor: debug job_id: '45942' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: global: auth client required: none auth cluster required: none auth service required: none auth supported: none debug asok: 0/0 debug auth: 0/0 debug bdev: 0/0 debug bluefs: 0/0 debug bluestore: 0/0 debug buffer: 0/0 debug civetweb: 0/0 debug client: 0/0 debug compressor: 0/0 debug context: 0/0 debug crush: 0/0 debug crypto: 0/0 debug dpdk: 0/0 debug eventtrace: 0/0 debug filer: 0/0 debug filestore: 0/0 debug finisher: 0/0 debug fuse: 0/0 debug heartbeatmap: 0/0 debug javaclient: 0/0 debug journal: 0/0 debug journaler: 0/0 debug kstore: 0/0 debug leveldb: 0/0 debug lockdep: 0/0 debug mds: 0/0 debug mds balancer: 0/0 debug mds locker: 0/0 debug mds log: 0/0 debug mds log expire: 0/0 debug mds migrator: 0/0 debug memdb: 0/0 debug mgr: 0/0 debug mgrc: 0/0 debug mon: 0/0 debug monc: 0/0 debug ms: 0/0 debug objclass: 0/0 debug objectcacher: 0/0 debug objecter: 0/0 debug optracker: 0/0 debug osd: 0/0 debug paxos: 0/0 debug perfcounter: 0/0 debug rados: 0/0 debug rbd: 0/0 debug rbd mirror: 0/0 debug rbd replay: 0/0 debug refs: 0/0 debug rgw: 0/0 debug rgw lifecycle: 0/0 debug rgw notification: 0/0 debug rgw sync: 0/0 debug rocksdb: 0/0 debug striper: 0/0 debug throttle: 0/0 debug timer: 0/0 debug tp: 0/0 enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 0/0 debug ms: 0/0 debug paxos: 0/0 osd pool default crimson: true osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug filestore: 0/0 debug journal: 0/0 debug ms: 0/0 debug osd: 0/0 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd objectstore: seastore osd shutdown pgref assert: true seastore cachepin size pershard: 64M seastore cachepin type: 2Q seastore main device type: RANDOM_BLOCK_SSD seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - \(PG_ - \(OSD_ - \(OBJECT_ - overall HEALTH sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} install: ceph: flavor: debug sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 workunit: branch: seastore_io_uring env: CRIMSON_COMPAT: '1' sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 owner: scheduled_moagrawa@soko04.front.sepia.ceph.com priority: 1000 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 4100 sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 sleep_before_teardown: 0 suite: crimson-rados suite_branch: seastore_io_uring suite_path: /home/teuthworker/src/github.com_mohit84_ceph_5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/qa suite_relpath: qa suite_repo: https://github.com/mohit84/ceph.git suite_sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 targets: trial025.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBRfuTGbU026NNqRFPSb9Cuzkx9XyRw8WrYkEEjuMD5mDWhgQbsostjuHo5rYgQ8m5CB2CyfAJZm7Rb5Ip4NroA= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: osd: debug monc: 20 wait-for-scrub: false - ssh_keys: null - cbt: benchmarks: librbdfio: iodepth: - 32 log_avg_msec: 100 mode: - randread norandommap: true op_size: - 4096 osd_ra: - 4096 pool_profile: rbd procs_per_volume: - 1 time: 60 vol_size: 4096 volumes_per_client: - 2 cluster: iterations: 1 osds_per_node: 3 pool_profiles: rbd: pg_size: 128 pgp_size: 128 replication: 3 user: ubuntu monitoring_profiles: perf: args: stat -p {pid} -o {perf_dir}/perf_stat.{pid} nodes: - osds perf_cmd: perf pid_glob: crimson-osd.*.pid teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-12_06:08:11 tube: trial user: moagrawa verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.2161924 2026-02-12T12:45:06.803 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_mohit84_ceph_5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/qa; will attempt to use it 2026-02-12T12:45:06.803 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_mohit84_ceph_5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/qa/tasks 2026-02-12T12:45:06.803 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T12:45:06.806 INFO:teuthology.task.internal:Checking packages... 2026-02-12T12:45:06.807 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0' 2026-02-12T12:45:06.807 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T12:45:06.807 INFO:teuthology.packaging:ref: None 2026-02-12T12:45:06.807 INFO:teuthology.packaging:tag: None 2026-02-12T12:45:06.807 INFO:teuthology.packaging:branch: main 2026-02-12T12:45:06.807 INFO:teuthology.packaging:sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T12:45:06.807 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=main 2026-02-12T12:45:06.953 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5273.g2bf58db4 2026-02-12T12:45:06.954 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T12:45:06.966 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T12:45:06.966 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T12:45:06.980 INFO:teuthology.task.internal:Saving configuration 2026-02-12T12:45:06.988 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T12:45:07.000 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T12:45:07.057 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial025.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial/45942', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 12:41:49.214930', 'locked_by': 'scheduled_moagrawa@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBRfuTGbU026NNqRFPSb9Cuzkx9XyRw8WrYkEEjuMD5mDWhgQbsostjuHo5rYgQ8m5CB2CyfAJZm7Rb5Ip4NroA='} 2026-02-12T12:45:07.057 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T12:45:07.069 INFO:teuthology.task.internal:roles: ubuntu@trial025.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-12T12:45:07.069 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T12:45:07.141 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7cc8a60349a0>, signals=[15]) 2026-02-12T12:45:07.142 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T12:45:07.153 INFO:teuthology.task.internal:Opening connections... 2026-02-12T12:45:07.153 DEBUG:teuthology.task.internal:connecting to ubuntu@trial025.front.sepia.ceph.com 2026-02-12T12:45:07.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T12:45:07.215 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T12:45:07.227 DEBUG:teuthology.orchestra.run.trial025:> uname -m 2026-02-12T12:45:07.290 INFO:teuthology.orchestra.run.trial025.stdout:x86_64 2026-02-12T12:45:07.290 DEBUG:teuthology.orchestra.run.trial025:> cat /etc/os-release 2026-02-12T12:45:07.345 INFO:teuthology.orchestra.run.trial025.stdout:NAME="CentOS Stream" 2026-02-12T12:45:07.345 INFO:teuthology.orchestra.run.trial025.stdout:VERSION="9" 2026-02-12T12:45:07.345 INFO:teuthology.orchestra.run.trial025.stdout:ID="centos" 2026-02-12T12:45:07.345 INFO:teuthology.orchestra.run.trial025.stdout:ID_LIKE="rhel fedora" 2026-02-12T12:45:07.345 INFO:teuthology.orchestra.run.trial025.stdout:VERSION_ID="9" 2026-02-12T12:45:07.345 INFO:teuthology.orchestra.run.trial025.stdout:PLATFORM_ID="platform:el9" 2026-02-12T12:45:07.345 INFO:teuthology.orchestra.run.trial025.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T12:45:07.345 INFO:teuthology.orchestra.run.trial025.stdout:ANSI_COLOR="0;31" 2026-02-12T12:45:07.345 INFO:teuthology.orchestra.run.trial025.stdout:LOGO="fedora-logo-icon" 2026-02-12T12:45:07.345 INFO:teuthology.orchestra.run.trial025.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T12:45:07.345 INFO:teuthology.orchestra.run.trial025.stdout:HOME_URL="https://centos.org/" 2026-02-12T12:45:07.345 INFO:teuthology.orchestra.run.trial025.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T12:45:07.345 INFO:teuthology.orchestra.run.trial025.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T12:45:07.345 INFO:teuthology.orchestra.run.trial025.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T12:45:07.345 INFO:teuthology.lock.ops:Updating trial025.front.sepia.ceph.com on lock server 2026-02-12T12:45:07.404 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T12:45:07.416 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T12:45:07.429 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T12:45:07.429 DEBUG:teuthology.orchestra.run.trial025:> test '!' -e /home/ubuntu/cephtest 2026-02-12T12:45:07.444 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T12:45:07.456 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T12:45:07.456 DEBUG:teuthology.orchestra.run.trial025:> test -z $(ls -A /var/lib/ceph) 2026-02-12T12:45:07.501 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T12:45:07.569 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T12:45:07.588 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-12T12:45:07.588 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-12T12:45:07.589 DEBUG:teuthology.orchestra.run.trial025:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T12:45:07.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T12:45:07.603 DEBUG:teuthology.orchestra.run.trial025:> uname -r 2026-02-12T12:45:07.659 INFO:teuthology.orchestra.run.trial025.stdout:5.14.0-645.el9.x86_64 2026-02-12T12:45:07.660 INFO:teuthology.task.kernel:Running kernel on trial025: 5.14.0-645.el9.x86_64 2026-02-12T12:45:07.660 DEBUG:teuthology.orchestra.run.trial025:> sudo yum install -y kernel 2026-02-12T12:45:09.992 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.9 MB 00:01 2026-02-12T12:45:13.023 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-12T12:45:16.628 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - CRB 7.1 MB/s | 7.8 MB 00:01 2026-02-12T12:45:17.540 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - Extras packages 109 kB/s | 20 kB 00:00 2026-02-12T12:45:18.162 INFO:teuthology.orchestra.run.trial025.stdout:Extra Packages for Enterprise Linux 37 MB/s | 20 MB 00:00 2026-02-12T12:45:21.402 INFO:teuthology.orchestra.run.trial025.stdout:lab-extras 2.0 MB/s | 50 kB 00:00 2026-02-12T12:45:22.466 INFO:teuthology.orchestra.run.trial025.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T12:45:22.486 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:45:22.487 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:45:22.487 INFO:teuthology.orchestra.run.trial025.stdout: Package Architecture Version Repository Size 2026-02-12T12:45:22.487 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:45:22.488 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T12:45:22.488 INFO:teuthology.orchestra.run.trial025.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T12:45:22.488 INFO:teuthology.orchestra.run.trial025.stdout:Installing dependencies: 2026-02-12T12:45:22.488 INFO:teuthology.orchestra.run.trial025.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T12:45:22.488 INFO:teuthology.orchestra.run.trial025.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T12:45:22.488 INFO:teuthology.orchestra.run.trial025.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T12:45:22.488 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:45:22.488 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T12:45:22.488 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:45:22.488 INFO:teuthology.orchestra.run.trial025.stdout:Install 4 Packages 2026-02-12T12:45:22.488 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:45:22.489 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 88 M 2026-02-12T12:45:22.489 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 135 M 2026-02-12T12:45:22.489 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T12:45:22.674 INFO:teuthology.orchestra.run.trial025.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 5.9 MB/s | 768 kB 00:00 2026-02-12T12:45:22.822 INFO:teuthology.orchestra.run.trial025.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 62 MB/s | 17 MB 00:00 2026-02-12T12:45:23.232 INFO:teuthology.orchestra.run.trial025.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 55 MB/s | 31 MB 00:00 2026-02-12T12:45:23.307 INFO:teuthology.orchestra.run.trial025.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 52 MB/s | 40 MB 00:00 2026-02-12T12:45:23.307 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:45:23.307 INFO:teuthology.orchestra.run.trial025.stdout:Total 108 MB/s | 88 MB 00:00 2026-02-12T12:45:23.495 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T12:45:23.697 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T12:45:23.697 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T12:45:24.044 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T12:45:24.044 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T12:45:25.130 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T12:45:25.412 INFO:teuthology.orchestra.run.trial025.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T12:45:25.431 INFO:teuthology.orchestra.run.trial025.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T12:45:27.207 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T12:45:27.235 INFO:teuthology.orchestra.run.trial025.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T12:45:30.329 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T12:45:30.335 INFO:teuthology.orchestra.run.trial025.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T12:45:33.372 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T12:46:04.000 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T12:46:04.022 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T12:46:04.089 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T12:46:04.089 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T12:46:04.089 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T12:46:04.090 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T12:46:04.142 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T12:46:04.142 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:46:04.142 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T12:46:04.142 INFO:teuthology.orchestra.run.trial025.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T12:46:04.143 INFO:teuthology.orchestra.run.trial025.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T12:46:04.143 INFO:teuthology.orchestra.run.trial025.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T12:46:04.143 INFO:teuthology.orchestra.run.trial025.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T12:46:04.143 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:46:04.143 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:46:04.200 DEBUG:teuthology.orchestra.run.trial025:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T12:46:04.226 INFO:teuthology.orchestra.run.trial025.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T12:46:04.227 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T12:46:04.227 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T12:46:04.227 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T12:46:04.227 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T12:46:04.227 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T12:46:04.227 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial025.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T12:46:04.228 DEBUG:teuthology.orchestra.run.trial025:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T12:46:04.289 INFO:teuthology.orchestra.run.trial025.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T12:46:04.290 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T12:46:04.291 DEBUG:teuthology.orchestra.run.trial025:> sudo rpm -qi grub2-tools 2026-02-12T12:46:04.359 INFO:teuthology.orchestra.run.trial025.stdout:Name : grub2-tools 2026-02-12T12:46:04.359 INFO:teuthology.orchestra.run.trial025.stdout:Epoch : 1 2026-02-12T12:46:04.360 INFO:teuthology.orchestra.run.trial025.stdout:Version : 2.06 2026-02-12T12:46:04.360 INFO:teuthology.orchestra.run.trial025.stdout:Release : 118.el9 2026-02-12T12:46:04.360 INFO:teuthology.orchestra.run.trial025.stdout:Architecture: x86_64 2026-02-12T12:46:04.360 INFO:teuthology.orchestra.run.trial025.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T12:46:04.360 INFO:teuthology.orchestra.run.trial025.stdout:Group : Unspecified 2026-02-12T12:46:04.360 INFO:teuthology.orchestra.run.trial025.stdout:Size : 8393909 2026-02-12T12:46:04.360 INFO:teuthology.orchestra.run.trial025.stdout:License : GPLv3+ 2026-02-12T12:46:04.360 INFO:teuthology.orchestra.run.trial025.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T12:46:04.360 INFO:teuthology.orchestra.run.trial025.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T12:46:04.360 INFO:teuthology.orchestra.run.trial025.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T12:46:04.360 INFO:teuthology.orchestra.run.trial025.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T12:46:04.361 INFO:teuthology.orchestra.run.trial025.stdout:Packager : builder@centos.org 2026-02-12T12:46:04.361 INFO:teuthology.orchestra.run.trial025.stdout:Vendor : CentOS 2026-02-12T12:46:04.361 INFO:teuthology.orchestra.run.trial025.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T12:46:04.361 INFO:teuthology.orchestra.run.trial025.stdout:Summary : Support tools for GRUB. 2026-02-12T12:46:04.361 INFO:teuthology.orchestra.run.trial025.stdout:Description : 2026-02-12T12:46:04.361 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:46:04.361 INFO:teuthology.orchestra.run.trial025.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T12:46:04.361 INFO:teuthology.orchestra.run.trial025.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T12:46:04.361 INFO:teuthology.orchestra.run.trial025.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T12:46:04.361 INFO:teuthology.orchestra.run.trial025.stdout:hardware devices. 2026-02-12T12:46:04.361 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:46:04.362 INFO:teuthology.orchestra.run.trial025.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T12:46:04.363 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T12:46:04.363 INFO:teuthology.task.kernel:Updating grub on trial025 to boot 5.14.0-677.el9.x86_64 2026-02-12T12:46:04.363 DEBUG:teuthology.orchestra.run.trial025:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T12:46:04.426 INFO:teuthology.orchestra.run.trial025.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T12:46:04.428 DEBUG:teuthology.orchestra.run.trial025:> sudo command -v grubby && echo yes || echo no 2026-02-12T12:46:04.491 INFO:teuthology.orchestra.run.trial025.stdout:/sbin/grubby 2026-02-12T12:46:04.493 INFO:teuthology.orchestra.run.trial025.stdout:yes 2026-02-12T12:46:04.493 DEBUG:teuthology.orchestra.run.trial025:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T12:46:04.558 INFO:teuthology.orchestra.run.trial025.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T12:46:04.559 DEBUG:teuthology.orchestra.run.trial025:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T12:46:04.633 DEBUG:teuthology.orchestra.run.trial025:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T12:46:04.843 INFO:teuthology.orchestra.run.trial025.stderr:Generating grub configuration file ... 2026-02-12T12:46:04.908 INFO:teuthology.orchestra.run.trial025.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T12:46:04.914 INFO:teuthology.orchestra.run.trial025.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T12:46:05.167 INFO:teuthology.orchestra.run.trial025.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T12:46:05.173 INFO:teuthology.orchestra.run.trial025.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T12:46:05.204 INFO:teuthology.orchestra.run.trial025.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T12:46:05.211 INFO:teuthology.orchestra.run.trial025.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T12:46:05.234 INFO:teuthology.orchestra.run.trial025.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T12:46:05.240 INFO:teuthology.orchestra.run.trial025.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T12:46:05.322 INFO:teuthology.orchestra.run.trial025.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T12:46:05.330 INFO:teuthology.orchestra.run.trial025.stderr:done 2026-02-12T12:46:05.332 DEBUG:teuthology.orchestra.run.trial025:> test -d /sys/firmware/efi 2026-02-12T12:46:05.348 DEBUG:teuthology.orchestra.run.trial025:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T12:46:05.412 INFO:teuthology.orchestra.run.trial025.stdout:/boot/efi/EFI/BOOT 2026-02-12T12:46:05.413 INFO:teuthology.orchestra.run.trial025.stdout:/boot/efi/EFI/centos 2026-02-12T12:46:05.414 DEBUG:teuthology.orchestra.run.trial025:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T12:46:05.480 INFO:teuthology.orchestra.run.trial025.stdout:no 2026-02-12T12:46:05.480 DEBUG:teuthology.orchestra.run.trial025:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T12:46:05.543 INFO:teuthology.orchestra.run.trial025.stdout:yes 2026-02-12T12:46:05.544 DEBUG:teuthology.orchestra.run.trial025:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T12:46:05.609 DEBUG:teuthology.orchestra.run.trial025:> sudo shutdown -r now 2026-02-12T12:46:05.683 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T12:46:35.669 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T12:46:35.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial025.front.sepia.ceph.com' 2026-02-12T12:46:35.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T12:47:35.715 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T12:47:44.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial025.front.sepia.ceph.com' 2026-02-12T12:47:44.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T12:47:44.859 DEBUG:teuthology.orchestra.run.trial025:> true 2026-02-12T12:47:45.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial025.front.sepia.ceph.com' 2026-02-12T12:47:45.017 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T12:47:45.017 DEBUG:teuthology.orchestra.run.trial025:> uname -r 2026-02-12T12:47:45.075 INFO:teuthology.orchestra.run.trial025.stdout:5.14.0-677.el9.x86_64 2026-02-12T12:47:45.075 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T12:47:45.076 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T12:47:45.076 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T12:47:46.077 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-12T12:47:46.077 DEBUG:teuthology.orchestra.run.trial025:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T12:47:46.107 INFO:teuthology.orchestra.run.trial025.stdout:ttyS1 2026-02-12T12:47:46.131 DEBUG:teuthology.parallel:result is None 2026-02-12T12:47:46.132 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-12T12:47:46.145 INFO:teuthology.task.internal:Creating test directory... 2026-02-12T12:47:46.146 DEBUG:teuthology.orchestra.run.trial025:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T12:47:46.189 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-12T12:47:46.200 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-12T12:47:46.214 INFO:teuthology.task.internal:Creating archive directory... 2026-02-12T12:47:46.214 DEBUG:teuthology.orchestra.run.trial025:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T12:47:46.251 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-12T12:47:46.263 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-12T12:47:46.264 DEBUG:teuthology.orchestra.run.trial025:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T12:47:46.311 INFO:teuthology.orchestra.run.trial025.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T12:47:46.320 INFO:teuthology.orchestra.run.trial025.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T12:47:46.322 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-12T12:47:46.334 INFO:teuthology.task.internal:Configuring sudo... 2026-02-12T12:47:46.334 DEBUG:teuthology.orchestra.run.trial025:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T12:47:46.388 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-12T12:47:46.408 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-12T12:47:46.408 DEBUG:teuthology.orchestra.run.trial025:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T12:47:46.444 DEBUG:teuthology.orchestra.run.trial025:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T12:47:46.606 DEBUG:teuthology.orchestra.run.trial025:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T12:47:46.631 DEBUG:teuthology.orchestra.run.trial025:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T12:47:46.778 DEBUG:teuthology.orchestra.run.trial025:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T12:47:46.803 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:47:46.803 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T12:47:46.869 DEBUG:teuthology.orchestra.run.trial025:> sudo service rsyslog restart 2026-02-12T12:47:46.937 INFO:teuthology.orchestra.run.trial025.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T12:47:47.335 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-12T12:47:47.349 INFO:teuthology.task.internal:Starting timer... 2026-02-12T12:47:47.349 INFO:teuthology.run_tasks:Running task pcp... 2026-02-12T12:47:47.371 INFO:teuthology.run_tasks:Running task selinux... 2026-02-12T12:47:47.390 DEBUG:teuthology.orchestra.run.trial025:> sudo service auditd rotate 2026-02-12T12:47:47.420 INFO:teuthology.orchestra.run.trial025.stdout:Rotating logs: 2026-02-12T12:47:47.422 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-12T12:47:47.422 DEBUG:teuthology.orchestra.run.trial025:> /usr/sbin/getenforce 2026-02-12T12:47:47.479 INFO:teuthology.orchestra.run.trial025.stdout:Permissive 2026-02-12T12:47:47.480 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial025.front.sepia.ceph.com': 'permissive'} 2026-02-12T12:47:47.480 DEBUG:teuthology.orchestra.run.trial025:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T12:47:47.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T12:47:47.547 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-12T12:47:47.547 DEBUG:teuthology.orchestra.run.trial025:> sudo /usr/sbin/setenforce permissive 2026-02-12T12:47:47.612 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-12T12:47:47.630 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-12T12:47:47.633 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-12T12:47:47.761 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-12T12:47:47.771 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-12T12:47:47.772 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial025.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-12T12:48:58.731 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial025.front.sepia.ceph.com')] 2026-02-12T12:48:58.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial025.front.sepia.ceph.com' 2026-02-12T12:48:58.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T12:48:58.888 DEBUG:teuthology.orchestra.run.trial025:> true 2026-02-12T12:48:58.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial025.front.sepia.ceph.com' 2026-02-12T12:48:58.971 INFO:teuthology.run_tasks:Running task clock... 2026-02-12T12:48:58.981 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-12T12:48:58.981 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T12:48:58.982 DEBUG:teuthology.orchestra.run.trial025:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T12:48:59.038 INFO:teuthology.orchestra.run.trial025.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T12:48:59.049 INFO:teuthology.orchestra.run.trial025.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T12:48:59.069 INFO:teuthology.orchestra.run.trial025.stderr:sudo: ntpd: command not found 2026-02-12T12:48:59.078 INFO:teuthology.orchestra.run.trial025.stdout:506 Cannot talk to daemon 2026-02-12T12:48:59.089 INFO:teuthology.orchestra.run.trial025.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T12:48:59.100 INFO:teuthology.orchestra.run.trial025.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T12:48:59.144 INFO:teuthology.orchestra.run.trial025.stderr:bash: line 1: ntpq: command not found 2026-02-12T12:48:59.146 INFO:teuthology.orchestra.run.trial025.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T12:48:59.146 INFO:teuthology.orchestra.run.trial025.stdout:=============================================================================== 2026-02-12T12:48:59.147 INFO:teuthology.run_tasks:Running task install... 2026-02-12T12:48:59.162 DEBUG:teuthology.task.install:project ceph 2026-02-12T12:48:59.162 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}} 2026-02-12T12:48:59.162 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'} 2026-02-12T12:48:59.162 INFO:teuthology.task.install:Using flavor: debug 2026-02-12T12:48:59.171 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-12T12:48:59.171 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-12T12:48:59.172 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0', 'tag': None, 'wait_for_package': False} 2026-02-12T12:48:59.173 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T12:49:07.745 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/ 2026-02-12T12:49:07.745 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5145.g5fdb7d8f 2026-02-12T12:49:07.949 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T12:49:07.949 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:49:07.949 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T12:49:07.976 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-12T12:49:07.976 DEBUG:teuthology.orchestra.run.trial025:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T12:49:08.041 DEBUG:teuthology.orchestra.run.trial025:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T12:49:08.115 DEBUG:teuthology.orchestra.run.trial025:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T12:49:08.180 INFO:teuthology.orchestra.run.trial025.stdout:check_obsoletes = 1 2026-02-12T12:49:08.182 DEBUG:teuthology.orchestra.run.trial025:> sudo yum clean all 2026-02-12T12:49:08.334 INFO:teuthology.orchestra.run.trial025.stdout:41 files removed 2026-02-12T12:49:08.349 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-radosgw 2026-02-12T12:49:08.798 INFO:teuthology.orchestra.run.trial025.stdout:ceph packages for x86_64 310 kB/s | 94 kB 00:00 2026-02-12T12:49:09.097 INFO:teuthology.orchestra.run.trial025.stdout:ceph noarch packages 89 kB/s | 24 kB 00:00 2026-02-12T12:49:09.366 INFO:teuthology.orchestra.run.trial025.stdout:ceph source packages 8.4 kB/s | 2.1 kB 00:00 2026-02-12T12:49:10.813 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.9 MB 00:01 2026-02-12T12:49:14.027 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-12T12:49:17.969 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 7.8 MB 00:01 2026-02-12T12:49:22.892 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - Extras packages 4.8 kB/s | 20 kB 00:04 2026-02-12T12:49:28.357 INFO:teuthology.orchestra.run.trial025.stdout:Extra Packages for Enterprise Linux 3.8 MB/s | 20 MB 00:05 2026-02-12T12:49:31.546 INFO:teuthology.orchestra.run.trial025.stdout:lab-extras 2.1 MB/s | 50 kB 00:00 2026-02-12T12:49:32.820 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:49:32.821 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:49:32.821 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repository Size 2026-02-12T12:49:32.822 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:49:32.822 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T12:49:32.822 INFO:teuthology.orchestra.run.trial025.stdout: ceph-radosgw x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 11 M 2026-02-12T12:49:32.822 INFO:teuthology.orchestra.run.trial025.stdout:Upgrading: 2026-02-12T12:49:32.822 INFO:teuthology.orchestra.run.trial025.stdout: librados2 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 3.3 M 2026-02-12T12:49:32.822 INFO:teuthology.orchestra.run.trial025.stdout: librbd1 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 2.7 M 2026-02-12T12:49:32.822 INFO:teuthology.orchestra.run.trial025.stdout:Installing dependencies: 2026-02-12T12:49:32.822 INFO:teuthology.orchestra.run.trial025.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T12:49:32.822 INFO:teuthology.orchestra.run.trial025.stdout: ceph-base x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 5.1 M 2026-02-12T12:49:32.822 INFO:teuthology.orchestra.run.trial025.stdout: ceph-common x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 21 M 2026-02-12T12:49:32.823 INFO:teuthology.orchestra.run.trial025.stdout: ceph-selinux x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 25 k 2026-02-12T12:49:32.823 INFO:teuthology.orchestra.run.trial025.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T12:49:32.823 INFO:teuthology.orchestra.run.trial025.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T12:49:32.823 INFO:teuthology.orchestra.run.trial025.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T12:49:32.823 INFO:teuthology.orchestra.run.trial025.stdout: libcephfs2 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 860 k 2026-02-12T12:49:32.823 INFO:teuthology.orchestra.run.trial025.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T12:49:32.823 INFO:teuthology.orchestra.run.trial025.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T12:49:32.823 INFO:teuthology.orchestra.run.trial025.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T12:49:32.823 INFO:teuthology.orchestra.run.trial025.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T12:49:32.823 INFO:teuthology.orchestra.run.trial025.stdout: libradosstriper1 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 263 k 2026-02-12T12:49:32.823 INFO:teuthology.orchestra.run.trial025.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T12:49:32.823 INFO:teuthology.orchestra.run.trial025.stdout: librgw2 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 5.6 M 2026-02-12T12:49:32.824 INFO:teuthology.orchestra.run.trial025.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T12:49:32.824 INFO:teuthology.orchestra.run.trial025.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T12:49:32.824 INFO:teuthology.orchestra.run.trial025.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T12:49:32.824 INFO:teuthology.orchestra.run.trial025.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T12:49:32.824 INFO:teuthology.orchestra.run.trial025.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T12:49:32.824 INFO:teuthology.orchestra.run.trial025.stdout: python3-ceph-argparse x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 45 k 2026-02-12T12:49:32.824 INFO:teuthology.orchestra.run.trial025.stdout: python3-ceph-common x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 184 k 2026-02-12T12:49:32.824 INFO:teuthology.orchestra.run.trial025.stdout: python3-cephfs x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 203 k 2026-02-12T12:49:32.824 INFO:teuthology.orchestra.run.trial025.stdout: python3-rados x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 324 k 2026-02-12T12:49:32.824 INFO:teuthology.orchestra.run.trial025.stdout: python3-rbd x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 305 k 2026-02-12T12:49:32.824 INFO:teuthology.orchestra.run.trial025.stdout: python3-rgw x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 100 k 2026-02-12T12:49:32.824 INFO:teuthology.orchestra.run.trial025.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T12:49:32.824 INFO:teuthology.orchestra.run.trial025.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T12:49:32.825 INFO:teuthology.orchestra.run.trial025.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T12:49:32.825 INFO:teuthology.orchestra.run.trial025.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T12:49:32.825 INFO:teuthology.orchestra.run.trial025.stdout:Installing weak dependencies: 2026-02-12T12:49:32.825 INFO:teuthology.orchestra.run.trial025.stdout: libcephfs-daemon x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 35 k 2026-02-12T12:49:32.825 INFO:teuthology.orchestra.run.trial025.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 24 k 2026-02-12T12:49:32.825 INFO:teuthology.orchestra.run.trial025.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-12T12:49:32.825 INFO:teuthology.orchestra.run.trial025.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T12:49:32.825 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:49:32.825 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T12:49:32.825 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:49:32.825 INFO:teuthology.orchestra.run.trial025.stdout:Install 35 Packages 2026-02-12T12:49:32.825 INFO:teuthology.orchestra.run.trial025.stdout:Upgrade 2 Packages 2026-02-12T12:49:32.826 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:49:32.826 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 61 M 2026-02-12T12:49:32.826 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T12:49:33.945 INFO:teuthology.orchestra.run.trial025.stdout:(1/37): ceph-base-20.3.0-5145.g5fdb7d8f.el9.x86 12 MB/s | 5.1 MB 00:00 2026-02-12T12:49:33.997 INFO:teuthology.orchestra.run.trial025.stdout:(2/37): ceph-selinux-20.3.0-5145.g5fdb7d8f.el9. 477 kB/s | 25 kB 00:00 2026-02-12T12:49:34.050 INFO:teuthology.orchestra.run.trial025.stdout:(3/37): libcephfs-daemon-20.3.0-5145.g5fdb7d8f. 663 kB/s | 35 kB 00:00 2026-02-12T12:49:34.114 INFO:teuthology.orchestra.run.trial025.stdout:(4/37): libcephfs-proxy2-20.3.0-5145.g5fdb7d8f. 375 kB/s | 24 kB 00:00 2026-02-12T12:49:34.162 INFO:teuthology.orchestra.run.trial025.stdout:(5/37): ceph-radosgw-20.3.0-5145.g5fdb7d8f.el9. 17 MB/s | 11 MB 00:00 2026-02-12T12:49:34.183 INFO:teuthology.orchestra.run.trial025.stdout:(6/37): libcephfs2-20.3.0-5145.g5fdb7d8f.el9.x8 12 MB/s | 860 kB 00:00 2026-02-12T12:49:34.221 INFO:teuthology.orchestra.run.trial025.stdout:(7/37): libradosstriper1-20.3.0-5145.g5fdb7d8f. 4.3 MB/s | 263 kB 00:00 2026-02-12T12:49:34.282 INFO:teuthology.orchestra.run.trial025.stdout:(8/37): python3-ceph-argparse-20.3.0-5145.g5fdb 739 kB/s | 45 kB 00:00 2026-02-12T12:49:34.350 INFO:teuthology.orchestra.run.trial025.stdout:(9/37): python3-ceph-common-20.3.0-5145.g5fdb7d 2.7 MB/s | 184 kB 00:00 2026-02-12T12:49:34.421 INFO:teuthology.orchestra.run.trial025.stdout:(10/37): python3-cephfs-20.3.0-5145.g5fdb7d8f.e 2.8 MB/s | 203 kB 00:00 2026-02-12T12:49:34.492 INFO:teuthology.orchestra.run.trial025.stdout:(11/37): python3-rados-20.3.0-5145.g5fdb7d8f.el 4.5 MB/s | 324 kB 00:00 2026-02-12T12:49:34.554 INFO:teuthology.orchestra.run.trial025.stdout:(12/37): python3-rbd-20.3.0-5145.g5fdb7d8f.el9. 4.8 MB/s | 305 kB 00:00 2026-02-12T12:49:34.561 INFO:teuthology.orchestra.run.trial025.stdout:(13/37): librgw2-20.3.0-5145.g5fdb7d8f.el9.x86_ 15 MB/s | 5.6 MB 00:00 2026-02-12T12:49:34.580 INFO:teuthology.orchestra.run.trial025.stdout:(14/37): python3-rgw-20.3.0-5145.g5fdb7d8f.el9. 3.7 MB/s | 100 kB 00:00 2026-02-12T12:49:34.665 INFO:teuthology.orchestra.run.trial025.stdout:(15/37): ceph-common-20.3.0-5145.g5fdb7d8f.el9. 18 MB/s | 21 MB 00:01 2026-02-12T12:49:34.986 INFO:teuthology.orchestra.run.trial025.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 78 kB/s | 33 kB 00:00 2026-02-12T12:49:35.108 INFO:teuthology.orchestra.run.trial025.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 851 kB/s | 104 kB 00:00 2026-02-12T12:49:35.163 INFO:teuthology.orchestra.run.trial025.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 2.9 MB/s | 164 kB 00:00 2026-02-12T12:49:35.198 INFO:teuthology.orchestra.run.trial025.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.5 MB/s | 160 kB 00:00 2026-02-12T12:49:35.211 INFO:teuthology.orchestra.run.trial025.stdout:(20/37): pciutils-3.7.0-7.el9.x86_64.rpm 173 kB/s | 93 kB 00:00 2026-02-12T12:49:35.224 INFO:teuthology.orchestra.run.trial025.stdout:(21/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 45 kB 00:00 2026-02-12T12:49:35.268 INFO:teuthology.orchestra.run.trial025.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 292 kB 00:00 2026-02-12T12:49:35.304 INFO:teuthology.orchestra.run.trial025.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 6.5 MB/s | 240 kB 00:00 2026-02-12T12:49:35.329 INFO:teuthology.orchestra.run.trial025.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.4 MB/s | 37 kB 00:00 2026-02-12T12:49:35.356 INFO:teuthology.orchestra.run.trial025.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.4 MB/s | 66 kB 00:00 2026-02-12T12:49:35.396 INFO:teuthology.orchestra.run.trial025.stdout:(26/37): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 662 kB 00:00 2026-02-12T12:49:40.055 INFO:teuthology.orchestra.run.trial025.stdout:(27/37): nvme-cli-2.13-1.el9.x86_64.rpm 205 kB/s | 1.1 MB 00:05 2026-02-12T12:49:40.090 INFO:teuthology.orchestra.run.trial025.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 746 kB/s | 25 kB 00:00 2026-02-12T12:49:40.108 INFO:teuthology.orchestra.run.trial025.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 2.6 MB/s | 49 kB 00:00 2026-02-12T12:49:40.121 INFO:teuthology.orchestra.run.trial025.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 5.0 MB/s | 67 kB 00:00 2026-02-12T12:49:40.125 INFO:teuthology.orchestra.run.trial025.stdout:(31/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 64 kB/s | 308 kB 00:04 2026-02-12T12:49:40.138 INFO:teuthology.orchestra.run.trial025.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 14 MB/s | 191 kB 00:00 2026-02-12T12:49:40.159 INFO:teuthology.orchestra.run.trial025.stdout:(33/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 22 MB/s | 838 kB 00:00 2026-02-12T12:49:40.169 INFO:teuthology.orchestra.run.trial025.stdout:(34/37): libarrow-9.0.0-15.el9.x86_64.rpm 946 kB/s | 4.4 MB 00:04 2026-02-12T12:49:40.182 INFO:teuthology.orchestra.run.trial025.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 37 MB/s | 1.6 MB 00:00 2026-02-12T12:49:40.308 INFO:teuthology.orchestra.run.trial025.stdout:(36/37): librbd1-20.3.0-5145.g5fdb7d8f.el9.x86_ 19 MB/s | 2.7 MB 00:00 2026-02-12T12:49:40.312 INFO:teuthology.orchestra.run.trial025.stdout:(37/37): librados2-20.3.0-5145.g5fdb7d8f.el9.x8 21 MB/s | 3.3 MB 00:00 2026-02-12T12:49:40.315 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:49:40.315 INFO:teuthology.orchestra.run.trial025.stdout:Total 8.2 MB/s | 61 MB 00:07 2026-02-12T12:49:40.417 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T12:49:40.437 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T12:49:40.437 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T12:49:40.685 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T12:49:40.686 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T12:49:40.975 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T12:49:41.119 INFO:teuthology.orchestra.run.trial025.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-12T12:49:41.124 INFO:teuthology.orchestra.run.trial025.stdout: Upgrading : librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/39 2026-02-12T12:49:41.174 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/39 2026-02-12T12:49:41.175 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 3/39 2026-02-12T12:49:41.187 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 3/39 2026-02-12T12:49:41.190 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libcephfs-daemon-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 4/39 2026-02-12T12:49:41.190 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libcephfs-proxy2-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 5/39 2026-02-12T12:49:41.219 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 5/39 2026-02-12T12:49:41.221 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 6/39 2026-02-12T12:49:41.228 INFO:teuthology.orchestra.run.trial025.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-12T12:49:41.231 INFO:teuthology.orchestra.run.trial025.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-12T12:49:41.234 INFO:teuthology.orchestra.run.trial025.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-12T12:49:41.238 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-12T12:49:41.251 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-ceph-argparse-2:20.3.0-5145.g5fdb7d8f.el9. 11/39 2026-02-12T12:49:41.264 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 12/39 2026-02-12T12:49:41.265 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libradosstriper1-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 13/39 2026-02-12T12:49:41.287 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 13/39 2026-02-12T12:49:41.291 INFO:teuthology.orchestra.run.trial025.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-12T12:49:41.321 INFO:teuthology.orchestra.run.trial025.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-12T12:49:41.325 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-12T12:49:41.331 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-12T12:49:41.333 INFO:teuthology.orchestra.run.trial025.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-12T12:49:41.338 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-12T12:49:41.454 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T12:49:41.456 INFO:teuthology.orchestra.run.trial025.stdout: Upgrading : librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 21/39 2026-02-12T12:49:41.482 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 21/39 2026-02-12T12:49:41.484 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 22/39 2026-02-12T12:49:41.492 INFO:teuthology.orchestra.run.trial025.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-12T12:49:41.745 INFO:teuthology.orchestra.run.trial025.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-12T12:49:41.746 INFO:teuthology.orchestra.run.trial025.stdout: Installing : librgw2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 25/39 2026-02-12T12:49:41.762 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: librgw2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 25/39 2026-02-12T12:49:41.766 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 26/39 2026-02-12T12:49:41.770 INFO:teuthology.orchestra.run.trial025.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-12T12:49:41.772 INFO:teuthology.orchestra.run.trial025.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-12T12:49:41.773 INFO:teuthology.orchestra.run.trial025.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T12:49:41.790 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T12:49:41.901 INFO:teuthology.orchestra.run.trial025.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-12T12:49:41.903 INFO:teuthology.orchestra.run.trial025.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T12:49:42.184 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T12:49:42.185 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T12:49:42.185 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:49:42.228 INFO:teuthology.orchestra.run.trial025.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-12T12:49:42.230 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x8 33/39 2026-02-12T12:49:43.193 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 34/39 2026-02-12T12:49:43.195 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 34/39 2026-02-12T12:49:43.460 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 34/39 2026-02-12T12:49:43.463 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 35/39 2026-02-12T12:49:43.500 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 35/39 2026-02-12T12:49:43.500 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T12:49:43.500 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T12:49:43.500 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:49:43.503 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-selinux-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 36/39 2026-02-12T12:49:48.000 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 36/39 2026-02-12T12:49:48.001 INFO:teuthology.orchestra.run.trial025.stdout:skipping the directory /sys 2026-02-12T12:49:48.001 INFO:teuthology.orchestra.run.trial025.stdout:skipping the directory /proc 2026-02-12T12:49:48.001 INFO:teuthology.orchestra.run.trial025.stdout:skipping the directory /mnt 2026-02-12T12:49:48.001 INFO:teuthology.orchestra.run.trial025.stdout:skipping the directory /var/tmp 2026-02-12T12:49:48.001 INFO:teuthology.orchestra.run.trial025.stdout:skipping the directory /home 2026-02-12T12:49:48.001 INFO:teuthology.orchestra.run.trial025.stdout:skipping the directory /root 2026-02-12T12:49:48.001 INFO:teuthology.orchestra.run.trial025.stdout:skipping the directory /tmp 2026-02-12T12:49:48.001 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:49:48.502 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 37/39 2026-02-12T12:49:48.525 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 37/39 2026-02-12T12:49:48.525 INFO:teuthology.orchestra.run.trial025.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T12:49:48.525 INFO:teuthology.orchestra.run.trial025.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T12:49:48.525 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T12:49:48.525 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T12:49:48.525 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:49:48.527 INFO:teuthology.orchestra.run.trial025.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T12:49:48.540 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T12:49:48.540 INFO:teuthology.orchestra.run.trial025.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T12:49:48.596 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T12:49:48.596 INFO:teuthology.orchestra.run.trial025.stdout:Creating group 'qat' with GID 992. 2026-02-12T12:49:48.596 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:49:48.883 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/39 2026-02-12T12:49:48.884 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/39 2026-02-12T12:49:48.884 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 3/39 2026-02-12T12:49:48.884 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-selinux-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 4/39 2026-02-12T12:49:48.884 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libcephfs-daemon-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 5/39 2026-02-12T12:49:48.884 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 6/39 2026-02-12T12:49:48.884 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 7/39 2026-02-12T12:49:48.884 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libradosstriper1-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 8/39 2026-02-12T12:49:48.884 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : librgw2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 9/39 2026-02-12T12:49:48.884 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5145.g5fdb7d8f.el9. 10/39 2026-02-12T12:49:48.885 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x8 11/39 2026-02-12T12:49:48.885 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 12/39 2026-02-12T12:49:48.885 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 13/39 2026-02-12T12:49:48.885 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 14/39 2026-02-12T12:49:48.885 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 15/39 2026-02-12T12:49:48.885 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-12T12:49:48.885 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-12T12:49:48.885 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-12T12:49:48.885 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-12T12:49:48.885 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T12:49:48.885 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-12T12:49:48.885 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-12T12:49:48.886 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-12T12:49:48.886 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-12T12:49:48.886 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-12T12:49:48.886 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-12T12:49:48.886 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-12T12:49:48.886 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-12T12:49:48.886 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-12T12:49:48.886 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-12T12:49:48.886 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-12T12:49:48.886 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-12T12:49:48.886 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-12T12:49:48.887 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-12T12:49:48.887 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-12T12:49:48.887 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 36/39 2026-02-12T12:49:48.887 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-12T12:49:48.887 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 38/39 2026-02-12T12:49:48.944 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T12:49:48.945 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:49:48.945 INFO:teuthology.orchestra.run.trial025.stdout:Upgraded: 2026-02-12T12:49:48.945 INFO:teuthology.orchestra.run.trial025.stdout: librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:48.945 INFO:teuthology.orchestra.run.trial025.stdout: librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:48.945 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T12:49:48.945 INFO:teuthology.orchestra.run.trial025.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T12:49:48.945 INFO:teuthology.orchestra.run.trial025.stdout: ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:48.945 INFO:teuthology.orchestra.run.trial025.stdout: ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:48.945 INFO:teuthology.orchestra.run.trial025.stdout: ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:48.946 INFO:teuthology.orchestra.run.trial025.stdout: ceph-selinux-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:48.946 INFO:teuthology.orchestra.run.trial025.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T12:49:48.946 INFO:teuthology.orchestra.run.trial025.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T12:49:48.946 INFO:teuthology.orchestra.run.trial025.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T12:49:48.946 INFO:teuthology.orchestra.run.trial025.stdout: libcephfs-daemon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:48.946 INFO:teuthology.orchestra.run.trial025.stdout: libcephfs-proxy2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:48.946 INFO:teuthology.orchestra.run.trial025.stdout: libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:48.946 INFO:teuthology.orchestra.run.trial025.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T12:49:48.946 INFO:teuthology.orchestra.run.trial025.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T12:49:48.946 INFO:teuthology.orchestra.run.trial025.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T12:49:48.946 INFO:teuthology.orchestra.run.trial025.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T12:49:48.946 INFO:teuthology.orchestra.run.trial025.stdout: libradosstriper1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:48.947 INFO:teuthology.orchestra.run.trial025.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T12:49:48.947 INFO:teuthology.orchestra.run.trial025.stdout: librgw2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:48.947 INFO:teuthology.orchestra.run.trial025.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T12:49:48.947 INFO:teuthology.orchestra.run.trial025.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T12:49:48.947 INFO:teuthology.orchestra.run.trial025.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T12:49:48.947 INFO:teuthology.orchestra.run.trial025.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-12T12:49:48.947 INFO:teuthology.orchestra.run.trial025.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T12:49:48.947 INFO:teuthology.orchestra.run.trial025.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T12:49:48.947 INFO:teuthology.orchestra.run.trial025.stdout: python3-ceph-argparse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:48.947 INFO:teuthology.orchestra.run.trial025.stdout: python3-ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:48.948 INFO:teuthology.orchestra.run.trial025.stdout: python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:48.948 INFO:teuthology.orchestra.run.trial025.stdout: python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:48.948 INFO:teuthology.orchestra.run.trial025.stdout: python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:48.948 INFO:teuthology.orchestra.run.trial025.stdout: python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:48.948 INFO:teuthology.orchestra.run.trial025.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T12:49:48.948 INFO:teuthology.orchestra.run.trial025.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T12:49:48.948 INFO:teuthology.orchestra.run.trial025.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T12:49:48.948 INFO:teuthology.orchestra.run.trial025.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T12:49:48.948 INFO:teuthology.orchestra.run.trial025.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T12:49:48.948 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:49:48.948 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:49:48.990 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-test 2026-02-12T12:49:49.290 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:18 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:49:49.373 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:49:49.374 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:49:49.374 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repository Size 2026-02-12T12:49:49.375 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:49:49.375 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T12:49:49.375 INFO:teuthology.orchestra.run.trial025.stdout: ceph-test x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 126 M 2026-02-12T12:49:49.375 INFO:teuthology.orchestra.run.trial025.stdout:Installing dependencies: 2026-02-12T12:49:49.375 INFO:teuthology.orchestra.run.trial025.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-12T12:49:49.375 INFO:teuthology.orchestra.run.trial025.stdout: libasan8 x86_64 15.1.1-2.5.el9 appstream 523 k 2026-02-12T12:49:49.375 INFO:teuthology.orchestra.run.trial025.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-12T12:49:49.375 INFO:teuthology.orchestra.run.trial025.stdout: libcephsqlite x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 153 k 2026-02-12T12:49:49.375 INFO:teuthology.orchestra.run.trial025.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-12T12:49:49.375 INFO:teuthology.orchestra.run.trial025.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T12:49:49.375 INFO:teuthology.orchestra.run.trial025.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-12T12:49:49.376 INFO:teuthology.orchestra.run.trial025.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T12:49:49.376 INFO:teuthology.orchestra.run.trial025.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T12:49:49.376 INFO:teuthology.orchestra.run.trial025.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T12:49:49.376 INFO:teuthology.orchestra.run.trial025.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-12T12:49:49.376 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:49:49.376 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T12:49:49.376 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:49:49.376 INFO:teuthology.orchestra.run.trial025.stdout:Install 12 Packages 2026-02-12T12:49:49.376 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:49:49.377 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 131 M 2026-02-12T12:49:49.377 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 977 M 2026-02-12T12:49:49.377 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T12:49:50.011 INFO:teuthology.orchestra.run.trial025.stdout:(1/12): libcephsqlite-20.3.0-5145.g5fdb7d8f.el9 401 kB/s | 153 kB 00:00 2026-02-12T12:49:50.058 INFO:teuthology.orchestra.run.trial025.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 490 kB/s | 23 kB 00:00 2026-02-12T12:49:50.101 INFO:teuthology.orchestra.run.trial025.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 2.1 MB/s | 94 kB 00:00 2026-02-12T12:49:50.165 INFO:teuthology.orchestra.run.trial025.stdout:(4/12): libasan8-15.1.1-2.5.el9.x86_64.rpm 8.0 MB/s | 523 kB 00:00 2026-02-12T12:49:50.175 INFO:teuthology.orchestra.run.trial025.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 17 MB/s | 176 kB 00:00 2026-02-12T12:49:50.184 INFO:teuthology.orchestra.run.trial025.stdout:(6/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 3.8 MB/s | 2.1 MB 00:00 2026-02-12T12:49:50.185 INFO:teuthology.orchestra.run.trial025.stdout:(7/12): libxslt-1.1.34-12.el9.x86_64.rpm 22 MB/s | 233 kB 00:00 2026-02-12T12:49:50.199 INFO:teuthology.orchestra.run.trial025.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 22 MB/s | 303 kB 00:00 2026-02-12T12:49:50.207 INFO:teuthology.orchestra.run.trial025.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 7.3 MB/s | 64 kB 00:00 2026-02-12T12:49:50.244 INFO:teuthology.orchestra.run.trial025.stdout:(10/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 3.3 MB/s | 122 kB 00:00 2026-02-12T12:49:50.258 INFO:teuthology.orchestra.run.trial025.stdout:(11/12): protobuf-3.14.0-17.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2026-02-12T12:49:57.371 INFO:teuthology.orchestra.run.trial025.stdout:(12/12): ceph-test-20.3.0-5145.g5fdb7d8f.el9.x8 16 MB/s | 126 MB 00:07 2026-02-12T12:49:57.372 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:49:57.372 INFO:teuthology.orchestra.run.trial025.stdout:Total 16 MB/s | 131 MB 00:07 2026-02-12T12:49:57.454 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T12:49:57.466 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T12:49:57.466 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T12:49:57.892 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T12:49:57.893 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T12:49:58.344 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T12:49:58.353 INFO:teuthology.orchestra.run.trial025.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-12T12:49:58.362 INFO:teuthology.orchestra.run.trial025.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-12T12:49:58.368 INFO:teuthology.orchestra.run.trial025.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-12T12:49:58.373 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-12T12:49:58.376 INFO:teuthology.orchestra.run.trial025.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-12T12:49:58.380 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-12T12:49:58.381 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libasan8-15.1.1-2.5.el9.x86_64 7/12 2026-02-12T12:49:58.400 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: libasan8-15.1.1-2.5.el9.x86_64 7/12 2026-02-12T12:49:58.402 INFO:teuthology.orchestra.run.trial025.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-12T12:49:58.413 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-12T12:49:58.422 INFO:teuthology.orchestra.run.trial025.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-12T12:49:58.423 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libcephsqlite-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 11/12 2026-02-12T12:50:05.306 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 11/12 2026-02-12T12:50:05.324 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 12/12 2026-02-12T12:50:06.113 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 12/12 2026-02-12T12:50:06.113 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/12 2026-02-12T12:50:06.114 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libcephsqlite-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/12 2026-02-12T12:50:06.114 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-12T12:50:06.114 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-12T12:50:06.114 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-12T12:50:06.114 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libasan8-15.1.1-2.5.el9.x86_64 6/12 2026-02-12T12:50:06.114 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-12T12:50:06.114 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-12T12:50:06.114 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-12T12:50:06.114 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-12T12:50:06.114 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-12T12:50:06.166 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-12T12:50:06.166 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:06.166 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T12:50:06.166 INFO:teuthology.orchestra.run.trial025.stdout: ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:50:06.166 INFO:teuthology.orchestra.run.trial025.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-12T12:50:06.167 INFO:teuthology.orchestra.run.trial025.stdout: libasan8-15.1.1-2.5.el9.x86_64 2026-02-12T12:50:06.167 INFO:teuthology.orchestra.run.trial025.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-12T12:50:06.167 INFO:teuthology.orchestra.run.trial025.stdout: libcephsqlite-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:50:06.167 INFO:teuthology.orchestra.run.trial025.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-12T12:50:06.167 INFO:teuthology.orchestra.run.trial025.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T12:50:06.167 INFO:teuthology.orchestra.run.trial025.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-12T12:50:06.167 INFO:teuthology.orchestra.run.trial025.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T12:50:06.167 INFO:teuthology.orchestra.run.trial025.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T12:50:06.167 INFO:teuthology.orchestra.run.trial025.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T12:50:06.167 INFO:teuthology.orchestra.run.trial025.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-12T12:50:06.167 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:06.167 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:06.209 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph 2026-02-12T12:50:06.504 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:35 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:06.590 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:06.593 INFO:teuthology.orchestra.run.trial025.stdout:======================================================================================= 2026-02-12T12:50:06.593 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repository Size 2026-02-12T12:50:06.593 INFO:teuthology.orchestra.run.trial025.stdout:======================================================================================= 2026-02-12T12:50:06.593 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T12:50:06.593 INFO:teuthology.orchestra.run.trial025.stdout: ceph x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 6.5 k 2026-02-12T12:50:06.594 INFO:teuthology.orchestra.run.trial025.stdout:Installing dependencies: 2026-02-12T12:50:06.594 INFO:teuthology.orchestra.run.trial025.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T12:50:06.594 INFO:teuthology.orchestra.run.trial025.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 57 k 2026-02-12T12:50:06.594 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mds x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 2.0 M 2026-02-12T12:50:06.594 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 937 k 2026-02-12T12:50:06.594 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 297 k 2026-02-12T12:50:06.594 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mon x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 4.8 M 2026-02-12T12:50:06.594 INFO:teuthology.orchestra.run.trial025.stdout: ceph-osd x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 163 k 2026-02-12T12:50:06.594 INFO:teuthology.orchestra.run.trial025.stdout: ceph-osd-classic x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 15 M 2026-02-12T12:50:06.594 INFO:teuthology.orchestra.run.trial025.stdout: ceph-osd-crimson x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 87 M 2026-02-12T12:50:06.594 INFO:teuthology.orchestra.run.trial025.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 17 k 2026-02-12T12:50:06.595 INFO:teuthology.orchestra.run.trial025.stdout: cephadm noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 1.0 M 2026-02-12T12:50:06.595 INFO:teuthology.orchestra.run.trial025.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T12:50:06.595 INFO:teuthology.orchestra.run.trial025.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T12:50:06.595 INFO:teuthology.orchestra.run.trial025.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T12:50:06.595 INFO:teuthology.orchestra.run.trial025.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T12:50:06.595 INFO:teuthology.orchestra.run.trial025.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T12:50:06.595 INFO:teuthology.orchestra.run.trial025.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T12:50:06.595 INFO:teuthology.orchestra.run.trial025.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T12:50:06.595 INFO:teuthology.orchestra.run.trial025.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T12:50:06.595 INFO:teuthology.orchestra.run.trial025.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T12:50:06.595 INFO:teuthology.orchestra.run.trial025.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T12:50:06.595 INFO:teuthology.orchestra.run.trial025.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T12:50:06.596 INFO:teuthology.orchestra.run.trial025.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T12:50:06.596 INFO:teuthology.orchestra.run.trial025.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T12:50:06.596 INFO:teuthology.orchestra.run.trial025.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T12:50:06.596 INFO:teuthology.orchestra.run.trial025.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T12:50:06.596 INFO:teuthology.orchestra.run.trial025.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T12:50:06.596 INFO:teuthology.orchestra.run.trial025.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T12:50:06.596 INFO:teuthology.orchestra.run.trial025.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T12:50:06.596 INFO:teuthology.orchestra.run.trial025.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T12:50:06.596 INFO:teuthology.orchestra.run.trial025.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T12:50:06.596 INFO:teuthology.orchestra.run.trial025.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T12:50:06.596 INFO:teuthology.orchestra.run.trial025.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T12:50:06.596 INFO:teuthology.orchestra.run.trial025.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T12:50:06.597 INFO:teuthology.orchestra.run.trial025.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T12:50:06.597 INFO:teuthology.orchestra.run.trial025.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T12:50:06.597 INFO:teuthology.orchestra.run.trial025.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T12:50:06.597 INFO:teuthology.orchestra.run.trial025.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T12:50:06.597 INFO:teuthology.orchestra.run.trial025.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T12:50:06.597 INFO:teuthology.orchestra.run.trial025.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T12:50:06.597 INFO:teuthology.orchestra.run.trial025.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T12:50:06.597 INFO:teuthology.orchestra.run.trial025.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T12:50:06.597 INFO:teuthology.orchestra.run.trial025.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-12T12:50:06.597 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T12:50:06.597 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T12:50:06.597 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-12T12:50:06.598 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T12:50:06.598 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T12:50:06.598 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T12:50:06.598 INFO:teuthology.orchestra.run.trial025.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T12:50:06.598 INFO:teuthology.orchestra.run.trial025.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T12:50:06.598 INFO:teuthology.orchestra.run.trial025.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T12:50:06.598 INFO:teuthology.orchestra.run.trial025.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T12:50:06.598 INFO:teuthology.orchestra.run.trial025.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-12T12:50:06.598 INFO:teuthology.orchestra.run.trial025.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T12:50:06.598 INFO:teuthology.orchestra.run.trial025.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T12:50:06.598 INFO:teuthology.orchestra.run.trial025.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-12T12:50:06.598 INFO:teuthology.orchestra.run.trial025.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T12:50:06.599 INFO:teuthology.orchestra.run.trial025.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T12:50:06.599 INFO:teuthology.orchestra.run.trial025.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T12:50:06.599 INFO:teuthology.orchestra.run.trial025.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T12:50:06.599 INFO:teuthology.orchestra.run.trial025.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T12:50:06.599 INFO:teuthology.orchestra.run.trial025.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T12:50:06.599 INFO:teuthology.orchestra.run.trial025.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T12:50:06.599 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T12:50:06.599 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T12:50:06.599 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T12:50:06.599 INFO:teuthology.orchestra.run.trial025.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T12:50:06.599 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T12:50:06.599 INFO:teuthology.orchestra.run.trial025.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T12:50:06.599 INFO:teuthology.orchestra.run.trial025.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T12:50:06.600 INFO:teuthology.orchestra.run.trial025.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T12:50:06.600 INFO:teuthology.orchestra.run.trial025.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T12:50:06.600 INFO:teuthology.orchestra.run.trial025.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T12:50:06.600 INFO:teuthology.orchestra.run.trial025.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T12:50:06.600 INFO:teuthology.orchestra.run.trial025.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T12:50:06.600 INFO:teuthology.orchestra.run.trial025.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T12:50:06.600 INFO:teuthology.orchestra.run.trial025.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T12:50:06.600 INFO:teuthology.orchestra.run.trial025.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T12:50:06.600 INFO:teuthology.orchestra.run.trial025.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T12:50:06.600 INFO:teuthology.orchestra.run.trial025.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-12T12:50:06.600 INFO:teuthology.orchestra.run.trial025.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T12:50:06.600 INFO:teuthology.orchestra.run.trial025.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T12:50:06.601 INFO:teuthology.orchestra.run.trial025.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T12:50:06.601 INFO:teuthology.orchestra.run.trial025.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-12T12:50:06.601 INFO:teuthology.orchestra.run.trial025.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-12T12:50:06.601 INFO:teuthology.orchestra.run.trial025.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T12:50:06.601 INFO:teuthology.orchestra.run.trial025.stdout:Installing weak dependencies: 2026-02-12T12:50:06.601 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 183 k 2026-02-12T12:50:06.601 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 15 M 2026-02-12T12:50:06.601 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 7.4 M 2026-02-12T12:50:06.601 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 22 k 2026-02-12T12:50:06.601 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-rook noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 50 k 2026-02-12T12:50:06.601 INFO:teuthology.orchestra.run.trial025.stdout: ceph-volume noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 299 k 2026-02-12T12:50:06.601 INFO:teuthology.orchestra.run.trial025.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-12T12:50:06.601 INFO:teuthology.orchestra.run.trial025.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-12T12:50:06.602 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:06.602 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T12:50:06.602 INFO:teuthology.orchestra.run.trial025.stdout:======================================================================================= 2026-02-12T12:50:06.602 INFO:teuthology.orchestra.run.trial025.stdout:Install 96 Packages 2026-02-12T12:50:06.602 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:06.603 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 189 M 2026-02-12T12:50:06.603 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 1.4 G 2026-02-12T12:50:06.603 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T12:50:07.177 INFO:teuthology.orchestra.run.trial025.stdout:(1/96): ceph-20.3.0-5145.g5fdb7d8f.el9.x86_64.r 130 kB/s | 6.5 kB 00:00 2026-02-12T12:50:07.263 INFO:teuthology.orchestra.run.trial025.stdout:(2/96): ceph-mgr-20.3.0-5145.g5fdb7d8f.el9.x86_ 6.7 MB/s | 937 kB 00:00 2026-02-12T12:50:07.280 INFO:teuthology.orchestra.run.trial025.stdout:(3/96): ceph-mds-20.3.0-5145.g5fdb7d8f.el9.x86_ 13 MB/s | 2.0 MB 00:00 2026-02-12T12:50:07.284 INFO:teuthology.orchestra.run.trial025.stdout:(4/96): ceph-osd-20.3.0-5145.g5fdb7d8f.el9.x86_ 7.6 MB/s | 163 kB 00:00 2026-02-12T12:50:07.464 INFO:teuthology.orchestra.run.trial025.stdout:(5/96): ceph-mon-20.3.0-5145.g5fdb7d8f.el9.x86_ 17 MB/s | 4.8 MB 00:00 2026-02-12T12:50:07.514 INFO:teuthology.orchestra.run.trial025.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5145.g5f 1.1 MB/s | 57 kB 00:00 2026-02-12T12:50:07.567 INFO:teuthology.orchestra.run.trial025.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5145.g5fdb7d8f. 3.4 MB/s | 183 kB 00:00 2026-02-12T12:50:07.871 INFO:teuthology.orchestra.run.trial025.stdout:(8/96): ceph-osd-classic-20.3.0-5145.g5fdb7d8f. 25 MB/s | 15 MB 00:00 2026-02-12T12:50:08.177 INFO:teuthology.orchestra.run.trial025.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-51 24 MB/s | 7.4 MB 00:00 2026-02-12T12:50:08.202 INFO:teuthology.orchestra.run.trial025.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5145.g5fdb7d 898 kB/s | 22 kB 00:00 2026-02-12T12:50:08.238 INFO:teuthology.orchestra.run.trial025.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5145.g5fd 7.9 MB/s | 297 kB 00:00 2026-02-12T12:50:08.271 INFO:teuthology.orchestra.run.trial025.stdout:(12/96): ceph-mgr-rook-20.3.0-5145.g5fdb7d8f.el 1.5 MB/s | 50 kB 00:00 2026-02-12T12:50:08.303 INFO:teuthology.orchestra.run.trial025.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5145.g5f 543 kB/s | 17 kB 00:00 2026-02-12T12:50:08.340 INFO:teuthology.orchestra.run.trial025.stdout:(14/96): ceph-volume-20.3.0-5145.g5fdb7d8f.el9. 7.9 MB/s | 299 kB 00:00 2026-02-12T12:50:08.392 INFO:teuthology.orchestra.run.trial025.stdout:(15/96): cephadm-20.3.0-5145.g5fdb7d8f.el9.noar 20 MB/s | 1.0 MB 00:00 2026-02-12T12:50:08.443 INFO:teuthology.orchestra.run.trial025.stdout:(16/96): ceph-mgr-dashboard-20.3.0-5145.g5fdb7d 17 MB/s | 15 MB 00:00 2026-02-12T12:50:08.529 INFO:teuthology.orchestra.run.trial025.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 471 kB/s | 40 kB 00:00 2026-02-12T12:50:08.556 INFO:teuthology.orchestra.run.trial025.stdout:(18/96): cryptsetup-2.8.1-2.el9.x86_64.rpm 2.1 MB/s | 350 kB 00:00 2026-02-12T12:50:08.589 INFO:teuthology.orchestra.run.trial025.stdout:(19/96): libconfig-1.7.2-9.el9.x86_64.rpm 1.2 MB/s | 72 kB 00:00 2026-02-12T12:50:08.623 INFO:teuthology.orchestra.run.trial025.stdout:(20/96): libgfortran-11.5.0-14.el9.x86_64.rpm 12 MB/s | 794 kB 00:00 2026-02-12T12:50:08.650 INFO:teuthology.orchestra.run.trial025.stdout:(21/96): libquadmath-11.5.0-14.el9.x86_64.rpm 3.0 MB/s | 184 kB 00:00 2026-02-12T12:50:08.653 INFO:teuthology.orchestra.run.trial025.stdout:(22/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 8.3 MB/s | 253 kB 00:00 2026-02-12T12:50:08.680 INFO:teuthology.orchestra.run.trial025.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 3.9 MB/s | 106 kB 00:00 2026-02-12T12:50:08.707 INFO:teuthology.orchestra.run.trial025.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 4.9 MB/s | 135 kB 00:00 2026-02-12T12:50:08.735 INFO:teuthology.orchestra.run.trial025.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 5.4 MB/s | 150 kB 00:00 2026-02-12T12:50:08.751 INFO:teuthology.orchestra.run.trial025.stdout:(26/96): python3-cryptography-36.0.1-5.el9.x86_ 12 MB/s | 1.2 MB 00:00 2026-02-12T12:50:08.762 INFO:teuthology.orchestra.run.trial025.stdout:(27/96): python3-requests-2.25.1-10.el9.noarch. 4.5 MB/s | 126 kB 00:00 2026-02-12T12:50:08.780 INFO:teuthology.orchestra.run.trial025.stdout:(28/96): python3-urllib3-1.26.5-7.el9.noarch.rp 7.5 MB/s | 218 kB 00:00 2026-02-12T12:50:08.789 INFO:teuthology.orchestra.run.trial025.stdout:(29/96): unzip-6.0-59.el9.x86_64.rpm 6.4 MB/s | 182 kB 00:00 2026-02-12T12:50:08.811 INFO:teuthology.orchestra.run.trial025.stdout:(30/96): zip-3.0-35.el9.x86_64.rpm 8.2 MB/s | 266 kB 00:00 2026-02-12T12:50:09.348 INFO:teuthology.orchestra.run.trial025.stdout:(31/96): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2026-02-12T12:50:09.629 INFO:teuthology.orchestra.run.trial025.stdout:(32/96): ceph-osd-crimson-20.3.0-5145.g5fdb7d8f 37 MB/s | 87 MB 00:02 2026-02-12T12:50:09.900 INFO:teuthology.orchestra.run.trial025.stdout:(33/96): flexiblas-openblas-openmp-3.0.4-8.el9. 33 kB/s | 18 kB 00:00 2026-02-12T12:50:09.970 INFO:teuthology.orchestra.run.trial025.stdout:(34/96): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 2.6 MB/s | 3.0 MB 00:01 2026-02-12T12:50:10.395 INFO:teuthology.orchestra.run.trial025.stdout:(35/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 323 kB/s | 246 kB 00:00 2026-02-12T12:50:10.548 INFO:teuthology.orchestra.run.trial025.stdout:(36/96): openblas-0.3.29-1.el9.x86_64.rpm 73 kB/s | 42 kB 00:00 2026-02-12T12:50:10.637 INFO:teuthology.orchestra.run.trial025.stdout:(37/96): lua-5.4.4-4.el9.x86_64.rpm 256 kB/s | 188 kB 00:00 2026-02-12T12:50:11.397 INFO:teuthology.orchestra.run.trial025.stdout:(38/96): python3-devel-3.9.25-2.el9.x86_64.rpm 322 kB/s | 244 kB 00:00 2026-02-12T12:50:11.513 INFO:teuthology.orchestra.run.trial025.stdout:(39/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 4.7 MB/s | 5.3 MB 00:01 2026-02-12T12:50:11.684 INFO:teuthology.orchestra.run.trial025.stdout:(40/96): python3-babel-2.9.1-2.el9.noarch.rpm 5.3 MB/s | 6.0 MB 00:01 2026-02-12T12:50:12.098 INFO:teuthology.orchestra.run.trial025.stdout:(41/96): python3-jmespath-1.0.1-1.el9.noarch.rp 81 kB/s | 48 kB 00:00 2026-02-12T12:50:12.161 INFO:teuthology.orchestra.run.trial025.stdout:(42/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 325 kB/s | 249 kB 00:00 2026-02-12T12:50:12.418 INFO:teuthology.orchestra.run.trial025.stdout:(43/96): python3-libstoragemgmt-1.10.1-1.el9.x8 241 kB/s | 177 kB 00:00 2026-02-12T12:50:12.723 INFO:teuthology.orchestra.run.trial025.stdout:(44/96): python3-markupsafe-1.1.1-12.el9.x86_64 62 kB/s | 35 kB 00:00 2026-02-12T12:50:13.042 INFO:teuthology.orchestra.run.trial025.stdout:(45/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 1.3 MB/s | 1.2 MB 00:00 2026-02-12T12:50:13.546 INFO:teuthology.orchestra.run.trial025.stdout:(46/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 5.4 MB/s | 6.1 MB 00:01 2026-02-12T12:50:13.555 INFO:teuthology.orchestra.run.trial025.stdout:(47/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 532 kB/s | 442 kB 00:00 2026-02-12T12:50:13.675 INFO:teuthology.orchestra.run.trial025.stdout:(48/96): python3-packaging-20.9-5.el9.noarch.rp 122 kB/s | 77 kB 00:00 2026-02-12T12:50:14.277 INFO:teuthology.orchestra.run.trial025.stdout:(49/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 220 kB/s | 159 kB 00:00 2026-02-12T12:50:14.320 INFO:teuthology.orchestra.run.trial025.stdout:(50/96): python3-protobuf-3.14.0-17.el9.noarch. 345 kB/s | 267 kB 00:00 2026-02-12T12:50:14.456 INFO:teuthology.orchestra.run.trial025.stdout:(51/96): python3-pyasn1-modules-0.4.8-6.el9.noa 357 kB/s | 279 kB 00:00 2026-02-12T12:50:14.875 INFO:teuthology.orchestra.run.trial025.stdout:(52/96): python3-requests-oauthlib-1.3.0-12.el9 90 kB/s | 54 kB 00:00 2026-02-12T12:50:15.031 INFO:teuthology.orchestra.run.trial025.stdout:(53/96): python3-toml-0.10.2-6.el9.noarch.rpm 72 kB/s | 42 kB 00:00 2026-02-12T12:50:15.611 INFO:teuthology.orchestra.run.trial025.stdout:(54/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 256 kB/s | 189 kB 00:00 2026-02-12T12:50:15.641 INFO:teuthology.orchestra.run.trial025.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 749 kB/s | 22 kB 00:00 2026-02-12T12:50:15.680 INFO:teuthology.orchestra.run.trial025.stdout:(56/96): protobuf-compiler-3.14.0-17.el9.x86_64 21 MB/s | 862 kB 00:00 2026-02-12T12:50:15.683 INFO:teuthology.orchestra.run.trial025.stdout:(57/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 139 kB/s | 90 kB 00:00 2026-02-12T12:50:15.741 INFO:teuthology.orchestra.run.trial025.stdout:(58/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 14 MB/s | 19 MB 00:01 2026-02-12T12:50:15.807 INFO:teuthology.orchestra.run.trial025.stdout:(59/96): grpc-data-1.46.7-10.el9.noarch.rpm 157 kB/s | 19 kB 00:00 2026-02-12T12:50:15.926 INFO:teuthology.orchestra.run.trial025.stdout:(60/96): luarocks-3.9.2-5.el9.noarch.rpm 820 kB/s | 151 kB 00:00 2026-02-12T12:50:15.955 INFO:teuthology.orchestra.run.trial025.stdout:(61/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.0 MB/s | 551 kB 00:00 2026-02-12T12:50:15.963 INFO:teuthology.orchestra.run.trial025.stdout:(62/96): python3-autocommand-2.2.2-8.el9.noarch 790 kB/s | 29 kB 00:00 2026-02-12T12:50:15.985 INFO:teuthology.orchestra.run.trial025.stdout:(63/96): python3-asyncssh-2.13.2-5.el9.noarch.r 3.0 MB/s | 548 kB 00:00 2026-02-12T12:50:15.990 INFO:teuthology.orchestra.run.trial025.stdout:(64/96): python3-backports-tarfile-1.2.0-1.el9. 1.7 MB/s | 60 kB 00:00 2026-02-12T12:50:16.002 INFO:teuthology.orchestra.run.trial025.stdout:(65/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.1 MB/s | 43 kB 00:00 2026-02-12T12:50:16.020 INFO:teuthology.orchestra.run.trial025.stdout:(66/96): python3-cachetools-4.2.4-1.el9.noarch. 932 kB/s | 32 kB 00:00 2026-02-12T12:50:16.024 INFO:teuthology.orchestra.run.trial025.stdout:(67/96): python3-certifi-2023.05.07-4.el9.noarc 421 kB/s | 14 kB 00:00 2026-02-12T12:50:16.062 INFO:teuthology.orchestra.run.trial025.stdout:(68/96): python3-cheroot-10.0.1-4.el9.noarch.rp 2.8 MB/s | 173 kB 00:00 2026-02-12T12:50:16.067 INFO:teuthology.orchestra.run.trial025.stdout:(69/96): python3-google-auth-2.45.0-1.el9.noarc 5.8 MB/s | 254 kB 00:00 2026-02-12T12:50:16.067 INFO:teuthology.orchestra.run.trial025.stdout:(70/96): python3-cherrypy-18.6.1-2.el9.noarch.r 7.3 MB/s | 358 kB 00:00 2026-02-12T12:50:16.106 INFO:teuthology.orchestra.run.trial025.stdout:(71/96): python3-grpcio-tools-1.46.7-10.el9.x86 3.6 MB/s | 144 kB 00:00 2026-02-12T12:50:16.107 INFO:teuthology.orchestra.run.trial025.stdout:(72/96): python3-influxdb-5.3.1-1.el9.noarch.rp 3.5 MB/s | 139 kB 00:00 2026-02-12T12:50:16.140 INFO:teuthology.orchestra.run.trial025.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 318 kB/s | 11 kB 00:00 2026-02-12T12:50:16.141 INFO:teuthology.orchestra.run.trial025.stdout:(74/96): python3-isodate-0.6.1-3.el9.noarch.rpm 1.6 MB/s | 56 kB 00:00 2026-02-12T12:50:16.174 INFO:teuthology.orchestra.run.trial025.stdout:(75/96): python3-jaraco-classes-3.2.1-5.el9.noa 524 kB/s | 18 kB 00:00 2026-02-12T12:50:16.174 INFO:teuthology.orchestra.run.trial025.stdout:(76/96): python3-jaraco-collections-3.0.0-8.el9 690 kB/s | 23 kB 00:00 2026-02-12T12:50:16.208 INFO:teuthology.orchestra.run.trial025.stdout:(77/96): python3-jaraco-context-6.0.1-3.el9.noa 580 kB/s | 20 kB 00:00 2026-02-12T12:50:16.208 INFO:teuthology.orchestra.run.trial025.stdout:(78/96): python3-jaraco-functools-3.5.0-2.el9.n 576 kB/s | 19 kB 00:00 2026-02-12T12:50:16.213 INFO:teuthology.orchestra.run.trial025.stdout:(79/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 14 MB/s | 2.0 MB 00:00 2026-02-12T12:50:16.242 INFO:teuthology.orchestra.run.trial025.stdout:(80/96): python3-jaraco-text-4.0.0-2.el9.noarch 780 kB/s | 26 kB 00:00 2026-02-12T12:50:16.248 INFO:teuthology.orchestra.run.trial025.stdout:(81/96): python3-more-itertools-8.12.0-2.el9.no 2.2 MB/s | 79 kB 00:00 2026-02-12T12:50:16.278 INFO:teuthology.orchestra.run.trial025.stdout:(82/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.3 MB/s | 86 kB 00:00 2026-02-12T12:50:16.283 INFO:teuthology.orchestra.run.trial025.stdout:(83/96): python3-natsort-7.1.1-5.el9.noarch.rpm 1.6 MB/s | 58 kB 00:00 2026-02-12T12:50:16.286 INFO:teuthology.orchestra.run.trial025.stdout:(84/96): python3-kubernetes-26.1.0-3.el9.noarch 13 MB/s | 1.0 MB 00:00 2026-02-12T12:50:16.312 INFO:teuthology.orchestra.run.trial025.stdout:(85/96): python3-portend-3.1.0-2.el9.noarch.rpm 484 kB/s | 16 kB 00:00 2026-02-12T12:50:16.318 INFO:teuthology.orchestra.run.trial025.stdout:(86/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.5 MB/s | 90 kB 00:00 2026-02-12T12:50:16.319 INFO:teuthology.orchestra.run.trial025.stdout:(87/96): python3-repoze-lru-0.7-16.el9.noarch.r 908 kB/s | 31 kB 00:00 2026-02-12T12:50:16.353 INFO:teuthology.orchestra.run.trial025.stdout:(88/96): python3-routes-2.5.1-5.el9.noarch.rpm 4.5 MB/s | 188 kB 00:00 2026-02-12T12:50:16.353 INFO:teuthology.orchestra.run.trial025.stdout:(89/96): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2026-02-12T12:50:16.355 INFO:teuthology.orchestra.run.trial025.stdout:(90/96): python3-saml-1.16.0-1.el9.noarch.rpm 3.5 MB/s | 125 kB 00:00 2026-02-12T12:50:16.388 INFO:teuthology.orchestra.run.trial025.stdout:(91/96): python3-tempora-5.0.0-2.el9.noarch.rpm 1.0 MB/s | 36 kB 00:00 2026-02-12T12:50:16.389 INFO:teuthology.orchestra.run.trial025.stdout:(92/96): python3-typing-extensions-4.15.0-1.el9 2.4 MB/s | 86 kB 00:00 2026-02-12T12:50:16.390 INFO:teuthology.orchestra.run.trial025.stdout:(93/96): python3-websocket-client-1.2.3-2.el9.n 2.5 MB/s | 90 kB 00:00 2026-02-12T12:50:16.422 INFO:teuthology.orchestra.run.trial025.stdout:(94/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.4 MB/s | 48 kB 00:00 2026-02-12T12:50:16.424 INFO:teuthology.orchestra.run.trial025.stdout:(95/96): python3-xmltodict-0.12.0-15.el9.noarch 626 kB/s | 22 kB 00:00 2026-02-12T12:50:16.425 INFO:teuthology.orchestra.run.trial025.stdout:(96/96): python3-zc-lockfile-2.0-10.el9.noarch. 570 kB/s | 20 kB 00:00 2026-02-12T12:50:16.428 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:50:16.428 INFO:teuthology.orchestra.run.trial025.stdout:Total 19 MB/s | 189 MB 00:09 2026-02-12T12:50:16.842 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T12:50:16.881 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T12:50:16.882 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T12:50:17.572 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T12:50:17.573 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T12:50:18.296 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T12:50:18.298 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-12T12:50:18.302 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-12T12:50:18.323 INFO:teuthology.orchestra.run.trial025.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-12T12:50:18.357 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-12T12:50:18.364 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-12T12:50:18.366 INFO:teuthology.orchestra.run.trial025.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-12T12:50:18.371 INFO:teuthology.orchestra.run.trial025.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 7/96 2026-02-12T12:50:18.394 INFO:teuthology.orchestra.run.trial025.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-12T12:50:18.406 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-12T12:50:18.410 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-12T12:50:18.416 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-12T12:50:18.418 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-12T12:50:18.429 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-12T12:50:18.435 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-12T12:50:18.459 INFO:teuthology.orchestra.run.trial025.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-12T12:50:18.462 INFO:teuthology.orchestra.run.trial025.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-12T12:50:18.511 INFO:teuthology.orchestra.run.trial025.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-12T12:50:18.524 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-12T12:50:18.526 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-12T12:50:18.530 INFO:teuthology.orchestra.run.trial025.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-12T12:50:18.536 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-12T12:50:18.540 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-12T12:50:18.543 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-12T12:50:18.557 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-12T12:50:18.562 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-12T12:50:18.567 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-12T12:50:18.578 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-12T12:50:18.587 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-12T12:50:18.593 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-12T12:50:18.612 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-12T12:50:18.623 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-12T12:50:18.639 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-12T12:50:18.643 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-12T12:50:18.651 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-12T12:50:18.690 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-12T12:50:19.010 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-12T12:50:19.020 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-12T12:50:19.024 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-12T12:50:19.030 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-12T12:50:19.032 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-12T12:50:19.058 INFO:teuthology.orchestra.run.trial025.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-12T12:50:19.101 INFO:teuthology.orchestra.run.trial025.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-12T12:50:19.109 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-12T12:50:19.115 INFO:teuthology.orchestra.run.trial025.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-12T12:50:19.119 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-12T12:50:19.125 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-12T12:50:19.128 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-12T12:50:19.135 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-12T12:50:19.139 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-12T12:50:19.166 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-12T12:50:19.176 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-12T12:50:19.182 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-12T12:50:19.189 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-12T12:50:19.223 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-12T12:50:19.446 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 55/96 2026-02-12T12:50:19.469 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-12T12:50:19.473 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-12T12:50:19.533 INFO:teuthology.orchestra.run.trial025.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-12T12:50:19.535 INFO:teuthology.orchestra.run.trial025.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-12T12:50:19.556 INFO:teuthology.orchestra.run.trial025.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 60/96 2026-02-12T12:50:19.881 INFO:teuthology.orchestra.run.trial025.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 61/96 2026-02-12T12:50:19.954 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-12T12:50:20.622 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-12T12:50:20.639 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-12T12:50:20.649 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-12T12:50:20.655 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-12T12:50:20.668 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-12T12:50:20.684 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-12T12:50:20.759 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-12T12:50:20.768 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-12T12:50:20.791 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-12T12:50:20.820 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-12T12:50:20.871 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-12T12:50:20.877 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-12T12:50:20.880 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-12T12:50:20.881 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-12T12:50:20.900 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T12:50:20.900 INFO:teuthology.orchestra.run.trial025.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T12:50:20.900 INFO:teuthology.orchestra.run.trial025.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T12:50:20.900 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:20.909 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T12:50:20.935 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T12:50:20.935 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T12:50:20.935 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:20.973 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-12T12:50:21.592 INFO:teuthology.orchestra.run.trial025.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 79/96 2026-02-12T12:50:27.129 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 80/96 2026-02-12T12:50:27.193 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 81/96 2026-02-12T12:50:27.195 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch 82/96 2026-02-12T12:50:27.210 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch 82/96 2026-02-12T12:50:27.210 INFO:teuthology.orchestra.run.trial025.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T12:50:27.210 INFO:teuthology.orchestra.run.trial025.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T12:50:27.210 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:27.220 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 83/96 2026-02-12T12:50:27.246 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 83/96 2026-02-12T12:50:27.246 INFO:teuthology.orchestra.run.trial025.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T12:50:27.246 INFO:teuthology.orchestra.run.trial025.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T12:50:27.246 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T12:50:27.246 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T12:50:27.246 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:27.308 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 84/96 2026-02-12T12:50:27.310 INFO:teuthology.orchestra.run.trial025.stdout: Installing : cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 84/96 2026-02-12T12:50:27.319 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5145.g5fdb7d8f.el9 85/96 2026-02-12T12:50:27.343 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5145.g5fdb7d8f.el 86/96 2026-02-12T12:50:27.344 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarc 87/96 2026-02-12T12:50:28.948 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarc 87/96 2026-02-12T12:50:28.955 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noa 88/96 2026-02-12T12:50:29.427 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noa 88/96 2026-02-12T12:50:29.428 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7 89/96 2026-02-12T12:50:29.441 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7 89/96 2026-02-12T12:50:29.441 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5145.g5fdb7d8f.el9.noa 90/96 2026-02-12T12:50:29.504 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5145.g5fdb7d8f.el9.noa 90/96 2026-02-12T12:50:29.545 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5145.g5fdb7d8f.el9. 91/96 2026-02-12T12:50:29.546 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 92/96 2026-02-12T12:50:29.568 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 92/96 2026-02-12T12:50:29.568 INFO:teuthology.orchestra.run.trial025.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T12:50:29.568 INFO:teuthology.orchestra.run.trial025.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T12:50:29.568 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T12:50:29.568 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T12:50:29.569 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:29.580 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch 93/96 2026-02-12T12:50:29.805 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch 93/96 2026-02-12T12:50:29.807 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 94/96 2026-02-12T12:50:29.829 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-mon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 94/96 2026-02-12T12:50:29.829 INFO:teuthology.orchestra.run.trial025.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T12:50:29.829 INFO:teuthology.orchestra.run.trial025.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T12:50:29.829 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T12:50:29.829 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T12:50:29.829 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:29.918 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mds-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 95/96 2026-02-12T12:50:29.940 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-mds-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 95/96 2026-02-12T12:50:29.940 INFO:teuthology.orchestra.run.trial025.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T12:50:29.940 INFO:teuthology.orchestra.run.trial025.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T12:50:29.940 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T12:50:29.940 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T12:50:29.940 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:29.941 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 96/96 2026-02-12T12:50:29.948 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 96/96 2026-02-12T12:50:29.973 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 96/96 2026-02-12T12:50:31.297 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 96/96 2026-02-12T12:50:31.297 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/96 2026-02-12T12:50:31.297 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mds-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/96 2026-02-12T12:50:31.298 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 3/96 2026-02-12T12:50:31.298 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 4/96 2026-02-12T12:50:31.298 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 5/96 2026-02-12T12:50:31.298 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 6/96 2026-02-12T12:50:31.298 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 7/96 2026-02-12T12:50:31.298 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5145.g5fdb7d8f.el 8/96 2026-02-12T12:50:31.298 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarc 9/96 2026-02-12T12:50:31.298 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noa 10/96 2026-02-12T12:50:31.298 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7 11/96 2026-02-12T12:50:31.298 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5145.g5fdb7d8f.el9.noa 12/96 2026-02-12T12:50:31.298 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5145.g5fdb7d8f.el9. 13/96 2026-02-12T12:50:31.299 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch 14/96 2026-02-12T12:50:31.299 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5145.g5fdb7d8f.el9 15/96 2026-02-12T12:50:31.299 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch 16/96 2026-02-12T12:50:31.299 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 17/96 2026-02-12T12:50:31.299 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 18/96 2026-02-12T12:50:31.299 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-12T12:50:31.299 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-12T12:50:31.299 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-12T12:50:31.299 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-12T12:50:31.299 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-12T12:50:31.299 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-12T12:50:31.299 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-12T12:50:31.299 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-12T12:50:31.300 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-12T12:50:31.300 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-12T12:50:31.300 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-12T12:50:31.300 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-12T12:50:31.300 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-12T12:50:31.300 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 32/96 2026-02-12T12:50:31.300 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 33/96 2026-02-12T12:50:31.300 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 34/96 2026-02-12T12:50:31.300 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-12T12:50:31.300 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-12T12:50:31.300 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-12T12:50:31.300 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-12T12:50:31.300 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-12T12:50:31.301 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 40/96 2026-02-12T12:50:31.301 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-12T12:50:31.301 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-12T12:50:31.301 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-12T12:50:31.301 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-12T12:50:31.301 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-12T12:50:31.301 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-12T12:50:31.301 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-12T12:50:31.301 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-12T12:50:31.301 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-12T12:50:31.301 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-12T12:50:31.301 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-12T12:50:31.302 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-12T12:50:31.302 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-12T12:50:31.302 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-12T12:50:31.302 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-12T12:50:31.302 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-12T12:50:31.302 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-12T12:50:31.302 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-12T12:50:31.302 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-12T12:50:31.302 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-12T12:50:31.302 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-12T12:50:31.303 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-12T12:50:31.303 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-12T12:50:31.303 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-12T12:50:31.303 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-12T12:50:31.303 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-12T12:50:31.303 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-12T12:50:31.303 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-12T12:50:31.303 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-12T12:50:31.303 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-12T12:50:31.303 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-12T12:50:31.303 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-12T12:50:31.304 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-12T12:50:31.304 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-12T12:50:31.304 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-12T12:50:31.304 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-12T12:50:31.304 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-12T12:50:31.304 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-12T12:50:31.304 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-12T12:50:31.304 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-12T12:50:31.304 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-12T12:50:31.304 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-12T12:50:31.304 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-12T12:50:31.304 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-12T12:50:31.304 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-12T12:50:31.305 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-12T12:50:31.305 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-12T12:50:31.305 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-12T12:50:31.305 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-12T12:50:31.305 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-12T12:50:31.305 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-12T12:50:31.305 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-12T12:50:31.305 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-12T12:50:31.305 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-12T12:50:31.305 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-12T12:50:31.361 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-12T12:50:31.361 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:31.361 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T12:50:31.361 INFO:teuthology.orchestra.run.trial025.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T12:50:31.361 INFO:teuthology.orchestra.run.trial025.stdout: ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:50:31.361 INFO:teuthology.orchestra.run.trial025.stdout: ceph-grafana-dashboards-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:50:31.362 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mds-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:50:31.362 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:50:31.362 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:50:31.362 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:50:31.362 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:50:31.362 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-k8sevents-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:50:31.362 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-modules-core-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:50:31.362 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:50:31.362 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:50:31.362 INFO:teuthology.orchestra.run.trial025.stdout: ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:50:31.363 INFO:teuthology.orchestra.run.trial025.stdout: ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:50:31.363 INFO:teuthology.orchestra.run.trial025.stdout: ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:50:31.363 INFO:teuthology.orchestra.run.trial025.stdout: ceph-prometheus-alerts-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:50:31.363 INFO:teuthology.orchestra.run.trial025.stdout: ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:50:31.363 INFO:teuthology.orchestra.run.trial025.stdout: cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:50:31.363 INFO:teuthology.orchestra.run.trial025.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T12:50:31.363 INFO:teuthology.orchestra.run.trial025.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T12:50:31.363 INFO:teuthology.orchestra.run.trial025.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T12:50:31.363 INFO:teuthology.orchestra.run.trial025.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T12:50:31.363 INFO:teuthology.orchestra.run.trial025.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T12:50:31.363 INFO:teuthology.orchestra.run.trial025.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T12:50:31.363 INFO:teuthology.orchestra.run.trial025.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T12:50:31.363 INFO:teuthology.orchestra.run.trial025.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T12:50:31.364 INFO:teuthology.orchestra.run.trial025.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T12:50:31.364 INFO:teuthology.orchestra.run.trial025.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T12:50:31.364 INFO:teuthology.orchestra.run.trial025.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T12:50:31.364 INFO:teuthology.orchestra.run.trial025.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T12:50:31.364 INFO:teuthology.orchestra.run.trial025.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T12:50:31.364 INFO:teuthology.orchestra.run.trial025.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T12:50:31.364 INFO:teuthology.orchestra.run.trial025.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T12:50:31.364 INFO:teuthology.orchestra.run.trial025.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T12:50:31.364 INFO:teuthology.orchestra.run.trial025.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T12:50:31.364 INFO:teuthology.orchestra.run.trial025.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T12:50:31.364 INFO:teuthology.orchestra.run.trial025.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T12:50:31.364 INFO:teuthology.orchestra.run.trial025.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T12:50:31.365 INFO:teuthology.orchestra.run.trial025.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T12:50:31.365 INFO:teuthology.orchestra.run.trial025.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T12:50:31.365 INFO:teuthology.orchestra.run.trial025.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T12:50:31.365 INFO:teuthology.orchestra.run.trial025.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T12:50:31.365 INFO:teuthology.orchestra.run.trial025.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T12:50:31.365 INFO:teuthology.orchestra.run.trial025.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T12:50:31.365 INFO:teuthology.orchestra.run.trial025.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T12:50:31.365 INFO:teuthology.orchestra.run.trial025.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T12:50:31.365 INFO:teuthology.orchestra.run.trial025.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T12:50:31.365 INFO:teuthology.orchestra.run.trial025.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T12:50:31.365 INFO:teuthology.orchestra.run.trial025.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T12:50:31.365 INFO:teuthology.orchestra.run.trial025.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-12T12:50:31.365 INFO:teuthology.orchestra.run.trial025.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-12T12:50:31.366 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T12:50:31.366 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T12:50:31.366 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T12:50:31.366 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T12:50:31.366 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T12:50:31.366 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T12:50:31.366 INFO:teuthology.orchestra.run.trial025.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T12:50:31.366 INFO:teuthology.orchestra.run.trial025.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T12:50:31.366 INFO:teuthology.orchestra.run.trial025.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T12:50:31.366 INFO:teuthology.orchestra.run.trial025.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T12:50:31.366 INFO:teuthology.orchestra.run.trial025.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-12T12:50:31.366 INFO:teuthology.orchestra.run.trial025.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T12:50:31.366 INFO:teuthology.orchestra.run.trial025.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T12:50:31.367 INFO:teuthology.orchestra.run.trial025.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-12T12:50:31.367 INFO:teuthology.orchestra.run.trial025.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T12:50:31.367 INFO:teuthology.orchestra.run.trial025.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T12:50:31.367 INFO:teuthology.orchestra.run.trial025.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T12:50:31.367 INFO:teuthology.orchestra.run.trial025.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T12:50:31.367 INFO:teuthology.orchestra.run.trial025.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T12:50:31.367 INFO:teuthology.orchestra.run.trial025.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T12:50:31.367 INFO:teuthology.orchestra.run.trial025.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T12:50:31.367 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T12:50:31.367 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T12:50:31.367 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T12:50:31.367 INFO:teuthology.orchestra.run.trial025.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T12:50:31.367 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T12:50:31.368 INFO:teuthology.orchestra.run.trial025.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T12:50:31.368 INFO:teuthology.orchestra.run.trial025.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T12:50:31.368 INFO:teuthology.orchestra.run.trial025.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T12:50:31.368 INFO:teuthology.orchestra.run.trial025.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T12:50:31.368 INFO:teuthology.orchestra.run.trial025.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T12:50:31.368 INFO:teuthology.orchestra.run.trial025.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-12T12:50:31.368 INFO:teuthology.orchestra.run.trial025.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T12:50:31.368 INFO:teuthology.orchestra.run.trial025.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T12:50:31.368 INFO:teuthology.orchestra.run.trial025.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T12:50:31.368 INFO:teuthology.orchestra.run.trial025.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T12:50:31.368 INFO:teuthology.orchestra.run.trial025.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T12:50:31.368 INFO:teuthology.orchestra.run.trial025.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T12:50:31.368 INFO:teuthology.orchestra.run.trial025.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-12T12:50:31.369 INFO:teuthology.orchestra.run.trial025.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T12:50:31.369 INFO:teuthology.orchestra.run.trial025.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T12:50:31.369 INFO:teuthology.orchestra.run.trial025.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T12:50:31.369 INFO:teuthology.orchestra.run.trial025.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-12T12:50:31.369 INFO:teuthology.orchestra.run.trial025.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-12T12:50:31.369 INFO:teuthology.orchestra.run.trial025.stdout: zip-3.0-35.el9.x86_64 2026-02-12T12:50:31.369 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:31.369 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:31.430 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-base 2026-02-12T12:50:31.744 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:00 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:31.809 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:31.828 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:31.828 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:31.828 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:31.851 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install cephadm 2026-02-12T12:50:32.155 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:01 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:32.220 INFO:teuthology.orchestra.run.trial025.stdout:Package cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:50:32.238 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:32.239 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:32.239 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:32.260 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T12:50:32.557 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:01 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:32.640 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:32.641 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:32.641 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repo Size 2026-02-12T12:50:32.641 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:32.642 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T12:50:32.642 INFO:teuthology.orchestra.run.trial025.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 149 k 2026-02-12T12:50:32.642 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:32.642 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T12:50:32.642 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:32.642 INFO:teuthology.orchestra.run.trial025.stdout:Install 1 Package 2026-02-12T12:50:32.642 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:32.642 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 149 k 2026-02-12T12:50:32.642 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 455 k 2026-02-12T12:50:32.642 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T12:50:32.731 INFO:teuthology.orchestra.run.trial025.stdout:ceph-immutable-object-cache-20.3.0-5145.g5fdb7d 1.6 MB/s | 149 kB 00:00 2026-02-12T12:50:32.732 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:50:32.732 INFO:teuthology.orchestra.run.trial025.stdout:Total 1.6 MB/s | 149 kB 00:00 2026-02-12T12:50:32.732 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T12:50:32.736 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T12:50:32.736 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T12:50:32.768 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T12:50:32.768 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T12:50:32.824 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T12:50:32.826 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f. 1/1 2026-02-12T12:50:32.848 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f. 1/1 2026-02-12T12:50:32.848 INFO:teuthology.orchestra.run.trial025.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T12:50:32.848 INFO:teuthology.orchestra.run.trial025.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T12:50:32.848 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:33.150 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f. 1/1 2026-02-12T12:50:33.150 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:33.150 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T12:50:33.150 INFO:teuthology.orchestra.run.trial025.stdout: ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:50:33.150 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:33.150 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:33.178 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr 2026-02-12T12:50:33.483 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:02 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:33.549 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:33.567 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:33.568 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:33.568 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:33.590 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T12:50:33.893 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:02 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:33.957 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:50:33.975 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:33.976 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:33.976 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:33.997 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T12:50:34.295 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:03 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:34.360 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:50:34.378 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:34.379 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:34.379 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:34.400 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr-rook 2026-02-12T12:50:34.708 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:03 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:34.774 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:50:34.793 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:34.793 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:34.794 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:34.815 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T12:50:35.120 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:04 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:35.186 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:50:35.204 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:35.205 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:35.205 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:35.227 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-osd 2026-02-12T12:50:35.527 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:04 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:35.592 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:35.610 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:35.611 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:35.611 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:35.633 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-osd-classic 2026-02-12T12:50:35.932 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:04 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:35.997 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:36.015 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:36.016 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:36.016 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:36.037 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-fuse 2026-02-12T12:50:36.342 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:05 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:36.425 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:36.426 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:36.426 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repo Size 2026-02-12T12:50:36.426 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:36.427 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T12:50:36.427 INFO:teuthology.orchestra.run.trial025.stdout: ceph-fuse x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 914 k 2026-02-12T12:50:36.427 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:36.427 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T12:50:36.427 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:36.427 INFO:teuthology.orchestra.run.trial025.stdout:Install 1 Package 2026-02-12T12:50:36.427 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:36.427 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 914 k 2026-02-12T12:50:36.427 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 2.9 M 2026-02-12T12:50:36.427 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T12:50:36.580 INFO:teuthology.orchestra.run.trial025.stdout:ceph-fuse-20.3.0-5145.g5fdb7d8f.el9.x86_64.rpm 5.8 MB/s | 914 kB 00:00 2026-02-12T12:50:36.581 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:50:36.581 INFO:teuthology.orchestra.run.trial025.stdout:Total 5.8 MB/s | 914 kB 00:00 2026-02-12T12:50:36.581 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T12:50:36.585 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T12:50:36.585 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T12:50:36.620 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T12:50:36.620 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T12:50:36.710 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T12:50:36.727 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:36.946 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:37.003 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:37.003 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:37.003 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T12:50:37.003 INFO:teuthology.orchestra.run.trial025.stdout: ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:50:37.003 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:37.003 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:37.031 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-volume 2026-02-12T12:50:37.335 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:06 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:37.400 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:50:37.418 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:37.418 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:37.418 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:37.440 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install librados-devel 2026-02-12T12:50:37.752 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:06 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:37.835 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:37.835 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:37.836 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repo Size 2026-02-12T12:50:37.836 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:37.836 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T12:50:37.836 INFO:teuthology.orchestra.run.trial025.stdout: librados-devel x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 124 k 2026-02-12T12:50:37.836 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:37.836 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T12:50:37.836 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:37.836 INFO:teuthology.orchestra.run.trial025.stdout:Install 1 Package 2026-02-12T12:50:37.837 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:37.837 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 124 k 2026-02-12T12:50:37.837 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 434 k 2026-02-12T12:50:37.837 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T12:50:37.921 INFO:teuthology.orchestra.run.trial025.stdout:librados-devel-20.3.0-5145.g5fdb7d8f.el9.x86_64 1.4 MB/s | 124 kB 00:00 2026-02-12T12:50:37.922 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:50:37.922 INFO:teuthology.orchestra.run.trial025.stdout:Total 1.4 MB/s | 124 kB 00:00 2026-02-12T12:50:37.922 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T12:50:37.925 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T12:50:37.925 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T12:50:37.959 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T12:50:37.959 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T12:50:38.015 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T12:50:38.031 INFO:teuthology.orchestra.run.trial025.stdout: Installing : librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:38.112 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:38.169 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:38.169 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:38.169 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T12:50:38.169 INFO:teuthology.orchestra.run.trial025.stdout: librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:50:38.169 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:38.169 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:38.197 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install libcephfs2 2026-02-12T12:50:38.501 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:07 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:38.566 INFO:teuthology.orchestra.run.trial025.stdout:Package libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:38.584 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:38.584 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:38.584 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:38.606 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install libcephfs-devel 2026-02-12T12:50:38.915 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:07 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:39.000 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:39.001 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:39.001 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repo Size 2026-02-12T12:50:39.001 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:39.001 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T12:50:39.001 INFO:teuthology.orchestra.run.trial025.stdout: libcephfs-devel x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 37 k 2026-02-12T12:50:39.001 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:39.001 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T12:50:39.001 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:39.001 INFO:teuthology.orchestra.run.trial025.stdout:Install 1 Package 2026-02-12T12:50:39.002 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:39.002 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 37 k 2026-02-12T12:50:39.002 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 171 k 2026-02-12T12:50:39.002 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T12:50:39.290 INFO:teuthology.orchestra.run.trial025.stdout:libcephfs-devel-20.3.0-5145.g5fdb7d8f.el9.x86_6 129 kB/s | 37 kB 00:00 2026-02-12T12:50:39.291 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:50:39.291 INFO:teuthology.orchestra.run.trial025.stdout:Total 128 kB/s | 37 kB 00:00 2026-02-12T12:50:39.292 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T12:50:39.294 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T12:50:39.294 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T12:50:39.297 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T12:50:39.297 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T12:50:39.319 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T12:50:39.335 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:39.390 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:39.445 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:39.446 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:39.446 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T12:50:39.446 INFO:teuthology.orchestra.run.trial025.stdout: libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:50:39.446 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:39.446 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:39.473 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install librados2 2026-02-12T12:50:39.770 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:08 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:39.834 INFO:teuthology.orchestra.run.trial025.stdout:Package librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:39.852 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:39.852 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:39.852 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:39.874 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install librbd1 2026-02-12T12:50:40.171 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:09 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:40.235 INFO:teuthology.orchestra.run.trial025.stdout:Package librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:40.252 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:40.253 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:40.253 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:40.275 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install python3-rados 2026-02-12T12:50:40.577 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:09 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:40.642 INFO:teuthology.orchestra.run.trial025.stdout:Package python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:40.660 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:40.661 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:40.661 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:40.682 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install python3-rgw 2026-02-12T12:50:40.984 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:09 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:41.049 INFO:teuthology.orchestra.run.trial025.stdout:Package python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:41.066 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:41.067 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:41.067 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:41.088 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install python3-cephfs 2026-02-12T12:50:41.390 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:10 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:41.456 INFO:teuthology.orchestra.run.trial025.stdout:Package python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:41.473 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:41.474 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:41.474 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:41.495 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install python3-rbd 2026-02-12T12:50:41.802 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:10 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:41.867 INFO:teuthology.orchestra.run.trial025.stdout:Package python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:41.885 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:41.885 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:41.885 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:41.907 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install rbd-fuse 2026-02-12T12:50:42.212 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:11 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:42.295 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:42.295 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:42.295 INFO:teuthology.orchestra.run.trial025.stdout: Package Architecture Version Repository Size 2026-02-12T12:50:42.295 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:42.295 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T12:50:42.295 INFO:teuthology.orchestra.run.trial025.stdout: rbd-fuse x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 87 k 2026-02-12T12:50:42.295 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:42.295 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T12:50:42.295 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:42.296 INFO:teuthology.orchestra.run.trial025.stdout:Install 1 Package 2026-02-12T12:50:42.296 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:42.296 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 87 k 2026-02-12T12:50:42.296 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 236 k 2026-02-12T12:50:42.296 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T12:50:42.488 INFO:teuthology.orchestra.run.trial025.stdout:rbd-fuse-20.3.0-5145.g5fdb7d8f.el9.x86_64.rpm 448 kB/s | 87 kB 00:00 2026-02-12T12:50:42.489 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:50:42.489 INFO:teuthology.orchestra.run.trial025.stdout:Total 446 kB/s | 87 kB 00:00 2026-02-12T12:50:42.489 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T12:50:42.494 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T12:50:42.494 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T12:50:42.526 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T12:50:42.526 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T12:50:42.577 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T12:50:42.594 INFO:teuthology.orchestra.run.trial025.stdout: Installing : rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:42.672 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:42.731 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:42.731 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:42.731 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T12:50:42.731 INFO:teuthology.orchestra.run.trial025.stdout: rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:50:42.731 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:42.732 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:42.760 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install rbd-mirror 2026-02-12T12:50:43.065 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:12 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:43.147 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:43.148 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:43.149 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repo Size 2026-02-12T12:50:43.149 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:43.149 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T12:50:43.149 INFO:teuthology.orchestra.run.trial025.stdout: rbd-mirror x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 2.6 M 2026-02-12T12:50:43.149 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:43.149 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T12:50:43.149 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:43.149 INFO:teuthology.orchestra.run.trial025.stdout:Install 1 Package 2026-02-12T12:50:43.149 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:43.149 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 2.6 M 2026-02-12T12:50:43.149 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 11 M 2026-02-12T12:50:43.150 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T12:50:43.287 INFO:teuthology.orchestra.run.trial025.stdout:rbd-mirror-20.3.0-5145.g5fdb7d8f.el9.x86_64.rpm 19 MB/s | 2.6 MB 00:00 2026-02-12T12:50:43.288 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:50:43.288 INFO:teuthology.orchestra.run.trial025.stdout:Total 19 MB/s | 2.6 MB 00:00 2026-02-12T12:50:43.288 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T12:50:43.292 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T12:50:43.293 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T12:50:43.332 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T12:50:43.332 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T12:50:43.497 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T12:50:43.498 INFO:teuthology.orchestra.run.trial025.stdout: Installing : rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:43.522 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:43.522 INFO:teuthology.orchestra.run.trial025.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T12:50:43.522 INFO:teuthology.orchestra.run.trial025.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T12:50:43.522 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T12:50:43.522 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T12:50:43.522 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:43.838 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:43.838 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:43.838 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T12:50:43.838 INFO:teuthology.orchestra.run.trial025.stdout: rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:50:43.839 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:43.839 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:43.866 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install rbd-nbd 2026-02-12T12:50:44.175 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:13 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:44.258 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:44.259 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:44.259 INFO:teuthology.orchestra.run.trial025.stdout: Package Architecture Version Repository Size 2026-02-12T12:50:44.259 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:44.259 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T12:50:44.259 INFO:teuthology.orchestra.run.trial025.stdout: rbd-nbd x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 167 k 2026-02-12T12:50:44.259 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:44.259 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T12:50:44.259 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:44.259 INFO:teuthology.orchestra.run.trial025.stdout:Install 1 Package 2026-02-12T12:50:44.259 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:44.260 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 167 k 2026-02-12T12:50:44.260 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 496 k 2026-02-12T12:50:44.260 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T12:50:44.617 INFO:teuthology.orchestra.run.trial025.stdout:rbd-nbd-20.3.0-5145.g5fdb7d8f.el9.x86_64.rpm 466 kB/s | 167 kB 00:00 2026-02-12T12:50:44.617 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:50:44.617 INFO:teuthology.orchestra.run.trial025.stdout:Total 465 kB/s | 167 kB 00:00 2026-02-12T12:50:44.617 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T12:50:44.622 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T12:50:44.622 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T12:50:44.654 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T12:50:44.654 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T12:50:44.710 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T12:50:44.727 INFO:teuthology.orchestra.run.trial025.stdout: Installing : rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:44.808 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:44.864 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:50:44.864 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:44.865 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T12:50:44.865 INFO:teuthology.orchestra.run.trial025.stdout: rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:50:44.865 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:44.865 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:44.892 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-osd-crimson 2026-02-12T12:50:45.194 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:14 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:45.258 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:45.276 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:45.276 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:50:45.277 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:50:45.298 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-12T12:50:45.603 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:01:14 ago on Thu 12 Feb 2026 12:49:31 PM UTC. 2026-02-12T12:50:45.685 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:50:45.686 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:45.686 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repo Size 2026-02-12T12:50:45.686 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:45.686 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T12:50:45.686 INFO:teuthology.orchestra.run.trial025.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 429 M 2026-02-12T12:50:45.686 INFO:teuthology.orchestra.run.trial025.stdout:Installing weak dependencies: 2026-02-12T12:50:45.686 INFO:teuthology.orchestra.run.trial025.stdout: ceph-debugsource x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 12 M 2026-02-12T12:50:45.686 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:45.687 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T12:50:45.687 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T12:50:45.687 INFO:teuthology.orchestra.run.trial025.stdout:Install 2 Packages 2026-02-12T12:50:45.687 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:50:45.687 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 441 M 2026-02-12T12:50:45.687 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 2.7 G 2026-02-12T12:50:45.687 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T12:50:47.046 INFO:teuthology.orchestra.run.trial025.stdout:(1/2): ceph-debugsource-20.3.0-5145.g5fdb7d8f.e 8.8 MB/s | 12 MB 00:01 2026-02-12T12:51:07.762 INFO:teuthology.orchestra.run.trial025.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5145.g 19 MB/s | 429 MB 00:22 2026-02-12T12:51:07.764 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:51:07.764 INFO:teuthology.orchestra.run.trial025.stdout:Total 20 MB/s | 441 MB 00:22 2026-02-12T12:51:07.764 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T12:51:07.769 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T12:51:07.769 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T12:51:09.128 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T12:51:09.129 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T12:51:12.690 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T12:51:34.711 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-debugsource-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/2 2026-02-12T12:51:34.729 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5145.g5fdb7d8f.e 2/2 2026-02-12T12:51:36.669 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5145.g5fdb7d8f.e 2/2 2026-02-12T12:51:36.669 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-debugsource-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/2 2026-02-12T12:51:36.726 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5145.g5fdb7d8f.e 2/2 2026-02-12T12:51:36.726 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:51:36.726 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T12:51:36.726 INFO:teuthology.orchestra.run.trial025.stdout: ceph-debugsource-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:51:36.726 INFO:teuthology.orchestra.run.trial025.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:51:36.726 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:51:36.726 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:51:36.804 DEBUG:teuthology.parallel:result is None 2026-02-12T12:51:36.804 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T12:51:36.965 DEBUG:teuthology.orchestra.run.trial025:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T12:51:36.986 INFO:teuthology.orchestra.run.trial025.stdout:20.3.0-5145.g5fdb7d8f.el9 2026-02-12T12:51:36.987 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5145.g5fdb7d8f.el9 2026-02-12T12:51:36.987 INFO:teuthology.task.install:The correct ceph version 20.3.0-5145.g5fdb7d8f is installed. 2026-02-12T12:51:36.989 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-12T12:51:36.989 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:51:36.989 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T12:51:37.051 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-12T12:51:37.052 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:51:37.052 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T12:51:37.116 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T12:51:37.181 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-12T12:51:37.181 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:51:37.182 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T12:51:37.245 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T12:51:37.311 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-12T12:51:37.311 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:51:37.311 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T12:51:37.374 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T12:51:37.439 INFO:teuthology.run_tasks:Running task pexec... 2026-02-12T12:51:37.456 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-12T12:51:37.457 DEBUG:teuthology.orchestra.run.trial025:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-12T12:51:37.481 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial025.front.sepia.ceph.com 2026-02-12T12:51:37.481 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-12T12:51:37.533 DEBUG:teuthology.parallel:result is None 2026-02-12T12:51:37.533 INFO:teuthology.run_tasks:Running task install... 2026-02-12T12:51:37.547 DEBUG:teuthology.task.install:project ceph 2026-02-12T12:51:37.547 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}} 2026-02-12T12:51:37.547 DEBUG:teuthology.task.install:config {'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'} 2026-02-12T12:51:37.547 INFO:teuthology.task.install:Using flavor: debug 2026-02-12T12:51:37.555 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-12T12:51:37.556 INFO:teuthology.task.install:extra packages: [] 2026-02-12T12:51:37.556 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0', 'tag': None, 'wait_for_package': False} 2026-02-12T12:51:37.556 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T12:51:37.716 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/ 2026-02-12T12:51:37.716 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5145.g5fdb7d8f 2026-02-12T12:51:38.035 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T12:51:38.035 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:51:38.036 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T12:51:38.060 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-12T12:51:38.061 DEBUG:teuthology.orchestra.run.trial025:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T12:51:38.125 DEBUG:teuthology.orchestra.run.trial025:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T12:51:38.190 DEBUG:teuthology.orchestra.run.trial025:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T12:51:38.245 INFO:teuthology.orchestra.run.trial025.stdout:check_obsoletes = 1 2026-02-12T12:51:38.255 DEBUG:teuthology.orchestra.run.trial025:> sudo yum clean all 2026-02-12T12:51:38.418 INFO:teuthology.orchestra.run.trial025.stdout:56 files removed 2026-02-12T12:51:38.434 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-radosgw 2026-02-12T12:51:39.171 INFO:teuthology.orchestra.run.trial025.stdout:ceph packages for x86_64 160 kB/s | 94 kB 00:00 2026-02-12T12:51:39.763 INFO:teuthology.orchestra.run.trial025.stdout:ceph noarch packages 43 kB/s | 24 kB 00:00 2026-02-12T12:51:40.196 INFO:teuthology.orchestra.run.trial025.stdout:ceph source packages 5.0 kB/s | 2.1 kB 00:00 2026-02-12T12:51:45.867 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - BaseOS 1.6 MB/s | 8.9 MB 00:05 2026-02-12T12:51:49.650 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - AppStream 8.2 MB/s | 27 MB 00:03 2026-02-12T12:51:53.231 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - CRB 7.2 MB/s | 7.8 MB 00:01 2026-02-12T12:52:04.144 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - Extras packages 2.0 kB/s | 20 kB 00:10 2026-02-12T12:52:08.984 INFO:teuthology.orchestra.run.trial025.stdout:Extra Packages for Enterprise Linux 4.3 MB/s | 20 MB 00:04 2026-02-12T12:52:17.215 INFO:teuthology.orchestra.run.trial025.stdout:lab-extras 10 kB/s | 50 kB 00:05 2026-02-12T12:52:18.471 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:18.488 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:18.489 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:18.489 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:18.512 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-test 2026-02-12T12:52:18.814 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:01 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:18.878 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:18.895 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:18.896 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:18.896 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:18.918 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph 2026-02-12T12:52:19.222 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:02 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:19.286 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:19.303 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:19.304 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:19.304 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:19.326 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-base 2026-02-12T12:52:19.629 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:02 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:19.693 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:19.710 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:19.711 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:19.711 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:19.734 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install cephadm 2026-02-12T12:52:20.038 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:03 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:20.102 INFO:teuthology.orchestra.run.trial025.stdout:Package cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:52:20.119 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:20.120 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:20.120 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:20.142 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T12:52:20.452 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:03 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:20.517 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:20.534 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:20.535 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:20.535 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:20.556 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr 2026-02-12T12:52:20.856 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:03 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:20.920 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:20.937 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:20.938 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:20.938 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:20.960 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T12:52:21.262 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:21.328 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:52:21.346 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:21.346 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:21.346 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:21.369 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T12:52:21.674 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:21.741 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:52:21.759 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:21.759 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:21.759 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:21.781 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr-rook 2026-02-12T12:52:22.083 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:05 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:22.148 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:52:22.165 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:22.166 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:22.166 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:22.189 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T12:52:22.490 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:05 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:22.556 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:52:22.573 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:22.574 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:22.574 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:22.595 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-osd 2026-02-12T12:52:22.899 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:05 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:22.963 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:22.981 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:22.981 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:22.981 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:23.003 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-osd-classic 2026-02-12T12:52:23.304 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:23.369 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:23.386 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:23.387 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:23.387 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:23.409 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-fuse 2026-02-12T12:52:23.709 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:23.773 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:23.790 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:23.791 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:23.791 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:23.813 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-volume 2026-02-12T12:52:24.113 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:07 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:24.178 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:52:24.196 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:24.196 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:24.197 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:24.219 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install librados-devel 2026-02-12T12:52:24.527 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:07 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:24.592 INFO:teuthology.orchestra.run.trial025.stdout:Package librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:24.609 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:24.610 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:24.610 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:24.633 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install libcephfs2 2026-02-12T12:52:24.937 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:07 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:25.001 INFO:teuthology.orchestra.run.trial025.stdout:Package libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:25.019 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:25.019 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:25.019 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:25.042 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install libcephfs-devel 2026-02-12T12:52:25.344 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:25.409 INFO:teuthology.orchestra.run.trial025.stdout:Package libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:25.427 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:25.427 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:25.427 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:25.449 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install librados2 2026-02-12T12:52:25.752 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:25.816 INFO:teuthology.orchestra.run.trial025.stdout:Package librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:25.834 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:25.834 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:25.834 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:25.856 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install librbd1 2026-02-12T12:52:26.156 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:09 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:26.220 INFO:teuthology.orchestra.run.trial025.stdout:Package librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:26.238 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:26.238 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:26.238 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:26.261 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install python3-rados 2026-02-12T12:52:26.569 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:09 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:26.634 INFO:teuthology.orchestra.run.trial025.stdout:Package python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:26.652 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:26.652 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:26.652 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:26.675 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install python3-rgw 2026-02-12T12:52:26.980 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:09 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:27.045 INFO:teuthology.orchestra.run.trial025.stdout:Package python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:27.062 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:27.063 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:27.063 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:27.085 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install python3-cephfs 2026-02-12T12:52:27.388 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:27.452 INFO:teuthology.orchestra.run.trial025.stdout:Package python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:27.470 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:27.471 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:27.471 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:27.493 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install python3-rbd 2026-02-12T12:52:27.798 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:27.864 INFO:teuthology.orchestra.run.trial025.stdout:Package python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:27.881 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:27.882 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:27.882 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:27.904 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install rbd-fuse 2026-02-12T12:52:28.211 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:11 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:28.275 INFO:teuthology.orchestra.run.trial025.stdout:Package rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:28.292 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:28.293 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:28.293 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:28.316 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install rbd-mirror 2026-02-12T12:52:28.623 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:11 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:28.688 INFO:teuthology.orchestra.run.trial025.stdout:Package rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:28.706 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:28.706 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:28.706 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:28.729 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install rbd-nbd 2026-02-12T12:52:29.033 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:12 ago on Thu 12 Feb 2026 12:52:17 PM UTC. 2026-02-12T12:52:29.097 INFO:teuthology.orchestra.run.trial025.stdout:Package rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:52:29.114 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T12:52:29.115 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T12:52:29.115 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T12:52:29.140 DEBUG:teuthology.parallel:result is None 2026-02-12T12:52:29.141 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T12:52:34.317 DEBUG:teuthology.orchestra.run.trial025:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T12:52:34.339 INFO:teuthology.orchestra.run.trial025.stdout:20.3.0-5145.g5fdb7d8f.el9 2026-02-12T12:52:34.339 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5145.g5fdb7d8f.el9 2026-02-12T12:52:34.339 INFO:teuthology.task.install:The correct ceph version 20.3.0-5145.g5fdb7d8f is installed. 2026-02-12T12:52:34.342 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-12T12:52:34.342 INFO:teuthology.run_tasks:Running task ceph... 2026-02-12T12:52:34.445 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-12T12:52:34.445 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod 777 /var/log/ceph 2026-02-12T12:52:34.470 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-12T12:52:34.470 DEBUG:teuthology.orchestra.run.trial025:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T12:52:34.533 INFO:tasks.ceph:Creating extra log directories... 2026-02-12T12:52:34.533 DEBUG:teuthology.orchestra.run.trial025:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T12:52:34.608 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-12T12:52:34.608 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-12T12:52:34.608 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial/45942', 'branch': 'main', 'description': 'crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} perf_ignorelist settings/optimized workloads/fio_4K_rand_read}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '45942', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}}, 'workunit': {'branch': 'seastore_io_uring', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}}, 'owner': 'scheduled_moagrawa@soko04.front.sepia.ceph.com', 'priority': 1000, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 4100, 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'seastore_io_uring', 'suite_path': '/home/teuthworker/src/github.com_mohit84_ceph_5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/mohit84/ceph.git', 'suite_sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0', 'targets': {'trial025.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBRfuTGbU026NNqRFPSb9Cuzkx9XyRw8WrYkEEjuMD5mDWhgQbsostjuHo5rYgQ8m5CB2CyfAJZm7Rb5Ip4NroA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}}, 'wait-for-scrub': False, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0', 'cluster': 'ceph'}}, {'ssh_keys': None}, {'cbt': {'benchmarks': {'librbdfio': {'iodepth': [32], 'log_avg_msec': 100, 'mode': ['randread'], 'norandommap': True, 'op_size': [4096], 'osd_ra': [4096], 'pool_profile': 'rbd', 'procs_per_volume': [1], 'time': 60, 'vol_size': 4096, 'volumes_per_client': [2]}}, 'cluster': {'iterations': 1, 'osds_per_node': 3, 'pool_profiles': {'rbd': {'pg_size': 128, 'pgp_size': 128, 'replication': 3}}, 'user': 'ubuntu'}, 'monitoring_profiles': {'perf': {'args': 'stat -p {pid} -o {perf_dir}/perf_stat.{pid}', 'nodes': ['osds'], 'perf_cmd': 'perf', 'pid_glob': 'crimson-osd.*.pid'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8bec0da71becad44414c54979f64c9ef0e7099c6', 'timestamp': '2026-02-12_06:08:11', 'tube': 'trial', 'user': 'moagrawa', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.2161924'} 2026-02-12T12:52:34.609 DEBUG:teuthology.orchestra.run.trial025:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T12:52:34.655 DEBUG:teuthology.orchestra.run.trial025:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T12:52:34.721 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:52:34.721 DEBUG:teuthology.orchestra.run.trial025:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T12:52:34.780 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T12:52:34.780 DEBUG:teuthology.orchestra.run.trial025:> stat /dev/vg_nvme/lv_1 2026-02-12T12:52:34.837 INFO:teuthology.orchestra.run.trial025.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T12:52:34.837 INFO:teuthology.orchestra.run.trial025.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T12:52:34.837 INFO:teuthology.orchestra.run.trial025.stdout:Device: 6h/6d Inode: 1316 Links: 1 2026-02-12T12:52:34.837 INFO:teuthology.orchestra.run.trial025.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T12:52:34.837 INFO:teuthology.orchestra.run.trial025.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T12:52:34.837 INFO:teuthology.orchestra.run.trial025.stdout:Access: 2026-02-12 12:50:43.666124985 +0000 2026-02-12T12:52:34.837 INFO:teuthology.orchestra.run.trial025.stdout:Modify: 2026-02-12 12:49:42.209975060 +0000 2026-02-12T12:52:34.837 INFO:teuthology.orchestra.run.trial025.stdout:Change: 2026-02-12 12:49:42.209975060 +0000 2026-02-12T12:52:34.837 INFO:teuthology.orchestra.run.trial025.stdout: Birth: 2026-02-12 12:49:42.209975060 +0000 2026-02-12T12:52:34.838 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T12:52:34.901 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records in 2026-02-12T12:52:34.901 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records out 2026-02-12T12:52:34.902 INFO:teuthology.orchestra.run.trial025.stderr:512 bytes copied, 0.000245387 s, 2.1 MB/s 2026-02-12T12:52:34.903 DEBUG:teuthology.orchestra.run.trial025:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T12:52:34.960 DEBUG:teuthology.orchestra.run.trial025:> stat /dev/vg_nvme/lv_2 2026-02-12T12:52:35.016 INFO:teuthology.orchestra.run.trial025.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T12:52:35.017 INFO:teuthology.orchestra.run.trial025.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T12:52:35.017 INFO:teuthology.orchestra.run.trial025.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-12T12:52:35.017 INFO:teuthology.orchestra.run.trial025.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T12:52:35.017 INFO:teuthology.orchestra.run.trial025.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T12:52:35.017 INFO:teuthology.orchestra.run.trial025.stdout:Access: 2026-02-12 12:50:43.667124968 +0000 2026-02-12T12:52:35.017 INFO:teuthology.orchestra.run.trial025.stdout:Modify: 2026-02-12 12:49:42.208975077 +0000 2026-02-12T12:52:35.017 INFO:teuthology.orchestra.run.trial025.stdout:Change: 2026-02-12 12:49:42.208975077 +0000 2026-02-12T12:52:35.017 INFO:teuthology.orchestra.run.trial025.stdout: Birth: 2026-02-12 12:49:42.208975077 +0000 2026-02-12T12:52:35.018 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T12:52:35.079 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records in 2026-02-12T12:52:35.079 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records out 2026-02-12T12:52:35.079 INFO:teuthology.orchestra.run.trial025.stderr:512 bytes copied, 0.000218737 s, 2.3 MB/s 2026-02-12T12:52:35.080 DEBUG:teuthology.orchestra.run.trial025:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T12:52:35.136 DEBUG:teuthology.orchestra.run.trial025:> stat /dev/vg_nvme/lv_3 2026-02-12T12:52:35.193 INFO:teuthology.orchestra.run.trial025.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T12:52:35.193 INFO:teuthology.orchestra.run.trial025.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T12:52:35.193 INFO:teuthology.orchestra.run.trial025.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-12T12:52:35.193 INFO:teuthology.orchestra.run.trial025.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T12:52:35.193 INFO:teuthology.orchestra.run.trial025.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T12:52:35.193 INFO:teuthology.orchestra.run.trial025.stdout:Access: 2026-02-12 12:50:43.667124968 +0000 2026-02-12T12:52:35.194 INFO:teuthology.orchestra.run.trial025.stdout:Modify: 2026-02-12 12:49:42.208975077 +0000 2026-02-12T12:52:35.194 INFO:teuthology.orchestra.run.trial025.stdout:Change: 2026-02-12 12:49:42.208975077 +0000 2026-02-12T12:52:35.194 INFO:teuthology.orchestra.run.trial025.stdout: Birth: 2026-02-12 12:49:42.208975077 +0000 2026-02-12T12:52:35.194 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T12:52:35.255 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records in 2026-02-12T12:52:35.255 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records out 2026-02-12T12:52:35.255 INFO:teuthology.orchestra.run.trial025.stderr:512 bytes copied, 0.000147765 s, 3.5 MB/s 2026-02-12T12:52:35.256 DEBUG:teuthology.orchestra.run.trial025:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T12:52:35.315 DEBUG:teuthology.orchestra.run.trial025:> stat /dev/vg_nvme/lv_4 2026-02-12T12:52:35.372 INFO:teuthology.orchestra.run.trial025.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T12:52:35.372 INFO:teuthology.orchestra.run.trial025.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T12:52:35.373 INFO:teuthology.orchestra.run.trial025.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-12T12:52:35.373 INFO:teuthology.orchestra.run.trial025.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T12:52:35.373 INFO:teuthology.orchestra.run.trial025.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T12:52:35.373 INFO:teuthology.orchestra.run.trial025.stdout:Access: 2026-02-12 12:50:43.667124968 +0000 2026-02-12T12:52:35.373 INFO:teuthology.orchestra.run.trial025.stdout:Modify: 2026-02-12 12:49:42.208975077 +0000 2026-02-12T12:52:35.373 INFO:teuthology.orchestra.run.trial025.stdout:Change: 2026-02-12 12:49:42.208975077 +0000 2026-02-12T12:52:35.373 INFO:teuthology.orchestra.run.trial025.stdout: Birth: 2026-02-12 12:49:42.208975077 +0000 2026-02-12T12:52:35.373 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T12:52:35.435 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records in 2026-02-12T12:52:35.435 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records out 2026-02-12T12:52:35.436 INFO:teuthology.orchestra.run.trial025.stderr:512 bytes copied, 0.000148236 s, 3.5 MB/s 2026-02-12T12:52:35.437 DEBUG:teuthology.orchestra.run.trial025:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T12:52:35.493 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T12:52:35.493 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial025.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-12T12:52:35.494 INFO:tasks.ceph:Generating config... 2026-02-12T12:52:35.496 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-12T12:52:35.496 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-12T12:52:35.496 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-12T12:52:35.496 INFO:tasks.ceph:[osd] debug filestore = 0/0 2026-02-12T12:52:35.496 INFO:tasks.ceph:[osd] debug journal = 0/0 2026-02-12T12:52:35.496 INFO:tasks.ceph:[osd] debug ms = 0/0 2026-02-12T12:52:35.497 INFO:tasks.ceph:[osd] debug osd = 0/0 2026-02-12T12:52:35.497 INFO:tasks.ceph:[osd] debug seastore = 20 2026-02-12T12:52:35.497 INFO:tasks.ceph:[osd] debug seastore backref = 20 2026-02-12T12:52:35.497 INFO:tasks.ceph:[osd] debug seastore cache = 20 2026-02-12T12:52:35.497 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2026-02-12T12:52:35.497 INFO:tasks.ceph:[osd] debug seastore device = 20 2026-02-12T12:52:35.497 INFO:tasks.ceph:[osd] debug seastore epm = 20 2026-02-12T12:52:35.497 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2026-02-12T12:52:35.497 INFO:tasks.ceph:[osd] debug seastore journal = 20 2026-02-12T12:52:35.497 INFO:tasks.ceph:[osd] debug seastore lba = 20 2026-02-12T12:52:35.497 INFO:tasks.ceph:[osd] debug seastore odata = 20 2026-02-12T12:52:35.497 INFO:tasks.ceph:[osd] debug seastore omap = 20 2026-02-12T12:52:35.498 INFO:tasks.ceph:[osd] debug seastore onode = 20 2026-02-12T12:52:35.498 INFO:tasks.ceph:[osd] debug seastore t = 20 2026-02-12T12:52:35.498 INFO:tasks.ceph:[osd] debug seastore tm = 20 2026-02-12T12:52:35.498 INFO:tasks.ceph:[osd] osd objectstore = seastore 2026-02-12T12:52:35.498 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-12T12:52:35.498 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-12T12:52:35.498 INFO:tasks.ceph:[osd] seastore cachepin type = 2Q 2026-02-12T12:52:35.498 INFO:tasks.ceph:[osd] seastore main device type = RANDOM_BLOCK_SSD 2026-02-12T12:52:35.498 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-12T12:52:35.498 INFO:tasks.ceph:[global] auth client required = none 2026-02-12T12:52:35.498 INFO:tasks.ceph:[global] auth cluster required = none 2026-02-12T12:52:35.498 INFO:tasks.ceph:[global] auth service required = none 2026-02-12T12:52:35.499 INFO:tasks.ceph:[global] auth supported = none 2026-02-12T12:52:35.499 INFO:tasks.ceph:[global] debug asok = 0/0 2026-02-12T12:52:35.499 INFO:tasks.ceph:[global] debug auth = 0/0 2026-02-12T12:52:35.499 INFO:tasks.ceph:[global] debug bdev = 0/0 2026-02-12T12:52:35.499 INFO:tasks.ceph:[global] debug bluefs = 0/0 2026-02-12T12:52:35.499 INFO:tasks.ceph:[global] debug bluestore = 0/0 2026-02-12T12:52:35.499 INFO:tasks.ceph:[global] debug buffer = 0/0 2026-02-12T12:52:35.499 INFO:tasks.ceph:[global] debug civetweb = 0/0 2026-02-12T12:52:35.499 INFO:tasks.ceph:[global] debug client = 0/0 2026-02-12T12:52:35.499 INFO:tasks.ceph:[global] debug compressor = 0/0 2026-02-12T12:52:35.499 INFO:tasks.ceph:[global] debug context = 0/0 2026-02-12T12:52:35.499 INFO:tasks.ceph:[global] debug crush = 0/0 2026-02-12T12:52:35.500 INFO:tasks.ceph:[global] debug crypto = 0/0 2026-02-12T12:52:35.500 INFO:tasks.ceph:[global] debug dpdk = 0/0 2026-02-12T12:52:35.500 INFO:tasks.ceph:[global] debug eventtrace = 0/0 2026-02-12T12:52:35.500 INFO:tasks.ceph:[global] debug filer = 0/0 2026-02-12T12:52:35.500 INFO:tasks.ceph:[global] debug filestore = 0/0 2026-02-12T12:52:35.500 INFO:tasks.ceph:[global] debug finisher = 0/0 2026-02-12T12:52:35.500 INFO:tasks.ceph:[global] debug fuse = 0/0 2026-02-12T12:52:35.500 INFO:tasks.ceph:[global] debug heartbeatmap = 0/0 2026-02-12T12:52:35.500 INFO:tasks.ceph:[global] debug javaclient = 0/0 2026-02-12T12:52:35.500 INFO:tasks.ceph:[global] debug journal = 0/0 2026-02-12T12:52:35.500 INFO:tasks.ceph:[global] debug journaler = 0/0 2026-02-12T12:52:35.500 INFO:tasks.ceph:[global] debug kstore = 0/0 2026-02-12T12:52:35.500 INFO:tasks.ceph:[global] debug leveldb = 0/0 2026-02-12T12:52:35.501 INFO:tasks.ceph:[global] debug lockdep = 0/0 2026-02-12T12:52:35.501 INFO:tasks.ceph:[global] debug mds = 0/0 2026-02-12T12:52:35.501 INFO:tasks.ceph:[global] debug mds balancer = 0/0 2026-02-12T12:52:35.501 INFO:tasks.ceph:[global] debug mds locker = 0/0 2026-02-12T12:52:35.501 INFO:tasks.ceph:[global] debug mds log = 0/0 2026-02-12T12:52:35.501 INFO:tasks.ceph:[global] debug mds log expire = 0/0 2026-02-12T12:52:35.501 INFO:tasks.ceph:[global] debug mds migrator = 0/0 2026-02-12T12:52:35.501 INFO:tasks.ceph:[global] debug memdb = 0/0 2026-02-12T12:52:35.501 INFO:tasks.ceph:[global] debug mgr = 0/0 2026-02-12T12:52:35.501 INFO:tasks.ceph:[global] debug mgrc = 0/0 2026-02-12T12:52:35.501 INFO:tasks.ceph:[global] debug mon = 0/0 2026-02-12T12:52:35.501 INFO:tasks.ceph:[global] debug monc = 0/0 2026-02-12T12:52:35.501 INFO:tasks.ceph:[global] debug ms = 0/0 2026-02-12T12:52:35.502 INFO:tasks.ceph:[global] debug objclass = 0/0 2026-02-12T12:52:35.502 INFO:tasks.ceph:[global] debug objectcacher = 0/0 2026-02-12T12:52:35.502 INFO:tasks.ceph:[global] debug objecter = 0/0 2026-02-12T12:52:35.502 INFO:tasks.ceph:[global] debug optracker = 0/0 2026-02-12T12:52:35.502 INFO:tasks.ceph:[global] debug osd = 0/0 2026-02-12T12:52:35.502 INFO:tasks.ceph:[global] debug paxos = 0/0 2026-02-12T12:52:35.502 INFO:tasks.ceph:[global] debug perfcounter = 0/0 2026-02-12T12:52:35.502 INFO:tasks.ceph:[global] debug rados = 0/0 2026-02-12T12:52:35.502 INFO:tasks.ceph:[global] debug rbd = 0/0 2026-02-12T12:52:35.502 INFO:tasks.ceph:[global] debug rbd mirror = 0/0 2026-02-12T12:52:35.502 INFO:tasks.ceph:[global] debug rbd replay = 0/0 2026-02-12T12:52:35.502 INFO:tasks.ceph:[global] debug refs = 0/0 2026-02-12T12:52:35.503 INFO:tasks.ceph:[global] debug rgw = 0/0 2026-02-12T12:52:35.503 INFO:tasks.ceph:[global] debug rgw lifecycle = 0/0 2026-02-12T12:52:35.503 INFO:tasks.ceph:[global] debug rgw notification = 0/0 2026-02-12T12:52:35.503 INFO:tasks.ceph:[global] debug rgw sync = 0/0 2026-02-12T12:52:35.503 INFO:tasks.ceph:[global] debug rocksdb = 0/0 2026-02-12T12:52:35.503 INFO:tasks.ceph:[global] debug striper = 0/0 2026-02-12T12:52:35.503 INFO:tasks.ceph:[global] debug throttle = 0/0 2026-02-12T12:52:35.503 INFO:tasks.ceph:[global] debug timer = 0/0 2026-02-12T12:52:35.503 INFO:tasks.ceph:[global] debug tp = 0/0 2026-02-12T12:52:35.503 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-12T12:52:35.503 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-12T12:52:35.503 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-12T12:52:35.503 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-12T12:52:35.504 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-12T12:52:35.504 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-12T12:52:35.504 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-12T12:52:35.504 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-12T12:52:35.504 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-12T12:52:35.504 INFO:tasks.ceph:[mon] debug mon = 0/0 2026-02-12T12:52:35.504 INFO:tasks.ceph:[mon] debug ms = 0/0 2026-02-12T12:52:35.504 INFO:tasks.ceph:[mon] debug paxos = 0/0 2026-02-12T12:52:35.504 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-12T12:52:35.504 INFO:tasks.ceph:Setting up mon.a... 2026-02-12T12:52:35.505 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-12T12:52:35.576 INFO:teuthology.orchestra.run.trial025.stdout:creating /etc/ceph/ceph.keyring 2026-02-12T12:52:35.579 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-12T12:52:35.663 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T12:52:35.687 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.25')] 2026-02-12T12:52:35.688 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'none', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.25', 'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': '0/0', 'debug mon': '0/0', 'debug paxos': '0/0', 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-12T12:52:35.690 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:52:35.690 DEBUG:teuthology.orchestra.run.trial025:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T12:52:35.744 DEBUG:teuthology.orchestra.run.trial025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.25 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-12T12:52:35.826 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:35.824+0000 7f7fb72acf40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:35.827 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:35.824+0000 7f7fb72acf40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:35.827 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:35.824+0000 7f7fb72acf40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:35.828 INFO:teuthology.orchestra.run.trial025.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-12T12:52:35.828 INFO:teuthology.orchestra.run.trial025.stdout:monmaptool: generated fsid 9e8a6ce4-35d0-4fd4-b51c-76422f1eda54 2026-02-12T12:52:35.828 INFO:teuthology.orchestra.run.trial025.stdout:setting min_mon_release = tentacle 2026-02-12T12:52:35.828 INFO:teuthology.orchestra.run.trial025.stdout:epoch 0 2026-02-12T12:52:35.828 INFO:teuthology.orchestra.run.trial025.stdout:fsid 9e8a6ce4-35d0-4fd4-b51c-76422f1eda54 2026-02-12T12:52:35.828 INFO:teuthology.orchestra.run.trial025.stdout:last_changed 2026-02-12T12:52:35.825926+0000 2026-02-12T12:52:35.828 INFO:teuthology.orchestra.run.trial025.stdout:created 2026-02-12T12:52:35.825926+0000 2026-02-12T12:52:35.829 INFO:teuthology.orchestra.run.trial025.stdout:min_mon_release 20 (tentacle) 2026-02-12T12:52:35.829 INFO:teuthology.orchestra.run.trial025.stdout:election_strategy: 1 2026-02-12T12:52:35.829 INFO:teuthology.orchestra.run.trial025.stdout:0: [v2:10.20.193.25:3300/0,v1:10.20.193.25:6789/0] mon.a 2026-02-12T12:52:35.829 INFO:teuthology.orchestra.run.trial025.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-12T12:52:35.830 DEBUG:teuthology.orchestra.run.trial025:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T12:52:35.886 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9e8a6ce4-35d0-4fd4-b51c-76422f1eda54... 2026-02-12T12:52:35.887 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T12:52:35.965 INFO:teuthology.orchestra.run.trial025.stdout:[global] 2026-02-12T12:52:35.965 INFO:teuthology.orchestra.run.trial025.stdout: chdir = "" 2026-02-12T12:52:35.965 INFO:teuthology.orchestra.run.trial025.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T12:52:35.966 INFO:teuthology.orchestra.run.trial025.stdout: auth supported = none 2026-02-12T12:52:35.966 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.966 INFO:teuthology.orchestra.run.trial025.stdout: filestore xattr use omap = true 2026-02-12T12:52:35.966 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.966 INFO:teuthology.orchestra.run.trial025.stdout: mon clock drift allowed = 1.000 2026-02-12T12:52:35.966 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.966 INFO:teuthology.orchestra.run.trial025.stdout: osd crush chooseleaf type = 0 2026-02-12T12:52:35.966 INFO:teuthology.orchestra.run.trial025.stdout: auth debug = true 2026-02-12T12:52:35.966 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.966 INFO:teuthology.orchestra.run.trial025.stdout: ms die on old message = true 2026-02-12T12:52:35.966 INFO:teuthology.orchestra.run.trial025.stdout: ms die on bug = true 2026-02-12T12:52:35.967 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.967 INFO:teuthology.orchestra.run.trial025.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T12:52:35.967 INFO:teuthology.orchestra.run.trial025.stdout: mon pg warn max object skew = 0 2026-02-12T12:52:35.967 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.967 INFO:teuthology.orchestra.run.trial025.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T12:52:35.967 INFO:teuthology.orchestra.run.trial025.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T12:52:35.967 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.967 INFO:teuthology.orchestra.run.trial025.stdout: osd pool default size = 2 2026-02-12T12:52:35.967 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.967 INFO:teuthology.orchestra.run.trial025.stdout: mon osd allow primary affinity = true 2026-02-12T12:52:35.967 INFO:teuthology.orchestra.run.trial025.stdout: mon osd allow pg remap = true 2026-02-12T12:52:35.967 INFO:teuthology.orchestra.run.trial025.stdout: mon warn on legacy crush tunables = false 2026-02-12T12:52:35.968 INFO:teuthology.orchestra.run.trial025.stdout: mon warn on crush straw calc version zero = false 2026-02-12T12:52:35.968 INFO:teuthology.orchestra.run.trial025.stdout: mon warn on no sortbitwise = false 2026-02-12T12:52:35.968 INFO:teuthology.orchestra.run.trial025.stdout: mon warn on osd down out interval zero = false 2026-02-12T12:52:35.968 INFO:teuthology.orchestra.run.trial025.stdout: mon warn on too few osds = false 2026-02-12T12:52:35.968 INFO:teuthology.orchestra.run.trial025.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T12:52:35.968 INFO:teuthology.orchestra.run.trial025.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T12:52:35.968 INFO:teuthology.orchestra.run.trial025.stdout: mon_allow_pool_size_one = true 2026-02-12T12:52:35.968 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.968 INFO:teuthology.orchestra.run.trial025.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T12:52:35.968 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.968 INFO:teuthology.orchestra.run.trial025.stdout: osd default data pool replay window = 5 2026-02-12T12:52:35.968 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.969 INFO:teuthology.orchestra.run.trial025.stdout: mon allow pool delete = true 2026-02-12T12:52:35.969 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.969 INFO:teuthology.orchestra.run.trial025.stdout: mon cluster log file level = debug 2026-02-12T12:52:35.969 INFO:teuthology.orchestra.run.trial025.stdout: debug asserts on shutdown = true 2026-02-12T12:52:35.969 INFO:teuthology.orchestra.run.trial025.stdout: mon health detail to clog = false 2026-02-12T12:52:35.969 INFO:teuthology.orchestra.run.trial025.stdout: mon host = 10.20.193.25 2026-02-12T12:52:35.969 INFO:teuthology.orchestra.run.trial025.stdout: auth client required = none 2026-02-12T12:52:35.969 INFO:teuthology.orchestra.run.trial025.stdout: auth cluster required = none 2026-02-12T12:52:35.969 INFO:teuthology.orchestra.run.trial025.stdout: auth service required = none 2026-02-12T12:52:35.969 INFO:teuthology.orchestra.run.trial025.stdout: debug asok = 0/0 2026-02-12T12:52:35.969 INFO:teuthology.orchestra.run.trial025.stdout: debug auth = 0/0 2026-02-12T12:52:35.969 INFO:teuthology.orchestra.run.trial025.stdout: debug bdev = 0/0 2026-02-12T12:52:35.970 INFO:teuthology.orchestra.run.trial025.stdout: debug bluefs = 0/0 2026-02-12T12:52:35.970 INFO:teuthology.orchestra.run.trial025.stdout: debug bluestore = 0/0 2026-02-12T12:52:35.970 INFO:teuthology.orchestra.run.trial025.stdout: debug buffer = 0/0 2026-02-12T12:52:35.970 INFO:teuthology.orchestra.run.trial025.stdout: debug civetweb = 0/0 2026-02-12T12:52:35.970 INFO:teuthology.orchestra.run.trial025.stdout: debug client = 0/0 2026-02-12T12:52:35.970 INFO:teuthology.orchestra.run.trial025.stdout: debug compressor = 0/0 2026-02-12T12:52:35.970 INFO:teuthology.orchestra.run.trial025.stdout: debug context = 0/0 2026-02-12T12:52:35.970 INFO:teuthology.orchestra.run.trial025.stdout: debug crush = 0/0 2026-02-12T12:52:35.970 INFO:teuthology.orchestra.run.trial025.stdout: debug crypto = 0/0 2026-02-12T12:52:35.970 INFO:teuthology.orchestra.run.trial025.stdout: debug dpdk = 0/0 2026-02-12T12:52:35.970 INFO:teuthology.orchestra.run.trial025.stdout: debug eventtrace = 0/0 2026-02-12T12:52:35.970 INFO:teuthology.orchestra.run.trial025.stdout: debug filer = 0/0 2026-02-12T12:52:35.970 INFO:teuthology.orchestra.run.trial025.stdout: debug filestore = 0/0 2026-02-12T12:52:35.971 INFO:teuthology.orchestra.run.trial025.stdout: debug finisher = 0/0 2026-02-12T12:52:35.971 INFO:teuthology.orchestra.run.trial025.stdout: debug fuse = 0/0 2026-02-12T12:52:35.971 INFO:teuthology.orchestra.run.trial025.stdout: debug heartbeatmap = 0/0 2026-02-12T12:52:35.971 INFO:teuthology.orchestra.run.trial025.stdout: debug javaclient = 0/0 2026-02-12T12:52:35.971 INFO:teuthology.orchestra.run.trial025.stdout: debug journal = 0/0 2026-02-12T12:52:35.971 INFO:teuthology.orchestra.run.trial025.stdout: debug journaler = 0/0 2026-02-12T12:52:35.971 INFO:teuthology.orchestra.run.trial025.stdout: debug kstore = 0/0 2026-02-12T12:52:35.971 INFO:teuthology.orchestra.run.trial025.stdout: debug leveldb = 0/0 2026-02-12T12:52:35.971 INFO:teuthology.orchestra.run.trial025.stdout: debug lockdep = 0/0 2026-02-12T12:52:35.971 INFO:teuthology.orchestra.run.trial025.stdout: debug mds = 0/0 2026-02-12T12:52:35.971 INFO:teuthology.orchestra.run.trial025.stdout: debug mds balancer = 0/0 2026-02-12T12:52:35.971 INFO:teuthology.orchestra.run.trial025.stdout: debug mds locker = 0/0 2026-02-12T12:52:35.971 INFO:teuthology.orchestra.run.trial025.stdout: debug mds log = 0/0 2026-02-12T12:52:35.972 INFO:teuthology.orchestra.run.trial025.stdout: debug mds log expire = 0/0 2026-02-12T12:52:35.972 INFO:teuthology.orchestra.run.trial025.stdout: debug mds migrator = 0/0 2026-02-12T12:52:35.972 INFO:teuthology.orchestra.run.trial025.stdout: debug memdb = 0/0 2026-02-12T12:52:35.972 INFO:teuthology.orchestra.run.trial025.stdout: debug mgr = 0/0 2026-02-12T12:52:35.972 INFO:teuthology.orchestra.run.trial025.stdout: debug mgrc = 0/0 2026-02-12T12:52:35.972 INFO:teuthology.orchestra.run.trial025.stdout: debug mon = 0/0 2026-02-12T12:52:35.972 INFO:teuthology.orchestra.run.trial025.stdout: debug monc = 0/0 2026-02-12T12:52:35.972 INFO:teuthology.orchestra.run.trial025.stdout: debug ms = 0/0 2026-02-12T12:52:35.972 INFO:teuthology.orchestra.run.trial025.stdout: debug objclass = 0/0 2026-02-12T12:52:35.972 INFO:teuthology.orchestra.run.trial025.stdout: debug objectcacher = 0/0 2026-02-12T12:52:35.972 INFO:teuthology.orchestra.run.trial025.stdout: debug objecter = 0/0 2026-02-12T12:52:35.972 INFO:teuthology.orchestra.run.trial025.stdout: debug optracker = 0/0 2026-02-12T12:52:35.972 INFO:teuthology.orchestra.run.trial025.stdout: debug osd = 0/0 2026-02-12T12:52:35.973 INFO:teuthology.orchestra.run.trial025.stdout: debug paxos = 0/0 2026-02-12T12:52:35.973 INFO:teuthology.orchestra.run.trial025.stdout: debug perfcounter = 0/0 2026-02-12T12:52:35.973 INFO:teuthology.orchestra.run.trial025.stdout: debug rados = 0/0 2026-02-12T12:52:35.973 INFO:teuthology.orchestra.run.trial025.stdout: debug rbd = 0/0 2026-02-12T12:52:35.973 INFO:teuthology.orchestra.run.trial025.stdout: debug rbd mirror = 0/0 2026-02-12T12:52:35.973 INFO:teuthology.orchestra.run.trial025.stdout: debug rbd replay = 0/0 2026-02-12T12:52:35.973 INFO:teuthology.orchestra.run.trial025.stdout: debug refs = 0/0 2026-02-12T12:52:35.973 INFO:teuthology.orchestra.run.trial025.stdout: debug rgw = 0/0 2026-02-12T12:52:35.973 INFO:teuthology.orchestra.run.trial025.stdout: debug rgw lifecycle = 0/0 2026-02-12T12:52:35.973 INFO:teuthology.orchestra.run.trial025.stdout: debug rgw notification = 0/0 2026-02-12T12:52:35.973 INFO:teuthology.orchestra.run.trial025.stdout: debug rgw sync = 0/0 2026-02-12T12:52:35.973 INFO:teuthology.orchestra.run.trial025.stdout: debug rocksdb = 0/0 2026-02-12T12:52:35.973 INFO:teuthology.orchestra.run.trial025.stdout: debug striper = 0/0 2026-02-12T12:52:35.974 INFO:teuthology.orchestra.run.trial025.stdout: debug throttle = 0/0 2026-02-12T12:52:35.974 INFO:teuthology.orchestra.run.trial025.stdout: debug timer = 0/0 2026-02-12T12:52:35.974 INFO:teuthology.orchestra.run.trial025.stdout: debug tp = 0/0 2026-02-12T12:52:35.974 INFO:teuthology.orchestra.run.trial025.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-12T12:52:35.974 INFO:teuthology.orchestra.run.trial025.stdout: ms client mode = crc 2026-02-12T12:52:35.974 INFO:teuthology.orchestra.run.trial025.stdout: ms cluster mode = crc 2026-02-12T12:52:35.974 INFO:teuthology.orchestra.run.trial025.stdout: ms mon client mode = crc 2026-02-12T12:52:35.974 INFO:teuthology.orchestra.run.trial025.stdout: ms mon cluster mode = crc 2026-02-12T12:52:35.974 INFO:teuthology.orchestra.run.trial025.stdout: ms mon service mode = crc 2026-02-12T12:52:35.974 INFO:teuthology.orchestra.run.trial025.stdout: ms service mode = crc 2026-02-12T12:52:35.974 INFO:teuthology.orchestra.run.trial025.stdout: fsid = 9e8a6ce4-35d0-4fd4-b51c-76422f1eda54 2026-02-12T12:52:35.974 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.974 INFO:teuthology.orchestra.run.trial025.stdout:[osd] 2026-02-12T12:52:35.975 INFO:teuthology.orchestra.run.trial025.stdout: osd journal size = 100 2026-02-12T12:52:35.975 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.975 INFO:teuthology.orchestra.run.trial025.stdout: osd scrub load threshold = 5.0 2026-02-12T12:52:35.975 INFO:teuthology.orchestra.run.trial025.stdout: osd scrub max interval = 600 2026-02-12T12:52:35.975 INFO:teuthology.orchestra.run.trial025.stdout: osd mclock profile = high_recovery_ops 2026-02-12T12:52:35.975 INFO:teuthology.orchestra.run.trial025.stdout: osd mclock skip benchmark = true 2026-02-12T12:52:35.975 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.975 INFO:teuthology.orchestra.run.trial025.stdout: osd recover clone overlap = true 2026-02-12T12:52:35.975 INFO:teuthology.orchestra.run.trial025.stdout: osd recovery max chunk = 1048576 2026-02-12T12:52:35.975 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.975 INFO:teuthology.orchestra.run.trial025.stdout: osd debug shutdown = true 2026-02-12T12:52:35.975 INFO:teuthology.orchestra.run.trial025.stdout: osd debug op order = true 2026-02-12T12:52:35.976 INFO:teuthology.orchestra.run.trial025.stdout: osd debug verify stray on activate = true 2026-02-12T12:52:35.976 INFO:teuthology.orchestra.run.trial025.stdout: osd debug trim objects = true 2026-02-12T12:52:35.976 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.976 INFO:teuthology.orchestra.run.trial025.stdout: osd open classes on start = true 2026-02-12T12:52:35.976 INFO:teuthology.orchestra.run.trial025.stdout: osd debug pg log writeout = true 2026-02-12T12:52:35.976 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.976 INFO:teuthology.orchestra.run.trial025.stdout: osd deep scrub update digest min age = 30 2026-02-12T12:52:35.976 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.976 INFO:teuthology.orchestra.run.trial025.stdout: osd map max advance = 10 2026-02-12T12:52:35.976 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.976 INFO:teuthology.orchestra.run.trial025.stdout: journal zero on create = true 2026-02-12T12:52:35.976 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.977 INFO:teuthology.orchestra.run.trial025.stdout: filestore ondisk finisher threads = 3 2026-02-12T12:52:35.977 INFO:teuthology.orchestra.run.trial025.stdout: filestore apply finisher threads = 3 2026-02-12T12:52:35.977 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.977 INFO:teuthology.orchestra.run.trial025.stdout: bdev debug aio = true 2026-02-12T12:52:35.977 INFO:teuthology.orchestra.run.trial025.stdout: osd debug misdirected ops = true 2026-02-12T12:52:35.977 INFO:teuthology.orchestra.run.trial025.stdout: debug monc = 20 2026-02-12T12:52:35.977 INFO:teuthology.orchestra.run.trial025.stdout: crimson cpu num = 4 2026-02-12T12:52:35.977 INFO:teuthology.orchestra.run.trial025.stdout: crimson osd obc lru size = 10 2026-02-12T12:52:35.977 INFO:teuthology.orchestra.run.trial025.stdout: debug filestore = 0/0 2026-02-12T12:52:35.977 INFO:teuthology.orchestra.run.trial025.stdout: debug journal = 0/0 2026-02-12T12:52:35.977 INFO:teuthology.orchestra.run.trial025.stdout: debug ms = 0/0 2026-02-12T12:52:35.977 INFO:teuthology.orchestra.run.trial025.stdout: debug osd = 0/0 2026-02-12T12:52:35.977 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore = 20 2026-02-12T12:52:35.978 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore backref = 20 2026-02-12T12:52:35.978 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore cache = 20 2026-02-12T12:52:35.978 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore cleaner = 20 2026-02-12T12:52:35.978 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore device = 20 2026-02-12T12:52:35.978 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore epm = 20 2026-02-12T12:52:35.978 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore fixedkv tree = 20 2026-02-12T12:52:35.978 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore journal = 20 2026-02-12T12:52:35.978 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore lba = 20 2026-02-12T12:52:35.978 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore odata = 20 2026-02-12T12:52:35.978 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore omap = 20 2026-02-12T12:52:35.978 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore onode = 20 2026-02-12T12:52:35.978 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore t = 20 2026-02-12T12:52:35.978 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore tm = 20 2026-02-12T12:52:35.978 INFO:teuthology.orchestra.run.trial025.stdout: osd objectstore = seastore 2026-02-12T12:52:35.979 INFO:teuthology.orchestra.run.trial025.stdout: osd shutdown pgref assert = True 2026-02-12T12:52:35.979 INFO:teuthology.orchestra.run.trial025.stdout: seastore cachepin size pershard = 64M 2026-02-12T12:52:35.979 INFO:teuthology.orchestra.run.trial025.stdout: seastore cachepin type = 2Q 2026-02-12T12:52:35.979 INFO:teuthology.orchestra.run.trial025.stdout: seastore main device type = RANDOM_BLOCK_SSD 2026-02-12T12:52:35.979 INFO:teuthology.orchestra.run.trial025.stdout: seastore max concurrent transactions = 8 2026-02-12T12:52:35.979 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.979 INFO:teuthology.orchestra.run.trial025.stdout:[mgr] 2026-02-12T12:52:35.979 INFO:teuthology.orchestra.run.trial025.stdout: debug ms = 1 2026-02-12T12:52:35.979 INFO:teuthology.orchestra.run.trial025.stdout: debug mgr = 20 2026-02-12T12:52:35.979 INFO:teuthology.orchestra.run.trial025.stdout: debug mon = 20 2026-02-12T12:52:35.979 INFO:teuthology.orchestra.run.trial025.stdout: debug auth = 20 2026-02-12T12:52:35.979 INFO:teuthology.orchestra.run.trial025.stdout: mon reweight min pgs per osd = 4 2026-02-12T12:52:35.979 INFO:teuthology.orchestra.run.trial025.stdout: mon reweight min bytes per osd = 10 2026-02-12T12:52:35.980 INFO:teuthology.orchestra.run.trial025.stdout: mgr/telemetry/nag = false 2026-02-12T12:52:35.980 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.980 INFO:teuthology.orchestra.run.trial025.stdout:[mon] 2026-02-12T12:52:35.980 INFO:teuthology.orchestra.run.trial025.stdout: debug ms = 0/0 2026-02-12T12:52:35.980 INFO:teuthology.orchestra.run.trial025.stdout: debug mon = 0/0 2026-02-12T12:52:35.980 INFO:teuthology.orchestra.run.trial025.stdout: debug paxos = 0/0 2026-02-12T12:52:35.980 INFO:teuthology.orchestra.run.trial025.stdout: debug auth = 20 2026-02-12T12:52:35.980 INFO:teuthology.orchestra.run.trial025.stdout: mon data avail warn = 5 2026-02-12T12:52:35.980 INFO:teuthology.orchestra.run.trial025.stdout: mon mgr mkfs grace = 240 2026-02-12T12:52:35.980 INFO:teuthology.orchestra.run.trial025.stdout: mon reweight min pgs per osd = 4 2026-02-12T12:52:35.980 INFO:teuthology.orchestra.run.trial025.stdout: mon osd reporter subtree level = osd 2026-02-12T12:52:35.980 INFO:teuthology.orchestra.run.trial025.stdout: mon osd prime pg temp = true 2026-02-12T12:52:35.981 INFO:teuthology.orchestra.run.trial025.stdout: mon reweight min bytes per osd = 10 2026-02-12T12:52:35.981 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.981 INFO:teuthology.orchestra.run.trial025.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T12:52:35.981 INFO:teuthology.orchestra.run.trial025.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T12:52:35.981 INFO:teuthology.orchestra.run.trial025.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T12:52:35.981 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.981 INFO:teuthology.orchestra.run.trial025.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T12:52:35.981 INFO:teuthology.orchestra.run.trial025.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T12:52:35.981 INFO:teuthology.orchestra.run.trial025.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T12:52:35.981 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.981 INFO:teuthology.orchestra.run.trial025.stdout: # 1m isn't quite enough 2026-02-12T12:52:35.981 INFO:teuthology.orchestra.run.trial025.stdout: mon_down_mkfs_grace = 2m 2026-02-12T12:52:35.982 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.982 INFO:teuthology.orchestra.run.trial025.stdout: mon_warn_on_filestore_osds = false 2026-02-12T12:52:35.982 INFO:teuthology.orchestra.run.trial025.stdout: osd pool default crimson = True 2026-02-12T12:52:35.982 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:35.982 INFO:teuthology.orchestra.run.trial025.stdout:[client] 2026-02-12T12:52:35.982 INFO:teuthology.orchestra.run.trial025.stdout: rgw cache enabled = true 2026-02-12T12:52:35.982 INFO:teuthology.orchestra.run.trial025.stdout: rgw enable ops log = true 2026-02-12T12:52:35.982 INFO:teuthology.orchestra.run.trial025.stdout: rgw enable usage log = true 2026-02-12T12:52:35.982 INFO:teuthology.orchestra.run.trial025.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T12:52:35.982 INFO:teuthology.orchestra.run.trial025.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T12:52:35.982 INFO:teuthology.orchestra.run.trial025.stdout:[mon.a] 2026-02-12T12:52:35.983 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-12T12:52:35.984 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-12T12:52:36.075 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-12T12:52:36.075 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:52:36.075 DEBUG:teuthology.orchestra.run.trial025:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-12T12:52:36.091 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:52:36.091 DEBUG:teuthology.orchestra.run.trial025:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-12T12:52:36.149 INFO:tasks.ceph:Sending monmap to node ubuntu@trial025.front.sepia.ceph.com 2026-02-12T12:52:36.149 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:52:36.149 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T12:52:36.149 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T12:52:36.224 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:52:36.224 DEBUG:teuthology.orchestra.run.trial025:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T12:52:36.281 INFO:tasks.ceph:Setting up mon nodes... 2026-02-12T12:52:36.281 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-12T12:52:36.281 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T12:52:36.370 INFO:teuthology.orchestra.run.trial025.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T12:52:36.373 INFO:tasks.ceph:Setting up mds nodes... 2026-02-12T12:52:36.373 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-12T12:52:36.373 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-12T12:52:36.415 INFO:teuthology.orchestra.run.trial025.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-12T12:52:36.427 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-12T12:52:36.427 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial025.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-12T12:52:36.427 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-12T12:52:36.491 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T12:52:36.491 INFO:tasks.ceph:role: osd.0 2026-02-12T12:52:36.491 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial025.front.sepia.ceph.com 2026-02-12T12:52:36.491 DEBUG:teuthology.orchestra.run.trial025:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T12:52:36.555 INFO:teuthology.orchestra.run.trial025.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T12:52:36.555 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T12:52:36.555 INFO:teuthology.orchestra.run.trial025.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T12:52:36.555 INFO:teuthology.orchestra.run.trial025.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T12:52:36.555 INFO:teuthology.orchestra.run.trial025.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T12:52:36.556 INFO:teuthology.orchestra.run.trial025.stdout: = sunit=0 swidth=0 blks 2026-02-12T12:52:36.556 INFO:teuthology.orchestra.run.trial025.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T12:52:36.556 INFO:teuthology.orchestra.run.trial025.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T12:52:36.556 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T12:52:36.556 INFO:teuthology.orchestra.run.trial025.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T12:52:37.130 INFO:teuthology.orchestra.run.trial025.stdout:Discarding blocks...Done. 2026-02-12T12:52:37.133 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial025.front.sepia.ceph.com -o noatime 2026-02-12T12:52:37.133 DEBUG:teuthology.orchestra.run.trial025:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-12T12:52:37.203 DEBUG:teuthology.orchestra.run.trial025:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-12T12:52:37.271 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-12T12:52:37.336 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T12:52:37.336 INFO:tasks.ceph:role: osd.1 2026-02-12T12:52:37.336 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial025.front.sepia.ceph.com 2026-02-12T12:52:37.337 DEBUG:teuthology.orchestra.run.trial025:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T12:52:37.403 INFO:teuthology.orchestra.run.trial025.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T12:52:37.403 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T12:52:37.403 INFO:teuthology.orchestra.run.trial025.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T12:52:37.403 INFO:teuthology.orchestra.run.trial025.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T12:52:37.403 INFO:teuthology.orchestra.run.trial025.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T12:52:37.403 INFO:teuthology.orchestra.run.trial025.stdout: = sunit=0 swidth=0 blks 2026-02-12T12:52:37.404 INFO:teuthology.orchestra.run.trial025.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T12:52:37.404 INFO:teuthology.orchestra.run.trial025.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T12:52:37.404 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T12:52:37.404 INFO:teuthology.orchestra.run.trial025.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T12:52:37.965 INFO:teuthology.orchestra.run.trial025.stdout:Discarding blocks...Done. 2026-02-12T12:52:37.968 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial025.front.sepia.ceph.com -o noatime 2026-02-12T12:52:37.968 DEBUG:teuthology.orchestra.run.trial025:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-12T12:52:38.035 DEBUG:teuthology.orchestra.run.trial025:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-12T12:52:38.102 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-12T12:52:38.166 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T12:52:38.166 INFO:tasks.ceph:role: osd.2 2026-02-12T12:52:38.166 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial025.front.sepia.ceph.com 2026-02-12T12:52:38.166 DEBUG:teuthology.orchestra.run.trial025:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-12T12:52:38.230 INFO:teuthology.orchestra.run.trial025.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T12:52:38.230 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T12:52:38.231 INFO:teuthology.orchestra.run.trial025.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T12:52:38.231 INFO:teuthology.orchestra.run.trial025.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T12:52:38.231 INFO:teuthology.orchestra.run.trial025.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T12:52:38.231 INFO:teuthology.orchestra.run.trial025.stdout: = sunit=0 swidth=0 blks 2026-02-12T12:52:38.231 INFO:teuthology.orchestra.run.trial025.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T12:52:38.231 INFO:teuthology.orchestra.run.trial025.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T12:52:38.231 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T12:52:38.231 INFO:teuthology.orchestra.run.trial025.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T12:52:38.798 INFO:teuthology.orchestra.run.trial025.stdout:Discarding blocks...Done. 2026-02-12T12:52:38.800 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial025.front.sepia.ceph.com -o noatime 2026-02-12T12:52:38.800 DEBUG:teuthology.orchestra.run.trial025:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-12T12:52:38.869 DEBUG:teuthology.orchestra.run.trial025:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-12T12:52:38.935 DEBUG:teuthology.orchestra.run.trial025:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T12:52:39.085 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T12:52:39.142 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:39,141 seastar - Reactor backend: linux-aio 2026-02-12T12:52:39.159 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:39,158 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:52:39.160 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:39,158 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:52:39.161 INFO:teuthology.orchestra.run.trial025.stderr:==21257==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T12:52:39.222 INFO:teuthology.orchestra.run.trial025.stderr:DEBUG 2026-02-12 12:52:39,221 [shard 0:main] seastar - reactor::drain 2026-02-12T12:52:41.335 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T12:52:41.335 INFO:teuthology.orchestra.run.trial025.stderr:Suppressions used: 2026-02-12T12:52:41.336 INFO:teuthology.orchestra.run.trial025.stderr: count bytes template 2026-02-12T12:52:41.336 INFO:teuthology.orchestra.run.trial025.stderr: 1 8 MallocExtension::Register 2026-02-12T12:52:41.336 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T12:52:41.336 INFO:teuthology.orchestra.run.trial025.stderr: 2026-02-12T12:52:41.354 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T12:52:41.354 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T12:52:41.402 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T12:52:41.402 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T12:52:41.409 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:41,408 seastar - Reactor backend: linux-aio 2026-02-12T12:52:41.418 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:41,417 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:52:41.418 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:41,417 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:52:41.422 INFO:teuthology.orchestra.run.trial025.stderr:==21255==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T12:52:41.422 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:41,421 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T12:52:41.562 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xec7e2 0xcb10b1 0x78a0caa 0x7bb2209 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:41.562 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0x9d58cb8 0x9d5e3d0 0x9d5ea0e 0x9d69304 0x78a0be9 0x7bb2209 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:41.563 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0x9c70435 0x9c7074d 0x9c709c0 0x9c70c76 0x9c71238 0x9c796df 0x9c79dbf 0x9d6290c 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:41.713 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x16f31f /lib64/libasan.so.8+0x4d6d5 0xe0c59d 0x7bb28b5 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:41.713 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x11913a /lib64/libasan.so.8+0xc5f4 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7fc 0xbb9861 0xbb9a6a 0xbb9fa7 0xe06b40 0x18eb6c4 0x9d4569f 0x9d45a44 0x9d622cf 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:41.713 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0xcb8a1a 0x1092c72 0xf2fdae 0x9d5308d 0x9d5367a 0x9d539fd 0x9d63b54 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:43.893 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T12:52:43.893 INFO:teuthology.orchestra.run.trial025.stderr:Suppressions used: 2026-02-12T12:52:43.893 INFO:teuthology.orchestra.run.trial025.stderr: count bytes template 2026-02-12T12:52:43.894 INFO:teuthology.orchestra.run.trial025.stderr: 1 8 MallocExtension::Register 2026-02-12T12:52:43.894 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T12:52:43.894 INFO:teuthology.orchestra.run.trial025.stderr: 2026-02-12T12:52:43.925 DEBUG:teuthology.orchestra.run.trial025:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-12T12:52:43.950 DEBUG:teuthology.orchestra.run.trial025:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T12:52:44.103 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T12:52:44.159 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:44,158 seastar - Reactor backend: linux-aio 2026-02-12T12:52:44.168 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:44,167 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:52:44.168 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:44,167 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:52:44.170 INFO:teuthology.orchestra.run.trial025.stderr:==21321==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T12:52:44.230 INFO:teuthology.orchestra.run.trial025.stderr:DEBUG 2026-02-12 12:52:44,229 [shard 0:main] seastar - reactor::drain 2026-02-12T12:52:46.334 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T12:52:46.334 INFO:teuthology.orchestra.run.trial025.stderr:Suppressions used: 2026-02-12T12:52:46.335 INFO:teuthology.orchestra.run.trial025.stderr: count bytes template 2026-02-12T12:52:46.335 INFO:teuthology.orchestra.run.trial025.stderr: 1 8 MallocExtension::Register 2026-02-12T12:52:46.335 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T12:52:46.335 INFO:teuthology.orchestra.run.trial025.stderr: 2026-02-12T12:52:46.354 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T12:52:46.354 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T12:52:46.398 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T12:52:46.399 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T12:52:46.405 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:46,404 seastar - Reactor backend: linux-aio 2026-02-12T12:52:46.414 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:46,413 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:52:46.414 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:46,413 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:52:46.417 INFO:teuthology.orchestra.run.trial025.stderr:==21319==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T12:52:46.417 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:46,416 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T12:52:46.556 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15858 0x9c70a14 0x9c726e7 0x9c72c34 0x9c72e33 0x9d58155 0x9d588b0 0x9d62b3e 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:46.556 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0x35eabf5 0x35eac0b 0x3606a88 0x9c8294b 0x9c82a0d 0x9d427fb 0x9d42990 0x9d42d22 0x9d44309 0x9d45624 0x9d45a44 0x9d622cf 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:46.556 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7fc 0x9b44d0b 0x9bc24a6 0x9bc25bc 0x9bc2698 0x9bc2914 0x9bc29cd 0x9bc2ebb 0x9bc32bf 0x9bc357c 0x9d50e47 0x9d51025 0x9d51281 0x9d51372 0x9d51f12 0x9d52516 0x9d528a9 0x9d65530 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:46.556 INFO:teuthology.orchestra.run.trial025.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffb1675c69 0xffffffffb181f917 0xffffffffb181fb70 0xffffffffb169525e 0xffffffffb19e6239 0xffffffffb19c97a5 0xffffffffb19d3b7b 0xffffffffb19d3fdb 0xffffffffb16910d2 0xffffffffb234d451 0xffffffffb2400ba2 2026-02-12T12:52:46.704 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0x316b438 0x9c706c6 0x9c709c0 0x9c726e7 0x9d58641 0x9d588b0 0x9d62b3e 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:46.704 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0x9c70295 0x9c7074d 0x9c709c0 0x9c70c76 0x9c71725 0x9c71c23 0x9c72253 0x9c723bd 0x9d5272d 0x9d65530 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:46.704 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1528c 0x9c702ec 0x9c7074d 0x9c709c0 0x9c70c76 0x9c71238 0x9c796df 0x9c79dbf 0x9d6290c 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:48.882 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T12:52:48.882 INFO:teuthology.orchestra.run.trial025.stderr:Suppressions used: 2026-02-12T12:52:48.882 INFO:teuthology.orchestra.run.trial025.stderr: count bytes template 2026-02-12T12:52:48.882 INFO:teuthology.orchestra.run.trial025.stderr: 1 8 MallocExtension::Register 2026-02-12T12:52:48.882 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T12:52:48.882 INFO:teuthology.orchestra.run.trial025.stderr: 2026-02-12T12:52:48.913 DEBUG:teuthology.orchestra.run.trial025:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-12T12:52:48.937 DEBUG:teuthology.orchestra.run.trial025:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T12:52:49.089 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T12:52:49.139 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:49,138 seastar - Reactor backend: linux-aio 2026-02-12T12:52:49.151 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:49,150 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:52:49.151 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:49,150 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:52:49.153 INFO:teuthology.orchestra.run.trial025.stderr:==21385==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T12:52:49.213 INFO:teuthology.orchestra.run.trial025.stderr:DEBUG 2026-02-12 12:52:49,212 [shard 0:main] seastar - reactor::drain 2026-02-12T12:52:51.321 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T12:52:51.321 INFO:teuthology.orchestra.run.trial025.stderr:Suppressions used: 2026-02-12T12:52:51.321 INFO:teuthology.orchestra.run.trial025.stderr: count bytes template 2026-02-12T12:52:51.321 INFO:teuthology.orchestra.run.trial025.stderr: 1 8 MallocExtension::Register 2026-02-12T12:52:51.321 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T12:52:51.322 INFO:teuthology.orchestra.run.trial025.stderr: 2026-02-12T12:52:51.341 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T12:52:51.341 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T12:52:51.385 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T12:52:51.385 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T12:52:51.392 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:51,391 seastar - Reactor backend: linux-aio 2026-02-12T12:52:51.400 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:51,399 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:52:51.400 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:51,399 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:52:51.404 INFO:teuthology.orchestra.run.trial025.stderr:==21383==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T12:52:51.404 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 12:52:51,404 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T12:52:51.547 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0x9d43df0 0x9d44130 0x9d4439a 0x9d45624 0x9d45a44 0x9d622cf 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:51.547 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0xba1817 0x9d53385 0x9d5367a 0x9d539fd 0x9d63b54 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:51.548 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15215 0x112781c 0xf2fda3 0x9c70283 0x9c7074d 0x9c709c0 0x9c726e7 0x9c72c34 0x9c72e33 0x9d58155 0x9d588b0 0x9d62b3e 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:51.695 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xb13e7 0xb6a317 0x1092c80 0xf2fdae 0x9c70450 0x9c7074d 0x9c709c0 0x9c70c76 0x9c71725 0x9c71c23 0x9c72253 0x9c723bd 0x9d5272d 0x9d65530 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:51.695 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0x9bc273d 0x9bc2914 0x9bc2ebb 0x9bc32bf 0x9bc357c 0x9bc43c4 0x9d3b018 0x9d3b111 0x7bb2246 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:51.695 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1294d2 /lib64/libasan.so.8+0x1297ad /lib64/libasan.so.8+0xc6631 /lib64/libasan.so.8+0x15e57 0x9c7060e 0x9c709c0 0x9c70c76 0x9c71238 0x9c796df 0x9c79dbf 0x9d6290c 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:52:53.871 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T12:52:53.871 INFO:teuthology.orchestra.run.trial025.stderr:Suppressions used: 2026-02-12T12:52:53.871 INFO:teuthology.orchestra.run.trial025.stderr: count bytes template 2026-02-12T12:52:53.871 INFO:teuthology.orchestra.run.trial025.stderr: 1 8 MallocExtension::Register 2026-02-12T12:52:53.871 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T12:52:53.871 INFO:teuthology.orchestra.run.trial025.stderr: 2026-02-12T12:52:53.902 DEBUG:teuthology.orchestra.run.trial025:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-12T12:52:53.928 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-12T12:52:53.928 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:52:53.928 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-12T12:52:53.992 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:52:53.992 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-12T12:52:54.056 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:52:54.056 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-12T12:52:54.119 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:52:54.119 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-12T12:52:54.183 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:52:54.184 DEBUG:teuthology.orchestra.run.trial025:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-12T12:52:54.240 INFO:tasks.ceph:Adding keys to all mons... 2026-02-12T12:52:54.240 DEBUG:teuthology.orchestra.run.trial025:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-12T12:52:54.303 INFO:teuthology.orchestra.run.trial025.stdout:[mgr.x] 2026-02-12T12:52:54.303 INFO:teuthology.orchestra.run.trial025.stdout: key = AQAUzY1pAysLFhAAuiozchy/kbv4k2jpic+vcQ== 2026-02-12T12:52:54.303 INFO:teuthology.orchestra.run.trial025.stdout:[osd.0] 2026-02-12T12:52:54.304 INFO:teuthology.orchestra.run.trial025.stdout: key = AQAZzY1pREj5HBAAQU/KV78v7KbKQgOBG+LV/Q== 2026-02-12T12:52:54.304 INFO:teuthology.orchestra.run.trial025.stdout:[osd.1] 2026-02-12T12:52:54.304 INFO:teuthology.orchestra.run.trial025.stdout: key = AQAezY1pitqwHBAAgeZm2FVzYbBPpDHWTUnAiA== 2026-02-12T12:52:54.304 INFO:teuthology.orchestra.run.trial025.stdout:[osd.2] 2026-02-12T12:52:54.304 INFO:teuthology.orchestra.run.trial025.stdout: key = AQAjzY1p2EUhHBAAjIg8Rx8mZ2uZcA9LTi5Qjg== 2026-02-12T12:52:54.304 INFO:teuthology.orchestra.run.trial025.stdout:[client.0] 2026-02-12T12:52:54.304 INFO:teuthology.orchestra.run.trial025.stdout: key = AQAUzY1pav27GBAAXmGFRF8E4kWd51SuWYIE0g== 2026-02-12T12:52:54.305 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-12T12:52:54.393 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T12:52:54.442 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T12:52:54.490 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T12:52:54.538 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-12T12:52:54.589 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-12T12:52:54.589 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-12T12:52:54.613 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T12:52:54.699 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:54.698+0000 7f40e648bc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:54.700 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:54.698+0000 7f40e648bc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:54.706 DEBUG:teuthology.orchestra.run.trial025:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-12T12:52:54.732 DEBUG:teuthology.orchestra.run.trial025:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-12T12:52:54.788 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-12T12:52:54.789 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-12T12:52:54.789 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-12T12:52:54.831 INFO:tasks.ceph.mon.a:Started 2026-02-12T12:52:54.831 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-12T12:52:54.832 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-12T12:52:54.832 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-12T12:52:54.834 INFO:tasks.ceph.mgr.x:Started 2026-02-12T12:52:54.835 DEBUG:tasks.ceph:set 0 configs 2026-02-12T12:52:54.835 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph config dump 2026-02-12T12:52:54.898 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-12T12:52:54.896+0000 7f6ae1e36fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:54.898 INFO:tasks.ceph.mon.a.trial025.stderr:2026-02-12T12:52:54.896+0000 7f55a4487c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:54.898 INFO:tasks.ceph.mon.a.trial025.stderr:2026-02-12T12:52:54.896+0000 7f55a4487c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:54.899 INFO:tasks.ceph.mon.a.trial025.stderr:2026-02-12T12:52:54.896+0000 7f55a4487c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:54.913 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:54.910+0000 7ff05301a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:54.915 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:54.913+0000 7ff05301a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:54.946 INFO:teuthology.orchestra.run.trial025.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-12T12:52:54.955 INFO:tasks.ceph:Setting crush tunables to default 2026-02-12T12:52:54.955 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph osd crush tunables default 2026-02-12T12:52:55.031 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:55.026+0000 7f3d5b9f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:55.032 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:55.030+0000 7f3d5b9f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:55.066 INFO:teuthology.orchestra.run.trial025.stderr:adjusted tunables profile to default 2026-02-12T12:52:55.075 INFO:tasks.ceph:check_enable_crimson: True 2026-02-12T12:52:55.076 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-12T12:52:55.076 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-12T12:52:55.100 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-12T12:52:55.098+0000 7f6ae1e36fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:55.100 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-12T12:52:55.098+0000 7f6ae1e36fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:55.150 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:55.146+0000 7fada6bd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:55.152 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:55.150+0000 7fada6bd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:55.189 INFO:tasks.ceph.mon.a.trial025.stderr:2026-02-12T12:52:55.188+0000 7f559bbf1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-12T12:52:55.189 INFO:tasks.ceph.mon.a.trial025.stderr:Please be aware that this feature is experimental, untested, 2026-02-12T12:52:55.190 INFO:tasks.ceph.mon.a.trial025.stderr:unsupported, and may result in data corruption, data loss, 2026-02-12T12:52:55.190 INFO:tasks.ceph.mon.a.trial025.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-12T12:52:55.190 INFO:tasks.ceph.mon.a.trial025.stderr:feature with important data. 2026-02-12T12:52:55.190 INFO:tasks.ceph.mon.a.trial025.stderr: 2026-02-12T12:52:55.944 INFO:tasks.ceph.mgr.x.trial025.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-12T12:52:55.944 INFO:tasks.ceph.mgr.x.trial025.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-12T12:52:55.944 INFO:tasks.ceph.mgr.x.trial025.stderr: from numpy import show_config as show_numpy_config 2026-02-12T12:52:56.077 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-12T12:52:56.077 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:52:56.077 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-12T12:52:56.142 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:52:56.142 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-12T12:52:56.207 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:52:56.207 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-12T12:52:56.271 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph osd new c891541b-2b1e-42ff-8082-b5bd216275fc 0 2026-02-12T12:52:56.388 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:56.383+0000 7f1c4830b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:56.389 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:56.387+0000 7f1c4830b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:56.427 INFO:teuthology.orchestra.run.trial025.stdout:0 2026-02-12T12:52:56.436 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph osd new cc89578e-3c89-4aee-8e5b-d50a62887557 1 2026-02-12T12:52:56.510 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:56.505+0000 7fe3514cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:56.511 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:56.510+0000 7fe3514cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:56.548 INFO:teuthology.orchestra.run.trial025.stdout:1 2026-02-12T12:52:56.557 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph osd new 48a2a89f-f86e-40f7-ae43-2462f50bdb9c 2 2026-02-12T12:52:56.630 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:56.626+0000 7f7bd1d93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:56.631 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:56.630+0000 7f7bd1d93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:56.668 INFO:teuthology.orchestra.run.trial025.stdout:2 2026-02-12T12:52:56.678 DEBUG:teuthology.orchestra.run.trial025:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-12T12:52:56.707 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-12T12:52:56.707 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-12T12:52:56.750 INFO:tasks.ceph.osd.0:Started 2026-02-12T12:52:56.750 DEBUG:teuthology.orchestra.run.trial025:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-12T12:52:56.779 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-12T12:52:56.779 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-12T12:52:56.822 INFO:tasks.ceph.osd.1:Started 2026-02-12T12:52:56.822 DEBUG:teuthology.orchestra.run.trial025:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-12T12:52:56.852 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-12T12:52:56.853 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-12T12:52:56.895 INFO:tasks.ceph.osd.2:Started 2026-02-12T12:52:56.895 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T12:52:56.976 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:56.972+0000 7f429e70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:56.977 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:52:56.975+0000 7f429e70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:57.010 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:52:57.010 INFO:teuthology.orchestra.run.trial025.stdout:{"epoch":6,"fsid":"9e8a6ce4-35d0-4fd4-b51c-76422f1eda54","created":"2026-02-12T12:52:54.908078+0000","modified":"2026-02-12T12:52:56.667555+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T12:52:56.667555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"c891541b-2b1e-42ff-8082-b5bd216275fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cc89578e-3c89-4aee-8e5b-d50a62887557","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"48a2a89f-f86e-40f7-ae43-2462f50bdb9c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T12:52:57.020 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-12T12:52:57.021 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-12T12:52:57.323 DEBUG:teuthology.orchestra.run.trial025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T12:52:57.390 INFO:teuthology.misc.health.trial025.stderr:2026-02-12T12:52:57.386+0000 7f4a40e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:57.391 INFO:teuthology.misc.health.trial025.stderr:2026-02-12T12:52:57.389+0000 7f4a40e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:52:57.422 INFO:teuthology.misc.health.trial025.stdout: 2026-02-12T12:52:57.422 INFO:teuthology.misc.health.trial025.stdout:{"epoch":6,"fsid":"9e8a6ce4-35d0-4fd4-b51c-76422f1eda54","created":"2026-02-12T12:52:54.908078+0000","modified":"2026-02-12T12:52:56.667555+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T12:52:56.667555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"c891541b-2b1e-42ff-8082-b5bd216275fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cc89578e-3c89-4aee-8e5b-d50a62887557","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"48a2a89f-f86e-40f7-ae43-2462f50bdb9c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T12:52:57.430 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-12T12:52:58.359 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-12T12:52:58.357+0000 7f69fca0a640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-12T12:53:03.733 DEBUG:teuthology.orchestra.run.trial025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T12:53:03.804 INFO:teuthology.misc.health.trial025.stderr:2026-02-12T12:53:03.800+0000 7feb0d9c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:03.805 INFO:teuthology.misc.health.trial025.stderr:2026-02-12T12:53:03.804+0000 7feb0d9c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:03.918 INFO:teuthology.misc.health.trial025.stdout: 2026-02-12T12:53:03.918 INFO:teuthology.misc.health.trial025.stdout:{"epoch":7,"fsid":"9e8a6ce4-35d0-4fd4-b51c-76422f1eda54","created":"2026-02-12T12:52:54.908078+0000","modified":"2026-02-12T12:53:03.091233+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T12:52:56.667555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"c891541b-2b1e-42ff-8082-b5bd216275fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cc89578e-3c89-4aee-8e5b-d50a62887557","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"48a2a89f-f86e-40f7-ae43-2462f50bdb9c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T12:53:03.926 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-12T12:53:10.228 DEBUG:teuthology.orchestra.run.trial025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T12:53:10.297 INFO:teuthology.misc.health.trial025.stderr:2026-02-12T12:53:10.293+0000 7fe1c74cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:10.298 INFO:teuthology.misc.health.trial025.stderr:2026-02-12T12:53:10.297+0000 7fe1c74cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:10.409 INFO:teuthology.misc.health.trial025.stdout: 2026-02-12T12:53:10.409 INFO:teuthology.misc.health.trial025.stdout:{"epoch":13,"fsid":"9e8a6ce4-35d0-4fd4-b51c-76422f1eda54","created":"2026-02-12T12:52:54.908078+0000","modified":"2026-02-12T12:53:10.107944+0000","last_up_change":"2026-02-12T12:53:06.093445+0000","last_in_change":"2026-02-12T12:52:56.667555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T12:53:07.366490+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c891541b-2b1e-42ff-8082-b5bd216275fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6802","nonce":591960777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6803","nonce":591960777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6810","nonce":591960777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6809","nonce":591960777}]},"public_addr":"10.20.193.25:6802/591960777","cluster_addr":"10.20.193.25:6803/591960777","heartbeat_back_addr":"10.20.193.25:6810/591960777","heartbeat_front_addr":"10.20.193.25:6809/591960777","state":["exists","up"]},{"osd":1,"uuid":"cc89578e-3c89-4aee-8e5b-d50a62887557","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6807","nonce":3654196871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6808","nonce":3654196871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6812","nonce":3654196871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6813","nonce":3654196871}]},"public_addr":"10.20.193.25:6807/3654196871","cluster_addr":"10.20.193.25:6808/3654196871","heartbeat_back_addr":"10.20.193.25:6812/3654196871","heartbeat_front_addr":"10.20.193.25:6813/3654196871","state":["exists","up"]},{"osd":2,"uuid":"48a2a89f-f86e-40f7-ae43-2462f50bdb9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6806","nonce":511598920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6805","nonce":511598920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6804","nonce":511598920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6811","nonce":511598920}]},"public_addr":"10.20.193.25:6806/511598920","cluster_addr":"10.20.193.25:6805/511598920","heartbeat_back_addr":"10.20.193.25:6804/511598920","heartbeat_front_addr":"10.20.193.25:6811/511598920","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T12:53:10.417 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-12T12:53:10.417 INFO:tasks.ceph:Creating RBD pool 2026-02-12T12:53:10.417 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-12T12:53:10.492 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:10.487+0000 7f910958a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:10.493 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:10.492+0000 7f910958a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:11.116 INFO:teuthology.orchestra.run.trial025.stderr:pool 'rbd' created 2026-02-12T12:53:11.130 DEBUG:teuthology.orchestra.run.trial025:> rbd --cluster ceph pool init rbd 2026-02-12T12:53:11.174 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:11.172+0000 7f52e04ea240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:11.174 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:11.172+0000 7f52e04ea240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:11.175 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:11.174+0000 7f52e04ea240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:14.154 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-12T12:53:14.155 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-12T12:53:14.155 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-12T12:53:14.232 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:14.228+0000 7f20351c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:14.233 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:14.231+0000 7f20351c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:14.342 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:53:14.351 INFO:teuthology.orchestra.run.trial025.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-12T12:53:14.351 INFO:tasks.ceph_manager:config epoch is 1 2026-02-12T12:53:14.351 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-12T12:53:14.351 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-12T12:53:14.352 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-12T12:53:14.428 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:14.424+0000 7fc253851640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:14.429 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:14.427+0000 7fc253851640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:14.567 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:53:14.575 INFO:teuthology.orchestra.run.trial025.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6800","nonce":596027180},{"type":"v1","addr":"10.20.193.25:6801","nonce":596027180}]},"active_addr":"10.20.193.25:6801/596027180","active_change":"2026-02-12T12:52:57.352250+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.25:0","nonce":2824975940}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.25:0","nonce":2518213166}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.25:0","nonce":2573995491}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.25:0","nonce":3902716139}]}]} 2026-02-12T12:53:14.579 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-12T12:53:14.580 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-12T12:53:14.580 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T12:53:14.658 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:14.654+0000 7f1cddf8a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:14.659 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:14.657+0000 7f1cddf8a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:14.768 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:53:14.768 INFO:teuthology.orchestra.run.trial025.stdout:{"epoch":17,"fsid":"9e8a6ce4-35d0-4fd4-b51c-76422f1eda54","created":"2026-02-12T12:52:54.908078+0000","modified":"2026-02-12T12:53:14.125860+0000","last_up_change":"2026-02-12T12:53:06.093445+0000","last_in_change":"2026-02-12T12:52:56.667555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T12:53:07.366490+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T12:53:10.606225+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c891541b-2b1e-42ff-8082-b5bd216275fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6802","nonce":591960777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6803","nonce":591960777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6810","nonce":591960777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6809","nonce":591960777}]},"public_addr":"10.20.193.25:6802/591960777","cluster_addr":"10.20.193.25:6803/591960777","heartbeat_back_addr":"10.20.193.25:6810/591960777","heartbeat_front_addr":"10.20.193.25:6809/591960777","state":["exists","up"]},{"osd":1,"uuid":"cc89578e-3c89-4aee-8e5b-d50a62887557","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6807","nonce":3654196871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6808","nonce":3654196871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6812","nonce":3654196871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6813","nonce":3654196871}]},"public_addr":"10.20.193.25:6807/3654196871","cluster_addr":"10.20.193.25:6808/3654196871","heartbeat_back_addr":"10.20.193.25:6812/3654196871","heartbeat_front_addr":"10.20.193.25:6813/3654196871","state":["exists","up"]},{"osd":2,"uuid":"48a2a89f-f86e-40f7-ae43-2462f50bdb9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6806","nonce":511598920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6805","nonce":511598920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6804","nonce":511598920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6811","nonce":511598920}]},"public_addr":"10.20.193.25:6806/511598920","cluster_addr":"10.20.193.25:6805/511598920","heartbeat_back_addr":"10.20.193.25:6804/511598920","heartbeat_front_addr":"10.20.193.25:6811/511598920","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T12:53:14.777 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-12T12:53:14.777 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T12:53:14.855 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:14.851+0000 7fe6e20cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:14.856 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:14.854+0000 7fe6e20cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:14.966 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:53:14.967 INFO:teuthology.orchestra.run.trial025.stdout:{"epoch":17,"fsid":"9e8a6ce4-35d0-4fd4-b51c-76422f1eda54","created":"2026-02-12T12:52:54.908078+0000","modified":"2026-02-12T12:53:14.125860+0000","last_up_change":"2026-02-12T12:53:06.093445+0000","last_in_change":"2026-02-12T12:52:56.667555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T12:53:07.366490+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T12:53:10.606225+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c891541b-2b1e-42ff-8082-b5bd216275fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6802","nonce":591960777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6803","nonce":591960777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6810","nonce":591960777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6809","nonce":591960777}]},"public_addr":"10.20.193.25:6802/591960777","cluster_addr":"10.20.193.25:6803/591960777","heartbeat_back_addr":"10.20.193.25:6810/591960777","heartbeat_front_addr":"10.20.193.25:6809/591960777","state":["exists","up"]},{"osd":1,"uuid":"cc89578e-3c89-4aee-8e5b-d50a62887557","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6807","nonce":3654196871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6808","nonce":3654196871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6812","nonce":3654196871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6813","nonce":3654196871}]},"public_addr":"10.20.193.25:6807/3654196871","cluster_addr":"10.20.193.25:6808/3654196871","heartbeat_back_addr":"10.20.193.25:6812/3654196871","heartbeat_front_addr":"10.20.193.25:6813/3654196871","state":["exists","up"]},{"osd":2,"uuid":"48a2a89f-f86e-40f7-ae43-2462f50bdb9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6806","nonce":511598920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6805","nonce":511598920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6804","nonce":511598920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6811","nonce":511598920}]},"public_addr":"10.20.193.25:6806/511598920","cluster_addr":"10.20.193.25:6805/511598920","heartbeat_back_addr":"10.20.193.25:6804/511598920","heartbeat_front_addr":"10.20.193.25:6811/511598920","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T12:53:14.976 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-12T12:53:14.977 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-12T12:53:14.977 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-12T12:53:15.060 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.055+0000 7fba6805a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.060 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.055+0000 7f4225811640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.061 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.056+0000 7f464185a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.061 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.059+0000 7fba6805a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.062 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.060+0000 7f4225811640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.062 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.060+0000 7f464185a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.076 INFO:teuthology.orchestra.run.trial025.stdout:42949672968 2026-02-12T12:53:15.077 INFO:teuthology.orchestra.run.trial025.stdout:42949672968 2026-02-12T12:53:15.078 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T12:53:15.078 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T12:53:15.079 INFO:teuthology.orchestra.run.trial025.stdout:38654705673 2026-02-12T12:53:15.080 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T12:53:15.199 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.194+0000 7fdc3f2ae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.200 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.194+0000 7f54fea5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.200 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.195+0000 7f019b1b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.201 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.199+0000 7f54fea5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.201 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.199+0000 7f019b1b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.201 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.199+0000 7fdc3f2ae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.316 INFO:teuthology.orchestra.run.trial025.stdout:38654705673 2026-02-12T12:53:15.316 INFO:teuthology.orchestra.run.trial025.stdout:42949672968 2026-02-12T12:53:15.320 INFO:teuthology.orchestra.run.trial025.stdout:42949672968 2026-02-12T12:53:15.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.2 2026-02-12T12:53:15.328 DEBUG:teuthology.parallel:result is None 2026-02-12T12:53:15.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705673 got 38654705673 for osd.0 2026-02-12T12:53:15.329 DEBUG:teuthology.parallel:result is None 2026-02-12T12:53:15.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.1 2026-02-12T12:53:15.331 DEBUG:teuthology.parallel:result is None 2026-02-12T12:53:15.331 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-12T12:53:15.331 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T12:53:15.446 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.442+0000 7f5ee416f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.447 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.445+0000 7f5ee416f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.554 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:53:15.555 INFO:teuthology.orchestra.run.trial025.stderr:dumped all 2026-02-12T12:53:15.563 INFO:teuthology.orchestra.run.trial025.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-12T12:53:15.355873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":157286352,"kb_used":62917004,"kb_used_data":62917004,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":94369348,"statfs":{"total":161061224448,"available":96634212352,"internally_reserved":0,"allocated":64427012096,"data_stored":64427012096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.286663"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.139921+0000","last_change":"2026-02-12T12:53:14.143071+0000","last_active":"2026-02-12T12:53:14.139921+0000","last_peered":"2026-02-12T12:53:14.139921+0000","last_clean":"2026-02-12T12:53:14.139921+0000","last_became_active":"2026-02-12T12:53:12.155726+0000","last_became_peered":"2026-02-12T12:53:12.155726+0000","last_unstale":"2026-02-12T12:53:14.139921+0000","last_undegraded":"2026-02-12T12:53:14.139921+0000","last_fullsized":"2026-02-12T12:53:14.139921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_clean_scrub_stamp":"2026-02-12T12:53:11.114928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.141017+0000","last_change":"2026-02-12T12:53:14.144661+0000","last_active":"2026-02-12T12:53:14.141017+0000","last_peered":"2026-02-12T12:53:14.141017+0000","last_clean":"2026-02-12T12:53:14.141017+0000","last_became_active":"2026-02-12T12:53:12.153419+0000","last_became_peered":"2026-02-12T12:53:12.153419+0000","last_unstale":"2026-02-12T12:53:14.141017+0000","last_undegraded":"2026-02-12T12:53:14.141017+0000","last_fullsized":"2026-02-12T12:53:14.141017+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_clean_scrub_stamp":"2026-02-12T12:53:11.114928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.140988+0000","last_change":"2026-02-12T12:53:14.144097+0000","last_active":"2026-02-12T12:53:14.140988+0000","last_peered":"2026-02-12T12:53:14.140988+0000","last_clean":"2026-02-12T12:53:14.140988+0000","last_became_active":"2026-02-12T12:53:12.158527+0000","last_became_peered":"2026-02-12T12:53:12.158527+0000","last_unstale":"2026-02-12T12:53:14.140988+0000","last_undegraded":"2026-02-12T12:53:14.140988+0000","last_fullsized":"2026-02-12T12:53:14.140988+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_clean_scrub_stamp":"2026-02-12T12:53:11.114928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.141071+0000","last_change":"2026-02-12T12:53:14.144128+0000","last_active":"2026-02-12T12:53:14.141071+0000","last_peered":"2026-02-12T12:53:14.141071+0000","last_clean":"2026-02-12T12:53:14.141071+0000","last_became_active":"2026-02-12T12:53:12.165925+0000","last_became_peered":"2026-02-12T12:53:12.165925+0000","last_unstale":"2026-02-12T12:53:14.141071+0000","last_undegraded":"2026-02-12T12:53:14.141071+0000","last_fullsized":"2026-02-12T12:53:14.141071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_clean_scrub_stamp":"2026-02-12T12:53:11.114928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.138975+0000","last_change":"2026-02-12T12:53:14.138975+0000","last_active":"2026-02-12T12:53:14.138975+0000","last_peered":"2026-02-12T12:53:14.138975+0000","last_clean":"2026-02-12T12:53:14.138975+0000","last_became_active":"2026-02-12T12:53:12.162919+0000","last_became_peered":"2026-02-12T12:53:12.162919+0000","last_unstale":"2026-02-12T12:53:14.138975+0000","last_undegraded":"2026-02-12T12:53:14.138975+0000","last_fullsized":"2026-02-12T12:53:14.138975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_clean_scrub_stamp":"2026-02-12T12:53:11.114928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.138146+0000","last_change":"2026-02-12T12:53:14.140359+0000","last_active":"2026-02-12T12:53:14.138146+0000","last_peered":"2026-02-12T12:53:14.138146+0000","last_clean":"2026-02-12T12:53:14.138146+0000","last_became_active":"2026-02-12T12:53:12.167671+0000","last_became_peered":"2026-02-12T12:53:12.167671+0000","last_unstale":"2026-02-12T12:53:14.138146+0000","last_undegraded":"2026-02-12T12:53:14.138146+0000","last_fullsized":"2026-02-12T12:53:14.138146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_clean_scrub_stamp":"2026-02-12T12:53:11.114928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.136408+0000","last_change":"2026-02-12T12:53:14.138739+0000","last_active":"2026-02-12T12:53:14.136408+0000","last_peered":"2026-02-12T12:53:14.136408+0000","last_clean":"2026-02-12T12:53:14.136408+0000","last_became_active":"2026-02-12T12:53:12.165638+0000","last_became_peered":"2026-02-12T12:53:12.165638+0000","last_unstale":"2026-02-12T12:53:14.136408+0000","last_undegraded":"2026-02-12T12:53:14.136408+0000","last_fullsized":"2026-02-12T12:53:14.136408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_clean_scrub_stamp":"2026-02-12T12:53:11.114928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.141469+0000","last_change":"2026-02-12T12:53:14.143121+0000","last_active":"2026-02-12T12:53:14.141469+0000","last_peered":"2026-02-12T12:53:14.141469+0000","last_clean":"2026-02-12T12:53:14.141469+0000","last_became_active":"2026-02-12T12:53:12.153295+0000","last_became_peered":"2026-02-12T12:53:12.153295+0000","last_unstale":"2026-02-12T12:53:14.141469+0000","last_undegraded":"2026-02-12T12:53:14.141469+0000","last_fullsized":"2026-02-12T12:53:14.141469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_clean_scrub_stamp":"2026-02-12T12:53:11.114928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":90,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.139754+0000","last_change":"2026-02-12T12:53:09.134911+0000","last_active":"2026-02-12T12:53:14.139754+0000","last_peered":"2026-02-12T12:53:14.139754+0000","last_clean":"2026-02-12T12:53:14.139754+0000","last_became_active":"2026-02-12T12:53:09.127883+0000","last_became_peered":"2026-02-12T12:53:09.127883+0000","last_unstale":"2026-02-12T12:53:14.139754+0000","last_undegraded":"2026-02-12T12:53:14.139754+0000","last_fullsized":"2026-02-12T12:53:14.139754+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:08.099289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:08.099289+0000","last_clean_scrub_stamp":"2026-02-12T12:53:08.099289+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96634163200,"internally_reserved":0,"allocated":64427061248,"data_stored":64427061248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211079168,"internally_reserved":0,"allocated":21475995648,"data_stored":21475995648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971812,"kb_used_data":20971812,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456972,"statfs":{"total":53687074816,"available":32211939328,"internally_reserved":0,"allocated":21475135488,"data_stored":21475135488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972620,"kb_used_data":20972620,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456164,"statfs":{"total":53687074816,"available":32211111936,"internally_reserved":0,"allocated":21475962880,"data_stored":21475962880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972572,"kb_used_data":20972572,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456212,"statfs":{"total":53687074816,"available":32211161088,"internally_reserved":0,"allocated":21475913728,"data_stored":21475913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211079168,"internally_reserved":0,"allocated":21475995648,"data_stored":21475995648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53687074816,"available":32211152896,"internally_reserved":0,"allocated":21475921920,"data_stored":21475921920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53687074816,"available":32211079168,"internally_reserved":0,"allocated":21475995648,"data_stored":21475995648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53687074816,"available":32211931136,"internally_reserved":0,"allocated":21475143680,"data_stored":21475143680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T12:53:15.565 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T12:53:15.641 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.637+0000 7f6e158c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.642 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.641+0000 7f6e158c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.752 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:53:15.753 INFO:teuthology.orchestra.run.trial025.stderr:dumped all 2026-02-12T12:53:15.761 INFO:teuthology.orchestra.run.trial025.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-12T12:53:15.355873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":157286352,"kb_used":62917004,"kb_used_data":62917004,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":94369348,"statfs":{"total":161061224448,"available":96634212352,"internally_reserved":0,"allocated":64427012096,"data_stored":64427012096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.286663"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.139921+0000","last_change":"2026-02-12T12:53:14.143071+0000","last_active":"2026-02-12T12:53:14.139921+0000","last_peered":"2026-02-12T12:53:14.139921+0000","last_clean":"2026-02-12T12:53:14.139921+0000","last_became_active":"2026-02-12T12:53:12.155726+0000","last_became_peered":"2026-02-12T12:53:12.155726+0000","last_unstale":"2026-02-12T12:53:14.139921+0000","last_undegraded":"2026-02-12T12:53:14.139921+0000","last_fullsized":"2026-02-12T12:53:14.139921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_clean_scrub_stamp":"2026-02-12T12:53:11.114928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.141017+0000","last_change":"2026-02-12T12:53:14.144661+0000","last_active":"2026-02-12T12:53:14.141017+0000","last_peered":"2026-02-12T12:53:14.141017+0000","last_clean":"2026-02-12T12:53:14.141017+0000","last_became_active":"2026-02-12T12:53:12.153419+0000","last_became_peered":"2026-02-12T12:53:12.153419+0000","last_unstale":"2026-02-12T12:53:14.141017+0000","last_undegraded":"2026-02-12T12:53:14.141017+0000","last_fullsized":"2026-02-12T12:53:14.141017+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_clean_scrub_stamp":"2026-02-12T12:53:11.114928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.140988+0000","last_change":"2026-02-12T12:53:14.144097+0000","last_active":"2026-02-12T12:53:14.140988+0000","last_peered":"2026-02-12T12:53:14.140988+0000","last_clean":"2026-02-12T12:53:14.140988+0000","last_became_active":"2026-02-12T12:53:12.158527+0000","last_became_peered":"2026-02-12T12:53:12.158527+0000","last_unstale":"2026-02-12T12:53:14.140988+0000","last_undegraded":"2026-02-12T12:53:14.140988+0000","last_fullsized":"2026-02-12T12:53:14.140988+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_clean_scrub_stamp":"2026-02-12T12:53:11.114928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.141071+0000","last_change":"2026-02-12T12:53:14.144128+0000","last_active":"2026-02-12T12:53:14.141071+0000","last_peered":"2026-02-12T12:53:14.141071+0000","last_clean":"2026-02-12T12:53:14.141071+0000","last_became_active":"2026-02-12T12:53:12.165925+0000","last_became_peered":"2026-02-12T12:53:12.165925+0000","last_unstale":"2026-02-12T12:53:14.141071+0000","last_undegraded":"2026-02-12T12:53:14.141071+0000","last_fullsized":"2026-02-12T12:53:14.141071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_clean_scrub_stamp":"2026-02-12T12:53:11.114928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.138975+0000","last_change":"2026-02-12T12:53:14.138975+0000","last_active":"2026-02-12T12:53:14.138975+0000","last_peered":"2026-02-12T12:53:14.138975+0000","last_clean":"2026-02-12T12:53:14.138975+0000","last_became_active":"2026-02-12T12:53:12.162919+0000","last_became_peered":"2026-02-12T12:53:12.162919+0000","last_unstale":"2026-02-12T12:53:14.138975+0000","last_undegraded":"2026-02-12T12:53:14.138975+0000","last_fullsized":"2026-02-12T12:53:14.138975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_clean_scrub_stamp":"2026-02-12T12:53:11.114928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.138146+0000","last_change":"2026-02-12T12:53:14.140359+0000","last_active":"2026-02-12T12:53:14.138146+0000","last_peered":"2026-02-12T12:53:14.138146+0000","last_clean":"2026-02-12T12:53:14.138146+0000","last_became_active":"2026-02-12T12:53:12.167671+0000","last_became_peered":"2026-02-12T12:53:12.167671+0000","last_unstale":"2026-02-12T12:53:14.138146+0000","last_undegraded":"2026-02-12T12:53:14.138146+0000","last_fullsized":"2026-02-12T12:53:14.138146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_clean_scrub_stamp":"2026-02-12T12:53:11.114928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.136408+0000","last_change":"2026-02-12T12:53:14.138739+0000","last_active":"2026-02-12T12:53:14.136408+0000","last_peered":"2026-02-12T12:53:14.136408+0000","last_clean":"2026-02-12T12:53:14.136408+0000","last_became_active":"2026-02-12T12:53:12.165638+0000","last_became_peered":"2026-02-12T12:53:12.165638+0000","last_unstale":"2026-02-12T12:53:14.136408+0000","last_undegraded":"2026-02-12T12:53:14.136408+0000","last_fullsized":"2026-02-12T12:53:14.136408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_clean_scrub_stamp":"2026-02-12T12:53:11.114928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.141469+0000","last_change":"2026-02-12T12:53:14.143121+0000","last_active":"2026-02-12T12:53:14.141469+0000","last_peered":"2026-02-12T12:53:14.141469+0000","last_clean":"2026-02-12T12:53:14.141469+0000","last_became_active":"2026-02-12T12:53:12.153295+0000","last_became_peered":"2026-02-12T12:53:12.153295+0000","last_unstale":"2026-02-12T12:53:14.141469+0000","last_undegraded":"2026-02-12T12:53:14.141469+0000","last_fullsized":"2026-02-12T12:53:14.141469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:11.114928+0000","last_clean_scrub_stamp":"2026-02-12T12:53:11.114928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":90,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:53:14.139754+0000","last_change":"2026-02-12T12:53:09.134911+0000","last_active":"2026-02-12T12:53:14.139754+0000","last_peered":"2026-02-12T12:53:14.139754+0000","last_clean":"2026-02-12T12:53:14.139754+0000","last_became_active":"2026-02-12T12:53:09.127883+0000","last_became_peered":"2026-02-12T12:53:09.127883+0000","last_unstale":"2026-02-12T12:53:14.139754+0000","last_undegraded":"2026-02-12T12:53:14.139754+0000","last_fullsized":"2026-02-12T12:53:14.139754+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:53:08.099289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:53:08.099289+0000","last_clean_scrub_stamp":"2026-02-12T12:53:08.099289+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96634163200,"internally_reserved":0,"allocated":64427061248,"data_stored":64427061248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211079168,"internally_reserved":0,"allocated":21475995648,"data_stored":21475995648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971812,"kb_used_data":20971812,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456972,"statfs":{"total":53687074816,"available":32211939328,"internally_reserved":0,"allocated":21475135488,"data_stored":21475135488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972620,"kb_used_data":20972620,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456164,"statfs":{"total":53687074816,"available":32211111936,"internally_reserved":0,"allocated":21475962880,"data_stored":21475962880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972572,"kb_used_data":20972572,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456212,"statfs":{"total":53687074816,"available":32211161088,"internally_reserved":0,"allocated":21475913728,"data_stored":21475913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211079168,"internally_reserved":0,"allocated":21475995648,"data_stored":21475995648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53687074816,"available":32211152896,"internally_reserved":0,"allocated":21475921920,"data_stored":21475921920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53687074816,"available":32211079168,"internally_reserved":0,"allocated":21475995648,"data_stored":21475995648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53687074816,"available":32211931136,"internally_reserved":0,"allocated":21475143680,"data_stored":21475143680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T12:53:15.762 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-12T12:53:15.762 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-12T12:53:15.763 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-12T12:53:15.763 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-12T12:53:15.839 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.836+0000 7ff726a51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.840 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:15.838+0000 7ff726a51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:15.977 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T12:53:15.978 INFO:teuthology.orchestra.run.trial025.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-12T12:53:15.987 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-12T12:53:15.988 INFO:teuthology.run_tasks:Running task ssh_keys... 2026-02-12T12:53:16.091 DEBUG:teuthology.orchestra.run.trial025:> echo 'StrictHostKeyChecking no 2026-02-12T12:53:16.091 DEBUG:teuthology.orchestra.run.trial025:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2026-02-12T12:53:16.108 INFO:teuthology.task.ssh_keys:generated public key AAAAB3NzaC1yc2EAAAADAQABAAABAQC1k8RlWLma2ohJeWn4tzIXDKYYBcuVv3lT/HD2dRN3KQyjPWQUvoDAM6gpiK/3mILy8hW73/+M5k7+DwKKKpYCV1fPnRnuJNpDAxSvh40pf7ysAByl4Cez2rRNIbjirm5hyXCvSJIPdbX0rR9IO4zRUumLh63e7Ke8XzpHt9otTKVNeCSxkt4v7R1AyektaJ80l8TEmmmuyCzNARavNSAGxwwSOQtGpgwcDI1bQ7/zwQtk36e0GZS9Gc6CVwkLZaJKMzNFqfaPv4/Sqf4qOHqCxXWeLwICDVLVMQKW4fxpoKHJFslWeA4BjlxOwNOwVfkL+CS7mNjzDsvcGa1WZ7Nx 2026-02-12T12:53:16.108 INFO:teuthology.task.ssh_keys:pushing keys to trial025.front.sepia.ceph.com for ubuntu 2026-02-12T12:53:16.108 DEBUG:teuthology.orchestra.run.trial025:> rm -f -- /home/ubuntu/.ssh/id_rsa 2026-02-12T12:53:16.164 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:53:16.164 DEBUG:teuthology.orchestra.run.trial025:> dd of=/home/ubuntu/.ssh/id_rsa 2026-02-12T12:53:16.164 DEBUG:teuthology.orchestra.run.trial025:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2026-02-12T12:53:16.221 DEBUG:teuthology.orchestra.run.trial025:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2026-02-12T12:53:16.277 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:53:16.277 DEBUG:teuthology.orchestra.run.trial025:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2026-02-12T12:53:16.333 DEBUG:teuthology.orchestra.run.trial025:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2026-02-12_12:53:16:333385 2026-02-12T12:53:16.389 INFO:teuthology.orchestra.run.trial025.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2026-02-12_12:53:16:333385' 2026-02-12T12:53:16.390 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:53:16.390 DEBUG:teuthology.orchestra.run.trial025:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2026-02-12T12:53:16.446 INFO:teuthology.run_tasks:Running task cbt... 2026-02-12T12:53:16.471 INFO:tasks.cbt:cbt configuration is {'cluster': {'user': 'ubuntu', 'head': 'ubuntu@trial025.front.sepia.ceph.com', 'osds': ['ubuntu@trial025.front.sepia.ceph.com'], 'mons': ['ubuntu@trial025.front.sepia.ceph.com'], 'clients': ['ubuntu@trial025.front.sepia.ceph.com'], 'rgws': {'ubuntu@trial025.front.sepia.ceph.com': None}, 'osds_per_node': 3, 'rebuild_every_test': False, 'use_existing': True, 'is_teuthology': True, 'iterations': 1, 'tmp_dir': '/tmp/cbt', 'pool_profiles': {'rbd': {'pg_size': 128, 'pgp_size': 128, 'replication': 3}}, 'pid_dir': '/var/run/ceph'}, 'benchmarks': {'librbdfio': {'iodepth': [32], 'log_avg_msec': 100, 'mode': ['randread'], 'norandommap': True, 'op_size': [4096], 'osd_ra': [4096], 'pool_profile': 'rbd', 'procs_per_volume': [1], 'time': 60, 'vol_size': 4096, 'volumes_per_client': [2], 'cmd_path': '/home/ubuntu/cephtest/fio/fio'}}, 'client_endpoints': None, 'monitoring_profiles': {'perf': {'args': 'stat -p {pid} -o {perf_dir}/perf_stat.{pid}', 'nodes': ['osds'], 'perf_cmd': 'perf', 'pid_glob': 'crimson-osd.*.pid'}}} 2026-02-12T12:53:16.471 DEBUG:teuthology.orchestra.run.trial025:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/cbt 2026-02-12T12:53:16.506 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T12:53:16.507 DEBUG:teuthology.orchestra.run.trial025:> dd of=/home/ubuntu/cephtest/archive/cbt/cbt_config.yaml 2026-02-12T12:53:16.558 DEBUG:teuthology.orchestra.run.trial025:> git clone --depth 1 -b master https://github.com/ceph/cbt.git /home/ubuntu/cephtest/cbt 2026-02-12T12:53:16.620 INFO:teuthology.orchestra.run.trial025.stderr:Cloning into '/home/ubuntu/cephtest/cbt'... 2026-02-12T12:53:16.850 INFO:tasks.cbt:Installing collectl 2026-02-12T12:53:16.850 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir collectl && cd collectl && sudo wget https://sourceforge.net/projects/collectl/files/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz/download -O collectl.tar.gz && sudo tar -xvf collectl.tar.gz && cd collectl-4.3.1 && sudo ./INSTALL 2026-02-12T12:53:16.925 INFO:teuthology.orchestra.run.trial025.stderr:--2026-02-12 12:53:16-- https://sourceforge.net/projects/collectl/files/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz/download 2026-02-12T12:53:26.985 INFO:teuthology.orchestra.run.trial025.stderr:Resolving sourceforge.net (sourceforge.net)... failed: Name or service not known. 2026-02-12T12:53:26.985 INFO:teuthology.orchestra.run.trial025.stderr:wget: unable to resolve host address ‘sourceforge.net’ 2026-02-12T12:53:26.989 DEBUG:teuthology.orchestra.run:got remote process result: 4 2026-02-12T12:53:26.990 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/task/__init__.py", line 122, in __enter__ self.setup() File "/home/teuthworker/src/github.com_mohit84_ceph_5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/qa/tasks/cbt.py", line 158, in setup self.install_dependencies() File "/home/teuthworker/src/github.com_mohit84_ceph_5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/qa/tasks/cbt.py", line 73, in install_dependencies self.first_mon.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/remote.py", line 575, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial025 with status 4: 'sudo mkdir collectl && cd collectl && sudo wget https://sourceforge.net/projects/collectl/files/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz/download -O collectl.tar.gz && sudo tar -xvf collectl.tar.gz && cd collectl-4.3.1 && sudo ./INSTALL' 2026-02-12T12:53:26.993 DEBUG:teuthology.run_tasks:Unwinding manager cbt 2026-02-12T12:53:27.009 DEBUG:teuthology.orchestra.run.trial025:> rm --one-file-system -rf -- /home/ubuntu/cephtest/cbt 2026-02-12T12:53:27.050 DEBUG:teuthology.orchestra.run.trial025:> rm --one-file-system -rf -- /home/ubuntu/cephtest/fio 2026-02-12T12:53:27.107 INFO:tasks.cbt_performance:Collecting CBT performance data config 2026-02-12T12:53:27.107 INFO:tasks.cbt_performance:reading cbt preferences 2026-02-12T12:53:27.107 DEBUG:teuthology.orchestra.run.trial025:> find /home/ubuntu/cephtest -name 'json_output.*' 2026-02-12T12:53:27.163 DEBUG:teuthology.run_tasks:Unwinding manager ssh_keys 2026-02-12T12:53:27.178 INFO:teuthology.task.ssh_keys:Cleaning up SSH keys 2026-02-12T12:53:27.179 INFO:teuthology.task.ssh_keys:cleaning up keys added for testing 2026-02-12T12:53:27.179 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on trial025.front.sepia.ceph.com 2026-02-12T12:53:27.179 DEBUG:teuthology.orchestra.run.trial025:> rm -- /home/ubuntu/.ssh/id_rsa 2026-02-12T12:53:27.219 DEBUG:teuthology.orchestra.run.trial025:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2026-02-12T12:53:27.275 DEBUG:teuthology.orchestra.run.trial025:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2026-02-12T12:53:27.331 INFO:teuthology.orchestra.run.trial025.stdout:"600" 2026-02-12T12:53:27.331 DEBUG:teuthology.orchestra.run.trial025:> mv -- /home/ubuntu/.ssh/authorized_keys_2026-02-12_12:53:16:333385 /home/ubuntu/.ssh/authorized_keys 2026-02-12T12:53:27.387 DEBUG:teuthology.orchestra.run.trial025:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2026-02-12T12:53:27.444 DEBUG:teuthology.orchestra.run.trial025:> rm /home/ubuntu/.ssh/config 2026-02-12T12:53:27.499 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-12T12:53:27.517 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-12T12:53:27.615 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:27.608+0000 7f8424806640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:27.616 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T12:53:27.613+0000 7f8424806640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:53:27.739 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-12T12:53:27.739 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-12T12:53:27.740 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-12T12:53:27.740 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T12:53:27.786 INFO:tasks.ceph.osd.0:Stopped 2026-02-12T12:53:27.786 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-12T12:53:27.786 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T12:53:27.844 INFO:tasks.ceph.osd.1:Stopped 2026-02-12T12:53:27.844 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-12T12:53:27.844 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T12:53:27.888 INFO:tasks.ceph.osd.2:Stopped 2026-02-12T12:53:27.889 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-12T12:53:27.889 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-12T12:53:27.889 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T12:53:27.920 INFO:tasks.ceph.mgr.x:Stopped 2026-02-12T12:53:27.920 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-12T12:53:27.920 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-12T12:53:27.920 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T12:53:27.968 INFO:tasks.ceph.mon.a:Stopped 2026-02-12T12:53:27.968 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-12T12:53:27.969 DEBUG:teuthology.orchestra.run.trial025:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v '\(PG_' | grep -E -v '\(OSD_' | grep -E -v '\(OBJECT_' | grep -E -v 'overall HEALTH' | head -n 1 2026-02-12T12:53:28.034 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial025.front.sepia.ceph.com 2026-02-12T12:53:28.035 DEBUG:teuthology.orchestra.run.trial025:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-12T12:53:28.103 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial025.front.sepia.ceph.com 2026-02-12T12:53:28.103 DEBUG:teuthology.orchestra.run.trial025:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-12T12:53:28.170 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial025.front.sepia.ceph.com 2026-02-12T12:53:28.170 DEBUG:teuthology.orchestra.run.trial025:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-12T12:53:28.239 INFO:tasks.ceph:Archiving mon data... 2026-02-12T12:53:28.240 DEBUG:teuthology.misc:Transferring archived files from trial025:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial/45942/data/mon.a.tgz 2026-02-12T12:53:28.241 DEBUG:teuthology.orchestra.run.trial025:> mktemp 2026-02-12T12:53:28.294 INFO:teuthology.orchestra.run.trial025.stdout:/tmp/tmp.A9gmeImGF5 2026-02-12T12:53:28.295 DEBUG:teuthology.orchestra.run.trial025:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.A9gmeImGF5 2026-02-12T12:53:28.377 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod 0666 /tmp/tmp.A9gmeImGF5 2026-02-12T12:53:28.500 DEBUG:teuthology.orchestra.remote:trial025:/tmp/tmp.A9gmeImGF5 is 153KB 2026-02-12T12:53:28.547 DEBUG:teuthology.orchestra.run.trial025:> rm -fr /tmp/tmp.A9gmeImGF5 2026-02-12T12:53:28.562 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-12T12:53:28.562 DEBUG:teuthology.orchestra.run.trial025:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T12:53:28.683 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T12:53:28.683 INFO:tasks.ceph:Archiving crash dumps... 2026-02-12T12:53:28.685 DEBUG:teuthology.misc:Transferring archived files from trial025:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial/45942/remote/trial025/crash 2026-02-12T12:53:28.687 DEBUG:teuthology.orchestra.run.trial025:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T12:53:28.748 INFO:tasks.ceph:Compressing logs... 2026-02-12T12:53:28.749 DEBUG:teuthology.orchestra.run.trial025:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T12:53:28.812 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-12T12:53:28.823 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-12T12:53:28.823 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20622.log 2026-02-12T12:53:28.824 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-12T12:53:28.824 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph.tmp-client.admin.20622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23444.log 2026-02-12T12:53:28.824 INFO:teuthology.orchestra.run.trial025.stderr: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20622.log.gz 2026-02-12T12:53:28.824 INFO:teuthology.orchestra.run.trial025.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-12T12:53:28.824 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22528.log 2026-02-12T12:53:28.824 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22954.log 2026-02-12T12:53:28.824 INFO:teuthology.orchestra.run.trial025.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23444.log.gz 2026-02-12T12:53:28.824 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22528.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22528.log.gz 2026-02-12T12:53:28.824 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23155.log 2026-02-12T12:53:28.824 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23300.log 2026-02-12T12:53:28.824 INFO:teuthology.orchestra.run.trial025.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22954.log.gz 2026-02-12T12:53:28.825 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23154.log 2026-02-12T12:53:28.825 INFO:teuthology.orchestra.run.trial025.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23155.log.gz 2026-02-12T12:53:28.825 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23300.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23300.log.gz 2026-02-12T12:53:28.825 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23153.log 2026-02-12T12:53:28.825 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22498.log 2026-02-12T12:53:28.825 INFO:teuthology.orchestra.run.trial025.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23154.log.gz 2026-02-12T12:53:28.825 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22279.log 2026-02-12T12:53:28.825 INFO:teuthology.orchestra.run.trial025.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23153.log.gz 2026-02-12T12:53:28.825 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24025.log 2026-02-12T12:53:28.825 INFO:teuthology.orchestra.run.trial025.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22498.log.gz 2026-02-12T12:53:28.825 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23003.log 2026-02-12T12:53:28.825 INFO:teuthology.orchestra.run.trial025.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22279.log.gz 2026-02-12T12:53:28.826 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.24025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23052.log 2026-02-12T12:53:28.826 INFO:teuthology.orchestra.run.trial025.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.24025.log.gz 2026-02-12T12:53:28.826 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23003.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23003.log.gz -5 2026-02-12T12:53:28.826 INFO:teuthology.orchestra.run.trial025.stderr: --verbose -- /var/log/ceph/ceph-client.admin.22676.log 2026-02-12T12:53:28.826 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23052.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23052.log.gz 2026-02-12T12:53:28.826 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22048.log 2026-02-12T12:53:28.826 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21906.log 2026-02-12T12:53:28.826 INFO:teuthology.orchestra.run.trial025.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22676.log.gz 2026-02-12T12:53:28.826 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22905.log 2026-02-12T12:53:28.826 INFO:teuthology.orchestra.run.trial025.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22048.log.gz 2026-02-12T12:53:28.826 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.21906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22744.log 2026-02-12T12:53:28.826 INFO:teuthology.orchestra.run.trial025.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.21906.log.gz 2026-02-12T12:53:28.826 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22905.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22905.log.gz 2026-02-12T12:53:28.827 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23395.log 2026-02-12T12:53:28.827 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22001.log 2026-02-12T12:53:28.827 INFO:teuthology.orchestra.run.trial025.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22744.log.gz 2026-02-12T12:53:28.827 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23395.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-12T12:53:28.827 INFO:teuthology.orchestra.run.trial025.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.23395.log.gz 2026-02-12T12:53:28.827 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22839.log 2026-02-12T12:53:28.827 INFO:teuthology.orchestra.run.trial025.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22001.log.gz 2026-02-12T12:53:28.827 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-12T12:53:28.827 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22185.log 2026-02-12T12:53:28.827 INFO:teuthology.orchestra.run.trial025.stderr: 86.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-12T12:53:28.827 INFO:teuthology.orchestra.run.trial025.stderr: 67.2% -- replaced with /var/log/ceph/ceph-client.admin.22839.log.gz 2026-02-12T12:53:28.827 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22814.log 2026-02-12T12:53:28.828 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22185.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22185.log.gz 2026-02-12T12:53:28.828 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-12T12:53:28.828 INFO:teuthology.orchestra.run.trial025.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-12T12:53:28.828 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22814.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22814.log.gz 2026-02-12T12:53:28.828 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-12T12:53:28.828 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22232.log 2026-02-12T12:53:28.828 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23493.log 2026-02-12T12:53:28.828 INFO:teuthology.orchestra.run.trial025.stderr: 79.1% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-12T12:53:28.828 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23301.log 2026-02-12T12:53:28.828 INFO:teuthology.orchestra.run.trial025.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22232.log.gz 2026-02-12T12:53:28.828 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23302.log 2026-02-12T12:53:28.828 INFO:teuthology.orchestra.run.trial025.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23493.log.gz 2026-02-12T12:53:28.828 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23301.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23301.log.gz 2026-02-12T12:53:28.829 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23302.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23302.log.gz 2026-02-12T12:53:28.829 INFO:teuthology.orchestra.run.trial025.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-12T12:53:28.836 INFO:teuthology.orchestra.run.trial025.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-12T12:53:28.844 INFO:teuthology.orchestra.run.trial025.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-12T12:53:28.846 INFO:teuthology.orchestra.run.trial025.stderr: 2026-02-12T12:53:28.847 INFO:teuthology.orchestra.run.trial025.stderr:real 0m0.042s 2026-02-12T12:53:28.847 INFO:teuthology.orchestra.run.trial025.stderr:user 0m0.072s 2026-02-12T12:53:28.847 INFO:teuthology.orchestra.run.trial025.stderr:sys 0m0.027s 2026-02-12T12:53:28.847 INFO:tasks.ceph:Archiving logs... 2026-02-12T12:53:28.847 DEBUG:teuthology.misc:Transferring archived files from trial025:/var/log/ceph to /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial/45942/remote/trial025/log 2026-02-12T12:53:28.849 DEBUG:teuthology.orchestra.run.trial025:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T12:53:29.004 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T12:53:29.116 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T12:53:29.127 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-12T12:53:29.127 DEBUG:teuthology.orchestra.run.trial025:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T12:53:29.152 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-12T12:53:29.164 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-12T12:53:29.164 DEBUG:teuthology.orchestra.run.trial025:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T12:53:29.207 INFO:teuthology.orchestra.run.trial025.stderr:bash: line 1: ntpq: command not found 2026-02-12T12:53:29.234 INFO:teuthology.orchestra.run.trial025.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T12:53:29.234 INFO:teuthology.orchestra.run.trial025.stdout:=============================================================================== 2026-02-12T12:53:29.234 INFO:teuthology.orchestra.run.trial025.stdout:^- 108.61.215.221.vultruser> 2 6 377 4 -879us[ -879us] +/- 34ms 2026-02-12T12:53:29.234 INFO:teuthology.orchestra.run.trial025.stdout:^- dns-e.ns4v.icu 2 6 377 4 +2103us[+2103us] +/- 53ms 2026-02-12T12:53:29.234 INFO:teuthology.orchestra.run.trial025.stdout:^- chi2.us.ntp.li 2 6 377 5 +162us[ +162us] +/- 11ms 2026-02-12T12:53:29.234 INFO:teuthology.orchestra.run.trial025.stdout:^* ntp.nyc.icanbwell.com 2 6 377 5 -7753ns[ -21us] +/- 2988us 2026-02-12T12:53:29.235 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-12T12:53:29.251 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-12T12:53:29.252 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-12T12:53:29.265 DEBUG:teuthology.orchestra.run.trial025:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T12:53:29.320 DEBUG:teuthology.orchestra.run.trial025:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T12:53:29.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T12:53:29.386 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-12T12:53:29.404 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-12T12:53:29.421 INFO:teuthology.task.internal:Duration was 342.072587 seconds 2026-02-12T12:53:29.422 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-12T12:53:29.438 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-12T12:53:29.438 DEBUG:teuthology.orchestra.run.trial025:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T12:53:29.475 INFO:teuthology.orchestra.run.trial025.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T12:53:29.790 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-12T12:53:29.790 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial025.front.sepia.ceph.com 2026-02-12T12:53:29.790 DEBUG:teuthology.orchestra.run.trial025:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T12:53:29.849 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-12T12:53:29.849 DEBUG:teuthology.orchestra.run.trial025:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T12:53:29.931 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-12T12:53:29.932 DEBUG:teuthology.orchestra.run.trial025:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T12:53:29.996 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T12:53:29.996 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T12:53:29.996 INFO:teuthology.orchestra.run.trial025.stderr:gzip/home/ubuntu/cephtest/archive/syslog/misc.log: -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T12:53:29.996 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T12:53:29.996 INFO:teuthology.orchestra.run.trial025.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T12:53:29.999 INFO:teuthology.orchestra.run.trial025.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T12:53:30.001 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-12T12:53:30.026 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-12T12:53:30.027 DEBUG:teuthology.orchestra.run.trial025:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T12:53:30.066 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-12T12:53:30.085 DEBUG:teuthology.orchestra.run.trial025:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T12:53:30.129 INFO:teuthology.orchestra.run.trial025.stdout:kernel.core_pattern = core 2026-02-12T12:53:30.148 DEBUG:teuthology.orchestra.run.trial025:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T12:53:30.203 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T12:53:30.204 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-12T12:53:30.222 INFO:teuthology.task.internal:Transferring archived files... 2026-02-12T12:53:30.223 DEBUG:teuthology.misc:Transferring archived files from trial025:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial/45942/remote/trial025 2026-02-12T12:53:30.223 DEBUG:teuthology.orchestra.run.trial025:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T12:53:30.278 INFO:teuthology.task.internal:Removing archive directory... 2026-02-12T12:53:30.278 DEBUG:teuthology.orchestra.run.trial025:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T12:53:30.326 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-12T12:53:30.345 INFO:teuthology.task.internal:Not uploading archives. 2026-02-12T12:53:30.346 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-12T12:53:30.364 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-12T12:53:30.365 DEBUG:teuthology.orchestra.run.trial025:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T12:53:30.383 INFO:teuthology.orchestra.run.trial025.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 12:53 /home/ubuntu/cephtest 2026-02-12T12:53:30.384 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T12:53:30.403 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T12:53:30.445 INFO:teuthology.run:Summary data: description: crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} perf_ignorelist settings/optimized workloads/fio_4K_rand_read} duration: 342.07258653640747 failure_reason: 'Command failed on trial025 with status 4: ''sudo mkdir collectl && cd collectl && sudo wget https://sourceforge.net/projects/collectl/files/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz/download -O collectl.tar.gz && sudo tar -xvf collectl.tar.gz && cd collectl-4.3.1 && sudo ./INSTALL''' flavor: debug owner: scheduled_moagrawa@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T12:53:30.445 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:53:30.558 INFO:teuthology.run:FAIL