2026-02-12T08:35:33.993 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062 2026-02-12T08:35:34.008 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T08:35:34.088 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41553 branch: main description: crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} perf_ignorelist settings/optimized workloads/radosbench_omap_write} email: null first_in_suite: false flavor: debug job_id: '41553' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: global: auth client required: none auth cluster required: none auth service required: none auth supported: none debug asok: 0/0 debug auth: 0/0 debug bdev: 0/0 debug bluefs: 0/0 debug bluestore: 0/0 debug buffer: 0/0 debug civetweb: 0/0 debug client: 0/0 debug compressor: 0/0 debug context: 0/0 debug crush: 0/0 debug crypto: 0/0 debug dpdk: 0/0 debug eventtrace: 0/0 debug filer: 0/0 debug filestore: 0/0 debug finisher: 0/0 debug fuse: 0/0 debug heartbeatmap: 0/0 debug javaclient: 0/0 debug journal: 0/0 debug journaler: 0/0 debug kstore: 0/0 debug leveldb: 0/0 debug lockdep: 0/0 debug mds: 0/0 debug mds balancer: 0/0 debug mds locker: 0/0 debug mds log: 0/0 debug mds log expire: 0/0 debug mds migrator: 0/0 debug memdb: 0/0 debug mgr: 0/0 debug mgrc: 0/0 debug mon: 0/0 debug monc: 0/0 debug ms: 0/0 debug objclass: 0/0 debug objectcacher: 0/0 debug objecter: 0/0 debug optracker: 0/0 debug osd: 0/0 debug paxos: 0/0 debug perfcounter: 0/0 debug rados: 0/0 debug rbd: 0/0 debug rbd mirror: 0/0 debug rbd replay: 0/0 debug refs: 0/0 debug rgw: 0/0 debug rgw lifecycle: 0/0 debug rgw notification: 0/0 debug rgw sync: 0/0 debug rocksdb: 0/0 debug striper: 0/0 debug throttle: 0/0 debug timer: 0/0 debug tp: 0/0 enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 0/0 debug ms: 0/0 debug paxos: 0/0 osd pool default crimson: true osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug filestore: 0/0 debug journal: 0/0 debug ms: 0/0 debug osd: 0/0 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd objectstore: seastore osd shutdown pgref assert: true seastore cachepin size pershard: 64M seastore cachepin type: 2Q seastore main device type: RANDOM_BLOCK_SSD seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - \(PG_ - \(OSD_ - \(OBJECT_ - overall HEALTH sha1: 2401a109e2ac85dfa20fc57328da663aa754c875 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} install: ceph: flavor: debug sha1: 2401a109e2ac85dfa20fc57328da663aa754c875 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c owner: scheduled_matan@soko04.front.sepia.ceph.com priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 9353 sha1: 2401a109e2ac85dfa20fc57328da663aa754c875 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c targets: trial025.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC0neB+P+QbSyDwZRQHW0rNaftRQE+KRwZpIN9+hYi3a4kMlcCiG6bd8WDV2EOdGft6mnEezlN2S9UrrBjVEGy8= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: osd: debug monc: 20 wait-for-scrub: false - ssh_keys: null - radosbench: clients: - client.0 objectsize: 4096 size: 4096 time: 300 write-omap: true teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: c433f1062990a0488dc29a553589bc609a460691 timestamp: 2026-02-09_15:50:17 tube: trial user: matan verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.2161924 2026-02-12T08:35:34.088 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c/qa; will attempt to use it 2026-02-12T08:35:34.089 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c/qa/tasks 2026-02-12T08:35:34.089 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T08:35:34.090 INFO:teuthology.task.internal:Checking packages... 2026-02-12T08:35:34.091 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash '2401a109e2ac85dfa20fc57328da663aa754c875' 2026-02-12T08:35:34.091 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T08:35:34.091 INFO:teuthology.packaging:ref: None 2026-02-12T08:35:34.091 INFO:teuthology.packaging:tag: None 2026-02-12T08:35:34.091 INFO:teuthology.packaging:branch: main 2026-02-12T08:35:34.091 INFO:teuthology.packaging:sha1: 2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:35:34.091 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=main 2026-02-12T08:35:34.239 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5271.gdbd7cb72 2026-02-12T08:35:34.241 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T08:35:34.252 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T08:35:34.253 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T08:35:34.267 INFO:teuthology.task.internal:Saving configuration 2026-02-12T08:35:34.283 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T08:35:34.296 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T08:35:34.363 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial025.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41553', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 08:32:21.492634', 'locked_by': 'scheduled_matan@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC0neB+P+QbSyDwZRQHW0rNaftRQE+KRwZpIN9+hYi3a4kMlcCiG6bd8WDV2EOdGft6mnEezlN2S9UrrBjVEGy8='} 2026-02-12T08:35:34.363 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T08:35:34.374 INFO:teuthology.task.internal:roles: ubuntu@trial025.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-12T08:35:34.375 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T08:35:34.456 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7dfe31122660>, signals=[15]) 2026-02-12T08:35:34.456 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T08:35:34.471 INFO:teuthology.task.internal:Opening connections... 2026-02-12T08:35:34.471 DEBUG:teuthology.task.internal:connecting to ubuntu@trial025.front.sepia.ceph.com 2026-02-12T08:35:34.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:35:34.537 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T08:35:34.549 DEBUG:teuthology.orchestra.run.trial025:> uname -m 2026-02-12T08:35:34.616 INFO:teuthology.orchestra.run.trial025.stdout:x86_64 2026-02-12T08:35:34.616 DEBUG:teuthology.orchestra.run.trial025:> cat /etc/os-release 2026-02-12T08:35:34.673 INFO:teuthology.orchestra.run.trial025.stdout:NAME="CentOS Stream" 2026-02-12T08:35:34.673 INFO:teuthology.orchestra.run.trial025.stdout:VERSION="9" 2026-02-12T08:35:34.673 INFO:teuthology.orchestra.run.trial025.stdout:ID="centos" 2026-02-12T08:35:34.673 INFO:teuthology.orchestra.run.trial025.stdout:ID_LIKE="rhel fedora" 2026-02-12T08:35:34.673 INFO:teuthology.orchestra.run.trial025.stdout:VERSION_ID="9" 2026-02-12T08:35:34.673 INFO:teuthology.orchestra.run.trial025.stdout:PLATFORM_ID="platform:el9" 2026-02-12T08:35:34.673 INFO:teuthology.orchestra.run.trial025.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T08:35:34.673 INFO:teuthology.orchestra.run.trial025.stdout:ANSI_COLOR="0;31" 2026-02-12T08:35:34.673 INFO:teuthology.orchestra.run.trial025.stdout:LOGO="fedora-logo-icon" 2026-02-12T08:35:34.673 INFO:teuthology.orchestra.run.trial025.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T08:35:34.674 INFO:teuthology.orchestra.run.trial025.stdout:HOME_URL="https://centos.org/" 2026-02-12T08:35:34.674 INFO:teuthology.orchestra.run.trial025.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T08:35:34.674 INFO:teuthology.orchestra.run.trial025.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T08:35:34.674 INFO:teuthology.orchestra.run.trial025.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T08:35:34.675 INFO:teuthology.lock.ops:Updating trial025.front.sepia.ceph.com on lock server 2026-02-12T08:35:34.767 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T08:35:34.780 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T08:35:34.791 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T08:35:34.791 DEBUG:teuthology.orchestra.run.trial025:> test '!' -e /home/ubuntu/cephtest 2026-02-12T08:35:34.806 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T08:35:34.817 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T08:35:34.817 DEBUG:teuthology.orchestra.run.trial025:> test -z $(ls -A /var/lib/ceph) 2026-02-12T08:35:34.862 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T08:35:34.944 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T08:35:34.964 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-12T08:35:34.964 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-12T08:35:34.964 DEBUG:teuthology.orchestra.run.trial025:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T08:35:34.979 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:35:34.979 DEBUG:teuthology.orchestra.run.trial025:> uname -r 2026-02-12T08:35:35.035 INFO:teuthology.orchestra.run.trial025.stdout:5.14.0-645.el9.x86_64 2026-02-12T08:35:35.036 INFO:teuthology.task.kernel:Running kernel on trial025: 5.14.0-645.el9.x86_64 2026-02-12T08:35:35.036 DEBUG:teuthology.orchestra.run.trial025:> sudo yum install -y kernel 2026-02-12T08:35:36.099 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-12T08:35:39.458 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 27 MB 00:02 2026-02-12T08:35:43.328 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 7.8 MB 00:01 2026-02-12T08:35:45.291 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 20 kB 00:01 2026-02-12T08:35:56.835 INFO:teuthology.orchestra.run.trial025.stdout:Extra Packages for Enterprise Linux 1.8 MB/s | 20 MB 00:11 2026-02-12T08:36:00.004 INFO:teuthology.orchestra.run.trial025.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-12T08:36:01.077 INFO:teuthology.orchestra.run.trial025.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T08:36:01.097 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:36:01.098 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:36:01.098 INFO:teuthology.orchestra.run.trial025.stdout: Package Architecture Version Repository Size 2026-02-12T08:36:01.098 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:36:01.098 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T08:36:01.098 INFO:teuthology.orchestra.run.trial025.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T08:36:01.098 INFO:teuthology.orchestra.run.trial025.stdout:Installing dependencies: 2026-02-12T08:36:01.098 INFO:teuthology.orchestra.run.trial025.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T08:36:01.098 INFO:teuthology.orchestra.run.trial025.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T08:36:01.098 INFO:teuthology.orchestra.run.trial025.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T08:36:01.098 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:36:01.098 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T08:36:01.098 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:36:01.098 INFO:teuthology.orchestra.run.trial025.stdout:Install 4 Packages 2026-02-12T08:36:01.098 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:36:01.098 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 88 M 2026-02-12T08:36:01.098 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 135 M 2026-02-12T08:36:01.098 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T08:36:01.531 INFO:teuthology.orchestra.run.trial025.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 5.8 MB/s | 768 kB 00:00 2026-02-12T08:36:01.680 INFO:teuthology.orchestra.run.trial025.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 61 MB/s | 17 MB 00:00 2026-02-12T08:36:01.860 INFO:teuthology.orchestra.run.trial025.stdout:(3/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 87 MB/s | 40 MB 00:00 2026-02-12T08:36:02.131 INFO:teuthology.orchestra.run.trial025.stdout:(4/4): kernel-modules-core-5.14.0-677.el9.x86_6 51 MB/s | 31 MB 00:00 2026-02-12T08:36:02.131 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:36:02.131 INFO:teuthology.orchestra.run.trial025.stdout:Total 85 MB/s | 88 MB 00:01 2026-02-12T08:36:02.321 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T08:36:02.526 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T08:36:02.526 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T08:36:02.871 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T08:36:02.871 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T08:36:03.958 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T08:36:04.244 INFO:teuthology.orchestra.run.trial025.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T08:36:04.262 INFO:teuthology.orchestra.run.trial025.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T08:36:06.026 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T08:36:06.054 INFO:teuthology.orchestra.run.trial025.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T08:36:09.078 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T08:36:09.084 INFO:teuthology.orchestra.run.trial025.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:36:12.123 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:36:42.554 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:36:42.574 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:36:42.744 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:36:42.744 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T08:36:42.744 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T08:36:42.744 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T08:36:42.795 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T08:36:42.795 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:36:42.796 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T08:36:42.796 INFO:teuthology.orchestra.run.trial025.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T08:36:42.796 INFO:teuthology.orchestra.run.trial025.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T08:36:42.796 INFO:teuthology.orchestra.run.trial025.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T08:36:42.796 INFO:teuthology.orchestra.run.trial025.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T08:36:42.796 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:36:42.796 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:36:42.853 DEBUG:teuthology.orchestra.run.trial025:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T08:36:42.878 INFO:teuthology.orchestra.run.trial025.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T08:36:42.879 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T08:36:42.880 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T08:36:42.880 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T08:36:42.880 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T08:36:42.880 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T08:36:42.880 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial025.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T08:36:42.880 DEBUG:teuthology.orchestra.run.trial025:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T08:36:42.942 INFO:teuthology.orchestra.run.trial025.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T08:36:42.943 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T08:36:42.944 DEBUG:teuthology.orchestra.run.trial025:> sudo rpm -qi grub2-tools 2026-02-12T08:36:43.013 INFO:teuthology.orchestra.run.trial025.stdout:Name : grub2-tools 2026-02-12T08:36:43.013 INFO:teuthology.orchestra.run.trial025.stdout:Epoch : 1 2026-02-12T08:36:43.013 INFO:teuthology.orchestra.run.trial025.stdout:Version : 2.06 2026-02-12T08:36:43.013 INFO:teuthology.orchestra.run.trial025.stdout:Release : 118.el9 2026-02-12T08:36:43.013 INFO:teuthology.orchestra.run.trial025.stdout:Architecture: x86_64 2026-02-12T08:36:43.013 INFO:teuthology.orchestra.run.trial025.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T08:36:43.013 INFO:teuthology.orchestra.run.trial025.stdout:Group : Unspecified 2026-02-12T08:36:43.014 INFO:teuthology.orchestra.run.trial025.stdout:Size : 8393909 2026-02-12T08:36:43.014 INFO:teuthology.orchestra.run.trial025.stdout:License : GPLv3+ 2026-02-12T08:36:43.014 INFO:teuthology.orchestra.run.trial025.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T08:36:43.014 INFO:teuthology.orchestra.run.trial025.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T08:36:43.014 INFO:teuthology.orchestra.run.trial025.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T08:36:43.014 INFO:teuthology.orchestra.run.trial025.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T08:36:43.014 INFO:teuthology.orchestra.run.trial025.stdout:Packager : builder@centos.org 2026-02-12T08:36:43.014 INFO:teuthology.orchestra.run.trial025.stdout:Vendor : CentOS 2026-02-12T08:36:43.014 INFO:teuthology.orchestra.run.trial025.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T08:36:43.014 INFO:teuthology.orchestra.run.trial025.stdout:Summary : Support tools for GRUB. 2026-02-12T08:36:43.014 INFO:teuthology.orchestra.run.trial025.stdout:Description : 2026-02-12T08:36:43.014 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:36:43.014 INFO:teuthology.orchestra.run.trial025.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T08:36:43.015 INFO:teuthology.orchestra.run.trial025.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T08:36:43.015 INFO:teuthology.orchestra.run.trial025.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T08:36:43.015 INFO:teuthology.orchestra.run.trial025.stdout:hardware devices. 2026-02-12T08:36:43.015 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:36:43.015 INFO:teuthology.orchestra.run.trial025.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T08:36:43.016 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T08:36:43.016 INFO:teuthology.task.kernel:Updating grub on trial025 to boot 5.14.0-677.el9.x86_64 2026-02-12T08:36:43.016 DEBUG:teuthology.orchestra.run.trial025:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T08:36:43.078 INFO:teuthology.orchestra.run.trial025.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T08:36:43.080 DEBUG:teuthology.orchestra.run.trial025:> sudo command -v grubby && echo yes || echo no 2026-02-12T08:36:43.143 INFO:teuthology.orchestra.run.trial025.stdout:/sbin/grubby 2026-02-12T08:36:43.145 INFO:teuthology.orchestra.run.trial025.stdout:yes 2026-02-12T08:36:43.145 DEBUG:teuthology.orchestra.run.trial025:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T08:36:43.210 INFO:teuthology.orchestra.run.trial025.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T08:36:43.211 DEBUG:teuthology.orchestra.run.trial025:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T08:36:43.285 DEBUG:teuthology.orchestra.run.trial025:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T08:36:43.492 INFO:teuthology.orchestra.run.trial025.stderr:Generating grub configuration file ... 2026-02-12T08:36:43.556 INFO:teuthology.orchestra.run.trial025.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T08:36:43.562 INFO:teuthology.orchestra.run.trial025.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T08:36:43.813 INFO:teuthology.orchestra.run.trial025.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T08:36:43.819 INFO:teuthology.orchestra.run.trial025.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T08:36:43.850 INFO:teuthology.orchestra.run.trial025.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T08:36:43.857 INFO:teuthology.orchestra.run.trial025.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T08:36:43.880 INFO:teuthology.orchestra.run.trial025.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T08:36:43.887 INFO:teuthology.orchestra.run.trial025.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T08:36:43.969 INFO:teuthology.orchestra.run.trial025.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T08:36:43.978 INFO:teuthology.orchestra.run.trial025.stderr:done 2026-02-12T08:36:43.980 DEBUG:teuthology.orchestra.run.trial025:> test -d /sys/firmware/efi 2026-02-12T08:36:43.995 DEBUG:teuthology.orchestra.run.trial025:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T08:36:44.062 INFO:teuthology.orchestra.run.trial025.stdout:/boot/efi/EFI/BOOT 2026-02-12T08:36:44.062 INFO:teuthology.orchestra.run.trial025.stdout:/boot/efi/EFI/centos 2026-02-12T08:36:44.064 DEBUG:teuthology.orchestra.run.trial025:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T08:36:44.129 INFO:teuthology.orchestra.run.trial025.stdout:no 2026-02-12T08:36:44.129 DEBUG:teuthology.orchestra.run.trial025:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T08:36:44.195 INFO:teuthology.orchestra.run.trial025.stdout:yes 2026-02-12T08:36:44.196 DEBUG:teuthology.orchestra.run.trial025:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T08:36:44.261 DEBUG:teuthology.orchestra.run.trial025:> sudo shutdown -r now 2026-02-12T08:36:44.335 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T08:37:14.316 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T08:37:14.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial025.front.sepia.ceph.com' 2026-02-12T08:37:14.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:38:14.351 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T08:38:23.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial025.front.sepia.ceph.com' 2026-02-12T08:38:23.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:38:23.496 DEBUG:teuthology.orchestra.run.trial025:> true 2026-02-12T08:38:23.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial025.front.sepia.ceph.com' 2026-02-12T08:38:23.649 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T08:38:23.649 DEBUG:teuthology.orchestra.run.trial025:> uname -r 2026-02-12T08:38:23.704 INFO:teuthology.orchestra.run.trial025.stdout:5.14.0-677.el9.x86_64 2026-02-12T08:38:23.705 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T08:38:23.705 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T08:38:23.705 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T08:38:24.706 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-12T08:38:24.707 DEBUG:teuthology.orchestra.run.trial025:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T08:38:24.737 INFO:teuthology.orchestra.run.trial025.stdout:ttyS1 2026-02-12T08:38:24.756 DEBUG:teuthology.parallel:result is None 2026-02-12T08:38:24.756 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-12T08:38:24.769 INFO:teuthology.task.internal:Creating test directory... 2026-02-12T08:38:24.770 DEBUG:teuthology.orchestra.run.trial025:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T08:38:24.812 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-12T08:38:24.822 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-12T08:38:24.833 INFO:teuthology.task.internal:Creating archive directory... 2026-02-12T08:38:24.833 DEBUG:teuthology.orchestra.run.trial025:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T08:38:24.874 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-12T08:38:24.885 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-12T08:38:24.885 DEBUG:teuthology.orchestra.run.trial025:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T08:38:24.932 INFO:teuthology.orchestra.run.trial025.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T08:38:24.941 INFO:teuthology.orchestra.run.trial025.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T08:38:24.943 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-12T08:38:24.955 INFO:teuthology.task.internal:Configuring sudo... 2026-02-12T08:38:24.955 DEBUG:teuthology.orchestra.run.trial025:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T08:38:25.007 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-12T08:38:25.023 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-12T08:38:25.024 DEBUG:teuthology.orchestra.run.trial025:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T08:38:25.063 DEBUG:teuthology.orchestra.run.trial025:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T08:38:25.221 DEBUG:teuthology.orchestra.run.trial025:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T08:38:25.247 DEBUG:teuthology.orchestra.run.trial025:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T08:38:25.368 DEBUG:teuthology.orchestra.run.trial025:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T08:38:25.392 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:38:25.392 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T08:38:25.456 DEBUG:teuthology.orchestra.run.trial025:> sudo service rsyslog restart 2026-02-12T08:38:25.524 INFO:teuthology.orchestra.run.trial025.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T08:38:25.917 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-12T08:38:25.930 INFO:teuthology.task.internal:Starting timer... 2026-02-12T08:38:25.930 INFO:teuthology.run_tasks:Running task pcp... 2026-02-12T08:38:25.947 INFO:teuthology.run_tasks:Running task selinux... 2026-02-12T08:38:25.959 DEBUG:teuthology.orchestra.run.trial025:> sudo service auditd rotate 2026-02-12T08:38:25.988 INFO:teuthology.orchestra.run.trial025.stdout:Rotating logs: 2026-02-12T08:38:25.989 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-12T08:38:25.990 DEBUG:teuthology.orchestra.run.trial025:> /usr/sbin/getenforce 2026-02-12T08:38:26.045 INFO:teuthology.orchestra.run.trial025.stdout:Permissive 2026-02-12T08:38:26.045 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial025.front.sepia.ceph.com': 'permissive'} 2026-02-12T08:38:26.045 DEBUG:teuthology.orchestra.run.trial025:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T08:38:26.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T08:38:26.108 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-12T08:38:26.108 DEBUG:teuthology.orchestra.run.trial025:> sudo /usr/sbin/setenforce permissive 2026-02-12T08:38:26.171 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-12T08:38:26.184 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-12T08:38:26.186 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-12T08:38:26.317 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-12T08:38:26.325 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-12T08:38:26.326 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial025.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-12T08:39:50.993 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial025.front.sepia.ceph.com')] 2026-02-12T08:39:50.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial025.front.sepia.ceph.com' 2026-02-12T08:39:50.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:39:51.106 DEBUG:teuthology.orchestra.run.trial025:> true 2026-02-12T08:39:51.187 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial025.front.sepia.ceph.com' 2026-02-12T08:39:51.187 INFO:teuthology.run_tasks:Running task clock... 2026-02-12T08:39:51.203 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-12T08:39:51.204 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T08:39:51.204 DEBUG:teuthology.orchestra.run.trial025:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T08:39:51.253 INFO:teuthology.orchestra.run.trial025.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T08:39:51.265 INFO:teuthology.orchestra.run.trial025.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T08:39:51.286 INFO:teuthology.orchestra.run.trial025.stderr:sudo: ntpd: command not found 2026-02-12T08:39:51.296 INFO:teuthology.orchestra.run.trial025.stdout:506 Cannot talk to daemon 2026-02-12T08:39:51.308 INFO:teuthology.orchestra.run.trial025.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T08:39:51.321 INFO:teuthology.orchestra.run.trial025.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T08:39:51.363 INFO:teuthology.orchestra.run.trial025.stderr:bash: line 1: ntpq: command not found 2026-02-12T08:39:51.405 INFO:teuthology.orchestra.run.trial025.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T08:39:51.405 INFO:teuthology.orchestra.run.trial025.stdout:=============================================================================== 2026-02-12T08:39:51.405 INFO:teuthology.orchestra.run.trial025.stdout:^? white.web-ster.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T08:39:51.405 INFO:teuthology.orchestra.run.trial025.stdout:^? 170-187-147-56.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T08:39:51.405 INFO:teuthology.orchestra.run.trial025.stdout:^? time-usw2.crimpac.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T08:39:51.405 INFO:teuthology.orchestra.run.trial025.stdout:^? s2-b.time.mci1.us.rozint> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T08:39:51.407 INFO:teuthology.run_tasks:Running task install... 2026-02-12T08:39:51.421 DEBUG:teuthology.task.install:project ceph 2026-02-12T08:39:51.421 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'}} 2026-02-12T08:39:51.421 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'} 2026-02-12T08:39:51.421 INFO:teuthology.task.install:Using flavor: debug 2026-02-12T08:39:51.431 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-12T08:39:51.431 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-12T08:39:51.432 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875', 'tag': None, 'wait_for_package': False} 2026-02-12T08:39:51.432 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:39:51.606 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/ 2026-02-12T08:39:51.606 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5161.g2401a109 2026-02-12T08:39:51.974 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T08:39:51.974 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:39:51.975 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T08:39:52.001 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-12T08:39:52.001 DEBUG:teuthology.orchestra.run.trial025:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2401a109e2ac85dfa20fc57328da663aa754c875/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T08:39:52.067 DEBUG:teuthology.orchestra.run.trial025:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T08:39:52.142 DEBUG:teuthology.orchestra.run.trial025:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T08:39:52.205 INFO:teuthology.orchestra.run.trial025.stdout:check_obsoletes = 1 2026-02-12T08:39:52.207 DEBUG:teuthology.orchestra.run.trial025:> sudo yum clean all 2026-02-12T08:39:52.356 INFO:teuthology.orchestra.run.trial025.stdout:41 files removed 2026-02-12T08:39:52.370 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-radosgw 2026-02-12T08:39:53.195 INFO:teuthology.orchestra.run.trial025.stdout:ceph packages for x86_64 138 kB/s | 94 kB 00:00 2026-02-12T08:39:53.808 INFO:teuthology.orchestra.run.trial025.stdout:ceph noarch packages 41 kB/s | 24 kB 00:00 2026-02-12T08:39:54.346 INFO:teuthology.orchestra.run.trial025.stdout:ceph source packages 4.0 kB/s | 2.1 kB 00:00 2026-02-12T08:39:55.298 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.9 MB 00:00 2026-02-12T08:39:58.321 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-12T08:40:01.239 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - CRB 14 MB/s | 7.8 MB 00:00 2026-02-12T08:40:02.361 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 20 kB 00:00 2026-02-12T08:40:03.638 INFO:teuthology.orchestra.run.trial025.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2026-02-12T08:40:06.893 INFO:teuthology.orchestra.run.trial025.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-12T08:40:08.186 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:40:08.188 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:40:08.188 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repository Size 2026-02-12T08:40:08.188 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:40:08.188 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T08:40:08.188 INFO:teuthology.orchestra.run.trial025.stdout: ceph-radosgw x86_64 2:20.3.0-5161.g2401a109.el9 ceph 11 M 2026-02-12T08:40:08.188 INFO:teuthology.orchestra.run.trial025.stdout:Upgrading: 2026-02-12T08:40:08.188 INFO:teuthology.orchestra.run.trial025.stdout: librados2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 3.3 M 2026-02-12T08:40:08.189 INFO:teuthology.orchestra.run.trial025.stdout: librbd1 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 2.7 M 2026-02-12T08:40:08.189 INFO:teuthology.orchestra.run.trial025.stdout:Installing dependencies: 2026-02-12T08:40:08.189 INFO:teuthology.orchestra.run.trial025.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T08:40:08.189 INFO:teuthology.orchestra.run.trial025.stdout: ceph-base x86_64 2:20.3.0-5161.g2401a109.el9 ceph 5.1 M 2026-02-12T08:40:08.189 INFO:teuthology.orchestra.run.trial025.stdout: ceph-common x86_64 2:20.3.0-5161.g2401a109.el9 ceph 21 M 2026-02-12T08:40:08.189 INFO:teuthology.orchestra.run.trial025.stdout: ceph-selinux x86_64 2:20.3.0-5161.g2401a109.el9 ceph 25 k 2026-02-12T08:40:08.189 INFO:teuthology.orchestra.run.trial025.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T08:40:08.189 INFO:teuthology.orchestra.run.trial025.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T08:40:08.189 INFO:teuthology.orchestra.run.trial025.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T08:40:08.189 INFO:teuthology.orchestra.run.trial025.stdout: libcephfs2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 860 k 2026-02-12T08:40:08.189 INFO:teuthology.orchestra.run.trial025.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T08:40:08.189 INFO:teuthology.orchestra.run.trial025.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T08:40:08.190 INFO:teuthology.orchestra.run.trial025.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T08:40:08.190 INFO:teuthology.orchestra.run.trial025.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T08:40:08.190 INFO:teuthology.orchestra.run.trial025.stdout: libradosstriper1 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 263 k 2026-02-12T08:40:08.190 INFO:teuthology.orchestra.run.trial025.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T08:40:08.190 INFO:teuthology.orchestra.run.trial025.stdout: librgw2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 5.6 M 2026-02-12T08:40:08.190 INFO:teuthology.orchestra.run.trial025.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T08:40:08.190 INFO:teuthology.orchestra.run.trial025.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T08:40:08.190 INFO:teuthology.orchestra.run.trial025.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T08:40:08.190 INFO:teuthology.orchestra.run.trial025.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T08:40:08.190 INFO:teuthology.orchestra.run.trial025.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T08:40:08.190 INFO:teuthology.orchestra.run.trial025.stdout: python3-ceph-argparse x86_64 2:20.3.0-5161.g2401a109.el9 ceph 45 k 2026-02-12T08:40:08.190 INFO:teuthology.orchestra.run.trial025.stdout: python3-ceph-common x86_64 2:20.3.0-5161.g2401a109.el9 ceph 184 k 2026-02-12T08:40:08.191 INFO:teuthology.orchestra.run.trial025.stdout: python3-cephfs x86_64 2:20.3.0-5161.g2401a109.el9 ceph 204 k 2026-02-12T08:40:08.191 INFO:teuthology.orchestra.run.trial025.stdout: python3-rados x86_64 2:20.3.0-5161.g2401a109.el9 ceph 323 k 2026-02-12T08:40:08.191 INFO:teuthology.orchestra.run.trial025.stdout: python3-rbd x86_64 2:20.3.0-5161.g2401a109.el9 ceph 305 k 2026-02-12T08:40:08.191 INFO:teuthology.orchestra.run.trial025.stdout: python3-rgw x86_64 2:20.3.0-5161.g2401a109.el9 ceph 100 k 2026-02-12T08:40:08.191 INFO:teuthology.orchestra.run.trial025.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T08:40:08.191 INFO:teuthology.orchestra.run.trial025.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T08:40:08.191 INFO:teuthology.orchestra.run.trial025.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T08:40:08.191 INFO:teuthology.orchestra.run.trial025.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T08:40:08.191 INFO:teuthology.orchestra.run.trial025.stdout:Installing weak dependencies: 2026-02-12T08:40:08.191 INFO:teuthology.orchestra.run.trial025.stdout: libcephfs-daemon x86_64 2:20.3.0-5161.g2401a109.el9 ceph 35 k 2026-02-12T08:40:08.191 INFO:teuthology.orchestra.run.trial025.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5161.g2401a109.el9 ceph 24 k 2026-02-12T08:40:08.191 INFO:teuthology.orchestra.run.trial025.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-12T08:40:08.192 INFO:teuthology.orchestra.run.trial025.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T08:40:08.192 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:40:08.192 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T08:40:08.192 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:40:08.192 INFO:teuthology.orchestra.run.trial025.stdout:Install 35 Packages 2026-02-12T08:40:08.192 INFO:teuthology.orchestra.run.trial025.stdout:Upgrade 2 Packages 2026-02-12T08:40:08.192 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:40:08.193 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 61 M 2026-02-12T08:40:08.193 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T08:40:10.754 INFO:teuthology.orchestra.run.trial025.stdout:(1/37): ceph-base-20.3.0-5161.g2401a109.el9.x86 2.4 MB/s | 5.1 MB 00:02 2026-02-12T08:40:10.813 INFO:teuthology.orchestra.run.trial025.stdout:(2/37): ceph-selinux-20.3.0-5161.g2401a109.el9. 425 kB/s | 25 kB 00:00 2026-02-12T08:40:10.874 INFO:teuthology.orchestra.run.trial025.stdout:(3/37): libcephfs-daemon-20.3.0-5161.g2401a109. 574 kB/s | 35 kB 00:00 2026-02-12T08:40:10.936 INFO:teuthology.orchestra.run.trial025.stdout:(4/37): libcephfs-proxy2-20.3.0-5161.g2401a109. 392 kB/s | 24 kB 00:00 2026-02-12T08:40:11.200 INFO:teuthology.orchestra.run.trial025.stdout:(5/37): libcephfs2-20.3.0-5161.g2401a109.el9.x8 3.2 MB/s | 860 kB 00:00 2026-02-12T08:40:11.332 INFO:teuthology.orchestra.run.trial025.stdout:(6/37): libradosstriper1-20.3.0-5161.g2401a109. 1.9 MB/s | 263 kB 00:00 2026-02-12T08:40:12.968 INFO:teuthology.orchestra.run.trial025.stdout:(7/37): librgw2-20.3.0-5161.g2401a109.el9.x86_6 3.4 MB/s | 5.6 MB 00:01 2026-02-12T08:40:13.032 INFO:teuthology.orchestra.run.trial025.stdout:(8/37): python3-ceph-argparse-20.3.0-5161.g2401 706 kB/s | 45 kB 00:00 2026-02-12T08:40:13.101 INFO:teuthology.orchestra.run.trial025.stdout:(9/37): ceph-radosgw-20.3.0-5161.g2401a109.el9. 2.5 MB/s | 11 MB 00:04 2026-02-12T08:40:13.102 INFO:teuthology.orchestra.run.trial025.stdout:(10/37): python3-ceph-common-20.3.0-5161.g2401a 2.6 MB/s | 184 kB 00:00 2026-02-12T08:40:13.239 INFO:teuthology.orchestra.run.trial025.stdout:(11/37): python3-rados-20.3.0-5161.g2401a109.el 2.3 MB/s | 323 kB 00:00 2026-02-12T08:40:13.376 INFO:teuthology.orchestra.run.trial025.stdout:(12/37): python3-rbd-20.3.0-5161.g2401a109.el9. 2.2 MB/s | 305 kB 00:00 2026-02-12T08:40:13.442 INFO:teuthology.orchestra.run.trial025.stdout:(13/37): python3-rgw-20.3.0-5161.g2401a109.el9. 1.5 MB/s | 100 kB 00:00 2026-02-12T08:40:13.454 INFO:teuthology.orchestra.run.trial025.stdout:(14/37): python3-cephfs-20.3.0-5161.g2401a109.e 578 kB/s | 204 kB 00:00 2026-02-12T08:40:13.501 INFO:teuthology.orchestra.run.trial025.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 560 kB/s | 33 kB 00:00 2026-02-12T08:40:13.604 INFO:teuthology.orchestra.run.trial025.stdout:(16/37): nvme-cli-2.13-1.el9.x86_64.rpm 7.3 MB/s | 1.1 MB 00:00 2026-02-12T08:40:13.672 INFO:teuthology.orchestra.run.trial025.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 1.5 MB/s | 104 kB 00:00 2026-02-12T08:40:13.713 INFO:teuthology.orchestra.run.trial025.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 3.9 MB/s | 164 kB 00:00 2026-02-12T08:40:13.745 INFO:teuthology.orchestra.run.trial025.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.9 MB/s | 160 kB 00:00 2026-02-12T08:40:13.774 INFO:teuthology.orchestra.run.trial025.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.5 MB/s | 45 kB 00:00 2026-02-12T08:40:13.821 INFO:teuthology.orchestra.run.trial025.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 14 MB/s | 662 kB 00:00 2026-02-12T08:40:13.851 INFO:teuthology.orchestra.run.trial025.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 9.7 MB/s | 292 kB 00:00 2026-02-12T08:40:13.879 INFO:teuthology.orchestra.run.trial025.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 8.2 MB/s | 240 kB 00:00 2026-02-12T08:40:13.906 INFO:teuthology.orchestra.run.trial025.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.4 MB/s | 37 kB 00:00 2026-02-12T08:40:13.932 INFO:teuthology.orchestra.run.trial025.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.5 MB/s | 66 kB 00:00 2026-02-12T08:40:14.066 INFO:teuthology.orchestra.run.trial025.stdout:(26/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.2 MB/s | 308 kB 00:00 2026-02-12T08:40:14.170 INFO:teuthology.orchestra.run.trial025.stdout:(27/37): libarrow-9.0.0-15.el9.x86_64.rpm 42 MB/s | 4.4 MB 00:00 2026-02-12T08:40:14.190 INFO:teuthology.orchestra.run.trial025.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.2 MB/s | 25 kB 00:00 2026-02-12T08:40:14.209 INFO:teuthology.orchestra.run.trial025.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 2.5 MB/s | 49 kB 00:00 2026-02-12T08:40:14.229 INFO:teuthology.orchestra.run.trial025.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 3.3 MB/s | 67 kB 00:00 2026-02-12T08:40:14.240 INFO:teuthology.orchestra.run.trial025.stdout:(31/37): pciutils-3.7.0-7.el9.x86_64.rpm 126 kB/s | 93 kB 00:00 2026-02-12T08:40:14.272 INFO:teuthology.orchestra.run.trial025.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 19 MB/s | 838 kB 00:00 2026-02-12T08:40:14.297 INFO:teuthology.orchestra.run.trial025.stdout:(33/37): thrift-0.15.0-4.el9.x86_64.rpm 64 MB/s | 1.6 MB 00:00 2026-02-12T08:40:14.367 INFO:teuthology.orchestra.run.trial025.stdout:(34/37): re2-20211101-20.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2026-02-12T08:40:16.028 INFO:teuthology.orchestra.run.trial025.stdout:(35/37): librados2-20.3.0-5161.g2401a109.el9.x8 1.9 MB/s | 3.3 MB 00:01 2026-02-12T08:40:16.269 INFO:teuthology.orchestra.run.trial025.stdout:(36/37): ceph-common-20.3.0-5161.g2401a109.el9. 2.7 MB/s | 21 MB 00:07 2026-02-12T08:40:18.772 INFO:teuthology.orchestra.run.trial025.stdout:(37/37): librbd1-20.3.0-5161.g2401a109.el9.x86_ 625 kB/s | 2.7 MB 00:04 2026-02-12T08:40:18.777 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:40:18.777 INFO:teuthology.orchestra.run.trial025.stdout:Total 5.8 MB/s | 61 MB 00:10 2026-02-12T08:40:18.876 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T08:40:18.894 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T08:40:18.894 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T08:40:19.142 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T08:40:19.142 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T08:40:19.434 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T08:40:19.574 INFO:teuthology.orchestra.run.trial025.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-12T08:40:19.579 INFO:teuthology.orchestra.run.trial025.stdout: Upgrading : librados2-2:20.3.0-5161.g2401a109.el9.x86_64 2/39 2026-02-12T08:40:19.628 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: librados2-2:20.3.0-5161.g2401a109.el9.x86_64 2/39 2026-02-12T08:40:19.629 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 3/39 2026-02-12T08:40:19.642 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 3/39 2026-02-12T08:40:19.644 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libcephfs-daemon-2:20.3.0-5161.g2401a109.el9.x86_6 4/39 2026-02-12T08:40:19.645 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86_6 5/39 2026-02-12T08:40:19.675 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86_6 5/39 2026-02-12T08:40:19.677 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 6/39 2026-02-12T08:40:19.685 INFO:teuthology.orchestra.run.trial025.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-12T08:40:19.688 INFO:teuthology.orchestra.run.trial025.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-12T08:40:19.691 INFO:teuthology.orchestra.run.trial025.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-12T08:40:19.695 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-12T08:40:19.706 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-ceph-argparse-2:20.3.0-5161.g2401a109.el9. 11/39 2026-02-12T08:40:19.718 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 12/39 2026-02-12T08:40:19.719 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86_6 13/39 2026-02-12T08:40:19.741 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86_6 13/39 2026-02-12T08:40:19.745 INFO:teuthology.orchestra.run.trial025.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-12T08:40:19.775 INFO:teuthology.orchestra.run.trial025.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-12T08:40:19.779 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-12T08:40:19.786 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-12T08:40:19.789 INFO:teuthology.orchestra.run.trial025.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-12T08:40:19.793 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-12T08:40:19.907 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T08:40:19.908 INFO:teuthology.orchestra.run.trial025.stdout: Upgrading : librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 21/39 2026-02-12T08:40:19.933 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 21/39 2026-02-12T08:40:19.935 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 22/39 2026-02-12T08:40:19.941 INFO:teuthology.orchestra.run.trial025.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-12T08:40:20.190 INFO:teuthology.orchestra.run.trial025.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-12T08:40:20.191 INFO:teuthology.orchestra.run.trial025.stdout: Installing : librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 25/39 2026-02-12T08:40:20.208 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 25/39 2026-02-12T08:40:20.211 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 26/39 2026-02-12T08:40:20.216 INFO:teuthology.orchestra.run.trial025.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-12T08:40:20.218 INFO:teuthology.orchestra.run.trial025.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-12T08:40:20.219 INFO:teuthology.orchestra.run.trial025.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T08:40:20.237 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T08:40:20.349 INFO:teuthology.orchestra.run.trial025.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-12T08:40:20.351 INFO:teuthology.orchestra.run.trial025.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T08:40:20.620 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T08:40:20.620 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T08:40:20.620 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:40:20.663 INFO:teuthology.orchestra.run.trial025.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-12T08:40:20.666 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-ceph-common-2:20.3.0-5161.g2401a109.el9.x8 33/39 2026-02-12T08:40:21.605 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 34/39 2026-02-12T08:40:21.608 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 34/39 2026-02-12T08:40:21.870 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 34/39 2026-02-12T08:40:21.873 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 35/39 2026-02-12T08:40:21.914 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 35/39 2026-02-12T08:40:21.914 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T08:40:21.914 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T08:40:21.915 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:40:21.918 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 36/39 2026-02-12T08:40:26.455 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 36/39 2026-02-12T08:40:26.455 INFO:teuthology.orchestra.run.trial025.stdout:skipping the directory /sys 2026-02-12T08:40:26.455 INFO:teuthology.orchestra.run.trial025.stdout:skipping the directory /proc 2026-02-12T08:40:26.455 INFO:teuthology.orchestra.run.trial025.stdout:skipping the directory /mnt 2026-02-12T08:40:26.455 INFO:teuthology.orchestra.run.trial025.stdout:skipping the directory /var/tmp 2026-02-12T08:40:26.455 INFO:teuthology.orchestra.run.trial025.stdout:skipping the directory /home 2026-02-12T08:40:26.455 INFO:teuthology.orchestra.run.trial025.stdout:skipping the directory /root 2026-02-12T08:40:26.455 INFO:teuthology.orchestra.run.trial025.stdout:skipping the directory /tmp 2026-02-12T08:40:26.456 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:40:26.947 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 37/39 2026-02-12T08:40:26.970 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 37/39 2026-02-12T08:40:26.970 INFO:teuthology.orchestra.run.trial025.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:40:26.971 INFO:teuthology.orchestra.run.trial025.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T08:40:26.971 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T08:40:26.971 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T08:40:26.971 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:40:26.972 INFO:teuthology.orchestra.run.trial025.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T08:40:26.985 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T08:40:26.985 INFO:teuthology.orchestra.run.trial025.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T08:40:27.040 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T08:40:27.041 INFO:teuthology.orchestra.run.trial025.stdout:Creating group 'qat' with GID 992. 2026-02-12T08:40:27.041 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:40:27.321 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 1/39 2026-02-12T08:40:27.321 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 2/39 2026-02-12T08:40:27.321 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 3/39 2026-02-12T08:40:27.321 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 4/39 2026-02-12T08:40:27.321 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libcephfs-daemon-2:20.3.0-5161.g2401a109.el9.x86_6 5/39 2026-02-12T08:40:27.321 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86_6 6/39 2026-02-12T08:40:27.321 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 7/39 2026-02-12T08:40:27.321 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86_6 8/39 2026-02-12T08:40:27.322 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 9/39 2026-02-12T08:40:27.322 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5161.g2401a109.el9. 10/39 2026-02-12T08:40:27.322 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-ceph-common-2:20.3.0-5161.g2401a109.el9.x8 11/39 2026-02-12T08:40:27.322 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 12/39 2026-02-12T08:40:27.322 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 13/39 2026-02-12T08:40:27.322 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 14/39 2026-02-12T08:40:27.322 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 15/39 2026-02-12T08:40:27.322 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-12T08:40:27.322 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-12T08:40:27.322 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-12T08:40:27.322 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-12T08:40:27.322 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T08:40:27.322 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-12T08:40:27.323 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-12T08:40:27.323 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-12T08:40:27.323 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-12T08:40:27.323 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-12T08:40:27.323 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-12T08:40:27.323 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-12T08:40:27.323 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-12T08:40:27.323 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-12T08:40:27.323 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-12T08:40:27.323 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-12T08:40:27.323 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-12T08:40:27.323 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-12T08:40:27.324 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-12T08:40:27.324 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-12T08:40:27.324 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : librados2-2:20.3.0-5161.g2401a109.el9.x86_64 36/39 2026-02-12T08:40:27.324 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-12T08:40:27.324 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 38/39 2026-02-12T08:40:27.390 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T08:40:27.390 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:40:27.390 INFO:teuthology.orchestra.run.trial025.stdout:Upgraded: 2026-02-12T08:40:27.390 INFO:teuthology.orchestra.run.trial025.stdout: librados2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:40:27.390 INFO:teuthology.orchestra.run.trial025.stdout: librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:40:27.390 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T08:40:27.390 INFO:teuthology.orchestra.run.trial025.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T08:40:27.390 INFO:teuthology.orchestra.run.trial025.stdout: ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:40:27.391 INFO:teuthology.orchestra.run.trial025.stdout: ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:40:27.391 INFO:teuthology.orchestra.run.trial025.stdout: ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:40:27.391 INFO:teuthology.orchestra.run.trial025.stdout: ceph-selinux-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:40:27.391 INFO:teuthology.orchestra.run.trial025.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T08:40:27.391 INFO:teuthology.orchestra.run.trial025.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T08:40:27.391 INFO:teuthology.orchestra.run.trial025.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T08:40:27.391 INFO:teuthology.orchestra.run.trial025.stdout: libcephfs-daemon-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:40:27.391 INFO:teuthology.orchestra.run.trial025.stdout: libcephfs-proxy2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:40:27.391 INFO:teuthology.orchestra.run.trial025.stdout: libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:40:27.391 INFO:teuthology.orchestra.run.trial025.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T08:40:27.391 INFO:teuthology.orchestra.run.trial025.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T08:40:27.392 INFO:teuthology.orchestra.run.trial025.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T08:40:27.392 INFO:teuthology.orchestra.run.trial025.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T08:40:27.392 INFO:teuthology.orchestra.run.trial025.stdout: libradosstriper1-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:40:27.392 INFO:teuthology.orchestra.run.trial025.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T08:40:27.392 INFO:teuthology.orchestra.run.trial025.stdout: librgw2-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:40:27.392 INFO:teuthology.orchestra.run.trial025.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T08:40:27.392 INFO:teuthology.orchestra.run.trial025.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T08:40:27.392 INFO:teuthology.orchestra.run.trial025.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T08:40:27.392 INFO:teuthology.orchestra.run.trial025.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-12T08:40:27.392 INFO:teuthology.orchestra.run.trial025.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T08:40:27.392 INFO:teuthology.orchestra.run.trial025.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T08:40:27.392 INFO:teuthology.orchestra.run.trial025.stdout: python3-ceph-argparse-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:40:27.392 INFO:teuthology.orchestra.run.trial025.stdout: python3-ceph-common-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:40:27.393 INFO:teuthology.orchestra.run.trial025.stdout: python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:40:27.393 INFO:teuthology.orchestra.run.trial025.stdout: python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:40:27.393 INFO:teuthology.orchestra.run.trial025.stdout: python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:40:27.393 INFO:teuthology.orchestra.run.trial025.stdout: python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:40:27.393 INFO:teuthology.orchestra.run.trial025.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T08:40:27.393 INFO:teuthology.orchestra.run.trial025.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T08:40:27.393 INFO:teuthology.orchestra.run.trial025.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T08:40:27.393 INFO:teuthology.orchestra.run.trial025.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T08:40:27.393 INFO:teuthology.orchestra.run.trial025.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T08:40:27.393 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:40:27.393 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:40:27.432 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-test 2026-02-12T08:40:27.735 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:21 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:40:27.818 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:40:27.819 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:40:27.819 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repository Size 2026-02-12T08:40:27.819 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:40:27.819 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T08:40:27.819 INFO:teuthology.orchestra.run.trial025.stdout: ceph-test x86_64 2:20.3.0-5161.g2401a109.el9 ceph 126 M 2026-02-12T08:40:27.819 INFO:teuthology.orchestra.run.trial025.stdout:Installing dependencies: 2026-02-12T08:40:27.819 INFO:teuthology.orchestra.run.trial025.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-12T08:40:27.819 INFO:teuthology.orchestra.run.trial025.stdout: libasan8 x86_64 15.1.1-2.5.el9 appstream 523 k 2026-02-12T08:40:27.819 INFO:teuthology.orchestra.run.trial025.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-12T08:40:27.820 INFO:teuthology.orchestra.run.trial025.stdout: libcephsqlite x86_64 2:20.3.0-5161.g2401a109.el9 ceph 153 k 2026-02-12T08:40:27.820 INFO:teuthology.orchestra.run.trial025.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-12T08:40:27.820 INFO:teuthology.orchestra.run.trial025.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T08:40:27.820 INFO:teuthology.orchestra.run.trial025.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-12T08:40:27.820 INFO:teuthology.orchestra.run.trial025.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T08:40:27.820 INFO:teuthology.orchestra.run.trial025.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T08:40:27.820 INFO:teuthology.orchestra.run.trial025.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T08:40:27.820 INFO:teuthology.orchestra.run.trial025.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-12T08:40:27.820 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:40:27.820 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T08:40:27.820 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:40:27.821 INFO:teuthology.orchestra.run.trial025.stdout:Install 12 Packages 2026-02-12T08:40:27.821 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:40:27.821 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 131 M 2026-02-12T08:40:27.821 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 976 M 2026-02-12T08:40:27.822 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T08:40:28.815 INFO:teuthology.orchestra.run.trial025.stdout:(1/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 2.8 MB/s | 2.1 MB 00:00 2026-02-12T08:40:28.842 INFO:teuthology.orchestra.run.trial025.stdout:(2/12): libcephsqlite-20.3.0-5161.g2401a109.el9 200 kB/s | 153 kB 00:00 2026-02-12T08:40:28.893 INFO:teuthology.orchestra.run.trial025.stdout:(3/12): libatomic-11.5.0-14.el9.x86_64.rpm 291 kB/s | 23 kB 00:00 2026-02-12T08:40:29.062 INFO:teuthology.orchestra.run.trial025.stdout:(4/12): libasan8-15.1.1-2.5.el9.x86_64.rpm 3.0 MB/s | 523 kB 00:00 2026-02-12T08:40:29.087 INFO:teuthology.orchestra.run.trial025.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 6.8 MB/s | 176 kB 00:00 2026-02-12T08:40:29.112 INFO:teuthology.orchestra.run.trial025.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 9.2 MB/s | 233 kB 00:00 2026-02-12T08:40:29.171 INFO:teuthology.orchestra.run.trial025.stdout:(7/12): protobuf-3.14.0-17.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2026-02-12T08:40:29.196 INFO:teuthology.orchestra.run.trial025.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 12 MB/s | 303 kB 00:00 2026-02-12T08:40:29.220 INFO:teuthology.orchestra.run.trial025.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.5 MB/s | 64 kB 00:00 2026-02-12T08:40:29.231 INFO:teuthology.orchestra.run.trial025.stdout:(10/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 241 kB/s | 94 kB 00:00 2026-02-12T08:40:29.514 INFO:teuthology.orchestra.run.trial025.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 415 kB/s | 122 kB 00:00 2026-02-12T08:42:06.308 INFO:teuthology.orchestra.run.trial025.stdout:(12/12): ceph-test-20.3.0-5161.g2401a109.el9.x8 1.3 MB/s | 126 MB 01:38 2026-02-12T08:42:06.308 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:42:06.309 INFO:teuthology.orchestra.run.trial025.stdout:Total 1.3 MB/s | 131 MB 01:38 2026-02-12T08:42:06.378 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T08:42:06.389 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T08:42:06.389 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T08:42:06.819 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T08:42:06.819 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T08:42:07.274 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T08:42:07.283 INFO:teuthology.orchestra.run.trial025.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-12T08:42:07.292 INFO:teuthology.orchestra.run.trial025.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-12T08:42:07.297 INFO:teuthology.orchestra.run.trial025.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-12T08:42:07.301 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-12T08:42:07.303 INFO:teuthology.orchestra.run.trial025.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-12T08:42:07.308 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-12T08:42:07.308 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libasan8-15.1.1-2.5.el9.x86_64 7/12 2026-02-12T08:42:07.324 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: libasan8-15.1.1-2.5.el9.x86_64 7/12 2026-02-12T08:42:07.326 INFO:teuthology.orchestra.run.trial025.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-12T08:42:07.336 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-12T08:42:07.344 INFO:teuthology.orchestra.run.trial025.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-12T08:42:07.345 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 11/12 2026-02-12T08:42:14.329 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 11/12 2026-02-12T08:42:14.347 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 12/12 2026-02-12T08:42:15.109 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 12/12 2026-02-12T08:42:15.109 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 1/12 2026-02-12T08:42:15.110 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 2/12 2026-02-12T08:42:15.110 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-12T08:42:15.110 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-12T08:42:15.110 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-12T08:42:15.110 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libasan8-15.1.1-2.5.el9.x86_64 6/12 2026-02-12T08:42:15.110 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-12T08:42:15.110 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-12T08:42:15.110 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-12T08:42:15.110 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-12T08:42:15.110 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-12T08:42:15.162 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-12T08:42:15.162 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:42:15.163 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T08:42:15.163 INFO:teuthology.orchestra.run.trial025.stdout: ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:15.163 INFO:teuthology.orchestra.run.trial025.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-12T08:42:15.163 INFO:teuthology.orchestra.run.trial025.stdout: libasan8-15.1.1-2.5.el9.x86_64 2026-02-12T08:42:15.163 INFO:teuthology.orchestra.run.trial025.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-12T08:42:15.163 INFO:teuthology.orchestra.run.trial025.stdout: libcephsqlite-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:42:15.163 INFO:teuthology.orchestra.run.trial025.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-12T08:42:15.163 INFO:teuthology.orchestra.run.trial025.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T08:42:15.163 INFO:teuthology.orchestra.run.trial025.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-12T08:42:15.163 INFO:teuthology.orchestra.run.trial025.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T08:42:15.163 INFO:teuthology.orchestra.run.trial025.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T08:42:15.164 INFO:teuthology.orchestra.run.trial025.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T08:42:15.164 INFO:teuthology.orchestra.run.trial025.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-12T08:42:15.164 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:42:15.164 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:42:15.202 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph 2026-02-12T08:42:15.500 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:02:09 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:42:15.585 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:42:15.588 INFO:teuthology.orchestra.run.trial025.stdout:======================================================================================= 2026-02-12T08:42:15.588 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repository Size 2026-02-12T08:42:15.588 INFO:teuthology.orchestra.run.trial025.stdout:======================================================================================= 2026-02-12T08:42:15.589 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T08:42:15.589 INFO:teuthology.orchestra.run.trial025.stdout: ceph x86_64 2:20.3.0-5161.g2401a109.el9 ceph 6.5 k 2026-02-12T08:42:15.589 INFO:teuthology.orchestra.run.trial025.stdout:Installing dependencies: 2026-02-12T08:42:15.589 INFO:teuthology.orchestra.run.trial025.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T08:42:15.589 INFO:teuthology.orchestra.run.trial025.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 57 k 2026-02-12T08:42:15.589 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mds x86_64 2:20.3.0-5161.g2401a109.el9 ceph 2.0 M 2026-02-12T08:42:15.589 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr x86_64 2:20.3.0-5161.g2401a109.el9 ceph 937 k 2026-02-12T08:42:15.589 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 297 k 2026-02-12T08:42:15.589 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mon x86_64 2:20.3.0-5161.g2401a109.el9 ceph 4.8 M 2026-02-12T08:42:15.589 INFO:teuthology.orchestra.run.trial025.stdout: ceph-osd x86_64 2:20.3.0-5161.g2401a109.el9 ceph 163 k 2026-02-12T08:42:15.589 INFO:teuthology.orchestra.run.trial025.stdout: ceph-osd-classic x86_64 2:20.3.0-5161.g2401a109.el9 ceph 15 M 2026-02-12T08:42:15.590 INFO:teuthology.orchestra.run.trial025.stdout: ceph-osd-crimson x86_64 2:20.3.0-5161.g2401a109.el9 ceph 87 M 2026-02-12T08:42:15.590 INFO:teuthology.orchestra.run.trial025.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 17 k 2026-02-12T08:42:15.590 INFO:teuthology.orchestra.run.trial025.stdout: cephadm noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 1.0 M 2026-02-12T08:42:15.590 INFO:teuthology.orchestra.run.trial025.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T08:42:15.590 INFO:teuthology.orchestra.run.trial025.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T08:42:15.590 INFO:teuthology.orchestra.run.trial025.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T08:42:15.590 INFO:teuthology.orchestra.run.trial025.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T08:42:15.590 INFO:teuthology.orchestra.run.trial025.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T08:42:15.590 INFO:teuthology.orchestra.run.trial025.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T08:42:15.590 INFO:teuthology.orchestra.run.trial025.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T08:42:15.590 INFO:teuthology.orchestra.run.trial025.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T08:42:15.590 INFO:teuthology.orchestra.run.trial025.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T08:42:15.591 INFO:teuthology.orchestra.run.trial025.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T08:42:15.591 INFO:teuthology.orchestra.run.trial025.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T08:42:15.591 INFO:teuthology.orchestra.run.trial025.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T08:42:15.591 INFO:teuthology.orchestra.run.trial025.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T08:42:15.591 INFO:teuthology.orchestra.run.trial025.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T08:42:15.591 INFO:teuthology.orchestra.run.trial025.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T08:42:15.591 INFO:teuthology.orchestra.run.trial025.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T08:42:15.591 INFO:teuthology.orchestra.run.trial025.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T08:42:15.591 INFO:teuthology.orchestra.run.trial025.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T08:42:15.591 INFO:teuthology.orchestra.run.trial025.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T08:42:15.591 INFO:teuthology.orchestra.run.trial025.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T08:42:15.592 INFO:teuthology.orchestra.run.trial025.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T08:42:15.592 INFO:teuthology.orchestra.run.trial025.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T08:42:15.592 INFO:teuthology.orchestra.run.trial025.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T08:42:15.592 INFO:teuthology.orchestra.run.trial025.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T08:42:15.592 INFO:teuthology.orchestra.run.trial025.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T08:42:15.592 INFO:teuthology.orchestra.run.trial025.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T08:42:15.592 INFO:teuthology.orchestra.run.trial025.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T08:42:15.592 INFO:teuthology.orchestra.run.trial025.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T08:42:15.592 INFO:teuthology.orchestra.run.trial025.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T08:42:15.592 INFO:teuthology.orchestra.run.trial025.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T08:42:15.592 INFO:teuthology.orchestra.run.trial025.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T08:42:15.592 INFO:teuthology.orchestra.run.trial025.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-12T08:42:15.592 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T08:42:15.593 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T08:42:15.593 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-12T08:42:15.593 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T08:42:15.593 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T08:42:15.593 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T08:42:15.593 INFO:teuthology.orchestra.run.trial025.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T08:42:15.593 INFO:teuthology.orchestra.run.trial025.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T08:42:15.593 INFO:teuthology.orchestra.run.trial025.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T08:42:15.593 INFO:teuthology.orchestra.run.trial025.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T08:42:15.593 INFO:teuthology.orchestra.run.trial025.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-12T08:42:15.593 INFO:teuthology.orchestra.run.trial025.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T08:42:15.593 INFO:teuthology.orchestra.run.trial025.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T08:42:15.593 INFO:teuthology.orchestra.run.trial025.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-12T08:42:15.594 INFO:teuthology.orchestra.run.trial025.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T08:42:15.594 INFO:teuthology.orchestra.run.trial025.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T08:42:15.594 INFO:teuthology.orchestra.run.trial025.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T08:42:15.594 INFO:teuthology.orchestra.run.trial025.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T08:42:15.594 INFO:teuthology.orchestra.run.trial025.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T08:42:15.594 INFO:teuthology.orchestra.run.trial025.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T08:42:15.594 INFO:teuthology.orchestra.run.trial025.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T08:42:15.594 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T08:42:15.594 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T08:42:15.594 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T08:42:15.594 INFO:teuthology.orchestra.run.trial025.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T08:42:15.594 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T08:42:15.595 INFO:teuthology.orchestra.run.trial025.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T08:42:15.595 INFO:teuthology.orchestra.run.trial025.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T08:42:15.595 INFO:teuthology.orchestra.run.trial025.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T08:42:15.595 INFO:teuthology.orchestra.run.trial025.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T08:42:15.595 INFO:teuthology.orchestra.run.trial025.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T08:42:15.595 INFO:teuthology.orchestra.run.trial025.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T08:42:15.595 INFO:teuthology.orchestra.run.trial025.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T08:42:15.595 INFO:teuthology.orchestra.run.trial025.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T08:42:15.595 INFO:teuthology.orchestra.run.trial025.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T08:42:15.595 INFO:teuthology.orchestra.run.trial025.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T08:42:15.595 INFO:teuthology.orchestra.run.trial025.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T08:42:15.595 INFO:teuthology.orchestra.run.trial025.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-12T08:42:15.596 INFO:teuthology.orchestra.run.trial025.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T08:42:15.596 INFO:teuthology.orchestra.run.trial025.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T08:42:15.596 INFO:teuthology.orchestra.run.trial025.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T08:42:15.596 INFO:teuthology.orchestra.run.trial025.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-12T08:42:15.596 INFO:teuthology.orchestra.run.trial025.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-12T08:42:15.596 INFO:teuthology.orchestra.run.trial025.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T08:42:15.596 INFO:teuthology.orchestra.run.trial025.stdout:Installing weak dependencies: 2026-02-12T08:42:15.596 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 183 k 2026-02-12T08:42:15.596 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 15 M 2026-02-12T08:42:15.596 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 7.4 M 2026-02-12T08:42:15.596 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 22 k 2026-02-12T08:42:15.597 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-rook noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 50 k 2026-02-12T08:42:15.597 INFO:teuthology.orchestra.run.trial025.stdout: ceph-volume noarch 2:20.3.0-5161.g2401a109.el9 ceph-noarch 299 k 2026-02-12T08:42:15.597 INFO:teuthology.orchestra.run.trial025.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-12T08:42:15.597 INFO:teuthology.orchestra.run.trial025.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-12T08:42:15.597 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:42:15.597 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T08:42:15.597 INFO:teuthology.orchestra.run.trial025.stdout:======================================================================================= 2026-02-12T08:42:15.597 INFO:teuthology.orchestra.run.trial025.stdout:Install 96 Packages 2026-02-12T08:42:15.597 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:42:15.598 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 189 M 2026-02-12T08:42:15.598 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 1.4 G 2026-02-12T08:42:15.598 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T08:42:16.167 INFO:teuthology.orchestra.run.trial025.stdout:(1/96): ceph-20.3.0-5161.g2401a109.el9.x86_64.r 23 kB/s | 6.5 kB 00:00 2026-02-12T08:42:17.391 INFO:teuthology.orchestra.run.trial025.stdout:(2/96): ceph-mds-20.3.0-5161.g2401a109.el9.x86_ 1.3 MB/s | 2.0 MB 00:01 2026-02-12T08:42:17.511 INFO:teuthology.orchestra.run.trial025.stdout:(3/96): ceph-osd-20.3.0-5161.g2401a109.el9.x86_ 1.3 MB/s | 163 kB 00:00 2026-02-12T08:42:18.579 INFO:teuthology.orchestra.run.trial025.stdout:(4/96): ceph-mon-20.3.0-5161.g2401a109.el9.x86_ 2.0 MB/s | 4.8 MB 00:02 2026-02-12T08:42:19.028 INFO:teuthology.orchestra.run.trial025.stdout:(5/96): ceph-mgr-20.3.0-5161.g2401a109.el9.x86_ 298 kB/s | 937 kB 00:03 2026-02-12T08:42:19.168 INFO:teuthology.orchestra.run.trial025.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5161.g24 411 kB/s | 57 kB 00:00 2026-02-12T08:42:19.518 INFO:teuthology.orchestra.run.trial025.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5161.g2401a109. 524 kB/s | 183 kB 00:00 2026-02-12T08:42:28.546 INFO:teuthology.orchestra.run.trial025.stdout:(8/96): ceph-mgr-dashboard-20.3.0-5161.g2401a10 1.7 MB/s | 15 MB 00:09 2026-02-12T08:42:29.780 INFO:teuthology.orchestra.run.trial025.stdout:(9/96): ceph-osd-classic-20.3.0-5161.g2401a109. 1.2 MB/s | 15 MB 00:12 2026-02-12T08:42:29.848 INFO:teuthology.orchestra.run.trial025.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5161.g2401a1 327 kB/s | 22 kB 00:00 2026-02-12T08:42:30.130 INFO:teuthology.orchestra.run.trial025.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5161.g240 1.0 MB/s | 297 kB 00:00 2026-02-12T08:42:30.198 INFO:teuthology.orchestra.run.trial025.stdout:(12/96): ceph-mgr-rook-20.3.0-5161.g2401a109.el 740 kB/s | 50 kB 00:00 2026-02-12T08:42:30.262 INFO:teuthology.orchestra.run.trial025.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5161.g24 271 kB/s | 17 kB 00:00 2026-02-12T08:42:30.537 INFO:teuthology.orchestra.run.trial025.stdout:(14/96): ceph-volume-20.3.0-5161.g2401a109.el9. 1.1 MB/s | 299 kB 00:00 2026-02-12T08:42:31.415 INFO:teuthology.orchestra.run.trial025.stdout:(15/96): cephadm-20.3.0-5161.g2401a109.el9.noar 1.2 MB/s | 1.0 MB 00:00 2026-02-12T08:42:32.231 INFO:teuthology.orchestra.run.trial025.stdout:(16/96): cryptsetup-2.8.1-2.el9.x86_64.rpm 430 kB/s | 350 kB 00:00 2026-02-12T08:42:32.806 INFO:teuthology.orchestra.run.trial025.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 70 kB/s | 40 kB 00:00 2026-02-12T08:42:33.441 INFO:teuthology.orchestra.run.trial025.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 113 kB/s | 72 kB 00:00 2026-02-12T08:42:34.340 INFO:teuthology.orchestra.run.trial025.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 884 kB/s | 794 kB 00:00 2026-02-12T08:42:34.646 INFO:teuthology.orchestra.run.trial025.stdout:(20/96): ceph-mgr-diskprediction-local-20.3.0-5 1.2 MB/s | 7.4 MB 00:06 2026-02-12T08:42:35.071 INFO:teuthology.orchestra.run.trial025.stdout:(21/96): libquadmath-11.5.0-14.el9.x86_64.rpm 253 kB/s | 184 kB 00:00 2026-02-12T08:42:35.418 INFO:teuthology.orchestra.run.trial025.stdout:(22/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 328 kB/s | 253 kB 00:00 2026-02-12T08:42:36.034 INFO:teuthology.orchestra.run.trial025.stdout:(23/96): python3-cryptography-36.0.1-5.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2026-02-12T08:42:36.088 INFO:teuthology.orchestra.run.trial025.stdout:(24/96): python3-ply-3.11-14.el9.noarch.rpm 159 kB/s | 106 kB 00:00 2026-02-12T08:42:36.741 INFO:teuthology.orchestra.run.trial025.stdout:(25/96): python3-pycparser-2.20-6.el9.noarch.rp 191 kB/s | 135 kB 00:00 2026-02-12T08:42:36.802 INFO:teuthology.orchestra.run.trial025.stdout:(26/96): python3-pyparsing-2.4.7-9.el9.noarch.r 211 kB/s | 150 kB 00:00 2026-02-12T08:42:37.436 INFO:teuthology.orchestra.run.trial025.stdout:(27/96): python3-requests-2.25.1-10.el9.noarch. 182 kB/s | 126 kB 00:00 2026-02-12T08:42:37.550 INFO:teuthology.orchestra.run.trial025.stdout:(28/96): python3-urllib3-1.26.5-7.el9.noarch.rp 292 kB/s | 218 kB 00:00 2026-02-12T08:42:38.168 INFO:teuthology.orchestra.run.trial025.stdout:(29/96): unzip-6.0-59.el9.x86_64.rpm 248 kB/s | 182 kB 00:00 2026-02-12T08:42:38.194 INFO:teuthology.orchestra.run.trial025.stdout:(30/96): flexiblas-3.0.4-8.el9.x86_64.rpm 1.2 MB/s | 33 kB 00:00 2026-02-12T08:42:38.251 INFO:teuthology.orchestra.run.trial025.stdout:(31/96): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 53 MB/s | 3.0 MB 00:00 2026-02-12T08:42:38.259 INFO:teuthology.orchestra.run.trial025.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-8.el9. 2.1 MB/s | 18 kB 00:00 2026-02-12T08:42:38.269 INFO:teuthology.orchestra.run.trial025.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 24 MB/s | 246 kB 00:00 2026-02-12T08:42:38.280 INFO:teuthology.orchestra.run.trial025.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 18 MB/s | 188 kB 00:00 2026-02-12T08:42:38.288 INFO:teuthology.orchestra.run.trial025.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 4.8 MB/s | 42 kB 00:00 2026-02-12T08:42:38.316 INFO:teuthology.orchestra.run.trial025.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 196 MB/s | 5.3 MB 00:00 2026-02-12T08:42:38.328 INFO:teuthology.orchestra.run.trial025.stdout:(37/96): zip-3.0-35.el9.x86_64.rpm 341 kB/s | 266 kB 00:00 2026-02-12T08:42:38.348 INFO:teuthology.orchestra.run.trial025.stdout:(38/96): python3-babel-2.9.1-2.el9.noarch.rpm 183 MB/s | 6.0 MB 00:00 2026-02-12T08:42:38.360 INFO:teuthology.orchestra.run.trial025.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 22 MB/s | 249 kB 00:00 2026-02-12T08:42:38.369 INFO:teuthology.orchestra.run.trial025.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 5.0 MB/s | 48 kB 00:00 2026-02-12T08:42:38.375 INFO:teuthology.orchestra.run.trial025.stdout:(41/96): python3-devel-3.9.25-2.el9.x86_64.rpm 5.0 MB/s | 244 kB 00:00 2026-02-12T08:42:38.379 INFO:teuthology.orchestra.run.trial025.stdout:(42/96): python3-libstoragemgmt-1.10.1-1.el9.x8 17 MB/s | 177 kB 00:00 2026-02-12T08:42:38.388 INFO:teuthology.orchestra.run.trial025.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 3.7 MB/s | 35 kB 00:00 2026-02-12T08:42:38.414 INFO:teuthology.orchestra.run.trial025.stdout:(44/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 32 MB/s | 1.2 MB 00:00 2026-02-12T08:42:38.423 INFO:teuthology.orchestra.run.trial025.stdout:(45/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 176 MB/s | 6.1 MB 00:00 2026-02-12T08:42:38.427 INFO:teuthology.orchestra.run.trial025.stdout:(46/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 35 MB/s | 442 kB 00:00 2026-02-12T08:42:38.433 INFO:teuthology.orchestra.run.trial025.stdout:(47/96): python3-packaging-20.9-5.el9.noarch.rp 7.9 MB/s | 77 kB 00:00 2026-02-12T08:42:38.438 INFO:teuthology.orchestra.run.trial025.stdout:(48/96): python3-protobuf-3.14.0-17.el9.noarch. 23 MB/s | 267 kB 00:00 2026-02-12T08:42:38.443 INFO:teuthology.orchestra.run.trial025.stdout:(49/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 16 MB/s | 159 kB 00:00 2026-02-12T08:42:38.449 INFO:teuthology.orchestra.run.trial025.stdout:(50/96): python3-pyasn1-modules-0.4.8-6.el9.noa 25 MB/s | 279 kB 00:00 2026-02-12T08:42:38.452 INFO:teuthology.orchestra.run.trial025.stdout:(51/96): python3-requests-oauthlib-1.3.0-12.el9 5.7 MB/s | 54 kB 00:00 2026-02-12T08:42:38.461 INFO:teuthology.orchestra.run.trial025.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 4.4 MB/s | 42 kB 00:00 2026-02-12T08:42:38.471 INFO:teuthology.orchestra.run.trial025.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 20 MB/s | 189 kB 00:00 2026-02-12T08:42:38.480 INFO:teuthology.orchestra.run.trial025.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 9.3 MB/s | 90 kB 00:00 2026-02-12T08:42:38.862 INFO:teuthology.orchestra.run.trial025.stdout:(55/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 47 MB/s | 19 MB 00:00 2026-02-12T08:42:38.874 INFO:teuthology.orchestra.run.trial025.stdout:(56/96): lua-devel-5.4.4-4.el9.x86_64.rpm 57 kB/s | 22 kB 00:00 2026-02-12T08:42:39.204 INFO:teuthology.orchestra.run.trial025.stdout:(57/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.6 MB/s | 551 kB 00:00 2026-02-12T08:42:39.242 INFO:teuthology.orchestra.run.trial025.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 512 kB/s | 19 kB 00:00 2026-02-12T08:42:39.299 INFO:teuthology.orchestra.run.trial025.stdout:(59/96): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2026-02-12T08:42:39.376 INFO:teuthology.orchestra.run.trial025.stdout:(60/96): python3-asyncssh-2.13.2-5.el9.noarch.r 6.9 MB/s | 548 kB 00:00 2026-02-12T08:42:39.424 INFO:teuthology.orchestra.run.trial025.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 618 kB/s | 29 kB 00:00 2026-02-12T08:42:39.479 INFO:teuthology.orchestra.run.trial025.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 1.1 MB/s | 60 kB 00:00 2026-02-12T08:42:39.518 INFO:teuthology.orchestra.run.trial025.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.1 MB/s | 43 kB 00:00 2026-02-12T08:42:39.570 INFO:teuthology.orchestra.run.trial025.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 622 kB/s | 32 kB 00:00 2026-02-12T08:42:39.619 INFO:teuthology.orchestra.run.trial025.stdout:(65/96): python3-certifi-2023.05.07-4.el9.noarc 291 kB/s | 14 kB 00:00 2026-02-12T08:42:39.667 INFO:teuthology.orchestra.run.trial025.stdout:(66/96): python3-cheroot-10.0.1-4.el9.noarch.rp 3.5 MB/s | 173 kB 00:00 2026-02-12T08:42:39.726 INFO:teuthology.orchestra.run.trial025.stdout:(67/96): python3-cherrypy-18.6.1-2.el9.noarch.r 5.9 MB/s | 358 kB 00:00 2026-02-12T08:42:39.777 INFO:teuthology.orchestra.run.trial025.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 4.9 MB/s | 254 kB 00:00 2026-02-12T08:42:39.786 INFO:teuthology.orchestra.run.trial025.stdout:(69/96): protobuf-compiler-3.14.0-17.el9.x86_64 933 kB/s | 862 kB 00:00 2026-02-12T08:42:39.892 INFO:teuthology.orchestra.run.trial025.stdout:(70/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 18 MB/s | 2.0 MB 00:00 2026-02-12T08:42:39.937 INFO:teuthology.orchestra.run.trial025.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 3.0 MB/s | 139 kB 00:00 2026-02-12T08:42:39.984 INFO:teuthology.orchestra.run.trial025.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 1.2 MB/s | 56 kB 00:00 2026-02-12T08:42:40.022 INFO:teuthology.orchestra.run.trial025.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 282 kB/s | 11 kB 00:00 2026-02-12T08:42:40.026 INFO:teuthology.orchestra.run.trial025.stdout:(74/96): python3-grpcio-tools-1.46.7-10.el9.x86 603 kB/s | 144 kB 00:00 2026-02-12T08:42:40.060 INFO:teuthology.orchestra.run.trial025.stdout:(75/96): python3-jaraco-classes-3.2.1-5.el9.noa 464 kB/s | 18 kB 00:00 2026-02-12T08:42:40.067 INFO:teuthology.orchestra.run.trial025.stdout:(76/96): python3-jaraco-collections-3.0.0-8.el9 565 kB/s | 23 kB 00:00 2026-02-12T08:42:40.115 INFO:teuthology.orchestra.run.trial025.stdout:(77/96): python3-jaraco-context-6.0.1-3.el9.noa 356 kB/s | 20 kB 00:00 2026-02-12T08:42:40.119 INFO:teuthology.orchestra.run.trial025.stdout:(78/96): python3-jaraco-functools-3.5.0-2.el9.n 372 kB/s | 19 kB 00:00 2026-02-12T08:42:40.153 INFO:teuthology.orchestra.run.trial025.stdout:(79/96): python3-jaraco-text-4.0.0-2.el9.noarch 696 kB/s | 26 kB 00:00 2026-02-12T08:42:40.204 INFO:teuthology.orchestra.run.trial025.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2026-02-12T08:42:40.243 INFO:teuthology.orchestra.run.trial025.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.2 MB/s | 86 kB 00:00 2026-02-12T08:42:40.281 INFO:teuthology.orchestra.run.trial025.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 1.5 MB/s | 58 kB 00:00 2026-02-12T08:42:40.288 INFO:teuthology.orchestra.run.trial025.stdout:(83/96): python3-kubernetes-26.1.0-3.el9.noarch 6.0 MB/s | 1.0 MB 00:00 2026-02-12T08:42:40.323 INFO:teuthology.orchestra.run.trial025.stdout:(84/96): python3-portend-3.1.0-2.el9.noarch.rpm 392 kB/s | 16 kB 00:00 2026-02-12T08:42:40.328 INFO:teuthology.orchestra.run.trial025.stdout:(85/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.2 MB/s | 90 kB 00:00 2026-02-12T08:42:40.385 INFO:teuthology.orchestra.run.trial025.stdout:(86/96): python3-repoze-lru-0.7-16.el9.noarch.r 494 kB/s | 31 kB 00:00 2026-02-12T08:42:40.394 INFO:teuthology.orchestra.run.trial025.stdout:(87/96): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2026-02-12T08:42:40.432 INFO:teuthology.orchestra.run.trial025.stdout:(88/96): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2026-02-12T08:42:40.443 INFO:teuthology.orchestra.run.trial025.stdout:(89/96): python3-saml-1.16.0-1.el9.noarch.rpm 2.5 MB/s | 125 kB 00:00 2026-02-12T08:42:40.490 INFO:teuthology.orchestra.run.trial025.stdout:(90/96): python3-tempora-5.0.0-2.el9.noarch.rpm 614 kB/s | 36 kB 00:00 2026-02-12T08:42:40.492 INFO:teuthology.orchestra.run.trial025.stdout:(91/96): python3-typing-extensions-4.15.0-1.el9 1.7 MB/s | 86 kB 00:00 2026-02-12T08:42:40.553 INFO:teuthology.orchestra.run.trial025.stdout:(92/96): python3-websocket-client-1.2.3-2.el9.n 1.4 MB/s | 90 kB 00:00 2026-02-12T08:42:40.562 INFO:teuthology.orchestra.run.trial025.stdout:(93/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 688 kB/s | 48 kB 00:00 2026-02-12T08:42:40.607 INFO:teuthology.orchestra.run.trial025.stdout:(94/96): python3-xmltodict-0.12.0-15.el9.noarch 411 kB/s | 22 kB 00:00 2026-02-12T08:42:40.625 INFO:teuthology.orchestra.run.trial025.stdout:(95/96): python3-zc-lockfile-2.0-10.el9.noarch. 319 kB/s | 20 kB 00:00 2026-02-12T08:43:37.873 INFO:teuthology.orchestra.run.trial025.stdout:(96/96): ceph-osd-crimson-20.3.0-5161.g2401a109 1.1 MB/s | 87 MB 01:19 2026-02-12T08:43:37.876 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:43:37.876 INFO:teuthology.orchestra.run.trial025.stdout:Total 2.3 MB/s | 189 MB 01:22 2026-02-12T08:43:38.244 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T08:43:38.282 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T08:43:38.282 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T08:43:38.972 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T08:43:38.972 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T08:43:39.693 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T08:43:39.695 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-12T08:43:39.698 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-12T08:43:39.719 INFO:teuthology.orchestra.run.trial025.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-12T08:43:39.753 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-12T08:43:39.761 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-12T08:43:39.763 INFO:teuthology.orchestra.run.trial025.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-12T08:43:39.767 INFO:teuthology.orchestra.run.trial025.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 7/96 2026-02-12T08:43:39.790 INFO:teuthology.orchestra.run.trial025.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-12T08:43:39.803 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-12T08:43:39.807 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-12T08:43:39.813 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-12T08:43:39.816 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-12T08:43:39.827 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-12T08:43:39.833 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-12T08:43:39.858 INFO:teuthology.orchestra.run.trial025.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-12T08:43:39.861 INFO:teuthology.orchestra.run.trial025.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-12T08:43:39.911 INFO:teuthology.orchestra.run.trial025.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-12T08:43:39.923 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-12T08:43:39.926 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-12T08:43:39.930 INFO:teuthology.orchestra.run.trial025.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-12T08:43:39.935 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-12T08:43:39.940 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-12T08:43:39.943 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-12T08:43:39.957 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-12T08:43:39.962 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-12T08:43:39.967 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-12T08:43:39.978 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-12T08:43:39.987 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-12T08:43:39.993 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-12T08:43:40.013 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-12T08:43:40.024 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-12T08:43:40.039 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-12T08:43:40.044 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-12T08:43:40.052 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-12T08:43:40.091 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-12T08:43:40.415 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-12T08:43:40.425 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-12T08:43:40.429 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-12T08:43:40.435 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-12T08:43:40.437 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-12T08:43:40.465 INFO:teuthology.orchestra.run.trial025.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-12T08:43:40.508 INFO:teuthology.orchestra.run.trial025.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-12T08:43:40.517 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-12T08:43:40.523 INFO:teuthology.orchestra.run.trial025.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-12T08:43:40.526 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-12T08:43:40.532 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-12T08:43:40.535 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-12T08:43:40.542 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-12T08:43:40.546 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-12T08:43:40.574 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-12T08:43:40.584 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-12T08:43:40.590 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-12T08:43:40.597 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-12T08:43:40.632 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-12T08:43:40.854 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 55/96 2026-02-12T08:43:40.878 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-12T08:43:40.882 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-12T08:43:40.942 INFO:teuthology.orchestra.run.trial025.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-12T08:43:40.944 INFO:teuthology.orchestra.run.trial025.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-12T08:43:40.965 INFO:teuthology.orchestra.run.trial025.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 60/96 2026-02-12T08:43:41.290 INFO:teuthology.orchestra.run.trial025.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 61/96 2026-02-12T08:43:41.363 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-12T08:43:42.033 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-12T08:43:42.050 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-12T08:43:42.060 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-12T08:43:42.066 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-12T08:43:42.080 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-12T08:43:42.096 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-12T08:43:42.171 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-12T08:43:42.180 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-12T08:43:42.203 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-12T08:43:42.233 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-12T08:43:42.283 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-12T08:43:42.289 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-12T08:43:42.294 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-12T08:43:42.295 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-12T08:43:42.312 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T08:43:42.312 INFO:teuthology.orchestra.run.trial025.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T08:43:42.312 INFO:teuthology.orchestra.run.trial025.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T08:43:42.312 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:42.319 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T08:43:42.342 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T08:43:42.343 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T08:43:42.343 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:42.376 INFO:teuthology.orchestra.run.trial025.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-12T08:43:42.966 INFO:teuthology.orchestra.run.trial025.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 79/96 2026-02-12T08:43:48.337 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_6 80/96 2026-02-12T08:43:48.400 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86_6 81/96 2026-02-12T08:43:48.402 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 82/96 2026-02-12T08:43:48.416 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 82/96 2026-02-12T08:43:48.416 INFO:teuthology.orchestra.run.trial025.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:48.416 INFO:teuthology.orchestra.run.trial025.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T08:43:48.416 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:48.427 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 83/96 2026-02-12T08:43:48.449 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 83/96 2026-02-12T08:43:48.449 INFO:teuthology.orchestra.run.trial025.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:48.449 INFO:teuthology.orchestra.run.trial025.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T08:43:48.449 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T08:43:48.449 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T08:43:48.449 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:48.509 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: cephadm-2:20.3.0-5161.g2401a109.el9.noarch 84/96 2026-02-12T08:43:48.510 INFO:teuthology.orchestra.run.trial025.stdout: Installing : cephadm-2:20.3.0-5161.g2401a109.el9.noarch 84/96 2026-02-12T08:43:48.520 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5161.g2401a109.el9 85/96 2026-02-12T08:43:48.544 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5161.g2401a109.el 86/96 2026-02-12T08:43:48.545 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarc 87/96 2026-02-12T08:43:50.130 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarc 87/96 2026-02-12T08:43:50.138 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noa 88/96 2026-02-12T08:43:50.594 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noa 88/96 2026-02-12T08:43:50.595 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a 89/96 2026-02-12T08:43:50.607 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a 89/96 2026-02-12T08:43:50.607 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.noa 90/96 2026-02-12T08:43:50.669 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.noa 90/96 2026-02-12T08:43:50.710 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5161.g2401a109.el9. 91/96 2026-02-12T08:43:50.711 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 92/96 2026-02-12T08:43:50.731 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 92/96 2026-02-12T08:43:50.731 INFO:teuthology.orchestra.run.trial025.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:50.731 INFO:teuthology.orchestra.run.trial025.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T08:43:50.731 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T08:43:50.731 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T08:43:50.731 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:50.743 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 93/96 2026-02-12T08:43:50.959 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 93/96 2026-02-12T08:43:50.961 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 94/96 2026-02-12T08:43:50.980 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 94/96 2026-02-12T08:43:50.980 INFO:teuthology.orchestra.run.trial025.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:50.981 INFO:teuthology.orchestra.run.trial025.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T08:43:50.981 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T08:43:50.981 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T08:43:50.981 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:51.064 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 95/96 2026-02-12T08:43:51.083 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 95/96 2026-02-12T08:43:51.083 INFO:teuthology.orchestra.run.trial025.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:51.083 INFO:teuthology.orchestra.run.trial025.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T08:43:51.083 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T08:43:51.083 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T08:43:51.083 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:51.084 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-2:20.3.0-5161.g2401a109.el9.x86_64 96/96 2026-02-12T08:43:51.090 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_6 96/96 2026-02-12T08:43:51.114 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86_6 96/96 2026-02-12T08:43:52.473 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-2:20.3.0-5161.g2401a109.el9.x86_64 96/96 2026-02-12T08:43:52.474 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-2:20.3.0-5161.g2401a109.el9.x86_64 1/96 2026-02-12T08:43:52.474 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 2/96 2026-02-12T08:43:52.474 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 3/96 2026-02-12T08:43:52.474 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 4/96 2026-02-12T08:43:52.474 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 5/96 2026-02-12T08:43:52.474 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_6 6/96 2026-02-12T08:43:52.474 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86_6 7/96 2026-02-12T08:43:52.474 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5161.g2401a109.el 8/96 2026-02-12T08:43:52.474 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarc 9/96 2026-02-12T08:43:52.474 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noa 10/96 2026-02-12T08:43:52.475 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a 11/96 2026-02-12T08:43:52.475 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.noa 12/96 2026-02-12T08:43:52.475 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5161.g2401a109.el9. 13/96 2026-02-12T08:43:52.475 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 14/96 2026-02-12T08:43:52.475 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5161.g2401a109.el9 15/96 2026-02-12T08:43:52.475 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 16/96 2026-02-12T08:43:52.475 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : cephadm-2:20.3.0-5161.g2401a109.el9.noarch 17/96 2026-02-12T08:43:52.475 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 18/96 2026-02-12T08:43:52.475 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-12T08:43:52.476 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-12T08:43:52.476 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-12T08:43:52.476 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-12T08:43:52.476 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-12T08:43:52.476 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-12T08:43:52.476 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-12T08:43:52.476 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-12T08:43:52.476 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-12T08:43:52.476 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-12T08:43:52.476 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-12T08:43:52.477 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-12T08:43:52.477 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-12T08:43:52.477 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 32/96 2026-02-12T08:43:52.477 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 33/96 2026-02-12T08:43:52.477 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 34/96 2026-02-12T08:43:52.477 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-12T08:43:52.477 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-12T08:43:52.477 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-12T08:43:52.477 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-12T08:43:52.477 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-12T08:43:52.478 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 40/96 2026-02-12T08:43:52.478 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-12T08:43:52.478 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-12T08:43:52.478 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-12T08:43:52.478 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-12T08:43:52.478 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-12T08:43:52.478 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-12T08:43:52.478 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-12T08:43:52.478 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-12T08:43:52.478 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-12T08:43:52.479 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-12T08:43:52.479 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-12T08:43:52.479 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-12T08:43:52.479 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-12T08:43:52.479 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-12T08:43:52.479 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-12T08:43:52.479 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-12T08:43:52.479 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-12T08:43:52.479 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-12T08:43:52.479 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-12T08:43:52.479 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-12T08:43:52.480 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-12T08:43:52.480 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-12T08:43:52.480 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-12T08:43:52.480 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-12T08:43:52.480 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-12T08:43:52.480 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-12T08:43:52.480 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-12T08:43:52.480 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-12T08:43:52.480 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-12T08:43:52.480 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-12T08:43:52.480 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-12T08:43:52.481 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-12T08:43:52.481 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-12T08:43:52.481 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-12T08:43:52.481 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-12T08:43:52.481 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-12T08:43:52.481 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-12T08:43:52.481 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-12T08:43:52.481 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-12T08:43:52.481 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-12T08:43:52.481 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-12T08:43:52.482 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-12T08:43:52.482 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-12T08:43:52.482 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-12T08:43:52.482 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-12T08:43:52.482 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-12T08:43:52.482 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-12T08:43:52.482 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-12T08:43:52.482 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-12T08:43:52.482 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-12T08:43:52.482 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-12T08:43:52.482 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-12T08:43:52.483 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-12T08:43:52.483 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-12T08:43:52.483 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-12T08:43:52.533 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-12T08:43:52.533 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:52.533 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T08:43:52.533 INFO:teuthology.orchestra.run.trial025.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T08:43:52.533 INFO:teuthology.orchestra.run.trial025.stdout: ceph-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:52.533 INFO:teuthology.orchestra.run.trial025.stdout: ceph-grafana-dashboards-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:52.533 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mds-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:52.533 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:52.533 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:52.533 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:52.533 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:52.533 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-k8sevents-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:52.533 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-modules-core-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:52.533 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mon-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: ceph-prometheus-alerts-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: cephadm-2:20.3.0-5161.g2401a109.el9.noarch 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T08:43:52.534 INFO:teuthology.orchestra.run.trial025.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-12T08:43:52.535 INFO:teuthology.orchestra.run.trial025.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T08:43:52.536 INFO:teuthology.orchestra.run.trial025.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T08:43:52.536 INFO:teuthology.orchestra.run.trial025.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T08:43:52.536 INFO:teuthology.orchestra.run.trial025.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T08:43:52.536 INFO:teuthology.orchestra.run.trial025.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T08:43:52.536 INFO:teuthology.orchestra.run.trial025.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T08:43:52.536 INFO:teuthology.orchestra.run.trial025.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-12T08:43:52.536 INFO:teuthology.orchestra.run.trial025.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T08:43:52.536 INFO:teuthology.orchestra.run.trial025.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T08:43:52.536 INFO:teuthology.orchestra.run.trial025.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T08:43:52.536 INFO:teuthology.orchestra.run.trial025.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-12T08:43:52.536 INFO:teuthology.orchestra.run.trial025.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-12T08:43:52.536 INFO:teuthology.orchestra.run.trial025.stdout: zip-3.0-35.el9.x86_64 2026-02-12T08:43:52.536 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:52.536 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:43:52.597 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-base 2026-02-12T08:43:52.900 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:46 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:43:52.965 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:43:52.984 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:43:52.985 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:43:52.985 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:43:53.006 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install cephadm 2026-02-12T08:43:53.309 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:47 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:43:53.374 INFO:teuthology.orchestra.run.trial025.stdout:Package cephadm-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:43:53.392 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:43:53.393 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:43:53.393 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:43:53.414 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T08:43:53.716 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:47 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:43:53.799 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:43:53.800 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:43:53.800 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repo Size 2026-02-12T08:43:53.800 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:43:53.800 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T08:43:53.800 INFO:teuthology.orchestra.run.trial025.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5161.g2401a109.el9 ceph 149 k 2026-02-12T08:43:53.800 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:53.800 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T08:43:53.800 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:43:53.800 INFO:teuthology.orchestra.run.trial025.stdout:Install 1 Package 2026-02-12T08:43:53.801 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:53.801 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 149 k 2026-02-12T08:43:53.801 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 455 k 2026-02-12T08:43:53.801 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T08:43:54.360 INFO:teuthology.orchestra.run.trial025.stdout:ceph-immutable-object-cache-20.3.0-5161.g2401a1 267 kB/s | 149 kB 00:00 2026-02-12T08:43:54.360 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:43:54.360 INFO:teuthology.orchestra.run.trial025.stdout:Total 266 kB/s | 149 kB 00:00 2026-02-12T08:43:54.360 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T08:43:54.365 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T08:43:54.365 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T08:43:54.397 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T08:43:54.397 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T08:43:54.454 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T08:43:54.456 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5161.g2401a109. 1/1 2026-02-12T08:43:54.478 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5161.g2401a109. 1/1 2026-02-12T08:43:54.478 INFO:teuthology.orchestra.run.trial025.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:43:54.478 INFO:teuthology.orchestra.run.trial025.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T08:43:54.478 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:54.779 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5161.g2401a109. 1/1 2026-02-12T08:43:54.779 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:54.780 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T08:43:54.780 INFO:teuthology.orchestra.run.trial025.stdout: ceph-immutable-object-cache-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:54.780 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:54.780 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:43:54.806 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr 2026-02-12T08:43:55.104 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:49 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:43:55.168 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:43:55.187 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:43:55.187 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:43:55.188 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:43:55.208 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T08:43:55.507 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:49 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:43:55.573 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:43:55.591 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:43:55.592 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:43:55.592 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:43:55.613 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T08:43:55.915 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:49 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:43:55.980 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:43:55.998 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:43:55.999 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:43:55.999 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:43:56.019 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr-rook 2026-02-12T08:43:56.319 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:50 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:43:56.383 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:43:56.401 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:43:56.402 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:43:56.402 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:43:56.423 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T08:43:56.718 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:50 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:43:56.783 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:43:56.801 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:43:56.802 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:43:56.802 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:43:56.823 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-osd 2026-02-12T08:43:57.124 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:51 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:43:57.188 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:43:57.207 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:43:57.207 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:43:57.208 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:43:57.230 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-osd-classic 2026-02-12T08:43:57.530 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:51 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:43:57.594 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:43:57.613 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:43:57.614 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:43:57.614 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:43:57.634 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-fuse 2026-02-12T08:43:57.935 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:51 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:43:58.020 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:43:58.021 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:43:58.021 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repo Size 2026-02-12T08:43:58.021 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:43:58.021 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T08:43:58.021 INFO:teuthology.orchestra.run.trial025.stdout: ceph-fuse x86_64 2:20.3.0-5161.g2401a109.el9 ceph 914 k 2026-02-12T08:43:58.021 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:58.021 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T08:43:58.022 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:43:58.022 INFO:teuthology.orchestra.run.trial025.stdout:Install 1 Package 2026-02-12T08:43:58.022 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:58.022 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 914 k 2026-02-12T08:43:58.022 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 2.9 M 2026-02-12T08:43:58.022 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T08:43:58.832 INFO:teuthology.orchestra.run.trial025.stdout:ceph-fuse-20.3.0-5161.g2401a109.el9.x86_64.rpm 1.1 MB/s | 914 kB 00:00 2026-02-12T08:43:58.833 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:43:58.833 INFO:teuthology.orchestra.run.trial025.stdout:Total 1.1 MB/s | 914 kB 00:00 2026-02-12T08:43:58.833 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T08:43:58.838 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T08:43:58.838 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T08:43:58.873 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T08:43:58.873 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T08:43:58.965 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T08:43:58.981 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:43:59.198 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:43:59.255 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:43:59.255 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:59.255 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T08:43:59.255 INFO:teuthology.orchestra.run.trial025.stdout: ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:43:59.255 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:43:59.255 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:43:59.283 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-volume 2026-02-12T08:43:59.584 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:53 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:43:59.648 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:43:59.665 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:43:59.666 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:43:59.666 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:43:59.686 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install librados-devel 2026-02-12T08:43:59.986 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:53 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:44:00.069 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:44:00.069 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:00.069 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repo Size 2026-02-12T08:44:00.069 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:00.069 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T08:44:00.069 INFO:teuthology.orchestra.run.trial025.stdout: librados-devel x86_64 2:20.3.0-5161.g2401a109.el9 ceph 124 k 2026-02-12T08:44:00.069 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:00.069 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T08:44:00.070 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:00.070 INFO:teuthology.orchestra.run.trial025.stdout:Install 1 Package 2026-02-12T08:44:00.070 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:00.070 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 124 k 2026-02-12T08:44:00.070 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 434 k 2026-02-12T08:44:00.070 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T08:44:00.535 INFO:teuthology.orchestra.run.trial025.stdout:librados-devel-20.3.0-5161.g2401a109.el9.x86_64 265 kB/s | 124 kB 00:00 2026-02-12T08:44:00.536 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:44:00.536 INFO:teuthology.orchestra.run.trial025.stdout:Total 265 kB/s | 124 kB 00:00 2026-02-12T08:44:00.536 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T08:44:00.539 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T08:44:00.539 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T08:44:00.572 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T08:44:00.572 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T08:44:00.627 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T08:44:00.643 INFO:teuthology.orchestra.run.trial025.stdout: Installing : librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:44:00.724 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:44:00.782 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:44:00.782 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:00.782 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T08:44:00.782 INFO:teuthology.orchestra.run.trial025.stdout: librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:00.782 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:00.782 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:44:00.810 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install libcephfs2 2026-02-12T08:44:01.113 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:55 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:44:01.178 INFO:teuthology.orchestra.run.trial025.stdout:Package libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:01.195 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:44:01.196 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:44:01.196 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:44:01.217 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install libcephfs-devel 2026-02-12T08:44:01.519 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:55 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:44:01.602 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:44:01.602 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:01.602 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repo Size 2026-02-12T08:44:01.603 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:01.603 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T08:44:01.603 INFO:teuthology.orchestra.run.trial025.stdout: libcephfs-devel x86_64 2:20.3.0-5161.g2401a109.el9 ceph 37 k 2026-02-12T08:44:01.603 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:01.603 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T08:44:01.603 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:01.603 INFO:teuthology.orchestra.run.trial025.stdout:Install 1 Package 2026-02-12T08:44:01.603 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:01.603 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 37 k 2026-02-12T08:44:01.603 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 171 k 2026-02-12T08:44:01.603 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T08:44:02.088 INFO:teuthology.orchestra.run.trial025.stdout:libcephfs-devel-20.3.0-5161.g2401a109.el9.x86_6 77 kB/s | 37 kB 00:00 2026-02-12T08:44:02.088 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:44:02.089 INFO:teuthology.orchestra.run.trial025.stdout:Total 77 kB/s | 37 kB 00:00 2026-02-12T08:44:02.089 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T08:44:02.091 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T08:44:02.091 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T08:44:02.095 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T08:44:02.095 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T08:44:02.116 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T08:44:02.133 INFO:teuthology.orchestra.run.trial025.stdout: Installing : libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:44:02.188 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:44:02.246 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:44:02.246 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:02.246 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T08:44:02.246 INFO:teuthology.orchestra.run.trial025.stdout: libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:02.246 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:02.246 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:44:02.272 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install librados2 2026-02-12T08:44:02.577 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:56 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:44:02.642 INFO:teuthology.orchestra.run.trial025.stdout:Package librados2-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:02.659 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:44:02.659 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:44:02.660 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:44:02.681 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install librbd1 2026-02-12T08:44:02.984 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:56 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:44:03.050 INFO:teuthology.orchestra.run.trial025.stdout:Package librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:03.067 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:44:03.067 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:44:03.067 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:44:03.090 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install python3-rados 2026-02-12T08:44:03.392 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:57 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:44:03.458 INFO:teuthology.orchestra.run.trial025.stdout:Package python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:03.475 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:44:03.476 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:44:03.476 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:44:03.497 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install python3-rgw 2026-02-12T08:44:03.797 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:57 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:44:03.861 INFO:teuthology.orchestra.run.trial025.stdout:Package python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:03.878 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:44:03.879 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:44:03.879 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:44:03.901 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install python3-cephfs 2026-02-12T08:44:04.209 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:58 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:44:04.275 INFO:teuthology.orchestra.run.trial025.stdout:Package python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:04.292 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:44:04.293 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:44:04.293 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:44:04.315 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install python3-rbd 2026-02-12T08:44:04.615 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:58 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:44:04.680 INFO:teuthology.orchestra.run.trial025.stdout:Package python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:04.697 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:44:04.698 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:44:04.698 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:44:04.718 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install rbd-fuse 2026-02-12T08:44:05.022 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:03:59 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:44:05.105 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:44:05.105 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:05.105 INFO:teuthology.orchestra.run.trial025.stdout: Package Architecture Version Repository Size 2026-02-12T08:44:05.105 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:05.105 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T08:44:05.105 INFO:teuthology.orchestra.run.trial025.stdout: rbd-fuse x86_64 2:20.3.0-5161.g2401a109.el9 ceph 87 k 2026-02-12T08:44:05.105 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:05.105 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T08:44:05.105 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:05.105 INFO:teuthology.orchestra.run.trial025.stdout:Install 1 Package 2026-02-12T08:44:05.105 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:05.106 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 87 k 2026-02-12T08:44:05.106 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 236 k 2026-02-12T08:44:05.106 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T08:44:05.591 INFO:teuthology.orchestra.run.trial025.stdout:rbd-fuse-20.3.0-5161.g2401a109.el9.x86_64.rpm 178 kB/s | 87 kB 00:00 2026-02-12T08:44:05.591 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:44:05.591 INFO:teuthology.orchestra.run.trial025.stdout:Total 178 kB/s | 87 kB 00:00 2026-02-12T08:44:05.592 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T08:44:05.595 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T08:44:05.595 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T08:44:05.628 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T08:44:05.628 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T08:44:05.679 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T08:44:05.696 INFO:teuthology.orchestra.run.trial025.stdout: Installing : rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:44:05.777 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:44:05.834 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:44:05.835 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:05.835 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T08:44:05.835 INFO:teuthology.orchestra.run.trial025.stdout: rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:05.835 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:05.835 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:44:05.863 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install rbd-mirror 2026-02-12T08:44:06.170 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:04:00 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:44:06.252 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:44:06.253 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:06.253 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repo Size 2026-02-12T08:44:06.253 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:06.254 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T08:44:06.254 INFO:teuthology.orchestra.run.trial025.stdout: rbd-mirror x86_64 2:20.3.0-5161.g2401a109.el9 ceph 2.6 M 2026-02-12T08:44:06.254 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:06.254 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T08:44:06.254 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:06.254 INFO:teuthology.orchestra.run.trial025.stdout:Install 1 Package 2026-02-12T08:44:06.254 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:06.254 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 2.6 M 2026-02-12T08:44:06.254 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 11 M 2026-02-12T08:44:06.254 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T08:44:07.277 INFO:teuthology.orchestra.run.trial025.stdout:rbd-mirror-20.3.0-5161.g2401a109.el9.x86_64.rpm 2.5 MB/s | 2.6 MB 00:01 2026-02-12T08:44:07.277 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:44:07.277 INFO:teuthology.orchestra.run.trial025.stdout:Total 2.5 MB/s | 2.6 MB 00:01 2026-02-12T08:44:07.277 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T08:44:07.282 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T08:44:07.282 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T08:44:07.321 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T08:44:07.322 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T08:44:07.491 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T08:44:07.493 INFO:teuthology.orchestra.run.trial025.stdout: Installing : rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:44:07.515 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:44:07.515 INFO:teuthology.orchestra.run.trial025.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T08:44:07.515 INFO:teuthology.orchestra.run.trial025.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T08:44:07.516 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T08:44:07.516 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T08:44:07.516 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:07.802 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:44:07.802 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:07.802 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T08:44:07.802 INFO:teuthology.orchestra.run.trial025.stdout: rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:07.802 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:07.803 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:44:07.832 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install rbd-nbd 2026-02-12T08:44:08.138 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:04:02 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:44:08.221 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:44:08.221 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:08.221 INFO:teuthology.orchestra.run.trial025.stdout: Package Architecture Version Repository Size 2026-02-12T08:44:08.221 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:08.222 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T08:44:08.222 INFO:teuthology.orchestra.run.trial025.stdout: rbd-nbd x86_64 2:20.3.0-5161.g2401a109.el9 ceph 166 k 2026-02-12T08:44:08.222 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:08.222 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T08:44:08.222 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:08.222 INFO:teuthology.orchestra.run.trial025.stdout:Install 1 Package 2026-02-12T08:44:08.222 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:08.222 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 166 k 2026-02-12T08:44:08.222 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 496 k 2026-02-12T08:44:08.222 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T08:44:08.712 INFO:teuthology.orchestra.run.trial025.stdout:rbd-nbd-20.3.0-5161.g2401a109.el9.x86_64.rpm 340 kB/s | 166 kB 00:00 2026-02-12T08:44:08.712 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:44:08.712 INFO:teuthology.orchestra.run.trial025.stdout:Total 339 kB/s | 166 kB 00:00 2026-02-12T08:44:08.712 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T08:44:08.717 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T08:44:08.717 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T08:44:08.750 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T08:44:08.750 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T08:44:08.806 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T08:44:08.823 INFO:teuthology.orchestra.run.trial025.stdout: Installing : rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:44:08.906 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:44:08.965 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 1/1 2026-02-12T08:44:08.965 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:08.965 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T08:44:08.965 INFO:teuthology.orchestra.run.trial025.stdout: rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:44:08.966 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:08.966 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:44:08.994 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-osd-crimson 2026-02-12T08:44:09.297 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:04:03 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:44:09.362 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-osd-crimson-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:44:09.379 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:44:09.380 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:44:09.380 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:44:09.401 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-12T08:44:09.706 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:04:03 ago on Thu 12 Feb 2026 08:40:06 AM UTC. 2026-02-12T08:44:09.790 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:44:09.790 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:09.790 INFO:teuthology.orchestra.run.trial025.stdout: Package Arch Version Repo Size 2026-02-12T08:44:09.790 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:09.790 INFO:teuthology.orchestra.run.trial025.stdout:Installing: 2026-02-12T08:44:09.790 INFO:teuthology.orchestra.run.trial025.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5161.g2401a109.el9 ceph 429 M 2026-02-12T08:44:09.790 INFO:teuthology.orchestra.run.trial025.stdout:Installing weak dependencies: 2026-02-12T08:44:09.791 INFO:teuthology.orchestra.run.trial025.stdout: ceph-debugsource x86_64 2:20.3.0-5161.g2401a109.el9 ceph 12 M 2026-02-12T08:44:09.791 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:09.791 INFO:teuthology.orchestra.run.trial025.stdout:Transaction Summary 2026-02-12T08:44:09.791 INFO:teuthology.orchestra.run.trial025.stdout:================================================================================ 2026-02-12T08:44:09.791 INFO:teuthology.orchestra.run.trial025.stdout:Install 2 Packages 2026-02-12T08:44:09.791 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:44:09.791 INFO:teuthology.orchestra.run.trial025.stdout:Total download size: 441 M 2026-02-12T08:44:09.791 INFO:teuthology.orchestra.run.trial025.stdout:Installed size: 2.7 G 2026-02-12T08:44:09.791 INFO:teuthology.orchestra.run.trial025.stdout:Downloading Packages: 2026-02-12T08:44:18.884 INFO:teuthology.orchestra.run.trial025.stdout:(1/2): ceph-debugsource-20.3.0-5161.g2401a109.e 1.3 MB/s | 12 MB 00:09 2026-02-12T08:49:20.550 INFO:teuthology.orchestra.run.trial025.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5161.g 1.4 MB/s | 429 MB 05:10 2026-02-12T08:49:20.552 INFO:teuthology.orchestra.run.trial025.stdout:-------------------------------------------------------------------------------- 2026-02-12T08:49:20.552 INFO:teuthology.orchestra.run.trial025.stdout:Total 1.4 MB/s | 441 MB 05:10 2026-02-12T08:49:20.552 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction check 2026-02-12T08:49:20.558 INFO:teuthology.orchestra.run.trial025.stdout:Transaction check succeeded. 2026-02-12T08:49:20.558 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction test 2026-02-12T08:49:21.925 INFO:teuthology.orchestra.run.trial025.stdout:Transaction test succeeded. 2026-02-12T08:49:21.925 INFO:teuthology.orchestra.run.trial025.stdout:Running transaction 2026-02-12T08:49:25.510 INFO:teuthology.orchestra.run.trial025.stdout: Preparing : 1/1 2026-02-12T08:49:47.598 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-debugsource-2:20.3.0-5161.g2401a109.el9.x86_64 1/2 2026-02-12T08:49:47.616 INFO:teuthology.orchestra.run.trial025.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a109.e 2/2 2026-02-12T08:49:49.609 INFO:teuthology.orchestra.run.trial025.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a109.e 2/2 2026-02-12T08:49:49.609 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-debugsource-2:20.3.0-5161.g2401a109.el9.x86_64 1/2 2026-02-12T08:49:49.667 INFO:teuthology.orchestra.run.trial025.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a109.e 2/2 2026-02-12T08:49:49.667 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:49:49.667 INFO:teuthology.orchestra.run.trial025.stdout:Installed: 2026-02-12T08:49:49.667 INFO:teuthology.orchestra.run.trial025.stdout: ceph-debugsource-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:49:49.668 INFO:teuthology.orchestra.run.trial025.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5161.g2401a109.el9.x86_64 2026-02-12T08:49:49.668 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:49:49.668 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:49:49.749 DEBUG:teuthology.parallel:result is None 2026-02-12T08:49:49.752 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:49:49.943 DEBUG:teuthology.orchestra.run.trial025:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T08:49:49.965 INFO:teuthology.orchestra.run.trial025.stdout:20.3.0-5161.g2401a109.el9 2026-02-12T08:49:49.966 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5161.g2401a109.el9 2026-02-12T08:49:49.966 INFO:teuthology.task.install:The correct ceph version 20.3.0-5161.g2401a109 is installed. 2026-02-12T08:49:49.968 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-12T08:49:49.968 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:49:49.968 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T08:49:50.030 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-12T08:49:50.031 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:49:50.031 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T08:49:50.095 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T08:49:50.160 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-12T08:49:50.160 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:49:50.160 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T08:49:50.224 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T08:49:50.290 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-12T08:49:50.290 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:49:50.290 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T08:49:50.355 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T08:49:50.418 INFO:teuthology.run_tasks:Running task pexec... 2026-02-12T08:49:50.439 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-12T08:49:50.440 DEBUG:teuthology.orchestra.run.trial025:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-12T08:49:50.461 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial025.front.sepia.ceph.com 2026-02-12T08:49:50.461 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-12T08:49:50.512 DEBUG:teuthology.parallel:result is None 2026-02-12T08:49:50.512 INFO:teuthology.run_tasks:Running task install... 2026-02-12T08:49:50.526 DEBUG:teuthology.task.install:project ceph 2026-02-12T08:49:50.526 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'}} 2026-02-12T08:49:50.526 DEBUG:teuthology.task.install:config {'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'} 2026-02-12T08:49:50.526 INFO:teuthology.task.install:Using flavor: debug 2026-02-12T08:49:50.535 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-12T08:49:50.536 INFO:teuthology.task.install:extra packages: [] 2026-02-12T08:49:50.536 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875', 'tag': None, 'wait_for_package': False} 2026-02-12T08:49:50.537 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:49:50.693 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/ 2026-02-12T08:49:50.693 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5161.g2401a109 2026-02-12T08:49:51.070 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-66488-revert/2401a109e2ac85dfa20fc57328da663aa754c875/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T08:49:51.070 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:49:51.070 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T08:49:51.095 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-12T08:49:51.096 DEBUG:teuthology.orchestra.run.trial025:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2401a109e2ac85dfa20fc57328da663aa754c875/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T08:49:51.161 DEBUG:teuthology.orchestra.run.trial025:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T08:49:51.226 DEBUG:teuthology.orchestra.run.trial025:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T08:49:51.282 INFO:teuthology.orchestra.run.trial025.stdout:check_obsoletes = 1 2026-02-12T08:49:51.291 DEBUG:teuthology.orchestra.run.trial025:> sudo yum clean all 2026-02-12T08:49:51.451 INFO:teuthology.orchestra.run.trial025.stdout:56 files removed 2026-02-12T08:49:51.465 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-radosgw 2026-02-12T08:49:52.296 INFO:teuthology.orchestra.run.trial025.stdout:ceph packages for x86_64 138 kB/s | 94 kB 00:00 2026-02-12T08:49:52.962 INFO:teuthology.orchestra.run.trial025.stdout:ceph noarch packages 38 kB/s | 24 kB 00:00 2026-02-12T08:49:53.556 INFO:teuthology.orchestra.run.trial025.stdout:ceph source packages 3.6 kB/s | 2.1 kB 00:00 2026-02-12T08:49:56.841 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.9 MB 00:03 2026-02-12T08:50:00.077 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 27 MB 00:02 2026-02-12T08:50:04.260 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 7.8 MB 00:01 2026-02-12T08:50:05.482 INFO:teuthology.orchestra.run.trial025.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 20 kB 00:00 2026-02-12T08:50:05.991 INFO:teuthology.orchestra.run.trial025.stdout:Extra Packages for Enterprise Linux 47 MB/s | 20 MB 00:00 2026-02-12T08:50:09.268 INFO:teuthology.orchestra.run.trial025.stdout:lab-extras 787 kB/s | 50 kB 00:00 2026-02-12T08:50:10.532 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-radosgw-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:10.550 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:10.551 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:10.551 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:10.575 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-test 2026-02-12T08:50:10.881 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:01 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:10.946 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-test-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:10.963 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:10.964 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:10.964 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:10.986 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph 2026-02-12T08:50:11.288 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:02 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:11.353 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:11.371 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:11.371 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:11.372 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:11.394 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-base 2026-02-12T08:50:11.699 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:02 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:11.763 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-base-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:11.781 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:11.781 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:11.781 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:11.803 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install cephadm 2026-02-12T08:50:12.103 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:03 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:12.168 INFO:teuthology.orchestra.run.trial025.stdout:Package cephadm-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:50:12.185 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:12.186 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:12.186 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:12.207 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T08:50:12.512 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:03 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:12.576 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-immutable-object-cache-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:12.594 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:12.595 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:12.595 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:12.616 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr 2026-02-12T08:50:12.916 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:03 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:12.981 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:12.999 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:13.000 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:13.000 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:13.021 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T08:50:13.323 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:13.387 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-dashboard-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:50:13.404 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:13.405 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:13.405 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:13.427 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T08:50:13.729 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:13.794 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:50:13.811 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:13.812 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:13.812 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:13.833 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr-rook 2026-02-12T08:50:14.133 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:05 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:14.197 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-rook-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:50:14.214 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:14.215 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:14.215 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:14.237 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T08:50:14.539 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:05 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:14.604 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-mgr-cephadm-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:50:14.621 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:14.622 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:14.622 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:14.644 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-osd 2026-02-12T08:50:14.948 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:05 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:15.013 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-osd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:15.030 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:15.031 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:15.031 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:15.053 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-osd-classic 2026-02-12T08:50:15.356 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:15.420 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-osd-classic-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:15.438 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:15.438 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:15.439 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:15.461 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-fuse 2026-02-12T08:50:15.766 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:15.830 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:15.847 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:15.848 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:15.848 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:15.870 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install ceph-volume 2026-02-12T08:50:16.173 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:07 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:16.237 INFO:teuthology.orchestra.run.trial025.stdout:Package ceph-volume-2:20.3.0-5161.g2401a109.el9.noarch is already installed. 2026-02-12T08:50:16.254 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:16.255 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:16.255 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:16.276 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install librados-devel 2026-02-12T08:50:16.578 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:07 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:16.643 INFO:teuthology.orchestra.run.trial025.stdout:Package librados-devel-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:16.660 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:16.661 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:16.661 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:16.682 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install libcephfs2 2026-02-12T08:50:16.985 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:07 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:17.049 INFO:teuthology.orchestra.run.trial025.stdout:Package libcephfs2-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:17.066 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:17.067 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:17.067 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:17.089 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install libcephfs-devel 2026-02-12T08:50:17.393 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:17.457 INFO:teuthology.orchestra.run.trial025.stdout:Package libcephfs-devel-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:17.474 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:17.475 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:17.475 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:17.497 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install librados2 2026-02-12T08:50:17.801 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:17.866 INFO:teuthology.orchestra.run.trial025.stdout:Package librados2-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:17.883 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:17.884 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:17.884 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:17.905 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install librbd1 2026-02-12T08:50:18.209 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:09 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:18.273 INFO:teuthology.orchestra.run.trial025.stdout:Package librbd1-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:18.291 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:18.291 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:18.292 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:18.314 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install python3-rados 2026-02-12T08:50:18.620 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:09 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:18.684 INFO:teuthology.orchestra.run.trial025.stdout:Package python3-rados-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:18.702 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:18.702 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:18.702 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:18.724 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install python3-rgw 2026-02-12T08:50:19.025 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:19.089 INFO:teuthology.orchestra.run.trial025.stdout:Package python3-rgw-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:19.106 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:19.107 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:19.107 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:19.128 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install python3-cephfs 2026-02-12T08:50:19.432 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:19.496 INFO:teuthology.orchestra.run.trial025.stdout:Package python3-cephfs-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:19.514 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:19.515 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:19.515 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:19.536 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install python3-rbd 2026-02-12T08:50:19.841 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:19.906 INFO:teuthology.orchestra.run.trial025.stdout:Package python3-rbd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:19.924 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:19.924 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:19.924 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:19.946 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install rbd-fuse 2026-02-12T08:50:20.250 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:11 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:20.315 INFO:teuthology.orchestra.run.trial025.stdout:Package rbd-fuse-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:20.333 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:20.333 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:20.333 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:20.355 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install rbd-mirror 2026-02-12T08:50:20.657 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:11 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:20.721 INFO:teuthology.orchestra.run.trial025.stdout:Package rbd-mirror-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:20.738 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:20.739 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:20.739 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:20.761 DEBUG:teuthology.orchestra.run.trial025:> sudo yum -y install rbd-nbd 2026-02-12T08:50:21.065 INFO:teuthology.orchestra.run.trial025.stdout:Last metadata expiration check: 0:00:12 ago on Thu 12 Feb 2026 08:50:09 AM UTC. 2026-02-12T08:50:21.130 INFO:teuthology.orchestra.run.trial025.stdout:Package rbd-nbd-2:20.3.0-5161.g2401a109.el9.x86_64 is already installed. 2026-02-12T08:50:21.148 INFO:teuthology.orchestra.run.trial025.stdout:Dependencies resolved. 2026-02-12T08:50:21.148 INFO:teuthology.orchestra.run.trial025.stdout:Nothing to do. 2026-02-12T08:50:21.148 INFO:teuthology.orchestra.run.trial025.stdout:Complete! 2026-02-12T08:50:21.176 DEBUG:teuthology.parallel:result is None 2026-02-12T08:50:21.177 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=2401a109e2ac85dfa20fc57328da663aa754c875 2026-02-12T08:50:21.353 DEBUG:teuthology.orchestra.run.trial025:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T08:50:21.374 INFO:teuthology.orchestra.run.trial025.stdout:20.3.0-5161.g2401a109.el9 2026-02-12T08:50:21.374 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5161.g2401a109.el9 2026-02-12T08:50:21.374 INFO:teuthology.task.install:The correct ceph version 20.3.0-5161.g2401a109 is installed. 2026-02-12T08:50:21.377 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-12T08:50:21.377 INFO:teuthology.run_tasks:Running task ceph... 2026-02-12T08:50:21.484 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-12T08:50:21.484 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod 777 /var/log/ceph 2026-02-12T08:50:21.511 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-12T08:50:21.511 DEBUG:teuthology.orchestra.run.trial025:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T08:50:21.575 INFO:tasks.ceph:Creating extra log directories... 2026-02-12T08:50:21.575 DEBUG:teuthology.orchestra.run.trial025:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T08:50:21.649 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-12T08:50:21.650 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-12T08:50:21.650 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41553', 'branch': 'main', 'description': 'crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} perf_ignorelist settings/optimized workloads/radosbench_omap_write}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '41553', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'}}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c'}}, 'owner': 'scheduled_matan@soko04.front.sepia.ceph.com', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 9353, 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '6bf51b64d7733c58c2fe4a45746d4b9e65a38d1c', 'targets': {'trial025.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC0neB+P+QbSyDwZRQHW0rNaftRQE+KRwZpIN9+hYi3a4kMlcCiG6bd8WDV2EOdGft6mnEezlN2S9UrrBjVEGy8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}}, 'wait-for-scrub': False, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'sha1': '2401a109e2ac85dfa20fc57328da663aa754c875', 'cluster': 'ceph'}}, {'ssh_keys': None}, {'radosbench': {'clients': ['client.0'], 'objectsize': 4096, 'size': 4096, 'time': 300, 'write-omap': True}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'c433f1062990a0488dc29a553589bc609a460691', 'timestamp': '2026-02-09_15:50:17', 'tube': 'trial', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.2161924'} 2026-02-12T08:50:21.650 DEBUG:teuthology.orchestra.run.trial025:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T08:50:21.696 DEBUG:teuthology.orchestra.run.trial025:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T08:50:21.761 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:50:21.762 DEBUG:teuthology.orchestra.run.trial025:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T08:50:21.818 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T08:50:21.818 DEBUG:teuthology.orchestra.run.trial025:> stat /dev/vg_nvme/lv_1 2026-02-12T08:50:21.874 INFO:teuthology.orchestra.run.trial025.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T08:50:21.875 INFO:teuthology.orchestra.run.trial025.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:50:21.875 INFO:teuthology.orchestra.run.trial025.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-12T08:50:21.875 INFO:teuthology.orchestra.run.trial025.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:50:21.875 INFO:teuthology.orchestra.run.trial025.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:50:21.875 INFO:teuthology.orchestra.run.trial025.stdout:Access: 2026-02-12 08:44:07.649963530 +0000 2026-02-12T08:50:21.875 INFO:teuthology.orchestra.run.trial025.stdout:Modify: 2026-02-12 08:40:20.644535093 +0000 2026-02-12T08:50:21.875 INFO:teuthology.orchestra.run.trial025.stdout:Change: 2026-02-12 08:40:20.644535093 +0000 2026-02-12T08:50:21.875 INFO:teuthology.orchestra.run.trial025.stdout: Birth: 2026-02-12 08:40:20.644535093 +0000 2026-02-12T08:50:21.876 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T08:50:21.938 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records in 2026-02-12T08:50:21.938 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records out 2026-02-12T08:50:21.938 INFO:teuthology.orchestra.run.trial025.stderr:512 bytes copied, 0.000156621 s, 3.3 MB/s 2026-02-12T08:50:21.939 DEBUG:teuthology.orchestra.run.trial025:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T08:50:21.996 DEBUG:teuthology.orchestra.run.trial025:> stat /dev/vg_nvme/lv_2 2026-02-12T08:50:22.054 INFO:teuthology.orchestra.run.trial025.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T08:50:22.054 INFO:teuthology.orchestra.run.trial025.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:50:22.054 INFO:teuthology.orchestra.run.trial025.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-12T08:50:22.054 INFO:teuthology.orchestra.run.trial025.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:50:22.054 INFO:teuthology.orchestra.run.trial025.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:50:22.054 INFO:teuthology.orchestra.run.trial025.stdout:Access: 2026-02-12 08:44:07.649963530 +0000 2026-02-12T08:50:22.054 INFO:teuthology.orchestra.run.trial025.stdout:Modify: 2026-02-12 08:40:20.644535093 +0000 2026-02-12T08:50:22.054 INFO:teuthology.orchestra.run.trial025.stdout:Change: 2026-02-12 08:40:20.644535093 +0000 2026-02-12T08:50:22.055 INFO:teuthology.orchestra.run.trial025.stdout: Birth: 2026-02-12 08:40:20.644535093 +0000 2026-02-12T08:50:22.055 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T08:50:22.116 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records in 2026-02-12T08:50:22.116 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records out 2026-02-12T08:50:22.116 INFO:teuthology.orchestra.run.trial025.stderr:512 bytes copied, 0.000130733 s, 3.9 MB/s 2026-02-12T08:50:22.118 DEBUG:teuthology.orchestra.run.trial025:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T08:50:22.176 DEBUG:teuthology.orchestra.run.trial025:> stat /dev/vg_nvme/lv_3 2026-02-12T08:50:22.232 INFO:teuthology.orchestra.run.trial025.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T08:50:22.232 INFO:teuthology.orchestra.run.trial025.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:50:22.232 INFO:teuthology.orchestra.run.trial025.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-12T08:50:22.233 INFO:teuthology.orchestra.run.trial025.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:50:22.233 INFO:teuthology.orchestra.run.trial025.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:50:22.233 INFO:teuthology.orchestra.run.trial025.stdout:Access: 2026-02-12 08:44:07.650963514 +0000 2026-02-12T08:50:22.233 INFO:teuthology.orchestra.run.trial025.stdout:Modify: 2026-02-12 08:40:20.644535093 +0000 2026-02-12T08:50:22.233 INFO:teuthology.orchestra.run.trial025.stdout:Change: 2026-02-12 08:40:20.644535093 +0000 2026-02-12T08:50:22.233 INFO:teuthology.orchestra.run.trial025.stdout: Birth: 2026-02-12 08:40:20.644535093 +0000 2026-02-12T08:50:22.233 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T08:50:22.296 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records in 2026-02-12T08:50:22.296 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records out 2026-02-12T08:50:22.296 INFO:teuthology.orchestra.run.trial025.stderr:512 bytes copied, 0.000143437 s, 3.6 MB/s 2026-02-12T08:50:22.297 DEBUG:teuthology.orchestra.run.trial025:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T08:50:22.355 DEBUG:teuthology.orchestra.run.trial025:> stat /dev/vg_nvme/lv_4 2026-02-12T08:50:22.411 INFO:teuthology.orchestra.run.trial025.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T08:50:22.412 INFO:teuthology.orchestra.run.trial025.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T08:50:22.412 INFO:teuthology.orchestra.run.trial025.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-12T08:50:22.412 INFO:teuthology.orchestra.run.trial025.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T08:50:22.412 INFO:teuthology.orchestra.run.trial025.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T08:50:22.412 INFO:teuthology.orchestra.run.trial025.stdout:Access: 2026-02-12 08:44:07.650963514 +0000 2026-02-12T08:50:22.412 INFO:teuthology.orchestra.run.trial025.stdout:Modify: 2026-02-12 08:40:20.644535093 +0000 2026-02-12T08:50:22.412 INFO:teuthology.orchestra.run.trial025.stdout:Change: 2026-02-12 08:40:20.644535093 +0000 2026-02-12T08:50:22.412 INFO:teuthology.orchestra.run.trial025.stdout: Birth: 2026-02-12 08:40:20.644535093 +0000 2026-02-12T08:50:22.413 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T08:50:22.475 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records in 2026-02-12T08:50:22.475 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records out 2026-02-12T08:50:22.475 INFO:teuthology.orchestra.run.trial025.stderr:512 bytes copied, 0.00014558 s, 3.5 MB/s 2026-02-12T08:50:22.476 DEBUG:teuthology.orchestra.run.trial025:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T08:50:22.533 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T08:50:22.534 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial025.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-12T08:50:22.534 INFO:tasks.ceph:Generating config... 2026-02-12T08:50:22.537 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-12T08:50:22.537 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-12T08:50:22.537 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-12T08:50:22.537 INFO:tasks.ceph:[osd] debug filestore = 0/0 2026-02-12T08:50:22.537 INFO:tasks.ceph:[osd] debug journal = 0/0 2026-02-12T08:50:22.537 INFO:tasks.ceph:[osd] debug ms = 0/0 2026-02-12T08:50:22.537 INFO:tasks.ceph:[osd] debug osd = 0/0 2026-02-12T08:50:22.537 INFO:tasks.ceph:[osd] debug seastore = 20 2026-02-12T08:50:22.537 INFO:tasks.ceph:[osd] debug seastore backref = 20 2026-02-12T08:50:22.538 INFO:tasks.ceph:[osd] debug seastore cache = 20 2026-02-12T08:50:22.538 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2026-02-12T08:50:22.538 INFO:tasks.ceph:[osd] debug seastore device = 20 2026-02-12T08:50:22.538 INFO:tasks.ceph:[osd] debug seastore epm = 20 2026-02-12T08:50:22.538 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2026-02-12T08:50:22.538 INFO:tasks.ceph:[osd] debug seastore journal = 20 2026-02-12T08:50:22.538 INFO:tasks.ceph:[osd] debug seastore lba = 20 2026-02-12T08:50:22.538 INFO:tasks.ceph:[osd] debug seastore odata = 20 2026-02-12T08:50:22.538 INFO:tasks.ceph:[osd] debug seastore omap = 20 2026-02-12T08:50:22.538 INFO:tasks.ceph:[osd] debug seastore onode = 20 2026-02-12T08:50:22.538 INFO:tasks.ceph:[osd] debug seastore t = 20 2026-02-12T08:50:22.539 INFO:tasks.ceph:[osd] debug seastore tm = 20 2026-02-12T08:50:22.539 INFO:tasks.ceph:[osd] osd objectstore = seastore 2026-02-12T08:50:22.539 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-12T08:50:22.539 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-12T08:50:22.539 INFO:tasks.ceph:[osd] seastore cachepin type = 2Q 2026-02-12T08:50:22.539 INFO:tasks.ceph:[osd] seastore main device type = RANDOM_BLOCK_SSD 2026-02-12T08:50:22.539 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-12T08:50:22.539 INFO:tasks.ceph:[global] auth client required = none 2026-02-12T08:50:22.539 INFO:tasks.ceph:[global] auth cluster required = none 2026-02-12T08:50:22.539 INFO:tasks.ceph:[global] auth service required = none 2026-02-12T08:50:22.539 INFO:tasks.ceph:[global] auth supported = none 2026-02-12T08:50:22.540 INFO:tasks.ceph:[global] debug asok = 0/0 2026-02-12T08:50:22.540 INFO:tasks.ceph:[global] debug auth = 0/0 2026-02-12T08:50:22.540 INFO:tasks.ceph:[global] debug bdev = 0/0 2026-02-12T08:50:22.540 INFO:tasks.ceph:[global] debug bluefs = 0/0 2026-02-12T08:50:22.540 INFO:tasks.ceph:[global] debug bluestore = 0/0 2026-02-12T08:50:22.540 INFO:tasks.ceph:[global] debug buffer = 0/0 2026-02-12T08:50:22.540 INFO:tasks.ceph:[global] debug civetweb = 0/0 2026-02-12T08:50:22.540 INFO:tasks.ceph:[global] debug client = 0/0 2026-02-12T08:50:22.540 INFO:tasks.ceph:[global] debug compressor = 0/0 2026-02-12T08:50:22.540 INFO:tasks.ceph:[global] debug context = 0/0 2026-02-12T08:50:22.540 INFO:tasks.ceph:[global] debug crush = 0/0 2026-02-12T08:50:22.541 INFO:tasks.ceph:[global] debug crypto = 0/0 2026-02-12T08:50:22.541 INFO:tasks.ceph:[global] debug dpdk = 0/0 2026-02-12T08:50:22.541 INFO:tasks.ceph:[global] debug eventtrace = 0/0 2026-02-12T08:50:22.541 INFO:tasks.ceph:[global] debug filer = 0/0 2026-02-12T08:50:22.541 INFO:tasks.ceph:[global] debug filestore = 0/0 2026-02-12T08:50:22.541 INFO:tasks.ceph:[global] debug finisher = 0/0 2026-02-12T08:50:22.541 INFO:tasks.ceph:[global] debug fuse = 0/0 2026-02-12T08:50:22.541 INFO:tasks.ceph:[global] debug heartbeatmap = 0/0 2026-02-12T08:50:22.541 INFO:tasks.ceph:[global] debug javaclient = 0/0 2026-02-12T08:50:22.541 INFO:tasks.ceph:[global] debug journal = 0/0 2026-02-12T08:50:22.542 INFO:tasks.ceph:[global] debug journaler = 0/0 2026-02-12T08:50:22.542 INFO:tasks.ceph:[global] debug kstore = 0/0 2026-02-12T08:50:22.542 INFO:tasks.ceph:[global] debug leveldb = 0/0 2026-02-12T08:50:22.542 INFO:tasks.ceph:[global] debug lockdep = 0/0 2026-02-12T08:50:22.542 INFO:tasks.ceph:[global] debug mds = 0/0 2026-02-12T08:50:22.542 INFO:tasks.ceph:[global] debug mds balancer = 0/0 2026-02-12T08:50:22.542 INFO:tasks.ceph:[global] debug mds locker = 0/0 2026-02-12T08:50:22.542 INFO:tasks.ceph:[global] debug mds log = 0/0 2026-02-12T08:50:22.542 INFO:tasks.ceph:[global] debug mds log expire = 0/0 2026-02-12T08:50:22.542 INFO:tasks.ceph:[global] debug mds migrator = 0/0 2026-02-12T08:50:22.542 INFO:tasks.ceph:[global] debug memdb = 0/0 2026-02-12T08:50:22.542 INFO:tasks.ceph:[global] debug mgr = 0/0 2026-02-12T08:50:22.543 INFO:tasks.ceph:[global] debug mgrc = 0/0 2026-02-12T08:50:22.543 INFO:tasks.ceph:[global] debug mon = 0/0 2026-02-12T08:50:22.543 INFO:tasks.ceph:[global] debug monc = 0/0 2026-02-12T08:50:22.543 INFO:tasks.ceph:[global] debug ms = 0/0 2026-02-12T08:50:22.543 INFO:tasks.ceph:[global] debug objclass = 0/0 2026-02-12T08:50:22.543 INFO:tasks.ceph:[global] debug objectcacher = 0/0 2026-02-12T08:50:22.543 INFO:tasks.ceph:[global] debug objecter = 0/0 2026-02-12T08:50:22.543 INFO:tasks.ceph:[global] debug optracker = 0/0 2026-02-12T08:50:22.543 INFO:tasks.ceph:[global] debug osd = 0/0 2026-02-12T08:50:22.543 INFO:tasks.ceph:[global] debug paxos = 0/0 2026-02-12T08:50:22.543 INFO:tasks.ceph:[global] debug perfcounter = 0/0 2026-02-12T08:50:22.544 INFO:tasks.ceph:[global] debug rados = 0/0 2026-02-12T08:50:22.544 INFO:tasks.ceph:[global] debug rbd = 0/0 2026-02-12T08:50:22.544 INFO:tasks.ceph:[global] debug rbd mirror = 0/0 2026-02-12T08:50:22.544 INFO:tasks.ceph:[global] debug rbd replay = 0/0 2026-02-12T08:50:22.544 INFO:tasks.ceph:[global] debug refs = 0/0 2026-02-12T08:50:22.544 INFO:tasks.ceph:[global] debug rgw = 0/0 2026-02-12T08:50:22.544 INFO:tasks.ceph:[global] debug rgw lifecycle = 0/0 2026-02-12T08:50:22.544 INFO:tasks.ceph:[global] debug rgw notification = 0/0 2026-02-12T08:50:22.544 INFO:tasks.ceph:[global] debug rgw sync = 0/0 2026-02-12T08:50:22.544 INFO:tasks.ceph:[global] debug rocksdb = 0/0 2026-02-12T08:50:22.544 INFO:tasks.ceph:[global] debug striper = 0/0 2026-02-12T08:50:22.545 INFO:tasks.ceph:[global] debug throttle = 0/0 2026-02-12T08:50:22.545 INFO:tasks.ceph:[global] debug timer = 0/0 2026-02-12T08:50:22.545 INFO:tasks.ceph:[global] debug tp = 0/0 2026-02-12T08:50:22.545 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-12T08:50:22.545 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-12T08:50:22.545 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-12T08:50:22.545 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-12T08:50:22.545 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-12T08:50:22.545 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-12T08:50:22.545 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-12T08:50:22.545 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-12T08:50:22.546 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-12T08:50:22.546 INFO:tasks.ceph:[mon] debug mon = 0/0 2026-02-12T08:50:22.546 INFO:tasks.ceph:[mon] debug ms = 0/0 2026-02-12T08:50:22.546 INFO:tasks.ceph:[mon] debug paxos = 0/0 2026-02-12T08:50:22.546 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-12T08:50:22.546 INFO:tasks.ceph:Setting up mon.a... 2026-02-12T08:50:22.546 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-12T08:50:22.615 INFO:teuthology.orchestra.run.trial025.stdout:creating /etc/ceph/ceph.keyring 2026-02-12T08:50:22.618 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-12T08:50:22.704 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T08:50:22.729 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.25')] 2026-02-12T08:50:22.730 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'none', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.25', 'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': '0/0', 'debug mon': '0/0', 'debug paxos': '0/0', 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-12T08:50:22.732 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:50:22.732 DEBUG:teuthology.orchestra.run.trial025:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T08:50:22.788 DEBUG:teuthology.orchestra.run.trial025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.25 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:50:22.868 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:22.864+0000 7fb233c31f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:22.868 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:22.864+0000 7fb233c31f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:22.868 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:22.864+0000 7fb233c31f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:22.868 INFO:teuthology.orchestra.run.trial025.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:50:22.868 INFO:teuthology.orchestra.run.trial025.stdout:monmaptool: generated fsid 7dc82af0-8484-4b40-9c39-b1ef5b77f806 2026-02-12T08:50:22.869 INFO:teuthology.orchestra.run.trial025.stdout:setting min_mon_release = tentacle 2026-02-12T08:50:22.869 INFO:teuthology.orchestra.run.trial025.stdout:epoch 0 2026-02-12T08:50:22.869 INFO:teuthology.orchestra.run.trial025.stdout:fsid 7dc82af0-8484-4b40-9c39-b1ef5b77f806 2026-02-12T08:50:22.869 INFO:teuthology.orchestra.run.trial025.stdout:last_changed 2026-02-12T08:50:22.866587+0000 2026-02-12T08:50:22.869 INFO:teuthology.orchestra.run.trial025.stdout:created 2026-02-12T08:50:22.866587+0000 2026-02-12T08:50:22.869 INFO:teuthology.orchestra.run.trial025.stdout:min_mon_release 20 (tentacle) 2026-02-12T08:50:22.869 INFO:teuthology.orchestra.run.trial025.stdout:election_strategy: 1 2026-02-12T08:50:22.869 INFO:teuthology.orchestra.run.trial025.stdout:0: [v2:10.20.193.25:3300/0,v1:10.20.193.25:6789/0] mon.a 2026-02-12T08:50:22.869 INFO:teuthology.orchestra.run.trial025.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-12T08:50:22.870 DEBUG:teuthology.orchestra.run.trial025:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T08:50:22.928 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7dc82af0-8484-4b40-9c39-b1ef5b77f806... 2026-02-12T08:50:22.930 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T08:50:23.010 INFO:teuthology.orchestra.run.trial025.stdout:[global] 2026-02-12T08:50:23.010 INFO:teuthology.orchestra.run.trial025.stdout: chdir = "" 2026-02-12T08:50:23.010 INFO:teuthology.orchestra.run.trial025.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T08:50:23.011 INFO:teuthology.orchestra.run.trial025.stdout: auth supported = none 2026-02-12T08:50:23.011 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.011 INFO:teuthology.orchestra.run.trial025.stdout: filestore xattr use omap = true 2026-02-12T08:50:23.011 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.011 INFO:teuthology.orchestra.run.trial025.stdout: mon clock drift allowed = 1.000 2026-02-12T08:50:23.011 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.011 INFO:teuthology.orchestra.run.trial025.stdout: osd crush chooseleaf type = 0 2026-02-12T08:50:23.011 INFO:teuthology.orchestra.run.trial025.stdout: auth debug = true 2026-02-12T08:50:23.011 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.011 INFO:teuthology.orchestra.run.trial025.stdout: ms die on old message = true 2026-02-12T08:50:23.012 INFO:teuthology.orchestra.run.trial025.stdout: ms die on bug = true 2026-02-12T08:50:23.012 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.012 INFO:teuthology.orchestra.run.trial025.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T08:50:23.012 INFO:teuthology.orchestra.run.trial025.stdout: mon pg warn max object skew = 0 2026-02-12T08:50:23.012 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.012 INFO:teuthology.orchestra.run.trial025.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T08:50:23.012 INFO:teuthology.orchestra.run.trial025.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T08:50:23.012 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.012 INFO:teuthology.orchestra.run.trial025.stdout: osd pool default size = 2 2026-02-12T08:50:23.012 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.012 INFO:teuthology.orchestra.run.trial025.stdout: mon osd allow primary affinity = true 2026-02-12T08:50:23.012 INFO:teuthology.orchestra.run.trial025.stdout: mon osd allow pg remap = true 2026-02-12T08:50:23.013 INFO:teuthology.orchestra.run.trial025.stdout: mon warn on legacy crush tunables = false 2026-02-12T08:50:23.013 INFO:teuthology.orchestra.run.trial025.stdout: mon warn on crush straw calc version zero = false 2026-02-12T08:50:23.013 INFO:teuthology.orchestra.run.trial025.stdout: mon warn on no sortbitwise = false 2026-02-12T08:50:23.013 INFO:teuthology.orchestra.run.trial025.stdout: mon warn on osd down out interval zero = false 2026-02-12T08:50:23.013 INFO:teuthology.orchestra.run.trial025.stdout: mon warn on too few osds = false 2026-02-12T08:50:23.013 INFO:teuthology.orchestra.run.trial025.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T08:50:23.013 INFO:teuthology.orchestra.run.trial025.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T08:50:23.013 INFO:teuthology.orchestra.run.trial025.stdout: mon_allow_pool_size_one = true 2026-02-12T08:50:23.013 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.013 INFO:teuthology.orchestra.run.trial025.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T08:50:23.013 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.014 INFO:teuthology.orchestra.run.trial025.stdout: osd default data pool replay window = 5 2026-02-12T08:50:23.014 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.014 INFO:teuthology.orchestra.run.trial025.stdout: mon allow pool delete = true 2026-02-12T08:50:23.014 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.014 INFO:teuthology.orchestra.run.trial025.stdout: mon cluster log file level = debug 2026-02-12T08:50:23.014 INFO:teuthology.orchestra.run.trial025.stdout: debug asserts on shutdown = true 2026-02-12T08:50:23.015 INFO:teuthology.orchestra.run.trial025.stdout: mon health detail to clog = false 2026-02-12T08:50:23.015 INFO:teuthology.orchestra.run.trial025.stdout: mon host = 10.20.193.25 2026-02-12T08:50:23.015 INFO:teuthology.orchestra.run.trial025.stdout: auth client required = none 2026-02-12T08:50:23.015 INFO:teuthology.orchestra.run.trial025.stdout: auth cluster required = none 2026-02-12T08:50:23.015 INFO:teuthology.orchestra.run.trial025.stdout: auth service required = none 2026-02-12T08:50:23.015 INFO:teuthology.orchestra.run.trial025.stdout: debug asok = 0/0 2026-02-12T08:50:23.015 INFO:teuthology.orchestra.run.trial025.stdout: debug auth = 0/0 2026-02-12T08:50:23.015 INFO:teuthology.orchestra.run.trial025.stdout: debug bdev = 0/0 2026-02-12T08:50:23.015 INFO:teuthology.orchestra.run.trial025.stdout: debug bluefs = 0/0 2026-02-12T08:50:23.015 INFO:teuthology.orchestra.run.trial025.stdout: debug bluestore = 0/0 2026-02-12T08:50:23.015 INFO:teuthology.orchestra.run.trial025.stdout: debug buffer = 0/0 2026-02-12T08:50:23.015 INFO:teuthology.orchestra.run.trial025.stdout: debug civetweb = 0/0 2026-02-12T08:50:23.016 INFO:teuthology.orchestra.run.trial025.stdout: debug client = 0/0 2026-02-12T08:50:23.016 INFO:teuthology.orchestra.run.trial025.stdout: debug compressor = 0/0 2026-02-12T08:50:23.016 INFO:teuthology.orchestra.run.trial025.stdout: debug context = 0/0 2026-02-12T08:50:23.016 INFO:teuthology.orchestra.run.trial025.stdout: debug crush = 0/0 2026-02-12T08:50:23.016 INFO:teuthology.orchestra.run.trial025.stdout: debug crypto = 0/0 2026-02-12T08:50:23.016 INFO:teuthology.orchestra.run.trial025.stdout: debug dpdk = 0/0 2026-02-12T08:50:23.016 INFO:teuthology.orchestra.run.trial025.stdout: debug eventtrace = 0/0 2026-02-12T08:50:23.016 INFO:teuthology.orchestra.run.trial025.stdout: debug filer = 0/0 2026-02-12T08:50:23.016 INFO:teuthology.orchestra.run.trial025.stdout: debug filestore = 0/0 2026-02-12T08:50:23.016 INFO:teuthology.orchestra.run.trial025.stdout: debug finisher = 0/0 2026-02-12T08:50:23.016 INFO:teuthology.orchestra.run.trial025.stdout: debug fuse = 0/0 2026-02-12T08:50:23.016 INFO:teuthology.orchestra.run.trial025.stdout: debug heartbeatmap = 0/0 2026-02-12T08:50:23.016 INFO:teuthology.orchestra.run.trial025.stdout: debug javaclient = 0/0 2026-02-12T08:50:23.017 INFO:teuthology.orchestra.run.trial025.stdout: debug journal = 0/0 2026-02-12T08:50:23.017 INFO:teuthology.orchestra.run.trial025.stdout: debug journaler = 0/0 2026-02-12T08:50:23.017 INFO:teuthology.orchestra.run.trial025.stdout: debug kstore = 0/0 2026-02-12T08:50:23.017 INFO:teuthology.orchestra.run.trial025.stdout: debug leveldb = 0/0 2026-02-12T08:50:23.017 INFO:teuthology.orchestra.run.trial025.stdout: debug lockdep = 0/0 2026-02-12T08:50:23.017 INFO:teuthology.orchestra.run.trial025.stdout: debug mds = 0/0 2026-02-12T08:50:23.017 INFO:teuthology.orchestra.run.trial025.stdout: debug mds balancer = 0/0 2026-02-12T08:50:23.017 INFO:teuthology.orchestra.run.trial025.stdout: debug mds locker = 0/0 2026-02-12T08:50:23.017 INFO:teuthology.orchestra.run.trial025.stdout: debug mds log = 0/0 2026-02-12T08:50:23.017 INFO:teuthology.orchestra.run.trial025.stdout: debug mds log expire = 0/0 2026-02-12T08:50:23.017 INFO:teuthology.orchestra.run.trial025.stdout: debug mds migrator = 0/0 2026-02-12T08:50:23.017 INFO:teuthology.orchestra.run.trial025.stdout: debug memdb = 0/0 2026-02-12T08:50:23.018 INFO:teuthology.orchestra.run.trial025.stdout: debug mgr = 0/0 2026-02-12T08:50:23.018 INFO:teuthology.orchestra.run.trial025.stdout: debug mgrc = 0/0 2026-02-12T08:50:23.018 INFO:teuthology.orchestra.run.trial025.stdout: debug mon = 0/0 2026-02-12T08:50:23.018 INFO:teuthology.orchestra.run.trial025.stdout: debug monc = 0/0 2026-02-12T08:50:23.018 INFO:teuthology.orchestra.run.trial025.stdout: debug ms = 0/0 2026-02-12T08:50:23.018 INFO:teuthology.orchestra.run.trial025.stdout: debug objclass = 0/0 2026-02-12T08:50:23.018 INFO:teuthology.orchestra.run.trial025.stdout: debug objectcacher = 0/0 2026-02-12T08:50:23.018 INFO:teuthology.orchestra.run.trial025.stdout: debug objecter = 0/0 2026-02-12T08:50:23.018 INFO:teuthology.orchestra.run.trial025.stdout: debug optracker = 0/0 2026-02-12T08:50:23.018 INFO:teuthology.orchestra.run.trial025.stdout: debug osd = 0/0 2026-02-12T08:50:23.018 INFO:teuthology.orchestra.run.trial025.stdout: debug paxos = 0/0 2026-02-12T08:50:23.018 INFO:teuthology.orchestra.run.trial025.stdout: debug perfcounter = 0/0 2026-02-12T08:50:23.018 INFO:teuthology.orchestra.run.trial025.stdout: debug rados = 0/0 2026-02-12T08:50:23.019 INFO:teuthology.orchestra.run.trial025.stdout: debug rbd = 0/0 2026-02-12T08:50:23.019 INFO:teuthology.orchestra.run.trial025.stdout: debug rbd mirror = 0/0 2026-02-12T08:50:23.019 INFO:teuthology.orchestra.run.trial025.stdout: debug rbd replay = 0/0 2026-02-12T08:50:23.019 INFO:teuthology.orchestra.run.trial025.stdout: debug refs = 0/0 2026-02-12T08:50:23.019 INFO:teuthology.orchestra.run.trial025.stdout: debug rgw = 0/0 2026-02-12T08:50:23.019 INFO:teuthology.orchestra.run.trial025.stdout: debug rgw lifecycle = 0/0 2026-02-12T08:50:23.019 INFO:teuthology.orchestra.run.trial025.stdout: debug rgw notification = 0/0 2026-02-12T08:50:23.019 INFO:teuthology.orchestra.run.trial025.stdout: debug rgw sync = 0/0 2026-02-12T08:50:23.019 INFO:teuthology.orchestra.run.trial025.stdout: debug rocksdb = 0/0 2026-02-12T08:50:23.019 INFO:teuthology.orchestra.run.trial025.stdout: debug striper = 0/0 2026-02-12T08:50:23.019 INFO:teuthology.orchestra.run.trial025.stdout: debug throttle = 0/0 2026-02-12T08:50:23.019 INFO:teuthology.orchestra.run.trial025.stdout: debug timer = 0/0 2026-02-12T08:50:23.020 INFO:teuthology.orchestra.run.trial025.stdout: debug tp = 0/0 2026-02-12T08:50:23.020 INFO:teuthology.orchestra.run.trial025.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-12T08:50:23.020 INFO:teuthology.orchestra.run.trial025.stdout: ms client mode = crc 2026-02-12T08:50:23.020 INFO:teuthology.orchestra.run.trial025.stdout: ms cluster mode = crc 2026-02-12T08:50:23.020 INFO:teuthology.orchestra.run.trial025.stdout: ms mon client mode = crc 2026-02-12T08:50:23.020 INFO:teuthology.orchestra.run.trial025.stdout: ms mon cluster mode = crc 2026-02-12T08:50:23.020 INFO:teuthology.orchestra.run.trial025.stdout: ms mon service mode = crc 2026-02-12T08:50:23.020 INFO:teuthology.orchestra.run.trial025.stdout: ms service mode = crc 2026-02-12T08:50:23.020 INFO:teuthology.orchestra.run.trial025.stdout: fsid = 7dc82af0-8484-4b40-9c39-b1ef5b77f806 2026-02-12T08:50:23.020 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.020 INFO:teuthology.orchestra.run.trial025.stdout:[osd] 2026-02-12T08:50:23.020 INFO:teuthology.orchestra.run.trial025.stdout: osd journal size = 100 2026-02-12T08:50:23.020 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.021 INFO:teuthology.orchestra.run.trial025.stdout: osd scrub load threshold = 5.0 2026-02-12T08:50:23.021 INFO:teuthology.orchestra.run.trial025.stdout: osd scrub max interval = 600 2026-02-12T08:50:23.021 INFO:teuthology.orchestra.run.trial025.stdout: osd mclock profile = high_recovery_ops 2026-02-12T08:50:23.021 INFO:teuthology.orchestra.run.trial025.stdout: osd mclock skip benchmark = true 2026-02-12T08:50:23.021 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.021 INFO:teuthology.orchestra.run.trial025.stdout: osd recover clone overlap = true 2026-02-12T08:50:23.021 INFO:teuthology.orchestra.run.trial025.stdout: osd recovery max chunk = 1048576 2026-02-12T08:50:23.021 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.021 INFO:teuthology.orchestra.run.trial025.stdout: osd debug shutdown = true 2026-02-12T08:50:23.021 INFO:teuthology.orchestra.run.trial025.stdout: osd debug op order = true 2026-02-12T08:50:23.021 INFO:teuthology.orchestra.run.trial025.stdout: osd debug verify stray on activate = true 2026-02-12T08:50:23.022 INFO:teuthology.orchestra.run.trial025.stdout: osd debug trim objects = true 2026-02-12T08:50:23.022 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.022 INFO:teuthology.orchestra.run.trial025.stdout: osd open classes on start = true 2026-02-12T08:50:23.022 INFO:teuthology.orchestra.run.trial025.stdout: osd debug pg log writeout = true 2026-02-12T08:50:23.022 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.022 INFO:teuthology.orchestra.run.trial025.stdout: osd deep scrub update digest min age = 30 2026-02-12T08:50:23.022 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.022 INFO:teuthology.orchestra.run.trial025.stdout: osd map max advance = 10 2026-02-12T08:50:23.022 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.022 INFO:teuthology.orchestra.run.trial025.stdout: journal zero on create = true 2026-02-12T08:50:23.022 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.022 INFO:teuthology.orchestra.run.trial025.stdout: filestore ondisk finisher threads = 3 2026-02-12T08:50:23.023 INFO:teuthology.orchestra.run.trial025.stdout: filestore apply finisher threads = 3 2026-02-12T08:50:23.023 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.023 INFO:teuthology.orchestra.run.trial025.stdout: bdev debug aio = true 2026-02-12T08:50:23.023 INFO:teuthology.orchestra.run.trial025.stdout: osd debug misdirected ops = true 2026-02-12T08:50:23.023 INFO:teuthology.orchestra.run.trial025.stdout: debug monc = 20 2026-02-12T08:50:23.023 INFO:teuthology.orchestra.run.trial025.stdout: crimson cpu num = 4 2026-02-12T08:50:23.023 INFO:teuthology.orchestra.run.trial025.stdout: crimson osd obc lru size = 10 2026-02-12T08:50:23.023 INFO:teuthology.orchestra.run.trial025.stdout: debug filestore = 0/0 2026-02-12T08:50:23.023 INFO:teuthology.orchestra.run.trial025.stdout: debug journal = 0/0 2026-02-12T08:50:23.023 INFO:teuthology.orchestra.run.trial025.stdout: debug ms = 0/0 2026-02-12T08:50:23.023 INFO:teuthology.orchestra.run.trial025.stdout: debug osd = 0/0 2026-02-12T08:50:23.023 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore = 20 2026-02-12T08:50:23.023 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore backref = 20 2026-02-12T08:50:23.024 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore cache = 20 2026-02-12T08:50:23.024 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore cleaner = 20 2026-02-12T08:50:23.024 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore device = 20 2026-02-12T08:50:23.024 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore epm = 20 2026-02-12T08:50:23.024 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore fixedkv tree = 20 2026-02-12T08:50:23.024 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore journal = 20 2026-02-12T08:50:23.024 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore lba = 20 2026-02-12T08:50:23.024 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore odata = 20 2026-02-12T08:50:23.024 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore omap = 20 2026-02-12T08:50:23.024 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore onode = 20 2026-02-12T08:50:23.024 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore t = 20 2026-02-12T08:50:23.024 INFO:teuthology.orchestra.run.trial025.stdout: debug seastore tm = 20 2026-02-12T08:50:23.024 INFO:teuthology.orchestra.run.trial025.stdout: osd objectstore = seastore 2026-02-12T08:50:23.025 INFO:teuthology.orchestra.run.trial025.stdout: osd shutdown pgref assert = True 2026-02-12T08:50:23.025 INFO:teuthology.orchestra.run.trial025.stdout: seastore cachepin size pershard = 64M 2026-02-12T08:50:23.025 INFO:teuthology.orchestra.run.trial025.stdout: seastore cachepin type = 2Q 2026-02-12T08:50:23.025 INFO:teuthology.orchestra.run.trial025.stdout: seastore main device type = RANDOM_BLOCK_SSD 2026-02-12T08:50:23.025 INFO:teuthology.orchestra.run.trial025.stdout: seastore max concurrent transactions = 8 2026-02-12T08:50:23.025 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.025 INFO:teuthology.orchestra.run.trial025.stdout:[mgr] 2026-02-12T08:50:23.025 INFO:teuthology.orchestra.run.trial025.stdout: debug ms = 1 2026-02-12T08:50:23.025 INFO:teuthology.orchestra.run.trial025.stdout: debug mgr = 20 2026-02-12T08:50:23.025 INFO:teuthology.orchestra.run.trial025.stdout: debug mon = 20 2026-02-12T08:50:23.025 INFO:teuthology.orchestra.run.trial025.stdout: debug auth = 20 2026-02-12T08:50:23.025 INFO:teuthology.orchestra.run.trial025.stdout: mon reweight min pgs per osd = 4 2026-02-12T08:50:23.026 INFO:teuthology.orchestra.run.trial025.stdout: mon reweight min bytes per osd = 10 2026-02-12T08:50:23.026 INFO:teuthology.orchestra.run.trial025.stdout: mgr/telemetry/nag = false 2026-02-12T08:50:23.026 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.026 INFO:teuthology.orchestra.run.trial025.stdout:[mon] 2026-02-12T08:50:23.026 INFO:teuthology.orchestra.run.trial025.stdout: debug ms = 0/0 2026-02-12T08:50:23.026 INFO:teuthology.orchestra.run.trial025.stdout: debug mon = 0/0 2026-02-12T08:50:23.026 INFO:teuthology.orchestra.run.trial025.stdout: debug paxos = 0/0 2026-02-12T08:50:23.026 INFO:teuthology.orchestra.run.trial025.stdout: debug auth = 20 2026-02-12T08:50:23.026 INFO:teuthology.orchestra.run.trial025.stdout: mon data avail warn = 5 2026-02-12T08:50:23.027 INFO:teuthology.orchestra.run.trial025.stdout: mon mgr mkfs grace = 240 2026-02-12T08:50:23.027 INFO:teuthology.orchestra.run.trial025.stdout: mon reweight min pgs per osd = 4 2026-02-12T08:50:23.027 INFO:teuthology.orchestra.run.trial025.stdout: mon osd reporter subtree level = osd 2026-02-12T08:50:23.027 INFO:teuthology.orchestra.run.trial025.stdout: mon osd prime pg temp = true 2026-02-12T08:50:23.027 INFO:teuthology.orchestra.run.trial025.stdout: mon reweight min bytes per osd = 10 2026-02-12T08:50:23.027 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.028 INFO:teuthology.orchestra.run.trial025.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T08:50:23.028 INFO:teuthology.orchestra.run.trial025.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T08:50:23.028 INFO:teuthology.orchestra.run.trial025.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T08:50:23.028 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.028 INFO:teuthology.orchestra.run.trial025.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T08:50:23.028 INFO:teuthology.orchestra.run.trial025.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T08:50:23.028 INFO:teuthology.orchestra.run.trial025.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T08:50:23.028 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.029 INFO:teuthology.orchestra.run.trial025.stdout: # 1m isn't quite enough 2026-02-12T08:50:23.029 INFO:teuthology.orchestra.run.trial025.stdout: mon_down_mkfs_grace = 2m 2026-02-12T08:50:23.029 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.029 INFO:teuthology.orchestra.run.trial025.stdout: mon_warn_on_filestore_osds = false 2026-02-12T08:50:23.029 INFO:teuthology.orchestra.run.trial025.stdout: osd pool default crimson = True 2026-02-12T08:50:23.029 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:23.029 INFO:teuthology.orchestra.run.trial025.stdout:[client] 2026-02-12T08:50:23.029 INFO:teuthology.orchestra.run.trial025.stdout: rgw cache enabled = true 2026-02-12T08:50:23.029 INFO:teuthology.orchestra.run.trial025.stdout: rgw enable ops log = true 2026-02-12T08:50:23.029 INFO:teuthology.orchestra.run.trial025.stdout: rgw enable usage log = true 2026-02-12T08:50:23.029 INFO:teuthology.orchestra.run.trial025.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T08:50:23.030 INFO:teuthology.orchestra.run.trial025.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T08:50:23.030 INFO:teuthology.orchestra.run.trial025.stdout:[mon.a] 2026-02-12T08:50:23.031 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-12T08:50:23.031 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-12T08:50:23.122 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-12T08:50:23.122 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:50:23.123 DEBUG:teuthology.orchestra.run.trial025:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-12T08:50:23.139 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:50:23.139 DEBUG:teuthology.orchestra.run.trial025:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-12T08:50:23.196 INFO:tasks.ceph:Sending monmap to node ubuntu@trial025.front.sepia.ceph.com 2026-02-12T08:50:23.196 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:50:23.196 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T08:50:23.196 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T08:50:23.268 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:50:23.269 DEBUG:teuthology.orchestra.run.trial025:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:50:23.324 INFO:tasks.ceph:Setting up mon nodes... 2026-02-12T08:50:23.324 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-12T08:50:23.324 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T08:50:23.415 INFO:teuthology.orchestra.run.trial025.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T08:50:23.418 INFO:tasks.ceph:Setting up mds nodes... 2026-02-12T08:50:23.418 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-12T08:50:23.419 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-12T08:50:23.460 INFO:teuthology.orchestra.run.trial025.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-12T08:50:23.472 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-12T08:50:23.473 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial025.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-12T08:50:23.473 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-12T08:50:23.538 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T08:50:23.538 INFO:tasks.ceph:role: osd.0 2026-02-12T08:50:23.538 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial025.front.sepia.ceph.com 2026-02-12T08:50:23.538 DEBUG:teuthology.orchestra.run.trial025:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T08:50:23.603 INFO:teuthology.orchestra.run.trial025.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T08:50:23.604 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T08:50:23.604 INFO:teuthology.orchestra.run.trial025.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T08:50:23.604 INFO:teuthology.orchestra.run.trial025.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T08:50:23.604 INFO:teuthology.orchestra.run.trial025.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T08:50:23.604 INFO:teuthology.orchestra.run.trial025.stdout: = sunit=0 swidth=0 blks 2026-02-12T08:50:23.604 INFO:teuthology.orchestra.run.trial025.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T08:50:23.604 INFO:teuthology.orchestra.run.trial025.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T08:50:23.604 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T08:50:23.604 INFO:teuthology.orchestra.run.trial025.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T08:50:24.176 INFO:teuthology.orchestra.run.trial025.stdout:Discarding blocks...Done. 2026-02-12T08:50:24.178 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial025.front.sepia.ceph.com -o noatime 2026-02-12T08:50:24.178 DEBUG:teuthology.orchestra.run.trial025:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-12T08:50:24.247 DEBUG:teuthology.orchestra.run.trial025:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-12T08:50:24.313 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-12T08:50:24.377 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T08:50:24.377 INFO:tasks.ceph:role: osd.1 2026-02-12T08:50:24.377 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial025.front.sepia.ceph.com 2026-02-12T08:50:24.378 DEBUG:teuthology.orchestra.run.trial025:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T08:50:24.442 INFO:teuthology.orchestra.run.trial025.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T08:50:24.442 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T08:50:24.442 INFO:teuthology.orchestra.run.trial025.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T08:50:24.442 INFO:teuthology.orchestra.run.trial025.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T08:50:24.442 INFO:teuthology.orchestra.run.trial025.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T08:50:24.442 INFO:teuthology.orchestra.run.trial025.stdout: = sunit=0 swidth=0 blks 2026-02-12T08:50:24.442 INFO:teuthology.orchestra.run.trial025.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T08:50:24.442 INFO:teuthology.orchestra.run.trial025.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T08:50:24.442 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T08:50:24.443 INFO:teuthology.orchestra.run.trial025.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T08:50:24.998 INFO:teuthology.orchestra.run.trial025.stdout:Discarding blocks...Done. 2026-02-12T08:50:25.000 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial025.front.sepia.ceph.com -o noatime 2026-02-12T08:50:25.001 DEBUG:teuthology.orchestra.run.trial025:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-12T08:50:25.067 DEBUG:teuthology.orchestra.run.trial025:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-12T08:50:25.138 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-12T08:50:25.204 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T08:50:25.204 INFO:tasks.ceph:role: osd.2 2026-02-12T08:50:25.204 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial025.front.sepia.ceph.com 2026-02-12T08:50:25.204 DEBUG:teuthology.orchestra.run.trial025:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-12T08:50:25.269 INFO:teuthology.orchestra.run.trial025.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T08:50:25.269 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T08:50:25.269 INFO:teuthology.orchestra.run.trial025.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T08:50:25.269 INFO:teuthology.orchestra.run.trial025.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T08:50:25.269 INFO:teuthology.orchestra.run.trial025.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T08:50:25.269 INFO:teuthology.orchestra.run.trial025.stdout: = sunit=0 swidth=0 blks 2026-02-12T08:50:25.269 INFO:teuthology.orchestra.run.trial025.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T08:50:25.269 INFO:teuthology.orchestra.run.trial025.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T08:50:25.269 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T08:50:25.270 INFO:teuthology.orchestra.run.trial025.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T08:50:25.838 INFO:teuthology.orchestra.run.trial025.stdout:Discarding blocks...Done. 2026-02-12T08:50:25.840 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial025.front.sepia.ceph.com -o noatime 2026-02-12T08:50:25.840 DEBUG:teuthology.orchestra.run.trial025:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-12T08:50:25.908 DEBUG:teuthology.orchestra.run.trial025:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-12T08:50:25.978 DEBUG:teuthology.orchestra.run.trial025:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:50:26.125 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T08:50:26.178 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:26,177 seastar - Reactor backend: linux-aio 2026-02-12T08:50:26.190 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:26,188 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:50:26.190 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:26,188 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:50:26.192 INFO:teuthology.orchestra.run.trial025.stderr:==20624==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:50:26.251 INFO:teuthology.orchestra.run.trial025.stderr:DEBUG 2026-02-12 08:50:26,250 [shard 0:main] seastar - reactor::drain 2026-02-12T08:50:28.360 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T08:50:28.360 INFO:teuthology.orchestra.run.trial025.stderr:Suppressions used: 2026-02-12T08:50:28.360 INFO:teuthology.orchestra.run.trial025.stderr: count bytes template 2026-02-12T08:50:28.361 INFO:teuthology.orchestra.run.trial025.stderr: 1 8 MallocExtension::Register 2026-02-12T08:50:28.361 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T08:50:28.361 INFO:teuthology.orchestra.run.trial025.stderr: 2026-02-12T08:50:28.379 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T08:50:28.379 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T08:50:28.422 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T08:50:28.423 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T08:50:28.430 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:28,428 seastar - Reactor backend: linux-aio 2026-02-12T08:50:28.448 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:28,446 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:50:28.448 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:28,446 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:50:28.453 INFO:teuthology.orchestra.run.trial025.stderr:==20622==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:50:28.453 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:28,452 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T08:50:28.595 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0xe1d410 0x7bd6fde 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:28.595 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x9c890b5 0x9cf4c96 0x9cf5490 0x9d04526 0x9d06fb1 0x9d071c2 0x9d0726e 0x9d2f38d 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:28.595 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x9c3e081 0x9c3fc67 0x9c401b4 0x9c403b3 0x9d256d5 0x9d25e30 0x9d300be 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:28.749 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x9c3d97f 0x9c3dccd 0x9c3df40 0x9c3ef40 0x9c46fc3 0x9c4733f 0x9d2fe8c 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:28.750 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x157d4 0x9c3df94 0x9c3e1f6 0x9c3e7b8 0x9c46c5f 0x9c4733f 0x9d2fe8c 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:28.750 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x3169462 0x9c3dcae 0x9c3df40 0x9c3fc67 0x9c401b4 0x9c403b3 0x9d256d5 0x9d25e30 0x9d300be 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:30.950 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T08:50:30.950 INFO:teuthology.orchestra.run.trial025.stderr:Suppressions used: 2026-02-12T08:50:30.950 INFO:teuthology.orchestra.run.trial025.stderr: count bytes template 2026-02-12T08:50:30.950 INFO:teuthology.orchestra.run.trial025.stderr: 1 8 MallocExtension::Register 2026-02-12T08:50:30.950 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T08:50:30.950 INFO:teuthology.orchestra.run.trial025.stderr: 2026-02-12T08:50:30.981 DEBUG:teuthology.orchestra.run.trial025:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-12T08:50:31.007 DEBUG:teuthology.orchestra.run.trial025:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:50:31.157 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T08:50:31.213 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:31,211 seastar - Reactor backend: linux-aio 2026-02-12T08:50:31.222 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:31,221 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:50:31.223 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:31,221 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:50:31.225 INFO:teuthology.orchestra.run.trial025.stderr:==20692==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:50:31.284 INFO:teuthology.orchestra.run.trial025.stderr:DEBUG 2026-02-12 08:50:31,283 [shard 0:main] seastar - reactor::drain 2026-02-12T08:50:33.402 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T08:50:33.402 INFO:teuthology.orchestra.run.trial025.stderr:Suppressions used: 2026-02-12T08:50:33.402 INFO:teuthology.orchestra.run.trial025.stderr: count bytes template 2026-02-12T08:50:33.402 INFO:teuthology.orchestra.run.trial025.stderr: 1 8 MallocExtension::Register 2026-02-12T08:50:33.402 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T08:50:33.403 INFO:teuthology.orchestra.run.trial025.stderr: 2026-02-12T08:50:33.422 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T08:50:33.422 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T08:50:33.466 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T08:50:33.467 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T08:50:33.473 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:33,472 seastar - Reactor backend: linux-aio 2026-02-12T08:50:33.482 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:33,480 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:50:33.482 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:33,480 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:50:33.486 INFO:teuthology.orchestra.run.trial025.stderr:==20690==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:50:33.486 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:33,484 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T08:50:33.629 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x9c3dd78 0x9c3e1f6 0x9c3e7b8 0x9c46c5f 0x9c4733f 0x9d2fe8c 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:33.629 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0xb6e1c6 0x731c4bd 0x731c647 0x73c68cf 0x7149b9c 0x7bd6a2c 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:33.629 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cbef /lib64/libasan.so.8+0x1006bc /lib64/libasan.so.8+0xc6619 /lib64/libasan.so.8+0x157e7 0x10904af 0xf2dc9c 0x9c3d803 0x9c3dccd 0x9c3df40 0x9c3fc67 0x9c401b4 0x9c403b3 0x9d256d5 0x9d25e30 0x9d300be 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:33.775 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x316a758 0x9c3df2e 0x9c3e1f6 0x9c3eca5 0x9c3f1a3 0x9c3f7d3 0x9c3f93d 0x9d1fcad 0x9d32ab0 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:33.776 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x31692c5 0x9c3dc6b 0x9c3df40 0x9c3fc67 0x9d238ea 0x9d25290 0x9d258ea 0x9d25e30 0x9d300be 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:33.776 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0xcb01c7 0x109038c 0xf2dc9c 0x9c3d9d0 0x9c3dccd 0x9c3df40 0x9c3e1f6 0x9c3e7b8 0x9c46c5f 0x9c4733f 0x9d2fe8c 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:35.936 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T08:50:35.936 INFO:teuthology.orchestra.run.trial025.stderr:Suppressions used: 2026-02-12T08:50:35.936 INFO:teuthology.orchestra.run.trial025.stderr: count bytes template 2026-02-12T08:50:35.936 INFO:teuthology.orchestra.run.trial025.stderr: 1 8 MallocExtension::Register 2026-02-12T08:50:35.936 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T08:50:35.936 INFO:teuthology.orchestra.run.trial025.stderr: 2026-02-12T08:50:35.967 DEBUG:teuthology.orchestra.run.trial025:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-12T08:50:35.992 DEBUG:teuthology.orchestra.run.trial025:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:50:36.142 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T08:50:36.195 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:36,193 seastar - Reactor backend: linux-aio 2026-02-12T08:50:36.205 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:36,203 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:50:36.205 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:36,203 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:50:36.207 INFO:teuthology.orchestra.run.trial025.stderr:==20758==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:50:36.268 INFO:teuthology.orchestra.run.trial025.stderr:DEBUG 2026-02-12 08:50:36,267 [shard 0:main] seastar - reactor::drain 2026-02-12T08:50:38.377 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T08:50:38.377 INFO:teuthology.orchestra.run.trial025.stderr:Suppressions used: 2026-02-12T08:50:38.377 INFO:teuthology.orchestra.run.trial025.stderr: count bytes template 2026-02-12T08:50:38.377 INFO:teuthology.orchestra.run.trial025.stderr: 1 8 MallocExtension::Register 2026-02-12T08:50:38.377 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T08:50:38.378 INFO:teuthology.orchestra.run.trial025.stderr: 2026-02-12T08:50:38.397 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T08:50:38.397 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T08:50:38.441 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T08:50:38.442 INFO:teuthology.orchestra.run.trial025.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T08:50:38.449 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:38,447 seastar - Reactor backend: linux-aio 2026-02-12T08:50:38.456 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:38,455 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:50:38.457 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:38,455 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T08:50:38.462 INFO:teuthology.orchestra.run.trial025.stderr:==20756==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T08:50:38.462 INFO:teuthology.orchestra.run.trial025.stderr:INFO 2026-02-12 08:50:38,461 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T08:50:38.605 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc589 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7fc 0x9c967d5 0x9c96894 0x9c96b3c 0x9d2512b 0x9d258ea 0x9d25e30 0x9d300be 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:38.606 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0xcb01f0 0x109038c 0xf2dc9c 0x9c3d9d0 0x9c3dccd 0x9c3df40 0x9c3fc67 0x9d25bc1 0x9d25e30 0x9d300be 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:38.606 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f 0x77fad8b 0x9b11f66 0x9d339db 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f906da 0x6f944db 0x6f9a085 0x7408a8a 0x742b492 0x727f2b9 0x727f3b1 0x7351548 0x7351601 0x73517b8 0x742b513 0x727f42e 0x727f4b3 0x72ab251 0x741391a 0x741399f 0x7413a7d 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:38.758 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xfcb33 /lib64/libasan.so.8+0xb142f 0xa5c3d96 0x9d354f0 0x9d356d7 0x9d358a0 0x9d35933 0x9d36778 0x788188f 0x7bd6cd5 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:38.758 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/ld-linux-x86-64.so.2+0x16ec6 /lib64/libasan.so.8+0xc6611 /lib64/libasan.so.8+0x151b7 0x1124fe8 0xf2dc91 0x9c3d9d0 0x9c3dccd 0x9c3df40 0x9c3e1f6 0x9c3eca5 0x9c3f1a3 0x9c3f7d3 0x9c3f93d 0x9d1fcad 0x9d32ab0 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:38.759 INFO:teuthology.orchestra.run.trial025.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e14eec 0x9e151d5 0x9e75b73 0x9e76366 0x9e765d4 0x9e7671c 0x9e76bdb /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x511f /lib64/libasan.so.8+0xb0599 /lib64/libasan.so.8+0xb1477 0xb69317 0x1090438 0xf2dc9c 0x9d2060d 0x9d20bfa 0x9d20f7d 0x9d310d4 0x9d34537 0x9cf4b05 0x9cf3b05 0x7bd73a3 0x7be0f12 0x7a3027b 0x7a6d86f 0x710f04d 0x6f336f2 0x6f35a5a 0x7473988 0x729685f 0x7296961 0x7296a59 0x7350714 0x73507cd 0x7350980 0x7350ab8 0x7350b33 0x7350bb8 0x7350d13 0x7413397 0x7473a11 0x727dcf4 0x7296bd6 0x73a49b2 0x741fcb0 0x741fd2b 0x741fda6 0x74e35b8 0x75d8e38 0x9ecfa3b 0x9e23d10 0x9efd4ab 0x9f65c8e 0x9f8071e 0x9f80d9a 0x26e4fbb 0xa58eca0 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T08:50:40.948 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T08:50:40.948 INFO:teuthology.orchestra.run.trial025.stderr:Suppressions used: 2026-02-12T08:50:40.948 INFO:teuthology.orchestra.run.trial025.stderr: count bytes template 2026-02-12T08:50:40.948 INFO:teuthology.orchestra.run.trial025.stderr: 1 8 MallocExtension::Register 2026-02-12T08:50:40.949 INFO:teuthology.orchestra.run.trial025.stderr:----------------------------------------------------- 2026-02-12T08:50:40.949 INFO:teuthology.orchestra.run.trial025.stderr: 2026-02-12T08:50:40.978 DEBUG:teuthology.orchestra.run.trial025:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-12T08:50:41.003 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-12T08:50:41.003 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:50:41.004 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-12T08:50:41.069 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:50:41.069 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-12T08:50:41.132 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:50:41.133 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-12T08:50:41.195 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:50:41.196 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-12T08:50:41.259 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:50:41.259 DEBUG:teuthology.orchestra.run.trial025:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-12T08:50:41.315 INFO:tasks.ceph:Adding keys to all mons... 2026-02-12T08:50:41.315 DEBUG:teuthology.orchestra.run.trial025:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-12T08:50:41.377 INFO:teuthology.orchestra.run.trial025.stdout:[mgr.x] 2026-02-12T08:50:41.377 INFO:teuthology.orchestra.run.trial025.stdout: key = AQBPlI1pOYKvGBAArB0QQAoZA5Tew23EyOJnOw== 2026-02-12T08:50:41.377 INFO:teuthology.orchestra.run.trial025.stdout:[osd.0] 2026-02-12T08:50:41.378 INFO:teuthology.orchestra.run.trial025.stdout: key = AQBUlI1p+pLPHhAAwp1dPi6zdayNL+Qr1+HhGg== 2026-02-12T08:50:41.378 INFO:teuthology.orchestra.run.trial025.stdout:[osd.1] 2026-02-12T08:50:41.378 INFO:teuthology.orchestra.run.trial025.stdout: key = AQBZlI1p6nTqIBAAtU7dN+Dn3B8bDcLPdvTNhQ== 2026-02-12T08:50:41.378 INFO:teuthology.orchestra.run.trial025.stdout:[osd.2] 2026-02-12T08:50:41.378 INFO:teuthology.orchestra.run.trial025.stdout: key = AQBelI1px+huHxAAFOXR3ipw2gEhtZZXoJrz6Q== 2026-02-12T08:50:41.378 INFO:teuthology.orchestra.run.trial025.stdout:[client.0] 2026-02-12T08:50:41.378 INFO:teuthology.orchestra.run.trial025.stdout: key = AQBPlI1pNc5hGxAAc2CG5oWEm5I+jBff2Aznfw== 2026-02-12T08:50:41.379 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-12T08:50:41.468 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T08:50:41.516 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T08:50:41.565 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T08:50:41.614 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-12T08:50:41.665 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-12T08:50:41.665 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-12T08:50:41.690 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T08:50:41.774 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:41.771+0000 7f1c4828ac00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:41.775 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:41.771+0000 7f1c4828ac00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:41.782 DEBUG:teuthology.orchestra.run.trial025:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-12T08:50:41.806 DEBUG:teuthology.orchestra.run.trial025:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-12T08:50:41.864 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-12T08:50:41.864 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-12T08:50:41.864 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-12T08:50:41.906 INFO:tasks.ceph.mon.a:Started 2026-02-12T08:50:41.906 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-12T08:50:41.907 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-12T08:50:41.907 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-12T08:50:41.909 INFO:tasks.ceph.mgr.x:Started 2026-02-12T08:50:41.909 DEBUG:tasks.ceph:set 0 configs 2026-02-12T08:50:41.909 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph config dump 2026-02-12T08:50:41.968 INFO:tasks.ceph.mon.a.trial025.stderr:2026-02-12T08:50:41.964+0000 7f52efa92c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:41.968 INFO:tasks.ceph.mon.a.trial025.stderr:2026-02-12T08:50:41.964+0000 7f52efa92c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:41.968 INFO:tasks.ceph.mon.a.trial025.stderr:2026-02-12T08:50:41.964+0000 7f52efa92c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:41.973 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-12T08:50:41.970+0000 7f05653c6fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:41.984 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:41.978+0000 7f0c18446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:41.985 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:41.982+0000 7f0c18446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:42.016 INFO:teuthology.orchestra.run.trial025.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-12T08:50:42.024 INFO:tasks.ceph:Setting crush tunables to default 2026-02-12T08:50:42.024 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph osd crush tunables default 2026-02-12T08:50:42.099 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:42.093+0000 7f377839c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:42.100 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:42.097+0000 7f377839c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:42.134 INFO:teuthology.orchestra.run.trial025.stderr:adjusted tunables profile to default 2026-02-12T08:50:42.142 INFO:tasks.ceph:check_enable_crimson: True 2026-02-12T08:50:42.142 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-12T08:50:42.142 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-12T08:50:42.176 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-12T08:50:42.173+0000 7f05653c6fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:42.177 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-12T08:50:42.174+0000 7f05653c6fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:42.215 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:42.210+0000 7fce17ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:42.217 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:42.214+0000 7fce17ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:42.254 INFO:tasks.ceph.mon.a.trial025.stderr:2026-02-12T08:50:42.251+0000 7f52e71f1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-12T08:50:42.254 INFO:tasks.ceph.mon.a.trial025.stderr:Please be aware that this feature is experimental, untested, 2026-02-12T08:50:42.254 INFO:tasks.ceph.mon.a.trial025.stderr:unsupported, and may result in data corruption, data loss, 2026-02-12T08:50:42.255 INFO:tasks.ceph.mon.a.trial025.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-12T08:50:42.255 INFO:tasks.ceph.mon.a.trial025.stderr:feature with important data. 2026-02-12T08:50:42.255 INFO:tasks.ceph.mon.a.trial025.stderr: 2026-02-12T08:50:43.017 INFO:tasks.ceph.mgr.x.trial025.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-12T08:50:43.018 INFO:tasks.ceph.mgr.x.trial025.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-12T08:50:43.018 INFO:tasks.ceph.mgr.x.trial025.stderr: from numpy import show_config as show_numpy_config 2026-02-12T08:50:43.144 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-12T08:50:43.145 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:50:43.145 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-12T08:50:43.209 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:50:43.209 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-12T08:50:43.274 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:50:43.274 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-12T08:50:43.338 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph osd new c488dd84-a4de-4d8f-96c9-32b47ea01673 0 2026-02-12T08:50:43.451 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:43.445+0000 7fe94130b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:43.453 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:43.450+0000 7fe94130b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:43.491 INFO:teuthology.orchestra.run.trial025.stdout:0 2026-02-12T08:50:43.499 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph osd new 34efc8f2-9fc4-4283-a3f9-b8a3307fec24 1 2026-02-12T08:50:43.573 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:43.567+0000 7f3f4da5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:43.574 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:43.571+0000 7f3f4da5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:43.611 INFO:teuthology.orchestra.run.trial025.stdout:1 2026-02-12T08:50:43.620 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph osd new 1b5b8c04-b3eb-49e9-9e14-d2115ec31608 2 2026-02-12T08:50:43.697 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:43.690+0000 7f0e3d88b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:43.698 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:43.695+0000 7f0e37fff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:43.734 INFO:teuthology.orchestra.run.trial025.stdout:2 2026-02-12T08:50:43.744 DEBUG:teuthology.orchestra.run.trial025:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-12T08:50:43.772 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-12T08:50:43.772 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-12T08:50:43.814 INFO:tasks.ceph.osd.0:Started 2026-02-12T08:50:43.814 DEBUG:teuthology.orchestra.run.trial025:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-12T08:50:43.843 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-12T08:50:43.843 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-12T08:50:43.886 INFO:tasks.ceph.osd.1:Started 2026-02-12T08:50:43.886 DEBUG:teuthology.orchestra.run.trial025:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-12T08:50:43.914 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-12T08:50:43.914 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-12T08:50:43.956 INFO:tasks.ceph.osd.2:Started 2026-02-12T08:50:43.956 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T08:50:44.033 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:44.028+0000 7f02633a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:44.035 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:44.032+0000 7f02633a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:44.069 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:50:44.069 INFO:teuthology.orchestra.run.trial025.stdout:{"epoch":6,"fsid":"7dc82af0-8484-4b40-9c39-b1ef5b77f806","created":"2026-02-12T08:50:41.976080+0000","modified":"2026-02-12T08:50:43.732604+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T08:50:43.732604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"c488dd84-a4de-4d8f-96c9-32b47ea01673","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"34efc8f2-9fc4-4283-a3f9-b8a3307fec24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1b5b8c04-b3eb-49e9-9e14-d2115ec31608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:50:44.078 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-12T08:50:44.078 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-12T08:50:44.380 DEBUG:teuthology.orchestra.run.trial025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T08:50:44.449 INFO:teuthology.misc.health.trial025.stderr:2026-02-12T08:50:44.444+0000 7f5a3561a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:44.450 INFO:teuthology.misc.health.trial025.stderr:2026-02-12T08:50:44.447+0000 7f5a3561a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:44.482 INFO:teuthology.misc.health.trial025.stdout: 2026-02-12T08:50:44.482 INFO:teuthology.misc.health.trial025.stdout:{"epoch":6,"fsid":"7dc82af0-8484-4b40-9c39-b1ef5b77f806","created":"2026-02-12T08:50:41.976080+0000","modified":"2026-02-12T08:50:43.732604+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T08:50:43.732604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"c488dd84-a4de-4d8f-96c9-32b47ea01673","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"34efc8f2-9fc4-4283-a3f9-b8a3307fec24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1b5b8c04-b3eb-49e9-9e14-d2115ec31608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:50:44.489 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-12T08:50:45.415 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-12T08:50:45.412+0000 7f04803bd640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-12T08:50:50.791 DEBUG:teuthology.orchestra.run.trial025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T08:50:50.863 INFO:teuthology.misc.health.trial025.stderr:2026-02-12T08:50:50.859+0000 7f88cf28b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:50.864 INFO:teuthology.misc.health.trial025.stderr:2026-02-12T08:50:50.862+0000 7f88cf28b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:50.972 INFO:teuthology.misc.health.trial025.stdout: 2026-02-12T08:50:50.972 INFO:teuthology.misc.health.trial025.stdout:{"epoch":8,"fsid":"7dc82af0-8484-4b40-9c39-b1ef5b77f806","created":"2026-02-12T08:50:41.976080+0000","modified":"2026-02-12T08:50:50.273849+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T08:50:43.732604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"c488dd84-a4de-4d8f-96c9-32b47ea01673","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"34efc8f2-9fc4-4283-a3f9-b8a3307fec24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1b5b8c04-b3eb-49e9-9e14-d2115ec31608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:50:50.980 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-12T08:50:57.283 DEBUG:teuthology.orchestra.run.trial025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T08:50:57.355 INFO:teuthology.misc.health.trial025.stderr:2026-02-12T08:50:57.351+0000 7f2a9cbad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:57.356 INFO:teuthology.misc.health.trial025.stderr:2026-02-12T08:50:57.354+0000 7f2a9cbad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:57.467 INFO:teuthology.misc.health.trial025.stdout: 2026-02-12T08:50:57.467 INFO:teuthology.misc.health.trial025.stdout:{"epoch":14,"fsid":"7dc82af0-8484-4b40-9c39-b1ef5b77f806","created":"2026-02-12T08:50:41.976080+0000","modified":"2026-02-12T08:50:57.298461+0000","last_up_change":"2026-02-12T08:50:53.287613+0000","last_in_change":"2026-02-12T08:50:43.732604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T08:50:54.424127+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c488dd84-a4de-4d8f-96c9-32b47ea01673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6807","nonce":260747347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6810","nonce":260747347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6812","nonce":260747347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6813","nonce":260747347}]},"public_addr":"10.20.193.25:6807/260747347","cluster_addr":"10.20.193.25:6810/260747347","heartbeat_back_addr":"10.20.193.25:6812/260747347","heartbeat_front_addr":"10.20.193.25:6813/260747347","state":["exists","up"]},{"osd":1,"uuid":"34efc8f2-9fc4-4283-a3f9-b8a3307fec24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6803","nonce":3913458574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6804","nonce":3913458574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6805","nonce":3913458574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6802","nonce":3913458574}]},"public_addr":"10.20.193.25:6803/3913458574","cluster_addr":"10.20.193.25:6804/3913458574","heartbeat_back_addr":"10.20.193.25:6805/3913458574","heartbeat_front_addr":"10.20.193.25:6802/3913458574","state":["exists","up"]},{"osd":2,"uuid":"1b5b8c04-b3eb-49e9-9e14-d2115ec31608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6808","nonce":1567385332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6809","nonce":1567385332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6811","nonce":1567385332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6806","nonce":1567385332}]},"public_addr":"10.20.193.25:6808/1567385332","cluster_addr":"10.20.193.25:6809/1567385332","heartbeat_back_addr":"10.20.193.25:6811/1567385332","heartbeat_front_addr":"10.20.193.25:6806/1567385332","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:50:57.476 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-12T08:50:57.476 INFO:tasks.ceph:Creating RBD pool 2026-02-12T08:50:57.476 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-12T08:50:57.551 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:57.545+0000 7fe32ac8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:57.552 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:57.550+0000 7fe32ac8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:58.306 INFO:teuthology.orchestra.run.trial025.stderr:pool 'rbd' created 2026-02-12T08:50:58.319 DEBUG:teuthology.orchestra.run.trial025:> rbd --cluster ceph pool init rbd 2026-02-12T08:50:58.360 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:58.358+0000 7fbfd8c5f240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:58.361 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:58.358+0000 7fbfd8c5f240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:50:58.362 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:50:58.360+0000 7fbfd8c5f240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:01.349 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-12T08:51:01.350 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-12T08:51:01.351 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-12T08:51:01.469 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:01.464+0000 7efc52d9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:01.470 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:01.468+0000 7efc52d9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:01.579 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:51:01.588 INFO:teuthology.orchestra.run.trial025.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-12T08:51:01.589 INFO:tasks.ceph_manager:config epoch is 1 2026-02-12T08:51:01.589 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-12T08:51:01.589 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-12T08:51:01.589 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-12T08:51:01.665 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:01.662+0000 7f060d406640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:01.667 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:01.664+0000 7f060d406640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:01.808 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:51:01.815 INFO:teuthology.orchestra.run.trial025.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6800","nonce":2771835706},{"type":"v1","addr":"10.20.193.25:6801","nonce":2771835706}]},"active_addr":"10.20.193.25:6801/2771835706","active_change":"2026-02-12T08:50:44.408443+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.25:0","nonce":1347527822}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.25:0","nonce":618890958}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.25:0","nonce":3743113211}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.25:0","nonce":2915440992}]}]} 2026-02-12T08:51:01.819 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-12T08:51:01.819 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-12T08:51:01.820 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T08:51:01.894 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:01.890+0000 7f90cfd0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:01.895 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:01.893+0000 7f90cfd0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:02.008 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:51:02.008 INFO:teuthology.orchestra.run.trial025.stdout:{"epoch":18,"fsid":"7dc82af0-8484-4b40-9c39-b1ef5b77f806","created":"2026-02-12T08:50:41.976080+0000","modified":"2026-02-12T08:51:01.318470+0000","last_up_change":"2026-02-12T08:50:53.287613+0000","last_in_change":"2026-02-12T08:50:43.732604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T08:50:54.424127+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T08:50:57.664192+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c488dd84-a4de-4d8f-96c9-32b47ea01673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6807","nonce":260747347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6810","nonce":260747347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6812","nonce":260747347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6813","nonce":260747347}]},"public_addr":"10.20.193.25:6807/260747347","cluster_addr":"10.20.193.25:6810/260747347","heartbeat_back_addr":"10.20.193.25:6812/260747347","heartbeat_front_addr":"10.20.193.25:6813/260747347","state":["exists","up"]},{"osd":1,"uuid":"34efc8f2-9fc4-4283-a3f9-b8a3307fec24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6803","nonce":3913458574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6804","nonce":3913458574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6805","nonce":3913458574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6802","nonce":3913458574}]},"public_addr":"10.20.193.25:6803/3913458574","cluster_addr":"10.20.193.25:6804/3913458574","heartbeat_back_addr":"10.20.193.25:6805/3913458574","heartbeat_front_addr":"10.20.193.25:6802/3913458574","state":["exists","up"]},{"osd":2,"uuid":"1b5b8c04-b3eb-49e9-9e14-d2115ec31608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6808","nonce":1567385332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6809","nonce":1567385332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6811","nonce":1567385332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6806","nonce":1567385332}]},"public_addr":"10.20.193.25:6808/1567385332","cluster_addr":"10.20.193.25:6809/1567385332","heartbeat_back_addr":"10.20.193.25:6811/1567385332","heartbeat_front_addr":"10.20.193.25:6806/1567385332","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:51:02.018 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-12T08:51:02.019 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T08:51:02.094 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:02.090+0000 7fb0aef0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:02.095 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:02.093+0000 7fb0aef0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:02.203 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:51:02.203 INFO:teuthology.orchestra.run.trial025.stdout:{"epoch":18,"fsid":"7dc82af0-8484-4b40-9c39-b1ef5b77f806","created":"2026-02-12T08:50:41.976080+0000","modified":"2026-02-12T08:51:01.318470+0000","last_up_change":"2026-02-12T08:50:53.287613+0000","last_in_change":"2026-02-12T08:50:43.732604+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T08:50:54.424127+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T08:50:57.664192+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c488dd84-a4de-4d8f-96c9-32b47ea01673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6807","nonce":260747347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6810","nonce":260747347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6812","nonce":260747347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6813","nonce":260747347}]},"public_addr":"10.20.193.25:6807/260747347","cluster_addr":"10.20.193.25:6810/260747347","heartbeat_back_addr":"10.20.193.25:6812/260747347","heartbeat_front_addr":"10.20.193.25:6813/260747347","state":["exists","up"]},{"osd":1,"uuid":"34efc8f2-9fc4-4283-a3f9-b8a3307fec24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6803","nonce":3913458574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6804","nonce":3913458574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6805","nonce":3913458574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6802","nonce":3913458574}]},"public_addr":"10.20.193.25:6803/3913458574","cluster_addr":"10.20.193.25:6804/3913458574","heartbeat_back_addr":"10.20.193.25:6805/3913458574","heartbeat_front_addr":"10.20.193.25:6802/3913458574","state":["exists","up"]},{"osd":2,"uuid":"1b5b8c04-b3eb-49e9-9e14-d2115ec31608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6808","nonce":1567385332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6809","nonce":1567385332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6811","nonce":1567385332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6806","nonce":1567385332}]},"public_addr":"10.20.193.25:6808/1567385332","cluster_addr":"10.20.193.25:6809/1567385332","heartbeat_back_addr":"10.20.193.25:6811/1567385332","heartbeat_front_addr":"10.20.193.25:6806/1567385332","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T08:51:02.213 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-12T08:51:02.214 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-12T08:51:02.214 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-12T08:51:02.295 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:02.291+0000 7ff0d965a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:02.296 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:02.291+0000 7f4735bad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:02.296 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:02.291+0000 7f6173c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:02.297 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:02.295+0000 7f4735bad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:02.297 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:02.295+0000 7f6173c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:02.298 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:02.295+0000 7ff0d965a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:02.311 INFO:teuthology.orchestra.run.trial025.stdout:47244640264 2026-02-12T08:51:02.312 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T08:51:02.313 INFO:teuthology.orchestra.run.trial025.stdout:38654705675 2026-02-12T08:51:02.313 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T08:51:02.314 INFO:teuthology.orchestra.run.trial025.stdout:47244640264 2026-02-12T08:51:02.315 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T08:51:02.433 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:02.428+0000 7f307f4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:02.433 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:02.428+0000 7ff5ae2cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:02.434 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:02.429+0000 7f2ed0acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:02.434 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:02.432+0000 7f307f4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:02.435 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:02.432+0000 7ff5ae2cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:02.435 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:02.433+0000 7f2ed0acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:02.548 INFO:teuthology.orchestra.run.trial025.stdout:47244640260 2026-02-12T08:51:02.551 INFO:teuthology.orchestra.run.trial025.stdout:47244640260 2026-02-12T08:51:02.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640264 got 47244640260 for osd.0 2026-02-12T08:51:02.560 INFO:teuthology.orchestra.run.trial025.stdout:38654705668 2026-02-12T08:51:02.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640264 got 47244640260 for osd.2 2026-02-12T08:51:02.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705675 got 38654705668 for osd.1 2026-02-12T08:51:03.560 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T08:51:03.563 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T08:51:03.571 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T08:51:03.639 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:03.634+0000 7f90b6e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:03.640 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:03.638+0000 7f90b6e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:03.682 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:03.677+0000 7f8da19ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:03.682 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:03.677+0000 7fd374e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:03.683 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:03.681+0000 7fd374e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:03.683 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:03.681+0000 7f8da19ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:03.754 INFO:teuthology.orchestra.run.trial025.stdout:47244640264 2026-02-12T08:51:03.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640264 got 47244640264 for osd.0 2026-02-12T08:51:03.765 DEBUG:teuthology.parallel:result is None 2026-02-12T08:51:03.800 INFO:teuthology.orchestra.run.trial025.stdout:38654705675 2026-02-12T08:51:03.800 INFO:teuthology.orchestra.run.trial025.stdout:47244640264 2026-02-12T08:51:03.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705675 got 38654705675 for osd.1 2026-02-12T08:51:03.810 DEBUG:teuthology.parallel:result is None 2026-02-12T08:51:03.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640264 got 47244640264 for osd.2 2026-02-12T08:51:03.812 DEBUG:teuthology.parallel:result is None 2026-02-12T08:51:03.812 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-12T08:51:03.812 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T08:51:03.927 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:03.923+0000 7f2a6c7ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:03.928 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:03.926+0000 7f2a6c7ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:04.041 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:51:04.041 INFO:teuthology.orchestra.run.trial025.stderr:dumped all 2026-02-12T08:51:04.050 INFO:teuthology.orchestra.run.trial025.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-12T08:51:02.412861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":157286352,"kb_used":62917060,"kb_used_data":62917060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":94369292,"statfs":{"total":161061224448,"available":96634155008,"internally_reserved":0,"allocated":64427069440,"data_stored":64427069440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.090939"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.331143+0000","last_change":"2026-02-12T08:51:01.334109+0000","last_active":"2026-02-12T08:51:01.331143+0000","last_peered":"2026-02-12T08:51:01.331143+0000","last_clean":"2026-02-12T08:51:01.331143+0000","last_became_active":"2026-02-12T08:50:59.350827+0000","last_became_peered":"2026-02-12T08:50:59.350827+0000","last_unstale":"2026-02-12T08:51:01.331143+0000","last_undegraded":"2026-02-12T08:51:01.331143+0000","last_fullsized":"2026-02-12T08:51:01.331143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_clean_scrub_stamp":"2026-02-12T08:50:58.303776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.332470+0000","last_change":"2026-02-12T08:51:01.335009+0000","last_active":"2026-02-12T08:51:01.332470+0000","last_peered":"2026-02-12T08:51:01.332470+0000","last_clean":"2026-02-12T08:51:01.332470+0000","last_became_active":"2026-02-12T08:50:59.348586+0000","last_became_peered":"2026-02-12T08:50:59.348586+0000","last_unstale":"2026-02-12T08:51:01.332470+0000","last_undegraded":"2026-02-12T08:51:01.332470+0000","last_fullsized":"2026-02-12T08:51:01.332470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_clean_scrub_stamp":"2026-02-12T08:50:58.303776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.332623+0000","last_change":"2026-02-12T08:51:01.336624+0000","last_active":"2026-02-12T08:51:01.332623+0000","last_peered":"2026-02-12T08:51:01.332623+0000","last_clean":"2026-02-12T08:51:01.332623+0000","last_became_active":"2026-02-12T08:50:59.349424+0000","last_became_peered":"2026-02-12T08:50:59.349424+0000","last_unstale":"2026-02-12T08:51:01.332623+0000","last_undegraded":"2026-02-12T08:51:01.332623+0000","last_fullsized":"2026-02-12T08:51:01.332623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_clean_scrub_stamp":"2026-02-12T08:50:58.303776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.332421+0000","last_change":"2026-02-12T08:51:01.334978+0000","last_active":"2026-02-12T08:51:01.332421+0000","last_peered":"2026-02-12T08:51:01.332421+0000","last_clean":"2026-02-12T08:51:01.332421+0000","last_became_active":"2026-02-12T08:50:59.358192+0000","last_became_peered":"2026-02-12T08:50:59.358192+0000","last_unstale":"2026-02-12T08:51:01.332421+0000","last_undegraded":"2026-02-12T08:51:01.332421+0000","last_fullsized":"2026-02-12T08:51:01.332421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_clean_scrub_stamp":"2026-02-12T08:50:58.303776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.336453+0000","last_change":"2026-02-12T08:51:01.336453+0000","last_active":"2026-02-12T08:51:01.336453+0000","last_peered":"2026-02-12T08:51:01.336453+0000","last_clean":"2026-02-12T08:51:01.336453+0000","last_became_active":"2026-02-12T08:50:59.357774+0000","last_became_peered":"2026-02-12T08:50:59.357774+0000","last_unstale":"2026-02-12T08:51:01.336453+0000","last_undegraded":"2026-02-12T08:51:01.336453+0000","last_fullsized":"2026-02-12T08:51:01.336453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_clean_scrub_stamp":"2026-02-12T08:50:58.303776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.332583+0000","last_change":"2026-02-12T08:51:01.334815+0000","last_active":"2026-02-12T08:51:01.332583+0000","last_peered":"2026-02-12T08:51:01.332583+0000","last_clean":"2026-02-12T08:51:01.332583+0000","last_became_active":"2026-02-12T08:50:59.357343+0000","last_became_peered":"2026-02-12T08:50:59.357343+0000","last_unstale":"2026-02-12T08:51:01.332583+0000","last_undegraded":"2026-02-12T08:51:01.332583+0000","last_fullsized":"2026-02-12T08:51:01.332583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_clean_scrub_stamp":"2026-02-12T08:50:58.303776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.330876+0000","last_change":"2026-02-12T08:51:01.333013+0000","last_active":"2026-02-12T08:51:01.330876+0000","last_peered":"2026-02-12T08:51:01.330876+0000","last_clean":"2026-02-12T08:51:01.330876+0000","last_became_active":"2026-02-12T08:50:59.348296+0000","last_became_peered":"2026-02-12T08:50:59.348296+0000","last_unstale":"2026-02-12T08:51:01.330876+0000","last_undegraded":"2026-02-12T08:51:01.330876+0000","last_fullsized":"2026-02-12T08:51:01.330876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_clean_scrub_stamp":"2026-02-12T08:50:58.303776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.332540+0000","last_change":"2026-02-12T08:51:01.336328+0000","last_active":"2026-02-12T08:51:01.332540+0000","last_peered":"2026-02-12T08:51:01.332540+0000","last_clean":"2026-02-12T08:51:01.332540+0000","last_became_active":"2026-02-12T08:50:59.356780+0000","last_became_peered":"2026-02-12T08:50:59.356780+0000","last_unstale":"2026-02-12T08:51:01.332540+0000","last_undegraded":"2026-02-12T08:51:01.332540+0000","last_fullsized":"2026-02-12T08:51:01.332540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_clean_scrub_stamp":"2026-02-12T08:50:58.303776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":90,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.331036+0000","last_change":"2026-02-12T08:50:56.326011+0000","last_active":"2026-02-12T08:51:01.331036+0000","last_peered":"2026-02-12T08:51:01.331036+0000","last_clean":"2026-02-12T08:51:01.331036+0000","last_became_active":"2026-02-12T08:50:56.319050+0000","last_became_peered":"2026-02-12T08:50:56.319050+0000","last_unstale":"2026-02-12T08:51:01.331036+0000","last_undegraded":"2026-02-12T08:51:01.331036+0000","last_fullsized":"2026-02-12T08:51:01.331036+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:55.292064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:55.292064+0000","last_clean_scrub_stamp":"2026-02-12T08:50:55.292064+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96634114048,"internally_reserved":0,"allocated":64427110400,"data_stored":64427110400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211070976,"internally_reserved":0,"allocated":21476003840,"data_stored":21476003840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971820,"kb_used_data":20971820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456964,"statfs":{"total":53687074816,"available":32211931136,"internally_reserved":0,"allocated":21475143680,"data_stored":21475143680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972580,"kb_used_data":20972580,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456204,"statfs":{"total":53687074816,"available":32211152896,"internally_reserved":0,"allocated":21475921920,"data_stored":21475921920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705675,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972660,"kb_used_data":20972660,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456124,"statfs":{"total":53687074816,"available":32211070976,"internally_reserved":0,"allocated":21476003840,"data_stored":21476003840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211070976,"internally_reserved":0,"allocated":21476003840,"data_stored":21476003840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53687074816,"available":32211120128,"internally_reserved":0,"allocated":21475954688,"data_stored":21475954688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53687074816,"available":32211070976,"internally_reserved":0,"allocated":21476003840,"data_stored":21476003840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53687074816,"available":32211922944,"internally_reserved":0,"allocated":21475151872,"data_stored":21475151872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T08:51:04.051 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T08:51:04.128 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:04.124+0000 7f84c80cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:04.129 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:04.127+0000 7f84c6e42640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:04.240 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:51:04.240 INFO:teuthology.orchestra.run.trial025.stderr:dumped all 2026-02-12T08:51:04.249 INFO:teuthology.orchestra.run.trial025.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-12T08:51:02.412861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":157286352,"kb_used":62917060,"kb_used_data":62917060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":94369292,"statfs":{"total":161061224448,"available":96634155008,"internally_reserved":0,"allocated":64427069440,"data_stored":64427069440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.090939"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.331143+0000","last_change":"2026-02-12T08:51:01.334109+0000","last_active":"2026-02-12T08:51:01.331143+0000","last_peered":"2026-02-12T08:51:01.331143+0000","last_clean":"2026-02-12T08:51:01.331143+0000","last_became_active":"2026-02-12T08:50:59.350827+0000","last_became_peered":"2026-02-12T08:50:59.350827+0000","last_unstale":"2026-02-12T08:51:01.331143+0000","last_undegraded":"2026-02-12T08:51:01.331143+0000","last_fullsized":"2026-02-12T08:51:01.331143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_clean_scrub_stamp":"2026-02-12T08:50:58.303776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.332470+0000","last_change":"2026-02-12T08:51:01.335009+0000","last_active":"2026-02-12T08:51:01.332470+0000","last_peered":"2026-02-12T08:51:01.332470+0000","last_clean":"2026-02-12T08:51:01.332470+0000","last_became_active":"2026-02-12T08:50:59.348586+0000","last_became_peered":"2026-02-12T08:50:59.348586+0000","last_unstale":"2026-02-12T08:51:01.332470+0000","last_undegraded":"2026-02-12T08:51:01.332470+0000","last_fullsized":"2026-02-12T08:51:01.332470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_clean_scrub_stamp":"2026-02-12T08:50:58.303776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.332623+0000","last_change":"2026-02-12T08:51:01.336624+0000","last_active":"2026-02-12T08:51:01.332623+0000","last_peered":"2026-02-12T08:51:01.332623+0000","last_clean":"2026-02-12T08:51:01.332623+0000","last_became_active":"2026-02-12T08:50:59.349424+0000","last_became_peered":"2026-02-12T08:50:59.349424+0000","last_unstale":"2026-02-12T08:51:01.332623+0000","last_undegraded":"2026-02-12T08:51:01.332623+0000","last_fullsized":"2026-02-12T08:51:01.332623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_clean_scrub_stamp":"2026-02-12T08:50:58.303776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.332421+0000","last_change":"2026-02-12T08:51:01.334978+0000","last_active":"2026-02-12T08:51:01.332421+0000","last_peered":"2026-02-12T08:51:01.332421+0000","last_clean":"2026-02-12T08:51:01.332421+0000","last_became_active":"2026-02-12T08:50:59.358192+0000","last_became_peered":"2026-02-12T08:50:59.358192+0000","last_unstale":"2026-02-12T08:51:01.332421+0000","last_undegraded":"2026-02-12T08:51:01.332421+0000","last_fullsized":"2026-02-12T08:51:01.332421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_clean_scrub_stamp":"2026-02-12T08:50:58.303776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.336453+0000","last_change":"2026-02-12T08:51:01.336453+0000","last_active":"2026-02-12T08:51:01.336453+0000","last_peered":"2026-02-12T08:51:01.336453+0000","last_clean":"2026-02-12T08:51:01.336453+0000","last_became_active":"2026-02-12T08:50:59.357774+0000","last_became_peered":"2026-02-12T08:50:59.357774+0000","last_unstale":"2026-02-12T08:51:01.336453+0000","last_undegraded":"2026-02-12T08:51:01.336453+0000","last_fullsized":"2026-02-12T08:51:01.336453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_clean_scrub_stamp":"2026-02-12T08:50:58.303776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.332583+0000","last_change":"2026-02-12T08:51:01.334815+0000","last_active":"2026-02-12T08:51:01.332583+0000","last_peered":"2026-02-12T08:51:01.332583+0000","last_clean":"2026-02-12T08:51:01.332583+0000","last_became_active":"2026-02-12T08:50:59.357343+0000","last_became_peered":"2026-02-12T08:50:59.357343+0000","last_unstale":"2026-02-12T08:51:01.332583+0000","last_undegraded":"2026-02-12T08:51:01.332583+0000","last_fullsized":"2026-02-12T08:51:01.332583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_clean_scrub_stamp":"2026-02-12T08:50:58.303776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.330876+0000","last_change":"2026-02-12T08:51:01.333013+0000","last_active":"2026-02-12T08:51:01.330876+0000","last_peered":"2026-02-12T08:51:01.330876+0000","last_clean":"2026-02-12T08:51:01.330876+0000","last_became_active":"2026-02-12T08:50:59.348296+0000","last_became_peered":"2026-02-12T08:50:59.348296+0000","last_unstale":"2026-02-12T08:51:01.330876+0000","last_undegraded":"2026-02-12T08:51:01.330876+0000","last_fullsized":"2026-02-12T08:51:01.330876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_clean_scrub_stamp":"2026-02-12T08:50:58.303776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.332540+0000","last_change":"2026-02-12T08:51:01.336328+0000","last_active":"2026-02-12T08:51:01.332540+0000","last_peered":"2026-02-12T08:51:01.332540+0000","last_clean":"2026-02-12T08:51:01.332540+0000","last_became_active":"2026-02-12T08:50:59.356780+0000","last_became_peered":"2026-02-12T08:50:59.356780+0000","last_unstale":"2026-02-12T08:51:01.332540+0000","last_undegraded":"2026-02-12T08:51:01.332540+0000","last_fullsized":"2026-02-12T08:51:01.332540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:58.303776+0000","last_clean_scrub_stamp":"2026-02-12T08:50:58.303776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":90,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T08:51:01.331036+0000","last_change":"2026-02-12T08:50:56.326011+0000","last_active":"2026-02-12T08:51:01.331036+0000","last_peered":"2026-02-12T08:51:01.331036+0000","last_clean":"2026-02-12T08:51:01.331036+0000","last_became_active":"2026-02-12T08:50:56.319050+0000","last_became_peered":"2026-02-12T08:50:56.319050+0000","last_unstale":"2026-02-12T08:51:01.331036+0000","last_undegraded":"2026-02-12T08:51:01.331036+0000","last_fullsized":"2026-02-12T08:51:01.331036+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T08:50:55.292064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T08:50:55.292064+0000","last_clean_scrub_stamp":"2026-02-12T08:50:55.292064+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96634114048,"internally_reserved":0,"allocated":64427110400,"data_stored":64427110400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211070976,"internally_reserved":0,"allocated":21476003840,"data_stored":21476003840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971820,"kb_used_data":20971820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456964,"statfs":{"total":53687074816,"available":32211931136,"internally_reserved":0,"allocated":21475143680,"data_stored":21475143680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972580,"kb_used_data":20972580,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456204,"statfs":{"total":53687074816,"available":32211152896,"internally_reserved":0,"allocated":21475921920,"data_stored":21475921920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705675,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972660,"kb_used_data":20972660,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456124,"statfs":{"total":53687074816,"available":32211070976,"internally_reserved":0,"allocated":21476003840,"data_stored":21476003840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211070976,"internally_reserved":0,"allocated":21476003840,"data_stored":21476003840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53687074816,"available":32211120128,"internally_reserved":0,"allocated":21475954688,"data_stored":21475954688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53687074816,"available":32211070976,"internally_reserved":0,"allocated":21476003840,"data_stored":21476003840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53687074816,"available":32211922944,"internally_reserved":0,"allocated":21475151872,"data_stored":21475151872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T08:51:04.250 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-12T08:51:04.250 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-12T08:51:04.250 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-12T08:51:04.251 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-12T08:51:04.325 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:04.322+0000 7ff757e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:04.327 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:04.325+0000 7ff757e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:04.472 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-12T08:51:04.472 INFO:teuthology.orchestra.run.trial025.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-12T08:51:04.482 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-12T08:51:04.482 INFO:teuthology.run_tasks:Running task ssh_keys... 2026-02-12T08:51:04.559 DEBUG:teuthology.orchestra.run.trial025:> echo 'StrictHostKeyChecking no 2026-02-12T08:51:04.559 DEBUG:teuthology.orchestra.run.trial025:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2026-02-12T08:51:04.575 INFO:teuthology.task.ssh_keys:generated public key AAAAB3NzaC1yc2EAAAADAQABAAABAQDbS9IellMwBsJZXyTVUiE+L8oyhYpniaSxCRhOA9VfM+QlIHYmh4b7z6yXSKWqdDBsC0Locx1fpy5aqTaO8SH+bZHGfvelzIhcw9jxhL1h8PjTk26SJrbPo2ddm1jsfnWBHy0BpFnpViMXPEdbBInqjEFiTfqe6RKHKgQodao7dqCQwvC2/vpPMhYhXE6dpvLXF1NMuYen2ov+rRqlx6aqKihtDpwExLlCnaEyrWco7R/LI5bKXCcX36KRb/ngyXxPixZSSe594WM2lq6j6SWrO70qs1mzyV9DVfMrXPO3gYHJx2xiH8nbEm/bA5g9Kp5Ayl9W2Lj0Mj4ghInrTWc7 2026-02-12T08:51:04.575 INFO:teuthology.task.ssh_keys:pushing keys to trial025.front.sepia.ceph.com for ubuntu 2026-02-12T08:51:04.576 DEBUG:teuthology.orchestra.run.trial025:> rm -f -- /home/ubuntu/.ssh/id_rsa 2026-02-12T08:51:04.630 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:51:04.631 DEBUG:teuthology.orchestra.run.trial025:> dd of=/home/ubuntu/.ssh/id_rsa 2026-02-12T08:51:04.631 DEBUG:teuthology.orchestra.run.trial025:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2026-02-12T08:51:04.688 DEBUG:teuthology.orchestra.run.trial025:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2026-02-12T08:51:04.744 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:51:04.744 DEBUG:teuthology.orchestra.run.trial025:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2026-02-12T08:51:04.800 DEBUG:teuthology.orchestra.run.trial025:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2026-02-12_08:51:04:800336 2026-02-12T08:51:04.857 INFO:teuthology.orchestra.run.trial025.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2026-02-12_08:51:04:800336' 2026-02-12T08:51:04.857 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-12T08:51:04.857 DEBUG:teuthology.orchestra.run.trial025:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2026-02-12T08:51:04.913 INFO:teuthology.run_tasks:Running task radosbench... 2026-02-12T08:51:04.931 INFO:tasks.radosbench:Beginning radosbench... 2026-02-12T08:51:04.931 INFO:tasks.radosbench:omap writes 2026-02-12T08:51:04.931 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-12T08:51:04.932 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2026-02-12T08:51:05.031 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:05.024+0000 7fd24c851640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:05.032 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:05.030+0000 7fd24c851640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:05.331 INFO:teuthology.orchestra.run.trial025.stderr:pool 'unique_pool_0' created 2026-02-12T08:51:05.346 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-12T08:51:05.431 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:05.424+0000 7f4f3f2c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:05.432 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T08:51:05.430+0000 7f4f3f2c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T08:51:06.335 INFO:teuthology.orchestra.run.trial025.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-12T08:51:07.351 DEBUG:teuthology.orchestra.run.trial025:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 16 -b 4096 --object-size 4096 -p unique_pool_0 bench 300 write --write-omap' 2026-02-12T08:51:07.353 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2026-02-12T08:51:07.369 INFO:tasks.radosbench:joining radosbench (timing out after 9300s) 2026-02-12T08:51:07.370 INFO:teuthology.orchestra.run:waiting for 9300 2026-02-12T08:51:07.399 INFO:tasks.radosbench.radosbench.0.trial025.stdout:hints = 1 2026-02-12T08:51:07.399 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 300 seconds or 0 objects 2026-02-12T08:51:07.399 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Object prefix: benchmark_data_trial025_23301 2026-02-12T08:51:07.399 INFO:tasks.radosbench.radosbench.0.trial025.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T08:51:07.400 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 0 0 0 0 0 0 - 0 2026-02-12T08:51:08.399 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 1 16 315 299 1.16787 1.16797 0.0823117 0.0514029 2026-02-12T08:51:09.399 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 2 16 618 602 1.17568 1.18359 0.0295929 0.0519723 2026-02-12T08:51:10.399 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 3 16 907 891 1.16006 1.12891 0.010606 0.0528901 2026-02-12T08:51:11.399 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 4 16 1204 1188 1.16006 1.16016 0.0660721 0.0526886 2026-02-12T08:51:12.399 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 5 16 1503 1487 1.16162 1.16797 0.0364362 0.0532077 2026-02-12T08:51:13.401 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 6 16 1820 1804 1.17439 1.23828 0.105601 0.0530191 2026-02-12T08:51:14.400 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 7 16 2149 2133 1.1902 1.28516 0.0468628 0.0521503 2026-02-12T08:51:15.400 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 8 16 2490 2474 1.20791 1.33203 0.0298858 0.0515867 2026-02-12T08:51:16.400 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 9 16 2832 2816 1.22212 1.33594 0.072778 0.050972 2026-02-12T08:51:17.400 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 10 16 3169 3153 1.23154 1.31641 0.040453 0.0505504 2026-02-12T08:51:18.400 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 11 16 3519 3503 1.24386 1.36719 0.0188167 0.0500697 2026-02-12T08:51:19.400 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 12 16 3876 3860 1.25641 1.39453 0.0402297 0.0496334 2026-02-12T08:51:20.400 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 13 16 4216 4200 1.26192 1.32812 0.0448853 0.0494482 2026-02-12T08:51:21.400 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 14 16 4558 4542 1.2672 1.33594 0.0361218 0.0491894 2026-02-12T08:51:22.400 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 15 16 4901 4885 1.27203 1.33984 0.0357666 0.0490377 2026-02-12T08:51:23.400 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 16 16 5245 5229 1.27651 1.34375 0.0407897 0.0488281 2026-02-12T08:51:24.400 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 17 16 5583 5567 1.27908 1.32031 0.0440532 0.0487815 2026-02-12T08:51:25.400 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 18 16 5933 5917 1.28397 1.36719 0.0253839 0.0485761 2026-02-12T08:51:26.401 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 19 16 6283 6267 1.28834 1.36719 0.0402429 0.0484444 2026-02-12T08:51:27.401 INFO:tasks.radosbench.radosbench.0.trial025.stdout:2026-02-12T08:51:27.399371+0000 min lat: 0.00989178 max lat: 0.46563 avg lat: 0.0482774 2026-02-12T08:51:27.401 INFO:tasks.radosbench.radosbench.0.trial025.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T08:51:27.401 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 20 16 6635 6619 1.29267 1.375 0.0458152 0.0482774 2026-02-12T08:51:28.401 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 21 16 6997 6981 1.29844 1.41406 0.0376719 0.0480862 2026-02-12T08:51:29.401 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 22 16 7332 7316 1.2989 1.30859 0.0464422 0.0480284 2026-02-12T08:51:30.401 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 23 16 7678 7662 1.30118 1.35156 0.0452117 0.047987 2026-02-12T08:51:31.401 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 24 16 8018 8002 1.3023 1.32812 0.0578433 0.0479355 2026-02-12T08:51:32.401 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 25 16 8372 8356 1.30552 1.38281 0.0727112 0.0478302 2026-02-12T08:51:33.401 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 26 16 8716 8700 1.30698 1.34375 0.0576987 0.0477716 2026-02-12T08:51:34.401 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 27 16 9047 9031 1.30646 1.29297 0.0303169 0.0477894 2026-02-12T08:51:35.401 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 28 16 9370 9354 1.30486 1.26172 0.0387662 0.0478573 2026-02-12T08:51:36.401 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 29 16 9708 9692 1.30539 1.32031 0.0381454 0.0478343 2026-02-12T08:51:37.402 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 30 16 10051 10035 1.30653 1.33984 0.0605632 0.0477868 2026-02-12T08:51:38.402 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 31 16 10392 10376 1.30735 1.33203 0.0600796 0.0477606 2026-02-12T08:51:39.402 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 32 16 10731 10715 1.30788 1.32422 0.0365485 0.0477406 2026-02-12T08:51:40.402 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 33 16 11075 11059 1.30896 1.34375 0.0364339 0.0476963 2026-02-12T08:51:41.402 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 34 16 11392 11376 1.30688 1.23828 0.0298278 0.0477935 2026-02-12T08:51:42.402 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 35 16 11729 11713 1.30715 1.31641 0.0511606 0.0477802 2026-02-12T08:51:43.402 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 36 16 12062 12046 1.30697 1.30078 0.032383 0.047772 2026-02-12T08:51:44.402 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 37 16 12407 12391 1.30806 1.34766 0.0432821 0.0477413 2026-02-12T08:51:45.402 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 38 16 12736 12720 1.30746 1.28516 0.0512263 0.0477448 2026-02-12T08:51:46.402 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 39 16 13072 13056 1.30759 1.3125 0.0534866 0.0477525 2026-02-12T08:51:47.402 INFO:tasks.radosbench.radosbench.0.trial025.stdout:2026-02-12T08:51:47.401041+0000 min lat: 0.00989178 max lat: 0.46563 avg lat: 0.0477267 2026-02-12T08:51:47.403 INFO:tasks.radosbench.radosbench.0.trial025.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T08:51:47.403 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 40 16 13414 13398 1.30829 1.33594 0.0456994 0.0477267 2026-02-12T08:51:48.402 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 41 16 13740 13724 1.30744 1.27344 0.0583091 0.047747 2026-02-12T08:51:49.402 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 42 16 14048 14032 1.30495 1.20312 0.0320761 0.0478538 2026-02-12T08:51:50.402 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 43 16 14372 14356 1.30404 1.26562 0.0754306 0.0478896 2026-02-12T08:51:51.403 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 44 16 14695 14679 1.30307 1.26172 0.0577297 0.047931 2026-02-12T08:51:52.403 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 45 16 14999 14983 1.3005 1.1875 0.0280324 0.0480093 2026-02-12T08:51:53.403 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 46 16 15304 15288 1.29813 1.19141 0.0367044 0.0481162 2026-02-12T08:51:54.403 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 47 16 15600 15584 1.29511 1.15625 0.0911697 0.0482139 2026-02-12T08:51:55.403 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 48 16 15928 15912 1.29482 1.28125 0.0712356 0.0482318 2026-02-12T08:51:56.403 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 49 16 16229 16213 1.29239 1.17578 0.0601597 0.0483386 2026-02-12T08:51:57.403 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 50 16 16542 16526 1.29099 1.22266 0.0375919 0.0483721 2026-02-12T08:51:58.403 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 51 16 16865 16849 1.29041 1.26172 0.0419899 0.0484122 2026-02-12T08:51:59.403 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 52 16 17194 17178 1.29031 1.28516 0.0260354 0.0484102 2026-02-12T08:52:00.403 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 53 16 17495 17479 1.28815 1.17578 0.0287013 0.0484729 2026-02-12T08:52:01.403 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 54 16 17791 17775 1.2857 1.15625 0.0248069 0.0485856 2026-02-12T08:52:02.403 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 55 16 18071 18055 1.28221 1.09375 0.026503 0.0487103 2026-02-12T08:52:03.404 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 56 16 18347 18331 1.27857 1.07812 0.0591458 0.0488528 2026-02-12T08:52:04.404 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 57 16 18666 18650 1.27799 1.24609 0.0682194 0.0488631 2026-02-12T08:52:05.404 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 58 16 18978 18962 1.27697 1.21875 0.047868 0.0489182 2026-02-12T08:52:06.404 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 59 16 19261 19245 1.27406 1.10547 0.179841 0.0490139 2026-02-12T08:52:07.404 INFO:tasks.radosbench.radosbench.0.trial025.stdout:2026-02-12T08:52:07.402623+0000 min lat: 0.00989178 max lat: 0.46563 avg lat: 0.0490587 2026-02-12T08:52:07.404 INFO:tasks.radosbench.radosbench.0.trial025.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T08:52:07.404 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 60 16 19572 19556 1.27307 1.21484 0.060557 0.0490587 2026-02-12T08:52:08.404 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 61 16 19889 19873 1.2725 1.23828 0.0370359 0.0490899 2026-02-12T08:52:09.404 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 62 16 20210 20194 1.2722 1.25391 0.0543417 0.049108 2026-02-12T08:52:10.404 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 63 16 20509 20493 1.27054 1.16797 0.0447721 0.0491635 2026-02-12T08:52:11.404 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 64 16 20798 20782 1.26833 1.12891 0.0486529 0.049244 2026-02-12T08:52:12.404 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 65 16 21105 21089 1.26727 1.19922 0.0714362 0.0492884 2026-02-12T08:52:13.404 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 66 16 21400 21384 1.26552 1.15234 0.0453974 0.0493485 2026-02-12T08:52:14.405 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 67 16 21701 21685 1.26418 1.17578 0.0607623 0.0494185 2026-02-12T08:52:15.405 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 68 16 22001 21985 1.26282 1.17188 0.0564824 0.0494647 2026-02-12T08:52:16.405 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 69 16 22305 22289 1.26173 1.1875 0.061771 0.0495039 2026-02-12T08:52:17.405 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 70 16 22602 22586 1.26028 1.16016 0.0790316 0.0495643 2026-02-12T08:52:18.405 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 71 16 22905 22889 1.2592 1.18359 0.11039 0.049604 2026-02-12T08:52:19.405 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 72 16 23187 23171 1.25701 1.10156 0.0645898 0.0496975 2026-02-12T08:52:20.405 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 73 16 23486 23470 1.25578 1.16797 0.0395544 0.0497362 2026-02-12T08:52:21.405 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 74 16 23780 23764 1.25433 1.14844 0.0628089 0.0497943 2026-02-12T08:52:22.405 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 75 16 24061 24045 1.25224 1.09766 0.0632952 0.0498769 2026-02-12T08:52:23.405 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 76 16 24344 24328 1.25031 1.10547 0.0325568 0.0499636 2026-02-12T08:52:24.405 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 77 16 24637 24621 1.24894 1.14453 0.0489497 0.0500182 2026-02-12T08:52:25.405 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 78 16 24925 24909 1.24735 1.125 0.0824565 0.0500816 2026-02-12T08:52:26.406 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 79 16 25209 25193 1.2456 1.10938 0.101857 0.0501416 2026-02-12T08:52:27.406 INFO:tasks.radosbench.radosbench.0.trial025.stdout:2026-02-12T08:52:27.404254+0000 min lat: 0.00989178 max lat: 0.46563 avg lat: 0.0502086 2026-02-12T08:52:27.406 INFO:tasks.radosbench.radosbench.0.trial025.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T08:52:27.406 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 80 16 25499 25483 1.24419 1.13281 0.0492801 0.0502086 2026-02-12T08:52:28.406 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 81 16 25793 25777 1.243 1.14844 0.0536592 0.0502571 2026-02-12T08:52:29.406 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 82 16 26063 26047 1.24071 1.05469 0.123401 0.0503365 2026-02-12T08:52:30.406 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 83 16 26355 26339 1.2395 1.14062 0.0424106 0.0504062 2026-02-12T08:52:31.406 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 84 16 26630 26614 1.23753 1.07422 0.135863 0.0504822 2026-02-12T08:52:32.406 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 85 16 26919 26903 1.23625 1.12891 0.0902447 0.0505333 2026-02-12T08:52:33.406 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 86 16 27203 27187 1.23477 1.10938 0.161546 0.0505873 2026-02-12T08:52:34.406 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 87 16 27488 27472 1.23338 1.11328 0.0710381 0.0506501 2026-02-12T08:52:35.406 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 88 16 27765 27749 1.23166 1.08203 0.0797915 0.0507235 2026-02-12T08:52:36.406 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 89 16 28045 28029 1.23011 1.09375 0.0480571 0.050791 2026-02-12T08:52:37.406 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 90 16 28322 28306 1.22846 1.08203 0.0313004 0.0508423 2026-02-12T08:52:38.406 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 91 16 28615 28599 1.22754 1.14453 0.0792774 0.0509005 2026-02-12T08:52:39.406 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 92 16 28897 28881 1.22617 1.10156 0.0997885 0.0509512 2026-02-12T08:52:40.407 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 93 16 29184 29168 1.22504 1.12109 0.0192891 0.0510027 2026-02-12T08:52:41.407 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 94 16 29460 29444 1.22347 1.07812 0.0445102 0.0510665 2026-02-12T08:52:42.407 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 95 16 29751 29735 1.22256 1.13672 0.109255 0.0510991 2026-02-12T08:52:43.407 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 96 16 30033 30017 1.2213 1.10156 0.0918387 0.0511522 2026-02-12T08:52:44.407 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 97 16 30320 30304 1.22026 1.12109 0.108087 0.0511981 2026-02-12T08:52:45.407 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 98 16 30616 30600 1.21961 1.15625 0.0463728 0.0512273 2026-02-12T08:52:46.407 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 99 16 30888 30872 1.21802 1.0625 0.0713819 0.0512947 2026-02-12T08:52:47.407 INFO:tasks.radosbench.radosbench.0.trial025.stdout:2026-02-12T08:52:47.405830+0000 min lat: 0.00989178 max lat: 0.46563 avg lat: 0.051326 2026-02-12T08:52:47.407 INFO:tasks.radosbench.radosbench.0.trial025.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T08:52:47.408 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 100 16 31178 31162 1.21717 1.13281 0.0981044 0.051326 2026-02-12T08:52:48.407 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 101 16 31460 31444 1.21602 1.10156 0.0572781 0.0513775 2026-02-12T08:52:49.407 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 102 16 31744 31728 1.21498 1.10938 0.0291754 0.0514153 2026-02-12T08:52:50.408 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 103 16 32011 31995 1.2133 1.04297 0.0420973 0.05149 2026-02-12T08:52:51.408 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 104 16 32278 32262 1.21167 1.04297 0.0814295 0.0515615 2026-02-12T08:52:52.408 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 105 16 32553 32537 1.21036 1.07422 0.0907982 0.0516141 2026-02-12T08:52:53.408 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 106 16 32825 32809 1.20896 1.0625 0.0384673 0.0516725 2026-02-12T08:52:54.408 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 107 16 33111 33095 1.2081 1.11719 0.056294 0.0517179 2026-02-12T08:52:55.408 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 108 16 33392 33376 1.20708 1.09766 0.0602112 0.0517622 2026-02-12T08:52:56.408 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 109 16 33665 33649 1.20579 1.06641 0.0756389 0.0518149 2026-02-12T08:52:57.408 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 110 16 33931 33915 1.20427 1.03906 0.0399421 0.0518789 2026-02-12T08:52:58.408 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 111 16 34208 34192 1.20317 1.08203 0.0573727 0.0519269 2026-02-12T08:52:59.408 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 112 16 34478 34462 1.20184 1.05469 0.0605823 0.0519862 2026-02-12T08:53:00.408 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 113 16 34759 34743 1.20092 1.09766 0.0750214 0.0520246 2026-02-12T08:53:01.408 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 114 16 35028 35012 1.1996 1.05078 0.0683338 0.0520833 2026-02-12T08:53:02.409 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 115 16 35291 35275 1.1981 1.02734 0.055156 0.0521476 2026-02-12T08:53:03.409 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 116 16 35564 35548 1.19697 1.06641 0.054408 0.0521961 2026-02-12T08:53:04.409 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 117 16 35827 35811 1.19552 1.02734 0.0622043 0.0522594 2026-02-12T08:53:05.408 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 118 16 36088 36072 1.19402 1.01953 0.0285691 0.0523265 2026-02-12T08:53:06.409 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 119 16 36359 36343 1.19289 1.05859 0.0929297 0.0523772 2026-02-12T08:53:07.409 INFO:tasks.radosbench.radosbench.0.trial025.stdout:2026-02-12T08:53:07.407410+0000 min lat: 0.00989178 max lat: 0.46563 avg lat: 0.0524435 2026-02-12T08:53:07.409 INFO:tasks.radosbench.radosbench.0.trial025.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T08:53:07.409 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 120 16 36608 36592 1.19105 0.972656 0.0651644 0.0524435 2026-02-12T08:53:08.409 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 121 16 36877 36861 1.18989 1.05078 0.0553826 0.0525058 2026-02-12T08:53:09.409 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 122 16 37147 37131 1.18878 1.05469 0.0735966 0.0525597 2026-02-12T08:53:10.409 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 123 16 37419 37403 1.18775 1.0625 0.0831273 0.0526031 2026-02-12T08:53:11.409 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 124 16 37678 37662 1.18633 1.01172 0.130033 0.0526603 2026-02-12T08:53:12.409 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 125 16 37942 37926 1.18509 1.03125 0.0884962 0.0527217 2026-02-12T08:53:13.409 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 126 16 38187 38171 1.18328 0.957031 0.0394911 0.0528004 2026-02-12T08:53:14.409 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 127 16 38435 38419 1.18159 0.96875 0.113342 0.0528696 2026-02-12T08:53:15.410 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 128 16 38705 38689 1.1806 1.05469 0.0510482 0.0529211 2026-02-12T08:53:16.410 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 129 16 38977 38961 1.17968 1.0625 0.0801897 0.0529641 2026-02-12T08:53:17.409 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 130 16 39224 39208 1.17803 0.964844 0.0232931 0.053031 2026-02-12T08:53:18.410 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 131 16 39482 39466 1.17673 1.00781 0.0258529 0.0530837 2026-02-12T08:53:19.410 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 132 16 39739 39723 1.17542 1.00391 0.0523685 0.0531567 2026-02-12T08:53:20.410 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 133 16 40002 39986 1.17431 1.02734 0.0873052 0.0532052 2026-02-12T08:53:21.410 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 134 16 40261 40245 1.17309 1.01172 0.0324764 0.0532601 2026-02-12T08:53:22.410 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 135 16 40518 40502 1.17184 1.00391 0.0411891 0.053314 2026-02-12T08:53:23.410 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 136 15 40777 40762 1.17069 1.01562 0.0827873 0.0533702 2026-02-12T08:53:24.410 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 137 16 41037 41021 1.16953 1.01172 0.0610062 0.0534208 2026-02-12T08:53:25.410 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 138 16 41289 41273 1.16819 0.984375 0.0833584 0.0534816 2026-02-12T08:53:26.410 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 139 16 41550 41534 1.16712 1.01953 0.0440078 0.0535366 2026-02-12T08:53:27.410 INFO:tasks.radosbench.radosbench.0.trial025.stdout:2026-02-12T08:53:27.408968+0000 min lat: 0.00989178 max lat: 0.46563 avg lat: 0.0536062 2026-02-12T08:53:27.411 INFO:tasks.radosbench.radosbench.0.trial025.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T08:53:27.411 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 140 16 41794 41778 1.16559 0.953125 0.076516 0.0536062 2026-02-12T08:53:28.411 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 141 16 42046 42030 1.1643 0.984375 0.0453126 0.0536633 2026-02-12T08:53:29.411 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 142 16 42302 42286 1.16314 1 0.105481 0.0537174 2026-02-12T08:53:30.411 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 143 16 42550 42534 1.16178 0.96875 0.0760256 0.0537796 2026-02-12T08:53:31.411 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 144 16 42787 42771 1.16014 0.925781 0.0651124 0.0538565 2026-02-12T08:53:32.411 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 145 15 43040 43025 1.15898 0.992188 0.0596175 0.0539119 2026-02-12T08:53:33.411 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 146 16 43298 43282 1.15792 1.00391 0.0561814 0.0539608 2026-02-12T08:53:34.412 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 147 16 43545 43529 1.15661 0.964844 0.0857098 0.0540224 2026-02-12T08:53:35.412 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 148 16 43804 43788 1.15563 1.01172 0.102549 0.0540669 2026-02-12T08:53:36.412 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 149 16 44060 44044 1.15458 1 0.0550573 0.0541176 2026-02-12T08:53:37.412 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 150 16 44324 44308 1.15376 1.03125 0.0967245 0.054153 2026-02-12T08:53:38.412 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 151 16 44562 44546 1.15227 0.929688 0.0703473 0.0542257 2026-02-12T08:53:39.412 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 152 16 44813 44797 1.15114 0.980469 0.0677536 0.0542755 2026-02-12T08:53:40.412 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 153 16 45065 45049 1.15005 0.984375 0.0528566 0.0543314 2026-02-12T08:53:41.412 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 154 16 45305 45289 1.14867 0.9375 0.0371087 0.0543906 2026-02-12T08:53:42.412 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 155 16 45548 45532 1.14738 0.949219 0.0693508 0.0544549 2026-02-12T08:53:43.412 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 156 16 45795 45779 1.14621 0.964844 0.0442116 0.0545135 2026-02-12T08:53:44.412 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 157 16 46031 46015 1.14478 0.921875 0.107568 0.0545822 2026-02-12T08:53:45.412 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 158 16 46277 46261 1.14362 0.960938 0.0714454 0.0546347 2026-02-12T08:53:46.413 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 159 16 46533 46517 1.14272 1 0.0995572 0.0546772 2026-02-12T08:53:47.412 INFO:tasks.radosbench.radosbench.0.trial025.stdout:2026-02-12T08:53:47.410981+0000 min lat: 0.00989178 max lat: 0.46563 avg lat: 0.0547253 2026-02-12T08:53:47.412 INFO:tasks.radosbench.radosbench.0.trial025.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T08:53:47.412 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 160 16 46785 46769 1.14173 0.984375 0.0608859 0.0547253 2026-02-12T08:53:48.413 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 161 16 47045 47029 1.14094 1.01562 0.0649357 0.0547637 2026-02-12T08:53:49.413 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 162 16 47288 47272 1.13976 0.949219 0.0274424 0.0548183 2026-02-12T08:53:50.413 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 163 16 47529 47513 1.13854 0.941406 0.0569213 0.0548824 2026-02-12T08:53:51.413 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 164 16 47779 47763 1.13755 0.976562 0.103289 0.054929 2026-02-12T08:53:52.413 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 165 16 48027 48011 1.13653 0.96875 0.114026 0.0549774 2026-02-12T08:53:53.413 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 166 16 48274 48258 1.1355 0.964844 0.0418224 0.0550168 2026-02-12T08:53:54.413 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 167 16 48527 48511 1.13461 0.988281 0.0428201 0.0550695 2026-02-12T08:53:55.413 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 168 16 48769 48753 1.13349 0.945312 0.0794549 0.0551229 2026-02-12T08:53:56.413 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 169 16 49014 48998 1.13244 0.957031 0.0616256 0.0551759 2026-02-12T08:53:57.413 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 170 16 49256 49240 1.13134 0.945312 0.0950382 0.0552301 2026-02-12T08:53:58.414 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 171 16 49501 49485 1.13032 0.957031 0.0417214 0.0552798 2026-02-12T08:53:59.414 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 172 16 49758 49742 1.12959 1.00391 0.0437299 0.0553152 2026-02-12T08:54:00.414 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 173 16 50002 49986 1.12856 0.953125 0.10002 0.0553636 2026-02-12T08:54:01.414 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 174 16 50236 50220 1.12733 0.914062 0.0545928 0.0554285 2026-02-12T08:54:02.414 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 175 16 50471 50455 1.12613 0.917969 0.0965597 0.055482 2026-02-12T08:54:03.414 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 176 16 50708 50692 1.125 0.925781 0.0544354 0.0555395 2026-02-12T08:54:04.414 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 177 16 50953 50937 1.12405 0.957031 0.0738941 0.0555882 2026-02-12T08:54:05.414 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 178 16 51194 51178 1.12302 0.941406 0.0650051 0.0556368 2026-02-12T08:54:06.414 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 179 16 51433 51417 1.12196 0.933594 0.0387293 0.0556908 2026-02-12T08:54:07.414 INFO:tasks.radosbench.radosbench.0.trial025.stdout:2026-02-12T08:54:07.412573+0000 min lat: 0.00989178 max lat: 0.46563 avg lat: 0.0557511 2026-02-12T08:54:07.414 INFO:tasks.radosbench.radosbench.0.trial025.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T08:54:07.415 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 180 16 51667 51651 1.12081 0.914062 0.0527706 0.0557511 2026-02-12T08:54:08.414 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 181 16 51916 51900 1.11999 0.972656 0.0930423 0.0557909 2026-02-12T08:54:09.414 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 182 16 52143 52127 1.11871 0.886719 0.133647 0.0558477 2026-02-12T08:54:10.414 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 183 16 52378 52362 1.11761 0.917969 0.0432552 0.0559097 2026-02-12T08:54:11.414 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 184 16 52615 52599 1.11657 0.925781 0.0376975 0.0559586 2026-02-12T08:54:12.415 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 185 16 52862 52846 1.11574 0.964844 0.0556671 0.056 2026-02-12T08:54:13.415 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 186 16 53099 53083 1.11472 0.925781 0.0293563 0.0560498 2026-02-12T08:54:14.415 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 187 16 53340 53324 1.1138 0.941406 0.0637975 0.0561012 2026-02-12T08:54:15.415 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 188 16 53578 53562 1.11282 0.929688 0.0763775 0.0561487 2026-02-12T08:54:16.415 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 189 16 53812 53796 1.11176 0.914062 0.0657011 0.056203 2026-02-12T08:54:17.415 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 190 16 54050 54034 1.11081 0.929688 0.0451386 0.0562504 2026-02-12T08:54:18.415 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 191 16 54298 54282 1.11006 0.96875 0.0540321 0.0562868 2026-02-12T08:54:19.415 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 192 16 54535 54519 1.1091 0.925781 0.10322 0.0563353 2026-02-12T08:54:20.415 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 193 16 54754 54738 1.10779 0.855469 0.123508 0.0564048 2026-02-12T08:54:21.415 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 194 16 54993 54977 1.10689 0.933594 0.0775197 0.0564493 2026-02-12T08:54:22.415 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 195 16 55217 55201 1.1057 0.875 0.0719889 0.0565087 2026-02-12T08:54:23.415 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 196 16 55444 55428 1.10458 0.886719 0.0794945 0.0565676 2026-02-12T08:54:24.416 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 197 16 55677 55661 1.10359 0.910156 0.0631767 0.0566101 2026-02-12T08:54:25.416 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 198 16 55907 55891 1.10256 0.898438 0.075016 0.0566693 2026-02-12T08:54:26.416 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 199 16 56127 56111 1.10134 0.859375 0.0344853 0.0567341 2026-02-12T08:54:27.416 INFO:tasks.radosbench.radosbench.0.trial025.stdout:2026-02-12T08:54:27.414094+0000 min lat: 0.00989178 max lat: 0.46563 avg lat: 0.0567912 2026-02-12T08:54:27.416 INFO:tasks.radosbench.radosbench.0.trial025.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T08:54:27.416 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 200 15 56352 56337 1.10024 0.882812 0.0760963 0.0567912 2026-02-12T08:54:28.416 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 201 16 56589 56573 1.09935 0.921875 0.0378574 0.0568359 2026-02-12T08:54:29.416 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 202 16 56813 56797 1.09824 0.875 0.109721 0.0568899 2026-02-12T08:54:30.416 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 203 16 57048 57032 1.09736 0.917969 0.0831605 0.0569427 2026-02-12T08:54:31.416 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 204 16 57264 57248 1.09611 0.84375 0.0719335 0.0569978 2026-02-12T08:54:32.416 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 205 16 57475 57459 1.09479 0.824219 0.0942298 0.0570665 2026-02-12T08:54:33.416 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 206 16 57705 57689 1.09383 0.898438 0.0471629 0.0571257 2026-02-12T08:54:34.416 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 207 16 57944 57928 1.09306 0.933594 0.0915256 0.057168 2026-02-12T08:54:35.416 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 208 16 58158 58142 1.09182 0.835938 0.0573268 0.0572325 2026-02-12T08:54:36.416 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 209 16 58383 58367 1.0908 0.878906 0.034954 0.0572764 2026-02-12T08:54:37.416 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 210 16 58609 58593 1.08981 0.882812 0.0402346 0.0573349 2026-02-12T08:54:38.416 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 211 16 58839 58823 1.0889 0.898438 0.0335066 0.0573765 2026-02-12T08:54:39.417 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 212 16 59071 59055 1.08804 0.90625 0.0487603 0.0574294 2026-02-12T08:54:40.417 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 213 16 59296 59280 1.08706 0.878906 0.0755816 0.0574801 2026-02-12T08:54:41.417 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 214 16 59516 59500 1.086 0.859375 0.085005 0.057539 2026-02-12T08:54:42.417 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 215 16 59750 59734 1.0852 0.914062 0.0265408 0.0575742 2026-02-12T08:54:43.417 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 216 16 59964 59948 1.08404 0.835938 0.0753775 0.0576411 2026-02-12T08:54:44.417 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 217 16 60188 60172 1.08308 0.875 0.143535 0.0576898 2026-02-12T08:54:45.417 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 218 16 60414 60398 1.08216 0.882812 0.0378083 0.0577388 2026-02-12T08:54:46.417 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 219 16 60638 60622 1.08121 0.875 0.0600527 0.0577899 2026-02-12T08:54:47.417 INFO:tasks.radosbench.radosbench.0.trial025.stdout:2026-02-12T08:54:47.415613+0000 min lat: 0.00989178 max lat: 0.46563 avg lat: 0.0578399 2026-02-12T08:54:47.418 INFO:tasks.radosbench.radosbench.0.trial025.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T08:54:47.418 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 220 16 60864 60848 1.08031 0.882812 0.136664 0.0578399 2026-02-12T08:54:48.417 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 221 16 61085 61069 1.07933 0.863281 0.0871564 0.0578914 2026-02-12T08:54:49.417 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 222 16 61311 61295 1.07844 0.882812 0.0865628 0.0579379 2026-02-12T08:54:50.417 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 223 16 61528 61512 1.07741 0.847656 0.0540406 0.0579945 2026-02-12T08:54:51.418 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 224 16 61740 61724 1.07629 0.828125 0.0451156 0.0580547 2026-02-12T08:54:52.418 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 225 16 61961 61945 1.07535 0.863281 0.0745745 0.0581076 2026-02-12T08:54:53.418 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 226 16 62177 62161 1.07432 0.84375 0.0452716 0.058158 2026-02-12T08:54:54.418 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 227 16 62400 62384 1.07343 0.871094 0.0382475 0.0582094 2026-02-12T08:54:55.418 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 228 16 62625 62609 1.07257 0.878906 0.0835851 0.0582602 2026-02-12T08:54:56.418 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 229 16 62842 62826 1.07159 0.847656 0.0380925 0.05831 2026-02-12T08:54:57.418 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 230 16 63066 63050 1.07074 0.875 0.0882897 0.0583531 2026-02-12T08:54:58.418 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 231 16 63279 63263 1.0697 0.832031 0.048022 0.0584099 2026-02-12T08:54:59.418 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 232 16 63500 63484 1.06881 0.863281 0.0469874 0.0584625 2026-02-12T08:55:00.418 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 233 16 63734 63718 1.06815 0.914062 0.0334338 0.0585026 2026-02-12T08:55:01.419 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 234 16 63964 63948 1.06742 0.898438 0.0457758 0.0585411 2026-02-12T08:55:02.418 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 235 16 64180 64164 1.06647 0.84375 0.0634455 0.0585935 2026-02-12T08:55:03.419 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 236 16 64404 64388 1.06566 0.875 0.0511332 0.0586337 2026-02-12T08:55:04.419 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 237 16 64621 64605 1.06474 0.847656 0.0985664 0.0586878 2026-02-12T08:55:05.419 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 238 16 64846 64830 1.06396 0.878906 0.0995483 0.058729 2026-02-12T08:55:06.419 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 239 16 65069 65053 1.06315 0.871094 0.0519283 0.0587712 2026-02-12T08:55:07.419 INFO:tasks.radosbench.radosbench.0.trial025.stdout:2026-02-12T08:55:07.417192+0000 min lat: 0.00989178 max lat: 0.46563 avg lat: 0.0588287 2026-02-12T08:55:07.419 INFO:tasks.radosbench.radosbench.0.trial025.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T08:55:07.419 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 240 16 65279 65263 1.06214 0.820312 0.0670711 0.0588287 2026-02-12T08:55:08.419 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 241 16 65495 65479 1.06123 0.84375 0.0651623 0.0588817 2026-02-12T08:55:09.419 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 242 16 65702 65686 1.06019 0.808594 0.145712 0.0589382 2026-02-12T08:55:10.419 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 243 16 65918 65902 1.0593 0.84375 0.047084 0.0589913 2026-02-12T08:55:11.419 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 244 16 66143 66127 1.05856 0.878906 0.0656542 0.0590309 2026-02-12T08:55:12.419 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 245 16 66355 66339 1.05762 0.828125 0.0570172 0.0590848 2026-02-12T08:55:13.419 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 246 16 66564 66548 1.05663 0.816406 0.0656703 0.0591359 2026-02-12T08:55:14.419 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 247 16 66772 66756 1.05565 0.8125 0.0746027 0.0591905 2026-02-12T08:55:15.419 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 248 16 66991 66975 1.05484 0.855469 0.0862469 0.0592408 2026-02-12T08:55:16.420 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 249 16 67196 67180 1.05382 0.800781 0.0696039 0.059295 2026-02-12T08:55:17.420 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 250 16 67415 67399 1.05302 0.855469 0.0592976 0.0593363 2026-02-12T08:55:18.420 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 251 16 67632 67616 1.05221 0.847656 0.0703805 0.059387 2026-02-12T08:55:19.420 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 252 16 67838 67822 1.05122 0.804688 0.0477133 0.0594386 2026-02-12T08:55:20.420 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 253 16 68052 68036 1.05037 0.835938 0.049955 0.0594888 2026-02-12T08:55:21.420 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 254 16 68267 68251 1.04954 0.839844 0.0744716 0.0595356 2026-02-12T08:55:22.420 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 255 16 68474 68458 1.0486 0.808594 0.0433056 0.0595905 2026-02-12T08:55:23.420 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 256 16 68691 68675 1.04781 0.847656 0.0923108 0.059636 2026-02-12T08:55:24.420 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 257 16 68906 68890 1.047 0.839844 0.0432536 0.0596812 2026-02-12T08:55:25.420 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 258 16 69119 69103 1.04617 0.832031 0.0531564 0.059732 2026-02-12T08:55:26.420 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 259 16 69334 69318 1.04537 0.839844 0.139081 0.0597743 2026-02-12T08:55:27.420 INFO:tasks.radosbench.radosbench.0.trial025.stdout:2026-02-12T08:55:27.418699+0000 min lat: 0.00989178 max lat: 0.46563 avg lat: 0.0598205 2026-02-12T08:55:27.421 INFO:tasks.radosbench.radosbench.0.trial025.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T08:55:27.421 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 260 16 69544 69528 1.04451 0.820312 0.109135 0.0598205 2026-02-12T08:55:28.420 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 261 16 69752 69736 1.04362 0.8125 0.177105 0.0598709 2026-02-12T08:55:29.421 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 262 16 69968 69952 1.04285 0.84375 0.078574 0.059919 2026-02-12T08:55:30.421 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 263 16 70178 70162 1.04201 0.820312 0.0880007 0.0599695 2026-02-12T08:55:31.421 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 264 16 70375 70359 1.04098 0.769531 0.0701297 0.0600258 2026-02-12T08:55:32.421 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 265 16 70584 70568 1.04013 0.816406 0.0549145 0.0600756 2026-02-12T08:55:33.421 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 266 16 70791 70775 1.03926 0.808594 0.0860787 0.0601246 2026-02-12T08:55:34.421 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 267 16 70999 70983 1.03841 0.8125 0.0491118 0.0601768 2026-02-12T08:55:35.421 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 268 16 71214 71198 1.03767 0.839844 0.0872379 0.0602192 2026-02-12T08:55:36.421 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 269 16 71433 71417 1.03699 0.855469 0.0936234 0.0602575 2026-02-12T08:55:37.421 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 270 16 71638 71622 1.03611 0.800781 0.0510254 0.060309 2026-02-12T08:55:38.421 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 271 16 71829 71813 1.03504 0.746094 0.0938964 0.060366 2026-02-12T08:55:39.421 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 272 16 72047 72031 1.03437 0.851562 0.0426783 0.0604094 2026-02-12T08:55:40.421 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 273 16 72255 72239 1.03356 0.8125 0.0746757 0.0604602 2026-02-12T08:55:41.421 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 274 16 72461 72445 1.03272 0.804688 0.054119 0.0605087 2026-02-12T08:55:42.422 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 275 16 72660 72644 1.03179 0.777344 0.183155 0.0605629 2026-02-12T08:55:43.422 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 276 16 72863 72847 1.03093 0.792969 0.0911294 0.0606117 2026-02-12T08:55:44.422 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 277 16 73067 73051 1.03008 0.796875 0.0739358 0.0606601 2026-02-12T08:55:45.422 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 278 16 73284 73268 1.02943 0.847656 0.0871693 0.0607008 2026-02-12T08:55:46.422 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 279 16 73494 73478 1.02868 0.820312 0.0676 0.0607424 2026-02-12T08:55:47.422 INFO:tasks.radosbench.radosbench.0.trial025.stdout:2026-02-12T08:55:47.420231+0000 min lat: 0.00989178 max lat: 0.46563 avg lat: 0.0607886 2026-02-12T08:55:47.422 INFO:tasks.radosbench.radosbench.0.trial025.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T08:55:47.422 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 280 16 73703 73687 1.02792 0.816406 0.0522429 0.0607886 2026-02-12T08:55:48.422 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 281 16 73908 73892 1.02711 0.800781 0.138478 0.0608392 2026-02-12T08:55:49.422 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 282 16 74115 74099 1.02633 0.808594 0.0787854 0.0608821 2026-02-12T08:55:50.422 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 283 16 74324 74308 1.02559 0.816406 0.0961369 0.0609273 2026-02-12T08:55:51.422 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 284 16 74518 74502 1.02465 0.757812 0.0392777 0.0609843 2026-02-12T08:55:52.422 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 285 16 74716 74700 1.02377 0.773438 0.0501192 0.0610349 2026-02-12T08:55:53.422 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 286 16 74913 74897 1.02288 0.769531 0.0479055 0.061089 2026-02-12T08:55:54.422 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 287 16 75123 75107 1.02217 0.820312 0.0454314 0.0611326 2026-02-12T08:55:55.423 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 288 16 75322 75306 1.02132 0.777344 0.0721162 0.0611849 2026-02-12T08:55:56.423 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 289 16 75518 75502 1.02044 0.765625 0.0669018 0.0612354 2026-02-12T08:55:57.423 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 290 16 75716 75700 1.01958 0.773438 0.0989605 0.0612863 2026-02-12T08:55:58.422 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 291 16 75920 75904 1.01882 0.796875 0.120965 0.0613339 2026-02-12T08:55:59.423 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 292 16 76120 76104 1.018 0.78125 0.118183 0.0613825 2026-02-12T08:56:00.423 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 293 16 76323 76307 1.01724 0.792969 0.0483216 0.0614198 2026-02-12T08:56:01.423 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 294 16 76533 76517 1.01657 0.820312 0.0987779 0.0614701 2026-02-12T08:56:02.423 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 295 16 76731 76715 1.01574 0.773438 0.109588 0.0615197 2026-02-12T08:56:03.423 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 296 16 76928 76912 1.01491 0.769531 0.0643451 0.0615702 2026-02-12T08:56:04.423 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 297 16 77123 77107 1.01406 0.761719 0.0403446 0.061623 2026-02-12T08:56:05.423 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 298 16 77327 77311 1.01333 0.796875 0.111075 0.0616663 2026-02-12T08:56:06.423 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 299 16 77524 77508 1.01251 0.769531 0.129604 0.0617116 2026-02-12T08:56:07.423 INFO:tasks.radosbench.radosbench.0.trial025.stdout:2026-02-12T08:56:07.421771+0000 min lat: 0.00989178 max lat: 0.46563 avg lat: 0.0617582 2026-02-12T08:56:07.424 INFO:tasks.radosbench.radosbench.0.trial025.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T08:56:07.424 INFO:tasks.radosbench.radosbench.0.trial025.stdout: 300 11 77724 77713 1.01181 0.800781 0.0581273 0.0617582 2026-02-12T08:56:08.424 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Total time run: 300.077 2026-02-12T08:56:08.424 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Total writes made: 77724 2026-02-12T08:56:08.424 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Write size: 4096 2026-02-12T08:56:08.424 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Object size: 4096 2026-02-12T08:56:08.424 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Bandwidth (MB/sec): 1.01177 2026-02-12T08:56:08.424 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Stddev Bandwidth: 0.17246 2026-02-12T08:56:08.424 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Max bandwidth (MB/sec): 1.41406 2026-02-12T08:56:08.424 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Min bandwidth (MB/sec): 0.746094 2026-02-12T08:56:08.424 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Average IOPS: 259 2026-02-12T08:56:08.425 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Stddev IOPS: 44.1497 2026-02-12T08:56:08.425 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Max IOPS: 362 2026-02-12T08:56:08.425 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Min IOPS: 191 2026-02-12T08:56:08.425 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Average Latency(s): 0.0617617 2026-02-12T08:56:08.425 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Stddev Latency(s): 0.0294503 2026-02-12T08:56:08.425 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Max latency(s): 0.46563 2026-02-12T08:56:08.425 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Min latency(s): 0.00989178 2026-02-12T08:56:08.450 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Cleaning up (deleting benchmark objects) 2026-02-12T09:04:03.477 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Removed 77724 objects 2026-02-12T09:04:03.477 INFO:tasks.radosbench.radosbench.0.trial025.stdout:Clean up completed and total clean up time :475.027 2026-02-12T09:04:08.307 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2026-02-12T09:04:08.308 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2026-02-12T09:04:08.391 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T09:04:08.384+0000 7f45315d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T09:04:08.392 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T09:04:08.390+0000 7f45315d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T09:04:09.222 INFO:teuthology.orchestra.run.trial025.stderr:pool 'unique_pool_0' removed 2026-02-12T09:04:09.235 DEBUG:teuthology.run_tasks:Unwinding manager ssh_keys 2026-02-12T09:04:09.245 INFO:teuthology.task.ssh_keys:Cleaning up SSH keys 2026-02-12T09:04:09.246 INFO:teuthology.task.ssh_keys:cleaning up keys added for testing 2026-02-12T09:04:09.246 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on trial025.front.sepia.ceph.com 2026-02-12T09:04:09.246 DEBUG:teuthology.orchestra.run.trial025:> rm -- /home/ubuntu/.ssh/id_rsa 2026-02-12T09:04:09.266 DEBUG:teuthology.orchestra.run.trial025:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2026-02-12T09:04:09.322 DEBUG:teuthology.orchestra.run.trial025:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2026-02-12T09:04:09.378 INFO:teuthology.orchestra.run.trial025.stdout:"600" 2026-02-12T09:04:09.382 DEBUG:teuthology.orchestra.run.trial025:> mv -- /home/ubuntu/.ssh/authorized_keys_2026-02-12_08:51:04:800336 /home/ubuntu/.ssh/authorized_keys 2026-02-12T09:04:09.436 DEBUG:teuthology.orchestra.run.trial025:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2026-02-12T09:04:09.503 DEBUG:teuthology.orchestra.run.trial025:> rm /home/ubuntu/.ssh/config 2026-02-12T09:04:09.569 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-12T09:04:09.582 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-12T09:04:09.704 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T09:04:09.697+0000 7f534cda4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T09:04:09.705 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-12T09:04:09.702+0000 7f534cda4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T09:04:09.846 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-12T09:04:09.846 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-12T09:04:09.846 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-12T09:04:09.846 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T09:04:09.939 INFO:tasks.ceph.osd.0:Stopped 2026-02-12T09:04:09.939 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-12T09:04:09.939 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T09:04:10.023 INFO:tasks.ceph.osd.1:Stopped 2026-02-12T09:04:10.023 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-12T09:04:10.023 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T09:04:10.112 INFO:tasks.ceph.osd.2:Stopped 2026-02-12T09:04:10.112 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-12T09:04:10.112 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-12T09:04:10.112 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T09:04:10.143 INFO:tasks.ceph.mgr.x:Stopped 2026-02-12T09:04:10.143 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-12T09:04:10.144 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-12T09:04:10.144 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T09:04:10.192 INFO:tasks.ceph.mon.a:Stopped 2026-02-12T09:04:10.192 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-12T09:04:10.192 DEBUG:teuthology.orchestra.run.trial025:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v '\(PG_' | grep -E -v '\(OSD_' | grep -E -v '\(OBJECT_' | grep -E -v 'overall HEALTH' | head -n 1 2026-02-12T09:04:10.257 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial025.front.sepia.ceph.com 2026-02-12T09:04:10.258 DEBUG:teuthology.orchestra.run.trial025:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-12T09:04:10.472 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial025.front.sepia.ceph.com 2026-02-12T09:04:10.472 DEBUG:teuthology.orchestra.run.trial025:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-12T09:04:10.500 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial025.front.sepia.ceph.com 2026-02-12T09:04:10.500 DEBUG:teuthology.orchestra.run.trial025:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-12T09:04:10.569 INFO:tasks.ceph:Archiving mon data... 2026-02-12T09:04:10.571 DEBUG:teuthology.misc:Transferring archived files from trial025:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41553/data/mon.a.tgz 2026-02-12T09:04:10.571 DEBUG:teuthology.orchestra.run.trial025:> mktemp 2026-02-12T09:04:10.625 INFO:teuthology.orchestra.run.trial025.stdout:/tmp/tmp.ogSTKuf4bg 2026-02-12T09:04:10.626 DEBUG:teuthology.orchestra.run.trial025:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ogSTKuf4bg 2026-02-12T09:04:10.714 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod 0666 /tmp/tmp.ogSTKuf4bg 2026-02-12T09:04:10.795 DEBUG:teuthology.orchestra.remote:trial025:/tmp/tmp.ogSTKuf4bg is 213KB 2026-02-12T09:04:10.889 DEBUG:teuthology.orchestra.run.trial025:> rm -fr /tmp/tmp.ogSTKuf4bg 2026-02-12T09:04:10.906 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-12T09:04:10.906 DEBUG:teuthology.orchestra.run.trial025:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T09:04:11.026 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T09:04:11.026 INFO:tasks.ceph:Archiving crash dumps... 2026-02-12T09:04:11.028 DEBUG:teuthology.misc:Transferring archived files from trial025:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41553/remote/trial025/crash 2026-02-12T09:04:11.030 DEBUG:teuthology.orchestra.run.trial025:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T09:04:11.091 INFO:tasks.ceph:Compressing logs... 2026-02-12T09:04:11.091 DEBUG:teuthology.orchestra.run.trial025:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T09:04:11.155 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-12T09:04:11.168 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-12T09:04:11.168 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22966.log 2026-02-12T09:04:11.168 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-12T09:04:11.168 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22378.log 2026-02-12T09:04:11.168 INFO:teuthology.orchestra.run.trial025.stderr: 48.4% -- replaced with /var/log/ceph/ceph-client.admin.22966.log.gz 2026-02-12T09:04:11.169 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-osd.0.log: 91.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-12T09:04:11.169 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22427.log 2026-02-12T09:04:11.169 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22528.log 2026-02-12T09:04:11.169 INFO:teuthology.orchestra.run.trial025.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22378.log.gz 2026-02-12T09:04:11.169 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22427.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22427.log.gz 2026-02-12T09:04:11.169 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22917.log 2026-02-12T09:04:11.169 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22529.log 2026-02-12T09:04:11.169 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22917.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22528.log.gz 2026-02-12T09:04:11.169 INFO:teuthology.orchestra.run.trial025.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22917.log.gz 2026-02-12T09:04:11.169 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21281.log 2026-02-12T09:04:11.169 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22529.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22529.log.gz 2026-02-12T09:04:11.170 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22677.log 2026-02-12T09:04:11.170 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.21281.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.21281.log.gz 2026-02-12T09:04:11.170 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22530.log 2026-02-12T09:04:11.170 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.23301.log 2026-02-12T09:04:11.170 INFO:teuthology.orchestra.run.trial025.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22677.log.gz 2026-02-12T09:04:11.170 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22214.log 2026-02-12T09:04:11.170 INFO:teuthology.orchestra.run.trial025.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22530.log.gz 2026-02-12T09:04:11.170 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.0.23301.log: 66.4% -- replaced with /var/log/ceph/ceph-client.0.23301.log.gz 2026-02-12T09:04:11.170 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21902.log 2026-02-12T09:04:11.170 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22280.log 2026-02-12T09:04:11.170 INFO:teuthology.orchestra.run.trial025.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.22214.log.gz 2026-02-12T09:04:11.170 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.21902.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.21902.log.gz 2026-02-12T09:04:11.171 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22823.log 2026-02-12T09:04:11.171 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21560.log 2026-02-12T09:04:11.171 INFO:teuthology.orchestra.run.trial025.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22280.log.gz 2026-02-12T09:04:11.171 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22823.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22823.log.gz 2026-02-12T09:04:11.171 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22118.log 2026-02-12T09:04:11.171 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.21560.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.21560.log.gz 2026-02-12T09:04:11.171 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22676.log 2026-02-12T09:04:11.171 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22118.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22118.log.gz 2026-02-12T09:04:11.171 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22824.log 2026-02-12T09:04:11.171 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22676.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.22676.log.gz 2026-02-12T09:04:11.171 INFO:teuthology.orchestra.run.trial025.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.23226.log 2026-02-12T09:04:11.172 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22824.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22824.log.gz 2026-02-12T09:04:11.172 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23015.log 2026-02-12T09:04:11.172 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23226.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23226.log.gz 2026-02-12T09:04:11.172 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21423.log 2026-02-12T09:04:11.172 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23015.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23015.log.gz 2026-02-12T09:04:11.172 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23697.log 2026-02-12T09:04:11.172 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.21423.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.21423.log.gz 2026-02-12T09:04:11.172 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21607.log 2026-02-12T09:04:11.172 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23697.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23697.log.gz 2026-02-12T09:04:11.172 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23512.log 2026-02-12T09:04:11.172 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.21607.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.21607.log.gz 2026-02-12T09:04:11.172 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22329.log 2026-02-12T09:04:11.173 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23512.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23512.log.gz 2026-02-12T09:04:11.173 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-12T09:04:11.173 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22329.log: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.22329.log.gz 2026-02-12T09:04:11.173 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-12T09:04:11.173 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21873.log 2026-02-12T09:04:11.173 INFO:teuthology.orchestra.run.trial025.stderr: 86.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-12T09:04:11.173 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21376.log 2026-02-12T09:04:11.173 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.21873.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.21873.log.gz 2026-02-12T09:04:11.173 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23278.log 2026-02-12T09:04:11.173 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.21376.log: gzip -5 --verbose 49.6% -- -- replaced with /var/log/ceph/ceph-client.admin.21376.log.gz /var/log/ceph/ceph-client.admin.21654.log 2026-02-12T09:04:11.173 INFO:teuthology.orchestra.run.trial025.stderr: 2026-02-12T09:04:11.174 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23278.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23278.log.gz 2026-02-12T09:04:11.174 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22189.log 2026-02-12T09:04:11.174 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.21654.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-12T09:04:11.174 INFO:teuthology.orchestra.run.trial025.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.21654.log.gz 2026-02-12T09:04:11.174 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22050.log 2026-02-12T09:04:11.174 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22189.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22189.log.gz 2026-02-12T09:04:11.174 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-12T09:04:11.174 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22675.log 2026-02-12T09:04:11.174 INFO:teuthology.orchestra.run.trial025.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22050.log.gz 2026-02-12T09:04:11.174 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22770.log 2026-02-12T09:04:11.174 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22675.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22675.log.gz 2026-02-12T09:04:11.174 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.19989.log 2026-02-12T09:04:11.174 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.22770.log: 88.6% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-12T09:04:11.175 INFO:teuthology.orchestra.run.trial025.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22770.log.gz 2026-02-12T09:04:11.175 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph.tmp-client.admin.19989.log: 67.5% -- replaced with /var/log/ceph/ceph.tmp-client.admin.19989.log.gz 2026-02-12T09:04:11.185 INFO:teuthology.orchestra.run.trial025.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-12T09:04:50.992 INFO:teuthology.orchestra.run.trial025.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-12T09:04:52.199 INFO:teuthology.orchestra.run.trial025.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-12T09:04:59.738 INFO:teuthology.orchestra.run.trial025.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-12T09:04:59.740 INFO:teuthology.orchestra.run.trial025.stderr: 2026-02-12T09:04:59.740 INFO:teuthology.orchestra.run.trial025.stderr:real 0m48.594s 2026-02-12T09:04:59.740 INFO:teuthology.orchestra.run.trial025.stderr:user 2m3.625s 2026-02-12T09:04:59.740 INFO:teuthology.orchestra.run.trial025.stderr:sys 0m5.610s 2026-02-12T09:04:59.741 INFO:tasks.ceph:Archiving logs... 2026-02-12T09:04:59.741 DEBUG:teuthology.misc:Transferring archived files from trial025:/var/log/ceph to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41553/remote/trial025/log 2026-02-12T09:04:59.742 DEBUG:teuthology.orchestra.run.trial025:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T09:05:08.881 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T09:05:08.951 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T09:05:08.962 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-12T09:05:08.962 DEBUG:teuthology.orchestra.run.trial025:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T09:05:08.988 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-12T09:05:08.998 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-12T09:05:08.998 DEBUG:teuthology.orchestra.run.trial025:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T09:05:09.043 INFO:teuthology.orchestra.run.trial025.stderr:bash: line 1: ntpq: command not found 2026-02-12T09:05:09.078 INFO:teuthology.orchestra.run.trial025.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T09:05:09.078 INFO:teuthology.orchestra.run.trial025.stdout:=============================================================================== 2026-02-12T09:05:09.078 INFO:teuthology.orchestra.run.trial025.stdout:^- white.web-ster.com 2 6 377 1058 -838us[ +59us] +/- 78ms 2026-02-12T09:05:09.078 INFO:teuthology.orchestra.run.trial025.stdout:^- 170-187-147-56.ip.linode> 2 7 377 24 -4553us[-4553us] +/- 81ms 2026-02-12T09:05:09.078 INFO:teuthology.orchestra.run.trial025.stdout:^- time-usw2.crimpac.net 2 6 377 23 -788us[ -788us] +/- 85ms 2026-02-12T09:05:09.078 INFO:teuthology.orchestra.run.trial025.stdout:^* s2-b.time.mci1.us.rozint> 2 6 377 26 +1357ns[ +17us] +/- 23ms 2026-02-12T09:05:09.079 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-12T09:05:09.094 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-12T09:05:09.095 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-12T09:05:09.108 DEBUG:teuthology.orchestra.run.trial025:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T09:05:09.161 DEBUG:teuthology.orchestra.run.trial025:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T09:05:09.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T09:05:09.225 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-12T09:05:09.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-12T09:05:09.249 INFO:teuthology.task.internal:Duration was 1603.318991 seconds 2026-02-12T09:05:09.250 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-12T09:05:09.262 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-12T09:05:09.262 DEBUG:teuthology.orchestra.run.trial025:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T09:05:09.302 INFO:teuthology.orchestra.run.trial025.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T09:05:09.464 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-12T09:05:09.464 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial025.front.sepia.ceph.com 2026-02-12T09:05:09.464 DEBUG:teuthology.orchestra.run.trial025:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T09:05:09.522 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-12T09:05:09.522 DEBUG:teuthology.orchestra.run.trial025:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T09:05:09.606 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-12T09:05:09.607 DEBUG:teuthology.orchestra.run.trial025:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T09:05:09.672 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T09:05:09.672 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T09:05:09.672 INFO:teuthology.orchestra.run.trial025.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T09:05:09.672 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T09:05:09.672 INFO:teuthology.orchestra.run.trial025.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T09:05:09.675 INFO:teuthology.orchestra.run.trial025.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T09:05:09.677 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-12T09:05:09.695 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-12T09:05:09.695 DEBUG:teuthology.orchestra.run.trial025:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T09:05:09.742 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-12T09:05:09.760 DEBUG:teuthology.orchestra.run.trial025:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T09:05:09.807 INFO:teuthology.orchestra.run.trial025.stdout:kernel.core_pattern = core 2026-02-12T09:05:09.821 DEBUG:teuthology.orchestra.run.trial025:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T09:05:09.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T09:05:09.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-12T09:05:09.895 INFO:teuthology.task.internal:Transferring archived files... 2026-02-12T09:05:09.896 DEBUG:teuthology.misc:Transferring archived files from trial025:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41553/remote/trial025 2026-02-12T09:05:09.896 DEBUG:teuthology.orchestra.run.trial025:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T09:05:09.953 INFO:teuthology.task.internal:Removing archive directory... 2026-02-12T09:05:09.953 DEBUG:teuthology.orchestra.run.trial025:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T09:05:09.999 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-12T09:05:10.019 INFO:teuthology.task.internal:Not uploading archives. 2026-02-12T09:05:10.019 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-12T09:05:10.038 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-12T09:05:10.038 DEBUG:teuthology.orchestra.run.trial025:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T09:05:10.054 INFO:teuthology.orchestra.run.trial025.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 09:05 /home/ubuntu/cephtest 2026-02-12T09:05:10.056 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T09:05:10.074 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T09:05:10.113 INFO:teuthology.run:Summary data: description: crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} perf_ignorelist settings/optimized workloads/radosbench_omap_write} duration: 1603.318990945816 flavor: debug owner: scheduled_matan@soko04.front.sepia.ceph.com success: true 2026-02-12T09:05:10.114 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:05:10.225 INFO:teuthology.run:pass