2026-02-12T12:41:18.660 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-12T12:41:18.675 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:41:18.756 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial/45939 branch: main description: crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} perf_ignorelist settings/optimized workloads/radosbench_omap_write} email: null first_in_suite: false flavor: debug job_id: '45939' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: global: auth client required: none auth cluster required: none auth service required: none auth supported: none debug asok: 0/0 debug auth: 0/0 debug bdev: 0/0 debug bluefs: 0/0 debug bluestore: 0/0 debug buffer: 0/0 debug civetweb: 0/0 debug client: 0/0 debug compressor: 0/0 debug context: 0/0 debug crush: 0/0 debug crypto: 0/0 debug dpdk: 0/0 debug eventtrace: 0/0 debug filer: 0/0 debug filestore: 0/0 debug finisher: 0/0 debug fuse: 0/0 debug heartbeatmap: 0/0 debug javaclient: 0/0 debug journal: 0/0 debug journaler: 0/0 debug kstore: 0/0 debug leveldb: 0/0 debug lockdep: 0/0 debug mds: 0/0 debug mds balancer: 0/0 debug mds locker: 0/0 debug mds log: 0/0 debug mds log expire: 0/0 debug mds migrator: 0/0 debug memdb: 0/0 debug mgr: 0/0 debug mgrc: 0/0 debug mon: 0/0 debug monc: 0/0 debug ms: 0/0 debug objclass: 0/0 debug objectcacher: 0/0 debug objecter: 0/0 debug optracker: 0/0 debug osd: 0/0 debug paxos: 0/0 debug perfcounter: 0/0 debug rados: 0/0 debug rbd: 0/0 debug rbd mirror: 0/0 debug rbd replay: 0/0 debug refs: 0/0 debug rgw: 0/0 debug rgw lifecycle: 0/0 debug rgw notification: 0/0 debug rgw sync: 0/0 debug rocksdb: 0/0 debug striper: 0/0 debug throttle: 0/0 debug timer: 0/0 debug tp: 0/0 enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 0/0 debug ms: 0/0 debug paxos: 0/0 osd pool default crimson: true osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug filestore: 0/0 debug journal: 0/0 debug ms: 0/0 debug osd: 0/0 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd objectstore: seastore osd shutdown pgref assert: true seastore cachepin size pershard: 64M seastore main device type: RANDOM_BLOCK_SSD seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - \(PG_ - \(OSD_ - \(OBJECT_ - overall HEALTH sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} install: ceph: flavor: debug sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 workunit: branch: seastore_io_uring env: CRIMSON_COMPAT: '1' sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 owner: scheduled_moagrawa@soko04.front.sepia.ceph.com priority: 1000 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 4100 sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 sleep_before_teardown: 0 suite: crimson-rados suite_branch: seastore_io_uring suite_path: /home/teuthworker/src/github.com_mohit84_ceph_5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/qa suite_relpath: qa suite_repo: https://github.com/mohit84/ceph.git suite_sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 targets: trial049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA60v2LlW/aTSD+AqfHY/hr6JeKVvvZRx4fgPPg6gDtKKmeuK9msrMvKtfD7Qg7lR6ADJAkPXJ4j3Eu3U5Ee0Vc= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: osd: debug monc: 20 wait-for-scrub: false - ssh_keys: null - radosbench: clients: - client.0 objectsize: 4096 size: 4096 time: 300 write-omap: true teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-12_06:08:11 tube: trial user: moagrawa verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.2161924 2026-02-12T12:41:18.756 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_mohit84_ceph_5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/qa; will attempt to use it 2026-02-12T12:41:18.757 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_mohit84_ceph_5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/qa/tasks 2026-02-12T12:41:18.757 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T12:41:18.766 INFO:teuthology.task.internal:Checking packages... 2026-02-12T12:41:18.766 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0' 2026-02-12T12:41:18.766 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T12:41:18.766 INFO:teuthology.packaging:ref: None 2026-02-12T12:41:18.766 INFO:teuthology.packaging:tag: None 2026-02-12T12:41:18.766 INFO:teuthology.packaging:branch: main 2026-02-12T12:41:18.766 INFO:teuthology.packaging:sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T12:41:18.766 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=main 2026-02-12T12:41:18.928 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5273.g2bf58db4 2026-02-12T12:41:18.929 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T12:41:18.941 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T12:41:18.941 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T12:41:18.955 INFO:teuthology.task.internal:Saving configuration 2026-02-12T12:41:18.973 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T12:41:18.987 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T12:41:19.073 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial049.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial/45939', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 12:38:05.862260', 'locked_by': 'scheduled_moagrawa@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA60v2LlW/aTSD+AqfHY/hr6JeKVvvZRx4fgPPg6gDtKKmeuK9msrMvKtfD7Qg7lR6ADJAkPXJ4j3Eu3U5Ee0Vc='} 2026-02-12T12:41:19.074 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T12:41:19.085 INFO:teuthology.task.internal:roles: ubuntu@trial049.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-12T12:41:19.085 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T12:41:19.174 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7dc94a8ffb00>, signals=[15]) 2026-02-12T12:41:19.174 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T12:41:19.186 INFO:teuthology.task.internal:Opening connections... 2026-02-12T12:41:19.186 DEBUG:teuthology.task.internal:connecting to ubuntu@trial049.front.sepia.ceph.com 2026-02-12T12:41:19.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T12:41:19.246 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T12:41:19.258 DEBUG:teuthology.orchestra.run.trial049:> uname -m 2026-02-12T12:41:19.324 INFO:teuthology.orchestra.run.trial049.stdout:x86_64 2026-02-12T12:41:19.325 DEBUG:teuthology.orchestra.run.trial049:> cat /etc/os-release 2026-02-12T12:41:19.380 INFO:teuthology.orchestra.run.trial049.stdout:NAME="CentOS Stream" 2026-02-12T12:41:19.380 INFO:teuthology.orchestra.run.trial049.stdout:VERSION="9" 2026-02-12T12:41:19.380 INFO:teuthology.orchestra.run.trial049.stdout:ID="centos" 2026-02-12T12:41:19.380 INFO:teuthology.orchestra.run.trial049.stdout:ID_LIKE="rhel fedora" 2026-02-12T12:41:19.380 INFO:teuthology.orchestra.run.trial049.stdout:VERSION_ID="9" 2026-02-12T12:41:19.381 INFO:teuthology.orchestra.run.trial049.stdout:PLATFORM_ID="platform:el9" 2026-02-12T12:41:19.381 INFO:teuthology.orchestra.run.trial049.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T12:41:19.381 INFO:teuthology.orchestra.run.trial049.stdout:ANSI_COLOR="0;31" 2026-02-12T12:41:19.381 INFO:teuthology.orchestra.run.trial049.stdout:LOGO="fedora-logo-icon" 2026-02-12T12:41:19.381 INFO:teuthology.orchestra.run.trial049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T12:41:19.381 INFO:teuthology.orchestra.run.trial049.stdout:HOME_URL="https://centos.org/" 2026-02-12T12:41:19.381 INFO:teuthology.orchestra.run.trial049.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T12:41:19.381 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T12:41:19.381 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T12:41:19.382 INFO:teuthology.lock.ops:Updating trial049.front.sepia.ceph.com on lock server 2026-02-12T12:41:19.472 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T12:41:19.485 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T12:41:19.496 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T12:41:19.496 DEBUG:teuthology.orchestra.run.trial049:> test '!' -e /home/ubuntu/cephtest 2026-02-12T12:41:19.511 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T12:41:19.522 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T12:41:19.522 DEBUG:teuthology.orchestra.run.trial049:> test -z $(ls -A /var/lib/ceph) 2026-02-12T12:41:19.568 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T12:41:19.677 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T12:41:19.699 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-12T12:41:19.699 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-12T12:41:19.699 DEBUG:teuthology.orchestra.run.trial049:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T12:41:19.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T12:41:19.714 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T12:41:19.769 INFO:teuthology.orchestra.run.trial049.stdout:5.14.0-645.el9.x86_64 2026-02-12T12:41:19.770 INFO:teuthology.task.kernel:Running kernel on trial049: 5.14.0-645.el9.x86_64 2026-02-12T12:41:19.770 DEBUG:teuthology.orchestra.run.trial049:> sudo yum install -y kernel 2026-02-12T12:41:20.842 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-12T12:41:28.846 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - AppStream 3.6 MB/s | 27 MB 00:07 2026-02-12T12:41:32.939 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 7.8 MB 00:01 2026-02-12T12:41:49.224 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - Extras packages 1.3 kB/s | 20 kB 00:15 2026-02-12T12:41:54.311 INFO:teuthology.orchestra.run.trial049.stdout:Extra Packages for Enterprise Linux 4.0 MB/s | 20 MB 00:05 2026-02-12T12:42:00.656 INFO:teuthology.orchestra.run.trial049.stdout:lab-extras 16 kB/s | 50 kB 00:03 2026-02-12T12:42:01.725 INFO:teuthology.orchestra.run.trial049.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T12:42:01.745 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:42:01.746 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:42:01.746 INFO:teuthology.orchestra.run.trial049.stdout: Package Architecture Version Repository Size 2026-02-12T12:42:01.746 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:42:01.746 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T12:42:01.746 INFO:teuthology.orchestra.run.trial049.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T12:42:01.746 INFO:teuthology.orchestra.run.trial049.stdout:Installing dependencies: 2026-02-12T12:42:01.746 INFO:teuthology.orchestra.run.trial049.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T12:42:01.746 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T12:42:01.746 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T12:42:01.747 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:42:01.747 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T12:42:01.747 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:42:01.747 INFO:teuthology.orchestra.run.trial049.stdout:Install 4 Packages 2026-02-12T12:42:01.747 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:42:01.747 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 88 M 2026-02-12T12:42:01.747 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 135 M 2026-02-12T12:42:01.747 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T12:42:07.021 INFO:teuthology.orchestra.run.trial049.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 147 kB/s | 768 kB 00:05 2026-02-12T12:42:07.168 INFO:teuthology.orchestra.run.trial049.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 3.2 MB/s | 17 MB 00:05 2026-02-12T12:42:07.411 INFO:teuthology.orchestra.run.trial049.stdout:(3/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 7.1 MB/s | 40 MB 00:05 2026-02-12T12:42:07.454 INFO:teuthology.orchestra.run.trial049.stdout:(4/4): kernel-modules-core-5.14.0-677.el9.x86_6 71 MB/s | 31 MB 00:00 2026-02-12T12:42:07.455 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:42:07.455 INFO:teuthology.orchestra.run.trial049.stdout:Total 15 MB/s | 88 MB 00:05 2026-02-12T12:42:07.643 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T12:42:07.846 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T12:42:07.846 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T12:42:08.192 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T12:42:08.192 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T12:42:09.282 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T12:42:09.565 INFO:teuthology.orchestra.run.trial049.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T12:42:09.584 INFO:teuthology.orchestra.run.trial049.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T12:42:11.349 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T12:42:11.377 INFO:teuthology.orchestra.run.trial049.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T12:42:14.463 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T12:42:14.469 INFO:teuthology.orchestra.run.trial049.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T12:42:17.496 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T12:42:48.179 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T12:42:48.200 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T12:42:48.264 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T12:42:48.264 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T12:42:48.265 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T12:42:48.265 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T12:42:48.317 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T12:42:48.317 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:42:48.317 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T12:42:48.317 INFO:teuthology.orchestra.run.trial049.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T12:42:48.317 INFO:teuthology.orchestra.run.trial049.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T12:42:48.317 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T12:42:48.317 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T12:42:48.317 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:42:48.318 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:42:48.375 DEBUG:teuthology.orchestra.run.trial049:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T12:42:48.402 INFO:teuthology.orchestra.run.trial049.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T12:42:48.403 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T12:42:48.403 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T12:42:48.403 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T12:42:48.403 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T12:42:48.403 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T12:42:48.403 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial049.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T12:42:48.404 DEBUG:teuthology.orchestra.run.trial049:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T12:42:48.466 INFO:teuthology.orchestra.run.trial049.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T12:42:48.467 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T12:42:48.467 DEBUG:teuthology.orchestra.run.trial049:> sudo rpm -qi grub2-tools 2026-02-12T12:42:48.536 INFO:teuthology.orchestra.run.trial049.stdout:Name : grub2-tools 2026-02-12T12:42:48.536 INFO:teuthology.orchestra.run.trial049.stdout:Epoch : 1 2026-02-12T12:42:48.536 INFO:teuthology.orchestra.run.trial049.stdout:Version : 2.06 2026-02-12T12:42:48.536 INFO:teuthology.orchestra.run.trial049.stdout:Release : 118.el9 2026-02-12T12:42:48.536 INFO:teuthology.orchestra.run.trial049.stdout:Architecture: x86_64 2026-02-12T12:42:48.537 INFO:teuthology.orchestra.run.trial049.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T12:42:48.537 INFO:teuthology.orchestra.run.trial049.stdout:Group : Unspecified 2026-02-12T12:42:48.537 INFO:teuthology.orchestra.run.trial049.stdout:Size : 8393909 2026-02-12T12:42:48.537 INFO:teuthology.orchestra.run.trial049.stdout:License : GPLv3+ 2026-02-12T12:42:48.537 INFO:teuthology.orchestra.run.trial049.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T12:42:48.537 INFO:teuthology.orchestra.run.trial049.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T12:42:48.537 INFO:teuthology.orchestra.run.trial049.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T12:42:48.537 INFO:teuthology.orchestra.run.trial049.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T12:42:48.537 INFO:teuthology.orchestra.run.trial049.stdout:Packager : builder@centos.org 2026-02-12T12:42:48.537 INFO:teuthology.orchestra.run.trial049.stdout:Vendor : CentOS 2026-02-12T12:42:48.537 INFO:teuthology.orchestra.run.trial049.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T12:42:48.537 INFO:teuthology.orchestra.run.trial049.stdout:Summary : Support tools for GRUB. 2026-02-12T12:42:48.537 INFO:teuthology.orchestra.run.trial049.stdout:Description : 2026-02-12T12:42:48.538 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:42:48.538 INFO:teuthology.orchestra.run.trial049.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T12:42:48.538 INFO:teuthology.orchestra.run.trial049.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T12:42:48.538 INFO:teuthology.orchestra.run.trial049.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T12:42:48.538 INFO:teuthology.orchestra.run.trial049.stdout:hardware devices. 2026-02-12T12:42:48.538 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:42:48.538 INFO:teuthology.orchestra.run.trial049.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T12:42:48.539 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T12:42:48.540 INFO:teuthology.task.kernel:Updating grub on trial049 to boot 5.14.0-677.el9.x86_64 2026-02-12T12:42:48.540 DEBUG:teuthology.orchestra.run.trial049:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T12:42:48.603 INFO:teuthology.orchestra.run.trial049.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T12:42:48.605 DEBUG:teuthology.orchestra.run.trial049:> sudo command -v grubby && echo yes || echo no 2026-02-12T12:42:48.668 INFO:teuthology.orchestra.run.trial049.stdout:/sbin/grubby 2026-02-12T12:42:48.669 INFO:teuthology.orchestra.run.trial049.stdout:yes 2026-02-12T12:42:48.670 DEBUG:teuthology.orchestra.run.trial049:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T12:42:48.734 INFO:teuthology.orchestra.run.trial049.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T12:42:48.735 DEBUG:teuthology.orchestra.run.trial049:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T12:42:48.809 DEBUG:teuthology.orchestra.run.trial049:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T12:42:49.023 INFO:teuthology.orchestra.run.trial049.stderr:Generating grub configuration file ... 2026-02-12T12:42:49.086 INFO:teuthology.orchestra.run.trial049.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T12:42:49.092 INFO:teuthology.orchestra.run.trial049.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T12:42:49.347 INFO:teuthology.orchestra.run.trial049.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T12:42:49.354 INFO:teuthology.orchestra.run.trial049.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T12:42:49.385 INFO:teuthology.orchestra.run.trial049.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T12:42:49.392 INFO:teuthology.orchestra.run.trial049.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T12:42:49.416 INFO:teuthology.orchestra.run.trial049.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T12:42:49.422 INFO:teuthology.orchestra.run.trial049.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T12:42:49.504 INFO:teuthology.orchestra.run.trial049.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T12:42:49.512 INFO:teuthology.orchestra.run.trial049.stderr:done 2026-02-12T12:42:49.514 DEBUG:teuthology.orchestra.run.trial049:> test -d /sys/firmware/efi 2026-02-12T12:42:49.530 DEBUG:teuthology.orchestra.run.trial049:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T12:42:49.595 INFO:teuthology.orchestra.run.trial049.stdout:/boot/efi/EFI/BOOT 2026-02-12T12:42:49.595 INFO:teuthology.orchestra.run.trial049.stdout:/boot/efi/EFI/centos 2026-02-12T12:42:49.597 DEBUG:teuthology.orchestra.run.trial049:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T12:42:49.662 INFO:teuthology.orchestra.run.trial049.stdout:no 2026-02-12T12:42:49.663 DEBUG:teuthology.orchestra.run.trial049:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T12:42:49.727 INFO:teuthology.orchestra.run.trial049.stdout:yes 2026-02-12T12:42:49.727 DEBUG:teuthology.orchestra.run.trial049:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T12:42:49.791 DEBUG:teuthology.orchestra.run.trial049:> sudo shutdown -r now 2026-02-12T12:42:49.866 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T12:43:19.836 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T12:43:19.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T12:43:19.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T12:44:19.884 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T12:44:28.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T12:44:28.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T12:44:29.021 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T12:44:29.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T12:44:29.175 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T12:44:29.176 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T12:44:29.232 INFO:teuthology.orchestra.run.trial049.stdout:5.14.0-677.el9.x86_64 2026-02-12T12:44:29.233 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T12:44:29.233 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T12:44:29.233 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T12:44:30.234 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-12T12:44:30.235 DEBUG:teuthology.orchestra.run.trial049:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T12:44:30.264 INFO:teuthology.orchestra.run.trial049.stdout:ttyS1 2026-02-12T12:44:30.293 DEBUG:teuthology.parallel:result is None 2026-02-12T12:44:30.294 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-12T12:44:30.309 INFO:teuthology.task.internal:Creating test directory... 2026-02-12T12:44:30.309 DEBUG:teuthology.orchestra.run.trial049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T12:44:30.349 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-12T12:44:30.361 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-12T12:44:30.377 INFO:teuthology.task.internal:Creating archive directory... 2026-02-12T12:44:30.377 DEBUG:teuthology.orchestra.run.trial049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T12:44:30.414 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-12T12:44:30.429 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-12T12:44:30.429 DEBUG:teuthology.orchestra.run.trial049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T12:44:30.473 INFO:teuthology.orchestra.run.trial049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T12:44:30.481 INFO:teuthology.orchestra.run.trial049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T12:44:30.483 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-12T12:44:30.497 INFO:teuthology.task.internal:Configuring sudo... 2026-02-12T12:44:30.498 DEBUG:teuthology.orchestra.run.trial049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T12:44:30.547 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-12T12:44:30.562 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-12T12:44:30.562 DEBUG:teuthology.orchestra.run.trial049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T12:44:30.605 DEBUG:teuthology.orchestra.run.trial049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T12:44:30.728 DEBUG:teuthology.orchestra.run.trial049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T12:44:30.752 DEBUG:teuthology.orchestra.run.trial049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T12:44:30.875 DEBUG:teuthology.orchestra.run.trial049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T12:44:30.900 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:44:30.900 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T12:44:30.963 DEBUG:teuthology.orchestra.run.trial049:> sudo service rsyslog restart 2026-02-12T12:44:31.030 INFO:teuthology.orchestra.run.trial049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T12:44:31.242 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-12T12:44:31.254 INFO:teuthology.task.internal:Starting timer... 2026-02-12T12:44:31.255 INFO:teuthology.run_tasks:Running task pcp... 2026-02-12T12:44:31.277 INFO:teuthology.run_tasks:Running task selinux... 2026-02-12T12:44:31.294 DEBUG:teuthology.orchestra.run.trial049:> sudo service auditd rotate 2026-02-12T12:44:31.324 INFO:teuthology.orchestra.run.trial049.stdout:Rotating logs: 2026-02-12T12:44:31.326 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-12T12:44:31.326 DEBUG:teuthology.orchestra.run.trial049:> /usr/sbin/getenforce 2026-02-12T12:44:31.381 INFO:teuthology.orchestra.run.trial049.stdout:Permissive 2026-02-12T12:44:31.382 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial049.front.sepia.ceph.com': 'permissive'} 2026-02-12T12:44:31.382 DEBUG:teuthology.orchestra.run.trial049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T12:44:31.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T12:44:31.446 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-12T12:44:31.447 DEBUG:teuthology.orchestra.run.trial049:> sudo /usr/sbin/setenforce permissive 2026-02-12T12:44:31.512 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-12T12:44:31.527 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-12T12:44:31.530 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-12T12:44:31.649 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-12T12:44:31.660 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-12T12:44:31.661 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial049.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-12T12:45:36.448 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial049.front.sepia.ceph.com')] 2026-02-12T12:45:36.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T12:45:36.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T12:45:36.557 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T12:45:36.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T12:45:36.634 INFO:teuthology.run_tasks:Running task clock... 2026-02-12T12:45:36.651 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-12T12:45:36.651 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T12:45:36.652 DEBUG:teuthology.orchestra.run.trial049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T12:45:36.700 INFO:teuthology.orchestra.run.trial049.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T12:45:36.711 INFO:teuthology.orchestra.run.trial049.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T12:45:36.732 INFO:teuthology.orchestra.run.trial049.stderr:sudo: ntpd: command not found 2026-02-12T12:45:36.742 INFO:teuthology.orchestra.run.trial049.stdout:506 Cannot talk to daemon 2026-02-12T12:45:36.753 INFO:teuthology.orchestra.run.trial049.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T12:45:36.765 INFO:teuthology.orchestra.run.trial049.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T12:45:36.812 INFO:teuthology.orchestra.run.trial049.stderr:bash: line 1: ntpq: command not found 2026-02-12T12:45:36.813 INFO:teuthology.orchestra.run.trial049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T12:45:36.814 INFO:teuthology.orchestra.run.trial049.stdout:=============================================================================== 2026-02-12T12:45:36.815 INFO:teuthology.run_tasks:Running task install... 2026-02-12T12:45:36.829 DEBUG:teuthology.task.install:project ceph 2026-02-12T12:45:36.829 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}} 2026-02-12T12:45:36.829 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'} 2026-02-12T12:45:36.829 INFO:teuthology.task.install:Using flavor: debug 2026-02-12T12:45:36.839 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-12T12:45:36.839 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-12T12:45:36.839 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0', 'tag': None, 'wait_for_package': False} 2026-02-12T12:45:36.840 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T12:45:36.998 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/ 2026-02-12T12:45:36.998 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5145.g5fdb7d8f 2026-02-12T12:45:37.358 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T12:45:37.358 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:45:37.359 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T12:45:37.385 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-12T12:45:37.385 DEBUG:teuthology.orchestra.run.trial049:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T12:45:37.451 DEBUG:teuthology.orchestra.run.trial049:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T12:45:37.525 DEBUG:teuthology.orchestra.run.trial049:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T12:45:37.589 INFO:teuthology.orchestra.run.trial049.stdout:check_obsoletes = 1 2026-02-12T12:45:37.590 DEBUG:teuthology.orchestra.run.trial049:> sudo yum clean all 2026-02-12T12:45:37.736 INFO:teuthology.orchestra.run.trial049.stdout:41 files removed 2026-02-12T12:45:37.750 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-radosgw 2026-02-12T12:45:38.498 INFO:teuthology.orchestra.run.trial049.stdout:ceph packages for x86_64 156 kB/s | 94 kB 00:00 2026-02-12T12:45:39.027 INFO:teuthology.orchestra.run.trial049.stdout:ceph noarch packages 48 kB/s | 24 kB 00:00 2026-02-12T12:45:39.521 INFO:teuthology.orchestra.run.trial049.stdout:ceph source packages 4.4 kB/s | 2.1 kB 00:00 2026-02-12T12:45:50.301 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - BaseOS 845 kB/s | 8.9 MB 00:10 2026-02-12T12:46:17.230 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 27 MB 00:26 2026-02-12T12:46:21.351 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 7.8 MB 00:01 2026-02-12T12:46:22.838 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 20 kB 00:00 2026-02-12T12:46:23.507 INFO:teuthology.orchestra.run.trial049.stdout:Extra Packages for Enterprise Linux 34 MB/s | 20 MB 00:00 2026-02-12T12:46:26.749 INFO:teuthology.orchestra.run.trial049.stdout:lab-extras 2.1 MB/s | 50 kB 00:00 2026-02-12T12:46:28.042 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:46:28.043 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:46:28.043 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repository Size 2026-02-12T12:46:28.044 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:46:28.044 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T12:46:28.044 INFO:teuthology.orchestra.run.trial049.stdout: ceph-radosgw x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 11 M 2026-02-12T12:46:28.044 INFO:teuthology.orchestra.run.trial049.stdout:Upgrading: 2026-02-12T12:46:28.044 INFO:teuthology.orchestra.run.trial049.stdout: librados2 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 3.3 M 2026-02-12T12:46:28.044 INFO:teuthology.orchestra.run.trial049.stdout: librbd1 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 2.7 M 2026-02-12T12:46:28.044 INFO:teuthology.orchestra.run.trial049.stdout:Installing dependencies: 2026-02-12T12:46:28.044 INFO:teuthology.orchestra.run.trial049.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T12:46:28.044 INFO:teuthology.orchestra.run.trial049.stdout: ceph-base x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 5.1 M 2026-02-12T12:46:28.044 INFO:teuthology.orchestra.run.trial049.stdout: ceph-common x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 21 M 2026-02-12T12:46:28.045 INFO:teuthology.orchestra.run.trial049.stdout: ceph-selinux x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 25 k 2026-02-12T12:46:28.045 INFO:teuthology.orchestra.run.trial049.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T12:46:28.045 INFO:teuthology.orchestra.run.trial049.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T12:46:28.045 INFO:teuthology.orchestra.run.trial049.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T12:46:28.045 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs2 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 860 k 2026-02-12T12:46:28.045 INFO:teuthology.orchestra.run.trial049.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T12:46:28.045 INFO:teuthology.orchestra.run.trial049.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T12:46:28.045 INFO:teuthology.orchestra.run.trial049.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T12:46:28.045 INFO:teuthology.orchestra.run.trial049.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T12:46:28.045 INFO:teuthology.orchestra.run.trial049.stdout: libradosstriper1 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 263 k 2026-02-12T12:46:28.045 INFO:teuthology.orchestra.run.trial049.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T12:46:28.045 INFO:teuthology.orchestra.run.trial049.stdout: librgw2 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 5.6 M 2026-02-12T12:46:28.046 INFO:teuthology.orchestra.run.trial049.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T12:46:28.046 INFO:teuthology.orchestra.run.trial049.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T12:46:28.046 INFO:teuthology.orchestra.run.trial049.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T12:46:28.046 INFO:teuthology.orchestra.run.trial049.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T12:46:28.046 INFO:teuthology.orchestra.run.trial049.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T12:46:28.046 INFO:teuthology.orchestra.run.trial049.stdout: python3-ceph-argparse x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 45 k 2026-02-12T12:46:28.046 INFO:teuthology.orchestra.run.trial049.stdout: python3-ceph-common x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 184 k 2026-02-12T12:46:28.046 INFO:teuthology.orchestra.run.trial049.stdout: python3-cephfs x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 203 k 2026-02-12T12:46:28.046 INFO:teuthology.orchestra.run.trial049.stdout: python3-rados x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 324 k 2026-02-12T12:46:28.046 INFO:teuthology.orchestra.run.trial049.stdout: python3-rbd x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 305 k 2026-02-12T12:46:28.046 INFO:teuthology.orchestra.run.trial049.stdout: python3-rgw x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 100 k 2026-02-12T12:46:28.046 INFO:teuthology.orchestra.run.trial049.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T12:46:28.046 INFO:teuthology.orchestra.run.trial049.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T12:46:28.047 INFO:teuthology.orchestra.run.trial049.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T12:46:28.047 INFO:teuthology.orchestra.run.trial049.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T12:46:28.047 INFO:teuthology.orchestra.run.trial049.stdout:Installing weak dependencies: 2026-02-12T12:46:28.047 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs-daemon x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 35 k 2026-02-12T12:46:28.047 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 24 k 2026-02-12T12:46:28.047 INFO:teuthology.orchestra.run.trial049.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-12T12:46:28.047 INFO:teuthology.orchestra.run.trial049.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T12:46:28.047 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:46:28.047 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T12:46:28.047 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:46:28.047 INFO:teuthology.orchestra.run.trial049.stdout:Install 35 Packages 2026-02-12T12:46:28.047 INFO:teuthology.orchestra.run.trial049.stdout:Upgrade 2 Packages 2026-02-12T12:46:28.048 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:46:28.048 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 61 M 2026-02-12T12:46:28.048 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T12:46:30.350 INFO:teuthology.orchestra.run.trial049.stdout:(1/37): ceph-base-20.3.0-5145.g5fdb7d8f.el9.x86 2.5 MB/s | 5.1 MB 00:02 2026-02-12T12:46:30.408 INFO:teuthology.orchestra.run.trial049.stdout:(2/37): ceph-selinux-20.3.0-5145.g5fdb7d8f.el9. 435 kB/s | 25 kB 00:00 2026-02-12T12:46:30.466 INFO:teuthology.orchestra.run.trial049.stdout:(3/37): libcephfs-daemon-20.3.0-5145.g5fdb7d8f. 607 kB/s | 35 kB 00:00 2026-02-12T12:46:30.524 INFO:teuthology.orchestra.run.trial049.stdout:(4/37): libcephfs-proxy2-20.3.0-5145.g5fdb7d8f. 417 kB/s | 24 kB 00:00 2026-02-12T12:46:30.769 INFO:teuthology.orchestra.run.trial049.stdout:(5/37): libcephfs2-20.3.0-5145.g5fdb7d8f.el9.x8 3.4 MB/s | 860 kB 00:00 2026-02-12T12:46:30.890 INFO:teuthology.orchestra.run.trial049.stdout:(6/37): libradosstriper1-20.3.0-5145.g5fdb7d8f. 2.1 MB/s | 263 kB 00:00 2026-02-12T12:46:32.773 INFO:teuthology.orchestra.run.trial049.stdout:(7/37): librgw2-20.3.0-5145.g5fdb7d8f.el9.x86_6 3.0 MB/s | 5.6 MB 00:01 2026-02-12T12:46:32.834 INFO:teuthology.orchestra.run.trial049.stdout:(8/37): python3-ceph-argparse-20.3.0-5145.g5fdb 745 kB/s | 45 kB 00:00 2026-02-12T12:46:32.949 INFO:teuthology.orchestra.run.trial049.stdout:(9/37): python3-ceph-common-20.3.0-5145.g5fdb7d 1.6 MB/s | 184 kB 00:00 2026-02-12T12:46:33.069 INFO:teuthology.orchestra.run.trial049.stdout:(10/37): python3-cephfs-20.3.0-5145.g5fdb7d8f.e 1.7 MB/s | 203 kB 00:00 2026-02-12T12:46:33.242 INFO:teuthology.orchestra.run.trial049.stdout:(11/37): python3-rados-20.3.0-5145.g5fdb7d8f.el 1.8 MB/s | 324 kB 00:00 2026-02-12T12:46:33.417 INFO:teuthology.orchestra.run.trial049.stdout:(12/37): python3-rbd-20.3.0-5145.g5fdb7d8f.el9. 1.7 MB/s | 305 kB 00:00 2026-02-12T12:46:33.476 INFO:teuthology.orchestra.run.trial049.stdout:(13/37): python3-rgw-20.3.0-5145.g5fdb7d8f.el9. 1.7 MB/s | 100 kB 00:00 2026-02-12T12:46:33.501 INFO:teuthology.orchestra.run.trial049.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 1.3 MB/s | 33 kB 00:00 2026-02-12T12:46:33.543 INFO:teuthology.orchestra.run.trial049.stdout:(15/37): nvme-cli-2.13-1.el9.x86_64.rpm 26 MB/s | 1.1 MB 00:00 2026-02-12T12:46:33.553 INFO:teuthology.orchestra.run.trial049.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 9.8 MB/s | 93 kB 00:00 2026-02-12T12:46:33.979 INFO:teuthology.orchestra.run.trial049.stdout:(17/37): ceph-radosgw-20.3.0-5145.g5fdb7d8f.el9 2.0 MB/s | 11 MB 00:05 2026-02-12T12:46:34.393 INFO:teuthology.orchestra.run.trial049.stdout:(18/37): boost-program-options-1.75.0-13.el9.x8 124 kB/s | 104 kB 00:00 2026-02-12T12:46:34.673 INFO:teuthology.orchestra.run.trial049.stdout:(19/37): libnbd-1.20.3-4.el9.x86_64.rpm 236 kB/s | 164 kB 00:00 2026-02-12T12:46:34.827 INFO:teuthology.orchestra.run.trial049.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 295 kB/s | 45 kB 00:00 2026-02-12T12:46:34.999 INFO:teuthology.orchestra.run.trial049.stdout:(21/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 264 kB/s | 160 kB 00:00 2026-02-12T12:46:35.669 INFO:teuthology.orchestra.run.trial049.stdout:(22/37): librdkafka-1.6.1-102.el9.x86_64.rpm 787 kB/s | 662 kB 00:00 2026-02-12T12:46:35.758 INFO:teuthology.orchestra.run.trial049.stdout:(23/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 385 kB/s | 292 kB 00:00 2026-02-12T12:46:35.911 INFO:teuthology.orchestra.run.trial049.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 242 kB/s | 37 kB 00:00 2026-02-12T12:46:36.052 INFO:teuthology.orchestra.run.trial049.stdout:(25/37): qatlib-25.08.0-2.el9.x86_64.rpm 625 kB/s | 240 kB 00:00 2026-02-12T12:46:36.105 INFO:teuthology.orchestra.run.trial049.stdout:(26/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 5.8 MB/s | 308 kB 00:00 2026-02-12T12:46:36.141 INFO:teuthology.orchestra.run.trial049.stdout:(27/37): libarrow-9.0.0-15.el9.x86_64.rpm 122 MB/s | 4.4 MB 00:00 2026-02-12T12:46:36.142 INFO:teuthology.orchestra.run.trial049.stdout:(28/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 288 kB/s | 66 kB 00:00 2026-02-12T12:46:36.149 INFO:teuthology.orchestra.run.trial049.stdout:(29/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 3.2 MB/s | 25 kB 00:00 2026-02-12T12:46:36.157 INFO:teuthology.orchestra.run.trial049.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 8.4 MB/s | 67 kB 00:00 2026-02-12T12:46:36.168 INFO:teuthology.orchestra.run.trial049.stdout:(31/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 75 MB/s | 838 kB 00:00 2026-02-12T12:46:36.168 INFO:teuthology.orchestra.run.trial049.stdout:(32/37): liboath-2.6.12-1.el9.x86_64.rpm 1.8 MB/s | 49 kB 00:00 2026-02-12T12:46:36.177 INFO:teuthology.orchestra.run.trial049.stdout:(33/37): re2-20211101-20.el9.x86_64.rpm 20 MB/s | 191 kB 00:00 2026-02-12T12:46:36.205 INFO:teuthology.orchestra.run.trial049.stdout:(34/37): thrift-0.15.0-4.el9.x86_64.rpm 43 MB/s | 1.6 MB 00:00 2026-02-12T12:46:37.940 INFO:teuthology.orchestra.run.trial049.stdout:(35/37): librbd1-20.3.0-5145.g5fdb7d8f.el9.x86_ 1.5 MB/s | 2.7 MB 00:01 2026-02-12T12:46:38.133 INFO:teuthology.orchestra.run.trial049.stdout:(36/37): librados2-20.3.0-5145.g5fdb7d8f.el9.x8 1.7 MB/s | 3.3 MB 00:01 2026-02-12T12:46:39.210 INFO:teuthology.orchestra.run.trial049.stdout:(37/37): ceph-common-20.3.0-5145.g5fdb7d8f.el9. 1.9 MB/s | 21 MB 00:10 2026-02-12T12:46:39.213 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:46:39.213 INFO:teuthology.orchestra.run.trial049.stdout:Total 5.5 MB/s | 61 MB 00:11 2026-02-12T12:46:39.310 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T12:46:39.329 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T12:46:39.329 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T12:46:39.576 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T12:46:39.576 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T12:46:39.865 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T12:46:40.008 INFO:teuthology.orchestra.run.trial049.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-12T12:46:40.012 INFO:teuthology.orchestra.run.trial049.stdout: Upgrading : librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/39 2026-02-12T12:46:40.061 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/39 2026-02-12T12:46:40.062 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 3/39 2026-02-12T12:46:40.075 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 3/39 2026-02-12T12:46:40.077 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libcephfs-daemon-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 4/39 2026-02-12T12:46:40.078 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libcephfs-proxy2-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 5/39 2026-02-12T12:46:40.105 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 5/39 2026-02-12T12:46:40.107 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 6/39 2026-02-12T12:46:40.115 INFO:teuthology.orchestra.run.trial049.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-12T12:46:40.117 INFO:teuthology.orchestra.run.trial049.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-12T12:46:40.120 INFO:teuthology.orchestra.run.trial049.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-12T12:46:40.125 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-12T12:46:40.136 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-ceph-argparse-2:20.3.0-5145.g5fdb7d8f.el9. 11/39 2026-02-12T12:46:40.148 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 12/39 2026-02-12T12:46:40.149 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libradosstriper1-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 13/39 2026-02-12T12:46:40.172 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 13/39 2026-02-12T12:46:40.177 INFO:teuthology.orchestra.run.trial049.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-12T12:46:40.210 INFO:teuthology.orchestra.run.trial049.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-12T12:46:40.213 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-12T12:46:40.219 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-12T12:46:40.222 INFO:teuthology.orchestra.run.trial049.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-12T12:46:40.226 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-12T12:46:40.342 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T12:46:40.343 INFO:teuthology.orchestra.run.trial049.stdout: Upgrading : librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 21/39 2026-02-12T12:46:40.369 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 21/39 2026-02-12T12:46:40.371 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 22/39 2026-02-12T12:46:40.377 INFO:teuthology.orchestra.run.trial049.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-12T12:46:40.625 INFO:teuthology.orchestra.run.trial049.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-12T12:46:40.626 INFO:teuthology.orchestra.run.trial049.stdout: Installing : librgw2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 25/39 2026-02-12T12:46:40.641 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librgw2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 25/39 2026-02-12T12:46:40.645 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 26/39 2026-02-12T12:46:40.651 INFO:teuthology.orchestra.run.trial049.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-12T12:46:40.653 INFO:teuthology.orchestra.run.trial049.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-12T12:46:40.654 INFO:teuthology.orchestra.run.trial049.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T12:46:40.671 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T12:46:40.784 INFO:teuthology.orchestra.run.trial049.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-12T12:46:40.786 INFO:teuthology.orchestra.run.trial049.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T12:46:41.066 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T12:46:41.066 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T12:46:41.066 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:46:41.108 INFO:teuthology.orchestra.run.trial049.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-12T12:46:41.110 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x8 33/39 2026-02-12T12:46:42.056 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 34/39 2026-02-12T12:46:42.058 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 34/39 2026-02-12T12:46:42.321 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 34/39 2026-02-12T12:46:42.324 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 35/39 2026-02-12T12:46:42.366 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 35/39 2026-02-12T12:46:42.366 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T12:46:42.366 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T12:46:42.366 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:46:42.369 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-selinux-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 36/39 2026-02-12T12:46:46.914 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 36/39 2026-02-12T12:46:46.914 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /sys 2026-02-12T12:46:46.914 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /proc 2026-02-12T12:46:46.914 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /mnt 2026-02-12T12:46:46.914 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /var/tmp 2026-02-12T12:46:46.914 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /home 2026-02-12T12:46:46.914 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /root 2026-02-12T12:46:46.914 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /tmp 2026-02-12T12:46:46.914 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:46:47.404 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 37/39 2026-02-12T12:46:47.427 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 37/39 2026-02-12T12:46:47.427 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T12:46:47.428 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T12:46:47.428 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T12:46:47.428 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T12:46:47.428 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:46:47.429 INFO:teuthology.orchestra.run.trial049.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T12:46:47.441 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T12:46:47.441 INFO:teuthology.orchestra.run.trial049.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T12:46:47.494 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T12:46:47.494 INFO:teuthology.orchestra.run.trial049.stdout:Creating group 'qat' with GID 992. 2026-02-12T12:46:47.495 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:46:47.777 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/39 2026-02-12T12:46:47.777 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/39 2026-02-12T12:46:47.778 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 3/39 2026-02-12T12:46:47.778 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-selinux-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 4/39 2026-02-12T12:46:47.778 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libcephfs-daemon-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 5/39 2026-02-12T12:46:47.778 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 6/39 2026-02-12T12:46:47.778 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 7/39 2026-02-12T12:46:47.778 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libradosstriper1-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 8/39 2026-02-12T12:46:47.778 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librgw2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 9/39 2026-02-12T12:46:47.778 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5145.g5fdb7d8f.el9. 10/39 2026-02-12T12:46:47.778 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x8 11/39 2026-02-12T12:46:47.778 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 12/39 2026-02-12T12:46:47.778 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 13/39 2026-02-12T12:46:47.779 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 14/39 2026-02-12T12:46:47.779 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 15/39 2026-02-12T12:46:47.779 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-12T12:46:47.779 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-12T12:46:47.779 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-12T12:46:47.779 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-12T12:46:47.779 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T12:46:47.779 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-12T12:46:47.779 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-12T12:46:47.779 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-12T12:46:47.779 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-12T12:46:47.779 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-12T12:46:47.779 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-12T12:46:47.780 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-12T12:46:47.780 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-12T12:46:47.780 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-12T12:46:47.780 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-12T12:46:47.780 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-12T12:46:47.780 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-12T12:46:47.780 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-12T12:46:47.780 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-12T12:46:47.780 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-12T12:46:47.780 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 36/39 2026-02-12T12:46:47.780 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-12T12:46:47.780 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 38/39 2026-02-12T12:46:47.841 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T12:46:47.841 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:46:47.841 INFO:teuthology.orchestra.run.trial049.stdout:Upgraded: 2026-02-12T12:46:47.842 INFO:teuthology.orchestra.run.trial049.stdout: librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:46:47.842 INFO:teuthology.orchestra.run.trial049.stdout: librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:46:47.842 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T12:46:47.842 INFO:teuthology.orchestra.run.trial049.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T12:46:47.842 INFO:teuthology.orchestra.run.trial049.stdout: ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:46:47.842 INFO:teuthology.orchestra.run.trial049.stdout: ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:46:47.842 INFO:teuthology.orchestra.run.trial049.stdout: ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:46:47.842 INFO:teuthology.orchestra.run.trial049.stdout: ceph-selinux-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:46:47.842 INFO:teuthology.orchestra.run.trial049.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T12:46:47.842 INFO:teuthology.orchestra.run.trial049.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T12:46:47.842 INFO:teuthology.orchestra.run.trial049.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T12:46:47.842 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs-daemon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:46:47.843 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs-proxy2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:46:47.843 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:46:47.843 INFO:teuthology.orchestra.run.trial049.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T12:46:47.843 INFO:teuthology.orchestra.run.trial049.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T12:46:47.843 INFO:teuthology.orchestra.run.trial049.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T12:46:47.843 INFO:teuthology.orchestra.run.trial049.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T12:46:47.843 INFO:teuthology.orchestra.run.trial049.stdout: libradosstriper1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:46:47.843 INFO:teuthology.orchestra.run.trial049.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T12:46:47.843 INFO:teuthology.orchestra.run.trial049.stdout: librgw2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:46:47.843 INFO:teuthology.orchestra.run.trial049.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T12:46:47.843 INFO:teuthology.orchestra.run.trial049.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T12:46:47.843 INFO:teuthology.orchestra.run.trial049.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T12:46:47.844 INFO:teuthology.orchestra.run.trial049.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-12T12:46:47.844 INFO:teuthology.orchestra.run.trial049.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T12:46:47.844 INFO:teuthology.orchestra.run.trial049.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T12:46:47.844 INFO:teuthology.orchestra.run.trial049.stdout: python3-ceph-argparse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:46:47.844 INFO:teuthology.orchestra.run.trial049.stdout: python3-ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:46:47.844 INFO:teuthology.orchestra.run.trial049.stdout: python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:46:47.844 INFO:teuthology.orchestra.run.trial049.stdout: python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:46:47.844 INFO:teuthology.orchestra.run.trial049.stdout: python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:46:47.844 INFO:teuthology.orchestra.run.trial049.stdout: python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:46:47.844 INFO:teuthology.orchestra.run.trial049.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T12:46:47.844 INFO:teuthology.orchestra.run.trial049.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T12:46:47.844 INFO:teuthology.orchestra.run.trial049.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T12:46:47.844 INFO:teuthology.orchestra.run.trial049.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T12:46:47.845 INFO:teuthology.orchestra.run.trial049.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T12:46:47.845 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:46:47.845 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:46:47.883 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-test 2026-02-12T12:46:48.189 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:22 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:46:48.273 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:46:48.274 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:46:48.274 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repository Size 2026-02-12T12:46:48.274 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:46:48.274 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T12:46:48.274 INFO:teuthology.orchestra.run.trial049.stdout: ceph-test x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 126 M 2026-02-12T12:46:48.274 INFO:teuthology.orchestra.run.trial049.stdout:Installing dependencies: 2026-02-12T12:46:48.274 INFO:teuthology.orchestra.run.trial049.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-12T12:46:48.275 INFO:teuthology.orchestra.run.trial049.stdout: libasan8 x86_64 15.1.1-2.5.el9 appstream 523 k 2026-02-12T12:46:48.275 INFO:teuthology.orchestra.run.trial049.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-12T12:46:48.275 INFO:teuthology.orchestra.run.trial049.stdout: libcephsqlite x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 153 k 2026-02-12T12:46:48.275 INFO:teuthology.orchestra.run.trial049.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-12T12:46:48.275 INFO:teuthology.orchestra.run.trial049.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T12:46:48.275 INFO:teuthology.orchestra.run.trial049.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-12T12:46:48.275 INFO:teuthology.orchestra.run.trial049.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T12:46:48.275 INFO:teuthology.orchestra.run.trial049.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T12:46:48.275 INFO:teuthology.orchestra.run.trial049.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T12:46:48.275 INFO:teuthology.orchestra.run.trial049.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-12T12:46:48.276 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:46:48.276 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T12:46:48.276 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:46:48.276 INFO:teuthology.orchestra.run.trial049.stdout:Install 12 Packages 2026-02-12T12:46:48.276 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:46:48.277 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 131 M 2026-02-12T12:46:48.277 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 977 M 2026-02-12T12:46:48.277 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T12:46:49.404 INFO:teuthology.orchestra.run.trial049.stdout:(1/12): libcephsqlite-20.3.0-5145.g5fdb7d8f.el9 377 kB/s | 153 kB 00:00 2026-02-12T12:46:49.943 INFO:teuthology.orchestra.run.trial049.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 42 kB/s | 23 kB 00:00 2026-02-12T12:46:50.120 INFO:teuthology.orchestra.run.trial049.stdout:(3/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 1.9 MB/s | 2.1 MB 00:01 2026-02-12T12:46:50.613 INFO:teuthology.orchestra.run.trial049.stdout:(4/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 140 kB/s | 94 kB 00:00 2026-02-12T12:46:50.701 INFO:teuthology.orchestra.run.trial049.stdout:(5/12): libasan8-15.1.1-2.5.el9.x86_64.rpm 901 kB/s | 523 kB 00:00 2026-02-12T12:46:50.802 INFO:teuthology.orchestra.run.trial049.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 2.3 MB/s | 233 kB 00:00 2026-02-12T12:46:50.986 INFO:teuthology.orchestra.run.trial049.stdout:(7/12): protobuf-3.14.0-17.el9.x86_64.rpm 5.4 MB/s | 1.0 MB 00:00 2026-02-12T12:46:51.070 INFO:teuthology.orchestra.run.trial049.stdout:(8/12): libubsan-11.5.0-14.el9.x86_64.rpm 385 kB/s | 176 kB 00:00 2026-02-12T12:46:51.075 INFO:teuthology.orchestra.run.trial049.stdout:(9/12): socat-1.7.4.1-8.el9.x86_64.rpm 3.3 MB/s | 303 kB 00:00 2026-02-12T12:46:51.166 INFO:teuthology.orchestra.run.trial049.stdout:(10/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 658 kB/s | 64 kB 00:00 2026-02-12T12:46:51.235 INFO:teuthology.orchestra.run.trial049.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 763 kB/s | 122 kB 00:00 2026-02-12T12:47:21.701 INFO:teuthology.orchestra.run.trial049.stdout:(12/12): ceph-test-20.3.0-5145.g5fdb7d8f.el9.x8 3.9 MB/s | 126 MB 00:32 2026-02-12T12:47:21.702 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:47:21.702 INFO:teuthology.orchestra.run.trial049.stdout:Total 3.9 MB/s | 131 MB 00:33 2026-02-12T12:47:21.780 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T12:47:21.791 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T12:47:21.791 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T12:47:22.216 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T12:47:22.217 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T12:47:22.669 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T12:47:22.677 INFO:teuthology.orchestra.run.trial049.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-12T12:47:22.686 INFO:teuthology.orchestra.run.trial049.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-12T12:47:22.692 INFO:teuthology.orchestra.run.trial049.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-12T12:47:22.697 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-12T12:47:22.699 INFO:teuthology.orchestra.run.trial049.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-12T12:47:22.703 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-12T12:47:22.704 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libasan8-15.1.1-2.5.el9.x86_64 7/12 2026-02-12T12:47:22.721 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libasan8-15.1.1-2.5.el9.x86_64 7/12 2026-02-12T12:47:22.723 INFO:teuthology.orchestra.run.trial049.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-12T12:47:22.733 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-12T12:47:22.743 INFO:teuthology.orchestra.run.trial049.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-12T12:47:22.743 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libcephsqlite-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 11/12 2026-02-12T12:47:29.614 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 11/12 2026-02-12T12:47:29.631 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 12/12 2026-02-12T12:47:30.406 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 12/12 2026-02-12T12:47:30.406 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/12 2026-02-12T12:47:30.406 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libcephsqlite-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/12 2026-02-12T12:47:30.406 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-12T12:47:30.406 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-12T12:47:30.407 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-12T12:47:30.407 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libasan8-15.1.1-2.5.el9.x86_64 6/12 2026-02-12T12:47:30.407 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-12T12:47:30.407 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-12T12:47:30.407 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-12T12:47:30.407 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-12T12:47:30.407 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-12T12:47:30.459 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-12T12:47:30.459 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:47:30.460 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T12:47:30.460 INFO:teuthology.orchestra.run.trial049.stdout: ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:47:30.460 INFO:teuthology.orchestra.run.trial049.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-12T12:47:30.460 INFO:teuthology.orchestra.run.trial049.stdout: libasan8-15.1.1-2.5.el9.x86_64 2026-02-12T12:47:30.460 INFO:teuthology.orchestra.run.trial049.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-12T12:47:30.460 INFO:teuthology.orchestra.run.trial049.stdout: libcephsqlite-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:47:30.460 INFO:teuthology.orchestra.run.trial049.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-12T12:47:30.460 INFO:teuthology.orchestra.run.trial049.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T12:47:30.460 INFO:teuthology.orchestra.run.trial049.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-12T12:47:30.460 INFO:teuthology.orchestra.run.trial049.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T12:47:30.460 INFO:teuthology.orchestra.run.trial049.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T12:47:30.460 INFO:teuthology.orchestra.run.trial049.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T12:47:30.461 INFO:teuthology.orchestra.run.trial049.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-12T12:47:30.461 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:47:30.461 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:47:30.501 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph 2026-02-12T12:47:30.800 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:01:04 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:47:30.888 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:47:30.891 INFO:teuthology.orchestra.run.trial049.stdout:======================================================================================= 2026-02-12T12:47:30.891 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repository Size 2026-02-12T12:47:30.891 INFO:teuthology.orchestra.run.trial049.stdout:======================================================================================= 2026-02-12T12:47:30.891 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T12:47:30.891 INFO:teuthology.orchestra.run.trial049.stdout: ceph x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 6.5 k 2026-02-12T12:47:30.891 INFO:teuthology.orchestra.run.trial049.stdout:Installing dependencies: 2026-02-12T12:47:30.891 INFO:teuthology.orchestra.run.trial049.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T12:47:30.892 INFO:teuthology.orchestra.run.trial049.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 57 k 2026-02-12T12:47:30.892 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mds x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 2.0 M 2026-02-12T12:47:30.892 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 937 k 2026-02-12T12:47:30.892 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 297 k 2026-02-12T12:47:30.892 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mon x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 4.8 M 2026-02-12T12:47:30.892 INFO:teuthology.orchestra.run.trial049.stdout: ceph-osd x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 163 k 2026-02-12T12:47:30.892 INFO:teuthology.orchestra.run.trial049.stdout: ceph-osd-classic x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 15 M 2026-02-12T12:47:30.892 INFO:teuthology.orchestra.run.trial049.stdout: ceph-osd-crimson x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 87 M 2026-02-12T12:47:30.892 INFO:teuthology.orchestra.run.trial049.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 17 k 2026-02-12T12:47:30.892 INFO:teuthology.orchestra.run.trial049.stdout: cephadm noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 1.0 M 2026-02-12T12:47:30.892 INFO:teuthology.orchestra.run.trial049.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T12:47:30.892 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T12:47:30.893 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T12:47:30.893 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T12:47:30.893 INFO:teuthology.orchestra.run.trial049.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T12:47:30.893 INFO:teuthology.orchestra.run.trial049.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T12:47:30.893 INFO:teuthology.orchestra.run.trial049.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T12:47:30.893 INFO:teuthology.orchestra.run.trial049.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T12:47:30.893 INFO:teuthology.orchestra.run.trial049.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T12:47:30.893 INFO:teuthology.orchestra.run.trial049.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T12:47:30.893 INFO:teuthology.orchestra.run.trial049.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T12:47:30.893 INFO:teuthology.orchestra.run.trial049.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T12:47:30.893 INFO:teuthology.orchestra.run.trial049.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T12:47:30.893 INFO:teuthology.orchestra.run.trial049.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T12:47:30.894 INFO:teuthology.orchestra.run.trial049.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T12:47:30.894 INFO:teuthology.orchestra.run.trial049.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T12:47:30.894 INFO:teuthology.orchestra.run.trial049.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T12:47:30.894 INFO:teuthology.orchestra.run.trial049.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T12:47:30.894 INFO:teuthology.orchestra.run.trial049.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T12:47:30.894 INFO:teuthology.orchestra.run.trial049.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T12:47:30.894 INFO:teuthology.orchestra.run.trial049.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T12:47:30.894 INFO:teuthology.orchestra.run.trial049.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T12:47:30.894 INFO:teuthology.orchestra.run.trial049.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T12:47:30.894 INFO:teuthology.orchestra.run.trial049.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T12:47:30.894 INFO:teuthology.orchestra.run.trial049.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T12:47:30.894 INFO:teuthology.orchestra.run.trial049.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T12:47:30.895 INFO:teuthology.orchestra.run.trial049.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T12:47:30.895 INFO:teuthology.orchestra.run.trial049.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T12:47:30.895 INFO:teuthology.orchestra.run.trial049.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T12:47:30.895 INFO:teuthology.orchestra.run.trial049.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T12:47:30.895 INFO:teuthology.orchestra.run.trial049.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T12:47:30.895 INFO:teuthology.orchestra.run.trial049.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-12T12:47:30.895 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T12:47:30.895 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T12:47:30.895 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-12T12:47:30.895 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T12:47:30.895 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T12:47:30.895 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T12:47:30.895 INFO:teuthology.orchestra.run.trial049.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T12:47:30.896 INFO:teuthology.orchestra.run.trial049.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T12:47:30.896 INFO:teuthology.orchestra.run.trial049.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T12:47:30.896 INFO:teuthology.orchestra.run.trial049.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T12:47:30.896 INFO:teuthology.orchestra.run.trial049.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-12T12:47:30.896 INFO:teuthology.orchestra.run.trial049.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T12:47:30.896 INFO:teuthology.orchestra.run.trial049.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T12:47:30.896 INFO:teuthology.orchestra.run.trial049.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-12T12:47:30.896 INFO:teuthology.orchestra.run.trial049.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T12:47:30.896 INFO:teuthology.orchestra.run.trial049.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T12:47:30.896 INFO:teuthology.orchestra.run.trial049.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T12:47:30.896 INFO:teuthology.orchestra.run.trial049.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T12:47:30.896 INFO:teuthology.orchestra.run.trial049.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T12:47:30.896 INFO:teuthology.orchestra.run.trial049.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T12:47:30.897 INFO:teuthology.orchestra.run.trial049.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T12:47:30.897 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T12:47:30.897 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T12:47:30.897 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T12:47:30.897 INFO:teuthology.orchestra.run.trial049.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T12:47:30.897 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T12:47:30.897 INFO:teuthology.orchestra.run.trial049.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T12:47:30.897 INFO:teuthology.orchestra.run.trial049.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T12:47:30.897 INFO:teuthology.orchestra.run.trial049.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T12:47:30.897 INFO:teuthology.orchestra.run.trial049.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T12:47:30.897 INFO:teuthology.orchestra.run.trial049.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T12:47:30.897 INFO:teuthology.orchestra.run.trial049.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T12:47:30.897 INFO:teuthology.orchestra.run.trial049.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T12:47:30.898 INFO:teuthology.orchestra.run.trial049.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T12:47:30.898 INFO:teuthology.orchestra.run.trial049.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T12:47:30.898 INFO:teuthology.orchestra.run.trial049.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T12:47:30.898 INFO:teuthology.orchestra.run.trial049.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T12:47:30.898 INFO:teuthology.orchestra.run.trial049.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-12T12:47:30.898 INFO:teuthology.orchestra.run.trial049.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T12:47:30.898 INFO:teuthology.orchestra.run.trial049.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T12:47:30.898 INFO:teuthology.orchestra.run.trial049.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T12:47:30.898 INFO:teuthology.orchestra.run.trial049.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-12T12:47:30.898 INFO:teuthology.orchestra.run.trial049.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-12T12:47:30.898 INFO:teuthology.orchestra.run.trial049.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T12:47:30.898 INFO:teuthology.orchestra.run.trial049.stdout:Installing weak dependencies: 2026-02-12T12:47:30.898 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 183 k 2026-02-12T12:47:30.899 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 15 M 2026-02-12T12:47:30.899 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 7.4 M 2026-02-12T12:47:30.899 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 22 k 2026-02-12T12:47:30.899 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-rook noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 50 k 2026-02-12T12:47:30.899 INFO:teuthology.orchestra.run.trial049.stdout: ceph-volume noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 299 k 2026-02-12T12:47:30.899 INFO:teuthology.orchestra.run.trial049.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-12T12:47:30.899 INFO:teuthology.orchestra.run.trial049.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-12T12:47:30.899 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:47:30.899 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T12:47:30.899 INFO:teuthology.orchestra.run.trial049.stdout:======================================================================================= 2026-02-12T12:47:30.899 INFO:teuthology.orchestra.run.trial049.stdout:Install 96 Packages 2026-02-12T12:47:30.900 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:47:30.900 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 189 M 2026-02-12T12:47:30.900 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 1.4 G 2026-02-12T12:47:30.900 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T12:47:31.704 INFO:teuthology.orchestra.run.trial049.stdout:(1/96): ceph-20.3.0-5145.g5fdb7d8f.el9.x86_64.r 24 kB/s | 6.5 kB 00:00 2026-02-12T12:47:32.303 INFO:teuthology.orchestra.run.trial049.stdout:(2/96): ceph-mgr-20.3.0-5145.g5fdb7d8f.el9.x86_ 1.1 MB/s | 937 kB 00:00 2026-02-12T12:47:32.427 INFO:teuthology.orchestra.run.trial049.stdout:(3/96): ceph-osd-20.3.0-5145.g5fdb7d8f.el9.x86_ 1.3 MB/s | 163 kB 00:00 2026-02-12T12:47:32.544 INFO:teuthology.orchestra.run.trial049.stdout:(4/96): ceph-mds-20.3.0-5145.g5fdb7d8f.el9.x86_ 1.8 MB/s | 2.0 MB 00:01 2026-02-12T12:47:34.009 INFO:teuthology.orchestra.run.trial049.stdout:(5/96): ceph-mon-20.3.0-5145.g5fdb7d8f.el9.x86_ 2.1 MB/s | 4.8 MB 00:02 2026-02-12T12:47:34.074 INFO:teuthology.orchestra.run.trial049.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5145.g5f 882 kB/s | 57 kB 00:00 2026-02-12T12:47:34.205 INFO:teuthology.orchestra.run.trial049.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5145.g5fdb7d8f. 1.4 MB/s | 183 kB 00:00 2026-02-12T12:47:37.765 INFO:teuthology.orchestra.run.trial049.stdout:(8/96): ceph-osd-classic-20.3.0-5145.g5fdb7d8f. 2.8 MB/s | 15 MB 00:05 2026-02-12T12:47:40.162 INFO:teuthology.orchestra.run.trial049.stdout:(9/96): ceph-mgr-dashboard-20.3.0-5145.g5fdb7d8 2.5 MB/s | 15 MB 00:05 2026-02-12T12:47:40.216 INFO:teuthology.orchestra.run.trial049.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5145.g5fdb7d 414 kB/s | 22 kB 00:00 2026-02-12T12:47:40.287 INFO:teuthology.orchestra.run.trial049.stdout:(11/96): ceph-mgr-diskprediction-local-20.3.0-5 2.9 MB/s | 7.4 MB 00:02 2026-02-12T12:47:40.334 INFO:teuthology.orchestra.run.trial049.stdout:(12/96): ceph-mgr-modules-core-20.3.0-5145.g5fd 2.4 MB/s | 297 kB 00:00 2026-02-12T12:47:40.344 INFO:teuthology.orchestra.run.trial049.stdout:(13/96): ceph-mgr-rook-20.3.0-5145.g5fdb7d8f.el 882 kB/s | 50 kB 00:00 2026-02-12T12:47:40.391 INFO:teuthology.orchestra.run.trial049.stdout:(14/96): ceph-prometheus-alerts-20.3.0-5145.g5f 308 kB/s | 17 kB 00:00 2026-02-12T12:47:40.463 INFO:teuthology.orchestra.run.trial049.stdout:(15/96): ceph-volume-20.3.0-5145.g5fdb7d8f.el9. 2.5 MB/s | 299 kB 00:00 2026-02-12T12:47:40.737 INFO:teuthology.orchestra.run.trial049.stdout:(16/96): cephadm-20.3.0-5145.g5fdb7d8f.el9.noar 2.9 MB/s | 1.0 MB 00:00 2026-02-12T12:47:41.269 INFO:teuthology.orchestra.run.trial049.stdout:(17/96): cryptsetup-2.8.1-2.el9.x86_64.rpm 435 kB/s | 350 kB 00:00 2026-02-12T12:47:41.316 INFO:teuthology.orchestra.run.trial049.stdout:(18/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 70 kB/s | 40 kB 00:00 2026-02-12T12:47:41.900 INFO:teuthology.orchestra.run.trial049.stdout:(19/96): libconfig-1.7.2-9.el9.x86_64.rpm 114 kB/s | 72 kB 00:00 2026-02-12T12:47:42.225 INFO:teuthology.orchestra.run.trial049.stdout:(20/96): libgfortran-11.5.0-14.el9.x86_64.rpm 875 kB/s | 794 kB 00:00 2026-02-12T12:47:42.629 INFO:teuthology.orchestra.run.trial049.stdout:(21/96): libquadmath-11.5.0-14.el9.x86_64.rpm 253 kB/s | 184 kB 00:00 2026-02-12T12:47:42.991 INFO:teuthology.orchestra.run.trial049.stdout:(22/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 330 kB/s | 253 kB 00:00 2026-02-12T12:47:43.574 INFO:teuthology.orchestra.run.trial049.stdout:(23/96): python3-cryptography-36.0.1-5.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2026-02-12T12:47:43.666 INFO:teuthology.orchestra.run.trial049.stdout:(24/96): python3-ply-3.11-14.el9.noarch.rpm 158 kB/s | 106 kB 00:00 2026-02-12T12:47:44.279 INFO:teuthology.orchestra.run.trial049.stdout:(25/96): python3-pycparser-2.20-6.el9.noarch.rp 192 kB/s | 135 kB 00:00 2026-02-12T12:47:44.376 INFO:teuthology.orchestra.run.trial049.stdout:(26/96): python3-pyparsing-2.4.7-9.el9.noarch.r 212 kB/s | 150 kB 00:00 2026-02-12T12:47:44.976 INFO:teuthology.orchestra.run.trial049.stdout:(27/96): python3-requests-2.25.1-10.el9.noarch. 181 kB/s | 126 kB 00:00 2026-02-12T12:47:45.129 INFO:teuthology.orchestra.run.trial049.stdout:(28/96): python3-urllib3-1.26.5-7.el9.noarch.rp 289 kB/s | 218 kB 00:00 2026-02-12T12:47:45.706 INFO:teuthology.orchestra.run.trial049.stdout:(29/96): unzip-6.0-59.el9.x86_64.rpm 249 kB/s | 182 kB 00:00 2026-02-12T12:47:45.900 INFO:teuthology.orchestra.run.trial049.stdout:(30/96): zip-3.0-35.el9.x86_64.rpm 344 kB/s | 266 kB 00:00 2026-02-12T12:47:46.100 INFO:teuthology.orchestra.run.trial049.stdout:(31/96): flexiblas-3.0.4-8.el9.x86_64.rpm 83 kB/s | 33 kB 00:00 2026-02-12T12:47:46.180 INFO:teuthology.orchestra.run.trial049.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-8.el9. 227 kB/s | 18 kB 00:00 2026-02-12T12:47:46.488 INFO:teuthology.orchestra.run.trial049.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 802 kB/s | 246 kB 00:00 2026-02-12T12:47:46.720 INFO:teuthology.orchestra.run.trial049.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 811 kB/s | 188 kB 00:00 2026-02-12T12:47:46.801 INFO:teuthology.orchestra.run.trial049.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 523 kB/s | 42 kB 00:00 2026-02-12T12:47:49.593 INFO:teuthology.orchestra.run.trial049.stdout:(36/96): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 829 kB/s | 3.0 MB 00:03 2026-02-12T12:47:52.651 INFO:teuthology.orchestra.run.trial049.stdout:(37/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 925 kB/s | 5.3 MB 00:05 2026-02-12T12:47:53.446 INFO:teuthology.orchestra.run.trial049.stdout:(38/96): ceph-osd-crimson-20.3.0-5145.g5fdb7d8f 4.1 MB/s | 87 MB 00:20 2026-02-12T12:47:54.072 INFO:teuthology.orchestra.run.trial049.stdout:(39/96): python3-devel-3.9.25-2.el9.x86_64.rpm 172 kB/s | 244 kB 00:01 2026-02-12T12:47:54.153 INFO:teuthology.orchestra.run.trial049.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 586 kB/s | 48 kB 00:00 2026-02-12T12:47:54.385 INFO:teuthology.orchestra.run.trial049.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 761 kB/s | 177 kB 00:00 2026-02-12T12:47:54.604 INFO:teuthology.orchestra.run.trial049.stdout:(42/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 215 kB/s | 249 kB 00:01 2026-02-12T12:47:54.763 INFO:teuthology.orchestra.run.trial049.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 219 kB/s | 35 kB 00:00 2026-02-12T12:47:55.757 INFO:teuthology.orchestra.run.trial049.stdout:(44/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 913 kB/s | 1.2 MB 00:01 2026-02-12T12:47:56.192 INFO:teuthology.orchestra.run.trial049.stdout:(45/96): python3-babel-2.9.1-2.el9.noarch.rpm 925 kB/s | 6.0 MB 00:06 2026-02-12T12:47:56.348 INFO:teuthology.orchestra.run.trial049.stdout:(46/96): python3-packaging-20.9-5.el9.noarch.rp 494 kB/s | 77 kB 00:00 2026-02-12T12:47:56.474 INFO:teuthology.orchestra.run.trial049.stdout:(47/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 617 kB/s | 442 kB 00:00 2026-02-12T12:47:56.656 INFO:teuthology.orchestra.run.trial049.stdout:(48/96): python3-protobuf-3.14.0-17.el9.noarch. 868 kB/s | 267 kB 00:00 2026-02-12T12:47:56.707 INFO:teuthology.orchestra.run.trial049.stdout:(49/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 680 kB/s | 159 kB 00:00 2026-02-12T12:47:56.964 INFO:teuthology.orchestra.run.trial049.stdout:(50/96): python3-pyasn1-modules-0.4.8-6.el9.noa 908 kB/s | 279 kB 00:00 2026-02-12T12:47:57.665 INFO:teuthology.orchestra.run.trial049.stdout:(51/96): python3-requests-oauthlib-1.3.0-12.el9 56 kB/s | 54 kB 00:00 2026-02-12T12:47:57.747 INFO:teuthology.orchestra.run.trial049.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 506 kB/s | 42 kB 00:00 2026-02-12T12:47:57.980 INFO:teuthology.orchestra.run.trial049.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 813 kB/s | 189 kB 00:00 2026-02-12T12:47:58.136 INFO:teuthology.orchestra.run.trial049.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 578 kB/s | 90 kB 00:00 2026-02-12T12:47:58.179 INFO:teuthology.orchestra.run.trial049.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 522 kB/s | 22 kB 00:00 2026-02-12T12:47:58.266 INFO:teuthology.orchestra.run.trial049.stdout:(56/96): protobuf-compiler-3.14.0-17.el9.x86_64 9.7 MB/s | 862 kB 00:00 2026-02-12T12:47:58.641 INFO:teuthology.orchestra.run.trial049.stdout:(57/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.4 MB/s | 551 kB 00:00 2026-02-12T12:47:58.684 INFO:teuthology.orchestra.run.trial049.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 451 kB/s | 19 kB 00:00 2026-02-12T12:47:58.734 INFO:teuthology.orchestra.run.trial049.stdout:(59/96): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2026-02-12T12:47:58.806 INFO:teuthology.orchestra.run.trial049.stdout:(60/96): python3-asyncssh-2.13.2-5.el9.noarch.r 7.5 MB/s | 548 kB 00:00 2026-02-12T12:47:58.849 INFO:teuthology.orchestra.run.trial049.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 687 kB/s | 29 kB 00:00 2026-02-12T12:47:58.894 INFO:teuthology.orchestra.run.trial049.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 1.3 MB/s | 60 kB 00:00 2026-02-12T12:47:58.938 INFO:teuthology.orchestra.run.trial049.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 988 kB/s | 43 kB 00:00 2026-02-12T12:47:58.981 INFO:teuthology.orchestra.run.trial049.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 747 kB/s | 32 kB 00:00 2026-02-12T12:47:59.024 INFO:teuthology.orchestra.run.trial049.stdout:(65/96): python3-certifi-2023.05.07-4.el9.noarc 332 kB/s | 14 kB 00:00 2026-02-12T12:47:59.074 INFO:teuthology.orchestra.run.trial049.stdout:(66/96): python3-cheroot-10.0.1-4.el9.noarch.rp 3.4 MB/s | 173 kB 00:00 2026-02-12T12:47:59.132 INFO:teuthology.orchestra.run.trial049.stdout:(67/96): python3-cherrypy-18.6.1-2.el9.noarch.r 6.0 MB/s | 358 kB 00:00 2026-02-12T12:47:59.186 INFO:teuthology.orchestra.run.trial049.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 4.6 MB/s | 254 kB 00:00 2026-02-12T12:47:59.316 INFO:teuthology.orchestra.run.trial049.stdout:(69/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 16 MB/s | 2.0 MB 00:00 2026-02-12T12:47:59.360 INFO:teuthology.orchestra.run.trial049.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 3.2 MB/s | 144 kB 00:00 2026-02-12T12:47:59.404 INFO:teuthology.orchestra.run.trial049.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 3.1 MB/s | 139 kB 00:00 2026-02-12T12:47:59.448 INFO:teuthology.orchestra.run.trial049.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 1.3 MB/s | 56 kB 00:00 2026-02-12T12:47:59.490 INFO:teuthology.orchestra.run.trial049.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 251 kB/s | 11 kB 00:00 2026-02-12T12:47:59.533 INFO:teuthology.orchestra.run.trial049.stdout:(74/96): python3-jaraco-classes-3.2.1-5.el9.noa 416 kB/s | 18 kB 00:00 2026-02-12T12:47:59.575 INFO:teuthology.orchestra.run.trial049.stdout:(75/96): python3-jaraco-collections-3.0.0-8.el9 545 kB/s | 23 kB 00:00 2026-02-12T12:47:59.618 INFO:teuthology.orchestra.run.trial049.stdout:(76/96): python3-jaraco-context-6.0.1-3.el9.noa 460 kB/s | 20 kB 00:00 2026-02-12T12:47:59.661 INFO:teuthology.orchestra.run.trial049.stdout:(77/96): python3-jaraco-functools-3.5.0-2.el9.n 455 kB/s | 19 kB 00:00 2026-02-12T12:47:59.704 INFO:teuthology.orchestra.run.trial049.stdout:(78/96): python3-jaraco-text-4.0.0-2.el9.noarch 618 kB/s | 26 kB 00:00 2026-02-12T12:47:59.761 INFO:teuthology.orchestra.run.trial049.stdout:(79/96): python3-kubernetes-26.1.0-3.el9.noarch 18 MB/s | 1.0 MB 00:00 2026-02-12T12:47:59.804 INFO:teuthology.orchestra.run.trial049.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2026-02-12T12:47:59.848 INFO:teuthology.orchestra.run.trial049.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.0 MB/s | 86 kB 00:00 2026-02-12T12:47:59.891 INFO:teuthology.orchestra.run.trial049.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 1.3 MB/s | 58 kB 00:00 2026-02-12T12:47:59.933 INFO:teuthology.orchestra.run.trial049.stdout:(83/96): python3-portend-3.1.0-2.el9.noarch.rpm 385 kB/s | 16 kB 00:00 2026-02-12T12:47:59.977 INFO:teuthology.orchestra.run.trial049.stdout:(84/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.0 MB/s | 90 kB 00:00 2026-02-12T12:48:00.019 INFO:teuthology.orchestra.run.trial049.stdout:(85/96): python3-repoze-lru-0.7-16.el9.noarch.r 718 kB/s | 31 kB 00:00 2026-02-12T12:48:00.065 INFO:teuthology.orchestra.run.trial049.stdout:(86/96): python3-routes-2.5.1-5.el9.noarch.rpm 4.1 MB/s | 188 kB 00:00 2026-02-12T12:48:00.108 INFO:teuthology.orchestra.run.trial049.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 1.3 MB/s | 59 kB 00:00 2026-02-12T12:48:00.152 INFO:teuthology.orchestra.run.trial049.stdout:(88/96): python3-saml-1.16.0-1.el9.noarch.rpm 2.8 MB/s | 125 kB 00:00 2026-02-12T12:48:00.195 INFO:teuthology.orchestra.run.trial049.stdout:(89/96): python3-tempora-5.0.0-2.el9.noarch.rpm 835 kB/s | 36 kB 00:00 2026-02-12T12:48:00.238 INFO:teuthology.orchestra.run.trial049.stdout:(90/96): python3-typing-extensions-4.15.0-1.el9 2.0 MB/s | 86 kB 00:00 2026-02-12T12:48:00.281 INFO:teuthology.orchestra.run.trial049.stdout:(91/96): python3-websocket-client-1.2.3-2.el9.n 2.0 MB/s | 90 kB 00:00 2026-02-12T12:48:00.325 INFO:teuthology.orchestra.run.trial049.stdout:(92/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.1 MB/s | 48 kB 00:00 2026-02-12T12:48:00.367 INFO:teuthology.orchestra.run.trial049.stdout:(93/96): python3-xmltodict-0.12.0-15.el9.noarch 518 kB/s | 22 kB 00:00 2026-02-12T12:48:00.410 INFO:teuthology.orchestra.run.trial049.stdout:(94/96): python3-zc-lockfile-2.0-10.el9.noarch. 468 kB/s | 20 kB 00:00 2026-02-12T12:48:02.114 INFO:teuthology.orchestra.run.trial049.stdout:(95/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 854 kB/s | 6.1 MB 00:07 2026-02-12T12:48:18.089 INFO:teuthology.orchestra.run.trial049.stdout:(96/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 934 kB/s | 19 MB 00:21 2026-02-12T12:48:18.092 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:48:18.093 INFO:teuthology.orchestra.run.trial049.stdout:Total 4.0 MB/s | 189 MB 00:47 2026-02-12T12:48:18.476 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T12:48:18.516 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T12:48:18.516 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T12:48:19.210 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T12:48:19.210 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T12:48:19.930 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T12:48:19.932 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-12T12:48:19.936 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-12T12:48:19.957 INFO:teuthology.orchestra.run.trial049.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-12T12:48:19.991 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-12T12:48:19.998 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-12T12:48:20.000 INFO:teuthology.orchestra.run.trial049.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-12T12:48:20.005 INFO:teuthology.orchestra.run.trial049.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 7/96 2026-02-12T12:48:20.028 INFO:teuthology.orchestra.run.trial049.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-12T12:48:20.040 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-12T12:48:20.044 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-12T12:48:20.049 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-12T12:48:20.051 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-12T12:48:20.062 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-12T12:48:20.068 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-12T12:48:20.092 INFO:teuthology.orchestra.run.trial049.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-12T12:48:20.095 INFO:teuthology.orchestra.run.trial049.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-12T12:48:20.145 INFO:teuthology.orchestra.run.trial049.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-12T12:48:20.158 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-12T12:48:20.160 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-12T12:48:20.165 INFO:teuthology.orchestra.run.trial049.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-12T12:48:20.170 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-12T12:48:20.175 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-12T12:48:20.178 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-12T12:48:20.192 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-12T12:48:20.196 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-12T12:48:20.201 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-12T12:48:20.213 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-12T12:48:20.221 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-12T12:48:20.228 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-12T12:48:20.247 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-12T12:48:20.258 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-12T12:48:20.273 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-12T12:48:20.278 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-12T12:48:20.285 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-12T12:48:20.325 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-12T12:48:20.647 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-12T12:48:20.657 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-12T12:48:20.661 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-12T12:48:20.666 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-12T12:48:20.668 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-12T12:48:20.696 INFO:teuthology.orchestra.run.trial049.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-12T12:48:20.739 INFO:teuthology.orchestra.run.trial049.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-12T12:48:20.747 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-12T12:48:20.753 INFO:teuthology.orchestra.run.trial049.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-12T12:48:20.756 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-12T12:48:20.762 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-12T12:48:20.766 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-12T12:48:20.772 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-12T12:48:20.776 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-12T12:48:20.804 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-12T12:48:20.813 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-12T12:48:20.819 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-12T12:48:20.826 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-12T12:48:20.860 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-12T12:48:21.083 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 55/96 2026-02-12T12:48:21.106 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-12T12:48:21.110 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-12T12:48:21.168 INFO:teuthology.orchestra.run.trial049.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-12T12:48:21.169 INFO:teuthology.orchestra.run.trial049.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-12T12:48:21.190 INFO:teuthology.orchestra.run.trial049.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 60/96 2026-02-12T12:48:21.513 INFO:teuthology.orchestra.run.trial049.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 61/96 2026-02-12T12:48:21.586 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-12T12:48:22.252 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-12T12:48:22.269 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-12T12:48:22.279 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-12T12:48:22.285 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-12T12:48:22.299 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-12T12:48:22.314 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-12T12:48:22.389 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-12T12:48:22.398 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-12T12:48:22.421 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-12T12:48:22.450 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-12T12:48:22.500 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-12T12:48:22.506 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-12T12:48:22.510 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-12T12:48:22.511 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-12T12:48:22.528 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T12:48:22.529 INFO:teuthology.orchestra.run.trial049.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T12:48:22.529 INFO:teuthology.orchestra.run.trial049.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T12:48:22.529 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:22.537 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T12:48:22.562 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T12:48:22.563 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T12:48:22.563 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:22.599 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-12T12:48:23.187 INFO:teuthology.orchestra.run.trial049.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 79/96 2026-02-12T12:48:28.511 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 80/96 2026-02-12T12:48:28.573 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 81/96 2026-02-12T12:48:28.576 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch 82/96 2026-02-12T12:48:28.589 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch 82/96 2026-02-12T12:48:28.590 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T12:48:28.590 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T12:48:28.590 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:28.601 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 83/96 2026-02-12T12:48:28.625 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 83/96 2026-02-12T12:48:28.625 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T12:48:28.625 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T12:48:28.625 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T12:48:28.625 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T12:48:28.625 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:28.685 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 84/96 2026-02-12T12:48:28.687 INFO:teuthology.orchestra.run.trial049.stdout: Installing : cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 84/96 2026-02-12T12:48:28.697 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5145.g5fdb7d8f.el9 85/96 2026-02-12T12:48:28.721 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5145.g5fdb7d8f.el 86/96 2026-02-12T12:48:28.723 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarc 87/96 2026-02-12T12:48:30.293 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarc 87/96 2026-02-12T12:48:30.300 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noa 88/96 2026-02-12T12:48:30.752 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noa 88/96 2026-02-12T12:48:30.753 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7 89/96 2026-02-12T12:48:30.764 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7 89/96 2026-02-12T12:48:30.765 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5145.g5fdb7d8f.el9.noa 90/96 2026-02-12T12:48:30.828 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5145.g5fdb7d8f.el9.noa 90/96 2026-02-12T12:48:30.868 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5145.g5fdb7d8f.el9. 91/96 2026-02-12T12:48:30.869 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 92/96 2026-02-12T12:48:30.890 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 92/96 2026-02-12T12:48:30.890 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T12:48:30.890 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T12:48:30.890 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T12:48:30.890 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T12:48:30.891 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:30.903 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch 93/96 2026-02-12T12:48:31.118 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch 93/96 2026-02-12T12:48:31.119 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 94/96 2026-02-12T12:48:31.140 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 94/96 2026-02-12T12:48:31.140 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T12:48:31.140 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T12:48:31.140 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T12:48:31.141 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T12:48:31.141 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:31.224 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mds-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 95/96 2026-02-12T12:48:31.245 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mds-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 95/96 2026-02-12T12:48:31.245 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T12:48:31.246 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T12:48:31.246 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T12:48:31.246 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T12:48:31.246 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:31.247 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 96/96 2026-02-12T12:48:31.253 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 96/96 2026-02-12T12:48:31.277 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 96/96 2026-02-12T12:48:32.578 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 96/96 2026-02-12T12:48:32.578 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/96 2026-02-12T12:48:32.578 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mds-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/96 2026-02-12T12:48:32.578 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 3/96 2026-02-12T12:48:32.578 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 4/96 2026-02-12T12:48:32.578 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 5/96 2026-02-12T12:48:32.578 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 6/96 2026-02-12T12:48:32.579 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 7/96 2026-02-12T12:48:32.579 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5145.g5fdb7d8f.el 8/96 2026-02-12T12:48:32.579 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarc 9/96 2026-02-12T12:48:32.579 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noa 10/96 2026-02-12T12:48:32.579 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7 11/96 2026-02-12T12:48:32.579 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5145.g5fdb7d8f.el9.noa 12/96 2026-02-12T12:48:32.579 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5145.g5fdb7d8f.el9. 13/96 2026-02-12T12:48:32.579 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch 14/96 2026-02-12T12:48:32.579 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5145.g5fdb7d8f.el9 15/96 2026-02-12T12:48:32.579 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch 16/96 2026-02-12T12:48:32.579 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 17/96 2026-02-12T12:48:32.580 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 18/96 2026-02-12T12:48:32.580 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-12T12:48:32.580 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-12T12:48:32.580 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-12T12:48:32.580 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-12T12:48:32.580 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-12T12:48:32.580 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-12T12:48:32.580 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-12T12:48:32.580 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-12T12:48:32.580 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-12T12:48:32.580 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-12T12:48:32.580 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-12T12:48:32.580 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-12T12:48:32.581 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-12T12:48:32.581 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 32/96 2026-02-12T12:48:32.581 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 33/96 2026-02-12T12:48:32.581 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 34/96 2026-02-12T12:48:32.581 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-12T12:48:32.581 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-12T12:48:32.581 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-12T12:48:32.581 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-12T12:48:32.581 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-12T12:48:32.581 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 40/96 2026-02-12T12:48:32.581 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-12T12:48:32.581 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-12T12:48:32.582 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-12T12:48:32.582 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-12T12:48:32.582 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-12T12:48:32.582 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-12T12:48:32.582 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-12T12:48:32.582 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-12T12:48:32.582 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-12T12:48:32.582 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-12T12:48:32.582 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-12T12:48:32.582 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-12T12:48:32.582 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-12T12:48:32.582 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-12T12:48:32.583 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-12T12:48:32.583 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-12T12:48:32.583 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-12T12:48:32.583 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-12T12:48:32.583 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-12T12:48:32.583 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-12T12:48:32.583 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-12T12:48:32.583 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-12T12:48:32.583 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-12T12:48:32.583 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-12T12:48:32.583 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-12T12:48:32.583 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-12T12:48:32.584 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-12T12:48:32.584 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-12T12:48:32.584 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-12T12:48:32.584 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-12T12:48:32.584 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-12T12:48:32.584 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-12T12:48:32.584 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-12T12:48:32.584 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-12T12:48:32.584 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-12T12:48:32.584 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-12T12:48:32.584 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-12T12:48:32.584 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-12T12:48:32.584 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-12T12:48:32.585 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-12T12:48:32.585 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-12T12:48:32.585 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-12T12:48:32.585 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-12T12:48:32.585 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-12T12:48:32.585 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-12T12:48:32.585 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-12T12:48:32.585 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-12T12:48:32.585 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-12T12:48:32.585 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-12T12:48:32.585 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-12T12:48:32.585 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-12T12:48:32.585 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-12T12:48:32.586 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-12T12:48:32.586 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-12T12:48:32.586 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: ceph-grafana-dashboards-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mds-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-k8sevents-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-modules-core-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:48:32.641 INFO:teuthology.orchestra.run.trial049.stdout: ceph-prometheus-alerts-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T12:48:32.642 INFO:teuthology.orchestra.run.trial049.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: zip-3.0-35.el9.x86_64 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:32.643 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:32.706 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-base 2026-02-12T12:48:33.016 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:07 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:33.081 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:48:33.100 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:33.100 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:33.101 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:33.122 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install cephadm 2026-02-12T12:48:33.425 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:07 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:33.490 INFO:teuthology.orchestra.run.trial049.stdout:Package cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:48:33.508 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:33.509 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:33.509 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:33.530 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T12:48:33.836 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:07 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:33.921 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:33.922 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:33.922 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-12T12:48:33.922 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:33.923 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T12:48:33.923 INFO:teuthology.orchestra.run.trial049.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 149 k 2026-02-12T12:48:33.923 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:33.923 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T12:48:33.923 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:33.923 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-12T12:48:33.923 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:33.923 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 149 k 2026-02-12T12:48:33.923 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 455 k 2026-02-12T12:48:33.923 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T12:48:34.411 INFO:teuthology.orchestra.run.trial049.stdout:ceph-immutable-object-cache-20.3.0-5145.g5fdb7d 306 kB/s | 149 kB 00:00 2026-02-12T12:48:34.411 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:48:34.411 INFO:teuthology.orchestra.run.trial049.stdout:Total 305 kB/s | 149 kB 00:00 2026-02-12T12:48:34.411 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T12:48:34.416 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T12:48:34.416 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T12:48:34.448 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T12:48:34.448 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T12:48:34.503 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T12:48:34.504 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f. 1/1 2026-02-12T12:48:34.527 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f. 1/1 2026-02-12T12:48:34.527 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T12:48:34.527 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T12:48:34.527 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:34.834 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f. 1/1 2026-02-12T12:48:34.834 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:34.834 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T12:48:34.834 INFO:teuthology.orchestra.run.trial049.stdout: ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:48:34.834 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:34.835 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:34.863 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr 2026-02-12T12:48:35.165 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:09 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:35.231 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:48:35.249 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:35.250 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:35.250 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:35.272 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T12:48:35.570 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:09 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:35.636 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:48:35.654 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:35.655 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:35.655 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:35.676 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T12:48:35.977 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:09 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:36.043 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:48:36.061 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:36.061 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:36.062 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:36.082 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr-rook 2026-02-12T12:48:36.380 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:10 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:36.444 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:48:36.463 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:36.463 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:36.463 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:36.485 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T12:48:36.790 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:10 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:36.858 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:48:36.876 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:36.876 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:36.877 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:36.897 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-osd 2026-02-12T12:48:37.201 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:11 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:37.266 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:48:37.284 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:37.285 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:37.285 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:37.305 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-osd-classic 2026-02-12T12:48:37.611 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:11 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:37.677 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:48:37.695 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:37.696 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:37.696 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:37.717 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-fuse 2026-02-12T12:48:38.023 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:12 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:38.107 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:38.109 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:38.109 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-12T12:48:38.109 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:38.109 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T12:48:38.109 INFO:teuthology.orchestra.run.trial049.stdout: ceph-fuse x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 914 k 2026-02-12T12:48:38.109 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:38.109 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T12:48:38.109 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:38.109 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-12T12:48:38.109 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:38.109 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 914 k 2026-02-12T12:48:38.109 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 2.9 M 2026-02-12T12:48:38.109 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T12:48:38.858 INFO:teuthology.orchestra.run.trial049.stdout:ceph-fuse-20.3.0-5145.g5fdb7d8f.el9.x86_64.rpm 1.2 MB/s | 914 kB 00:00 2026-02-12T12:48:38.858 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:48:38.858 INFO:teuthology.orchestra.run.trial049.stdout:Total 1.2 MB/s | 914 kB 00:00 2026-02-12T12:48:38.859 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T12:48:38.863 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T12:48:38.863 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T12:48:38.897 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T12:48:38.898 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T12:48:38.988 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T12:48:39.005 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:39.214 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:39.272 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:39.272 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:39.272 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T12:48:39.273 INFO:teuthology.orchestra.run.trial049.stdout: ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:48:39.273 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:39.273 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:39.302 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-volume 2026-02-12T12:48:39.610 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:13 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:39.676 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:48:39.693 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:39.694 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:39.694 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:39.715 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install librados-devel 2026-02-12T12:48:40.024 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:14 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:40.108 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:40.108 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:40.108 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-12T12:48:40.109 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:40.109 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T12:48:40.109 INFO:teuthology.orchestra.run.trial049.stdout: librados-devel x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 124 k 2026-02-12T12:48:40.109 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:40.109 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T12:48:40.109 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:40.109 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-12T12:48:40.109 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:40.109 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 124 k 2026-02-12T12:48:40.109 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 434 k 2026-02-12T12:48:40.109 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T12:48:40.466 INFO:teuthology.orchestra.run.trial049.stdout:librados-devel-20.3.0-5145.g5fdb7d8f.el9.x86_64 346 kB/s | 124 kB 00:00 2026-02-12T12:48:40.467 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:48:40.467 INFO:teuthology.orchestra.run.trial049.stdout:Total 345 kB/s | 124 kB 00:00 2026-02-12T12:48:40.467 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T12:48:40.470 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T12:48:40.470 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T12:48:40.502 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T12:48:40.502 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T12:48:40.557 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T12:48:40.574 INFO:teuthology.orchestra.run.trial049.stdout: Installing : librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:40.653 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:40.711 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:40.711 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:40.711 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T12:48:40.711 INFO:teuthology.orchestra.run.trial049.stdout: librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:48:40.712 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:40.712 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:40.739 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install libcephfs2 2026-02-12T12:48:41.043 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:15 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:41.107 INFO:teuthology.orchestra.run.trial049.stdout:Package libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:48:41.124 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:41.125 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:41.126 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:41.146 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install libcephfs-devel 2026-02-12T12:48:41.447 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:15 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:41.530 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:41.530 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:41.530 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-12T12:48:41.530 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:41.530 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T12:48:41.530 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs-devel x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 37 k 2026-02-12T12:48:41.531 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:41.531 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T12:48:41.531 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:41.531 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-12T12:48:41.531 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:41.531 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 37 k 2026-02-12T12:48:41.531 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 171 k 2026-02-12T12:48:41.531 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T12:48:41.749 INFO:teuthology.orchestra.run.trial049.stdout:libcephfs-devel-20.3.0-5145.g5fdb7d8f.el9.x86_6 171 kB/s | 37 kB 00:00 2026-02-12T12:48:41.750 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:48:41.750 INFO:teuthology.orchestra.run.trial049.stdout:Total 169 kB/s | 37 kB 00:00 2026-02-12T12:48:41.750 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T12:48:41.753 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T12:48:41.753 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T12:48:41.756 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T12:48:41.756 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T12:48:41.779 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T12:48:41.796 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:41.853 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:41.910 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:41.910 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:41.910 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T12:48:41.910 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:48:41.910 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:41.910 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:41.937 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install librados2 2026-02-12T12:48:42.242 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:16 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:42.308 INFO:teuthology.orchestra.run.trial049.stdout:Package librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:48:42.325 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:42.326 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:42.326 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:42.348 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install librbd1 2026-02-12T12:48:42.654 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:16 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:42.719 INFO:teuthology.orchestra.run.trial049.stdout:Package librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:48:42.736 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:42.737 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:42.737 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:42.759 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-rados 2026-02-12T12:48:43.063 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:17 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:43.129 INFO:teuthology.orchestra.run.trial049.stdout:Package python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:48:43.146 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:43.147 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:43.147 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:43.168 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-rgw 2026-02-12T12:48:43.473 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:17 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:43.537 INFO:teuthology.orchestra.run.trial049.stdout:Package python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:48:43.555 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:43.555 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:43.555 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:43.577 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-cephfs 2026-02-12T12:48:43.878 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:17 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:43.943 INFO:teuthology.orchestra.run.trial049.stdout:Package python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:48:43.960 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:43.961 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:43.961 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:43.983 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-rbd 2026-02-12T12:48:44.286 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:18 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:44.353 INFO:teuthology.orchestra.run.trial049.stdout:Package python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:48:44.370 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:44.371 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:44.371 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:44.392 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install rbd-fuse 2026-02-12T12:48:44.702 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:18 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:44.785 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:44.785 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:44.785 INFO:teuthology.orchestra.run.trial049.stdout: Package Architecture Version Repository Size 2026-02-12T12:48:44.785 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:44.785 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T12:48:44.785 INFO:teuthology.orchestra.run.trial049.stdout: rbd-fuse x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 87 k 2026-02-12T12:48:44.786 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:44.786 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T12:48:44.786 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:44.786 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-12T12:48:44.786 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:44.786 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 87 k 2026-02-12T12:48:44.786 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 236 k 2026-02-12T12:48:44.786 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T12:48:45.035 INFO:teuthology.orchestra.run.trial049.stdout:rbd-fuse-20.3.0-5145.g5fdb7d8f.el9.x86_64.rpm 348 kB/s | 87 kB 00:00 2026-02-12T12:48:45.035 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:48:45.035 INFO:teuthology.orchestra.run.trial049.stdout:Total 347 kB/s | 87 kB 00:00 2026-02-12T12:48:45.035 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T12:48:45.039 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T12:48:45.039 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T12:48:45.071 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T12:48:45.071 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T12:48:45.123 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T12:48:45.140 INFO:teuthology.orchestra.run.trial049.stdout: Installing : rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:45.219 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:45.277 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:45.278 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:45.278 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T12:48:45.278 INFO:teuthology.orchestra.run.trial049.stdout: rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:48:45.278 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:45.278 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:45.305 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install rbd-mirror 2026-02-12T12:48:45.613 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:19 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:45.698 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:45.698 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:45.698 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-12T12:48:45.698 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:45.698 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T12:48:45.699 INFO:teuthology.orchestra.run.trial049.stdout: rbd-mirror x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 2.6 M 2026-02-12T12:48:45.699 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:45.699 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T12:48:45.699 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:45.699 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-12T12:48:45.699 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:45.699 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 2.6 M 2026-02-12T12:48:45.699 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 11 M 2026-02-12T12:48:45.699 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T12:48:46.200 INFO:teuthology.orchestra.run.trial049.stdout:rbd-mirror-20.3.0-5145.g5fdb7d8f.el9.x86_64.rpm 5.2 MB/s | 2.6 MB 00:00 2026-02-12T12:48:46.201 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:48:46.201 INFO:teuthology.orchestra.run.trial049.stdout:Total 5.2 MB/s | 2.6 MB 00:00 2026-02-12T12:48:46.201 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T12:48:46.205 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T12:48:46.206 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T12:48:46.244 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T12:48:46.245 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T12:48:46.407 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T12:48:46.408 INFO:teuthology.orchestra.run.trial049.stdout: Installing : rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:46.431 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:46.431 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T12:48:46.431 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T12:48:46.432 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T12:48:46.432 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T12:48:46.432 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:46.742 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:46.742 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:46.742 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T12:48:46.742 INFO:teuthology.orchestra.run.trial049.stdout: rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:48:46.743 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:46.743 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:46.770 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install rbd-nbd 2026-02-12T12:48:47.075 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:21 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:47.158 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:47.158 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:47.158 INFO:teuthology.orchestra.run.trial049.stdout: Package Architecture Version Repository Size 2026-02-12T12:48:47.158 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:47.158 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T12:48:47.159 INFO:teuthology.orchestra.run.trial049.stdout: rbd-nbd x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 167 k 2026-02-12T12:48:47.159 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:47.159 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T12:48:47.159 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:47.159 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-12T12:48:47.159 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:47.159 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 167 k 2026-02-12T12:48:47.159 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 496 k 2026-02-12T12:48:47.159 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T12:48:47.373 INFO:teuthology.orchestra.run.trial049.stdout:rbd-nbd-20.3.0-5145.g5fdb7d8f.el9.x86_64.rpm 777 kB/s | 167 kB 00:00 2026-02-12T12:48:47.374 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:48:47.374 INFO:teuthology.orchestra.run.trial049.stdout:Total 773 kB/s | 167 kB 00:00 2026-02-12T12:48:47.374 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T12:48:47.378 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T12:48:47.379 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T12:48:47.410 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T12:48:47.410 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T12:48:47.466 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T12:48:47.482 INFO:teuthology.orchestra.run.trial049.stdout: Installing : rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:47.562 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:47.620 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T12:48:47.620 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:47.620 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T12:48:47.620 INFO:teuthology.orchestra.run.trial049.stdout: rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:48:47.620 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:47.620 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:47.650 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-osd-crimson 2026-02-12T12:48:47.955 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:21 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:48.020 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:48:48.038 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:48.038 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:48:48.039 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:48:48.060 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-12T12:48:48.364 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:22 ago on Thu 12 Feb 2026 12:46:26 PM UTC. 2026-02-12T12:48:48.449 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:48:48.450 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:48.450 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-12T12:48:48.450 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:48.450 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T12:48:48.450 INFO:teuthology.orchestra.run.trial049.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 429 M 2026-02-12T12:48:48.450 INFO:teuthology.orchestra.run.trial049.stdout:Installing weak dependencies: 2026-02-12T12:48:48.451 INFO:teuthology.orchestra.run.trial049.stdout: ceph-debugsource x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 12 M 2026-02-12T12:48:48.451 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:48.451 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T12:48:48.451 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T12:48:48.451 INFO:teuthology.orchestra.run.trial049.stdout:Install 2 Packages 2026-02-12T12:48:48.451 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:48:48.451 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 441 M 2026-02-12T12:48:48.451 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 2.7 G 2026-02-12T12:48:48.451 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T12:48:51.442 INFO:teuthology.orchestra.run.trial049.stdout:(1/2): ceph-debugsource-20.3.0-5145.g5fdb7d8f.e 4.0 MB/s | 12 MB 00:02 2026-02-12T12:49:24.964 INFO:teuthology.orchestra.run.trial049.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5145.g 12 MB/s | 429 MB 00:36 2026-02-12T12:49:24.965 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T12:49:24.966 INFO:teuthology.orchestra.run.trial049.stdout:Total 12 MB/s | 441 MB 00:36 2026-02-12T12:49:24.966 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T12:49:24.971 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T12:49:24.971 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T12:49:26.333 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T12:49:26.333 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T12:49:29.893 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T12:49:51.915 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-debugsource-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/2 2026-02-12T12:49:51.932 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5145.g5fdb7d8f.e 2/2 2026-02-12T12:49:53.863 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5145.g5fdb7d8f.e 2/2 2026-02-12T12:49:53.863 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-debugsource-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/2 2026-02-12T12:49:53.922 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5145.g5fdb7d8f.e 2/2 2026-02-12T12:49:53.923 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:49:53.923 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T12:49:53.923 INFO:teuthology.orchestra.run.trial049.stdout: ceph-debugsource-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:53.923 INFO:teuthology.orchestra.run.trial049.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T12:49:53.923 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:49:53.923 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:49:54.001 DEBUG:teuthology.parallel:result is None 2026-02-12T12:49:54.002 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T12:49:54.165 DEBUG:teuthology.orchestra.run.trial049:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T12:49:54.186 INFO:teuthology.orchestra.run.trial049.stdout:20.3.0-5145.g5fdb7d8f.el9 2026-02-12T12:49:54.187 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5145.g5fdb7d8f.el9 2026-02-12T12:49:54.187 INFO:teuthology.task.install:The correct ceph version 20.3.0-5145.g5fdb7d8f is installed. 2026-02-12T12:49:54.189 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-12T12:49:54.190 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:49:54.190 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T12:49:54.252 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-12T12:49:54.253 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:49:54.253 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T12:49:54.318 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T12:49:54.381 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-12T12:49:54.381 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:49:54.381 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T12:49:54.445 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T12:49:54.508 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-12T12:49:54.508 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:49:54.509 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T12:49:54.572 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T12:49:54.637 INFO:teuthology.run_tasks:Running task pexec... 2026-02-12T12:49:54.655 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-12T12:49:54.656 DEBUG:teuthology.orchestra.run.trial049:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-12T12:49:54.680 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial049.front.sepia.ceph.com 2026-02-12T12:49:54.680 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-12T12:49:54.731 DEBUG:teuthology.parallel:result is None 2026-02-12T12:49:54.731 INFO:teuthology.run_tasks:Running task install... 2026-02-12T12:49:54.745 DEBUG:teuthology.task.install:project ceph 2026-02-12T12:49:54.745 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}} 2026-02-12T12:49:54.745 DEBUG:teuthology.task.install:config {'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'} 2026-02-12T12:49:54.745 INFO:teuthology.task.install:Using flavor: debug 2026-02-12T12:49:54.754 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-12T12:49:54.754 INFO:teuthology.task.install:extra packages: [] 2026-02-12T12:49:54.754 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0', 'tag': None, 'wait_for_package': False} 2026-02-12T12:49:54.755 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T12:49:54.921 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/ 2026-02-12T12:49:54.921 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5145.g5fdb7d8f 2026-02-12T12:49:55.252 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T12:49:55.253 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:49:55.253 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T12:49:55.279 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-12T12:49:55.279 DEBUG:teuthology.orchestra.run.trial049:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T12:49:55.342 DEBUG:teuthology.orchestra.run.trial049:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T12:49:55.406 DEBUG:teuthology.orchestra.run.trial049:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T12:49:55.462 INFO:teuthology.orchestra.run.trial049.stdout:check_obsoletes = 1 2026-02-12T12:49:55.471 DEBUG:teuthology.orchestra.run.trial049:> sudo yum clean all 2026-02-12T12:49:55.632 INFO:teuthology.orchestra.run.trial049.stdout:56 files removed 2026-02-12T12:49:55.648 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-radosgw 2026-02-12T12:49:56.387 INFO:teuthology.orchestra.run.trial049.stdout:ceph packages for x86_64 159 kB/s | 94 kB 00:00 2026-02-12T12:49:56.970 INFO:teuthology.orchestra.run.trial049.stdout:ceph noarch packages 44 kB/s | 24 kB 00:00 2026-02-12T12:49:57.352 INFO:teuthology.orchestra.run.trial049.stdout:ceph source packages 5.8 kB/s | 2.1 kB 00:00 2026-02-12T12:49:58.024 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.9 MB 00:00 2026-02-12T12:50:01.035 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-12T12:50:03.685 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - CRB 30 MB/s | 7.8 MB 00:00 2026-02-12T12:50:05.448 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 20 kB 00:01 2026-02-12T12:50:06.156 INFO:teuthology.orchestra.run.trial049.stdout:Extra Packages for Enterprise Linux 32 MB/s | 20 MB 00:00 2026-02-12T12:50:09.378 INFO:teuthology.orchestra.run.trial049.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-12T12:50:10.639 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:10.657 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:10.657 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:10.657 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:10.682 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-test 2026-02-12T12:50:10.982 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:01 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:11.047 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:11.064 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:11.065 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:11.065 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:11.086 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph 2026-02-12T12:50:11.386 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:02 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:11.449 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:11.466 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:11.467 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:11.467 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:11.488 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-base 2026-02-12T12:50:11.788 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:02 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:11.853 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:11.871 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:11.871 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:11.871 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:11.892 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install cephadm 2026-02-12T12:50:12.192 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:03 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:12.257 INFO:teuthology.orchestra.run.trial049.stdout:Package cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:50:12.274 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:12.275 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:12.275 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:12.297 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T12:50:12.600 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:03 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:12.664 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:12.682 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:12.682 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:12.683 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:12.704 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr 2026-02-12T12:50:13.001 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:13.064 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:13.082 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:13.082 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:13.083 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:13.104 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T12:50:13.403 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:13.469 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:50:13.486 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:13.487 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:13.487 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:13.508 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T12:50:13.815 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:13.883 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:50:13.900 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:13.901 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:13.901 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:13.922 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr-rook 2026-02-12T12:50:14.224 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:05 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:14.289 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:50:14.306 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:14.307 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:14.307 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:14.329 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T12:50:14.629 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:05 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:14.695 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:50:14.712 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:14.713 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:14.713 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:14.734 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-osd 2026-02-12T12:50:15.033 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:15.097 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:15.115 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:15.115 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:15.115 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:15.137 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-osd-classic 2026-02-12T12:50:15.436 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:15.501 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:15.518 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:15.519 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:15.519 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:15.541 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-fuse 2026-02-12T12:50:15.842 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:15.906 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:15.923 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:15.924 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:15.924 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:15.946 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-volume 2026-02-12T12:50:16.252 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:07 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:16.319 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T12:50:16.336 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:16.337 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:16.337 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:16.359 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install librados-devel 2026-02-12T12:50:16.659 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:07 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:16.724 INFO:teuthology.orchestra.run.trial049.stdout:Package librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:16.742 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:16.742 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:16.743 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:16.764 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install libcephfs2 2026-02-12T12:50:17.069 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:17.134 INFO:teuthology.orchestra.run.trial049.stdout:Package libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:17.151 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:17.152 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:17.152 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:17.174 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install libcephfs-devel 2026-02-12T12:50:17.478 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:17.544 INFO:teuthology.orchestra.run.trial049.stdout:Package libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:17.561 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:17.562 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:17.562 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:17.583 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install librados2 2026-02-12T12:50:17.883 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:17.946 INFO:teuthology.orchestra.run.trial049.stdout:Package librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:17.964 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:17.965 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:17.965 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:17.987 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install librbd1 2026-02-12T12:50:18.289 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:09 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:18.353 INFO:teuthology.orchestra.run.trial049.stdout:Package librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:18.371 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:18.371 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:18.371 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:18.393 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-rados 2026-02-12T12:50:18.696 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:09 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:18.761 INFO:teuthology.orchestra.run.trial049.stdout:Package python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:18.778 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:18.779 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:18.779 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:18.800 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-rgw 2026-02-12T12:50:19.102 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:19.167 INFO:teuthology.orchestra.run.trial049.stdout:Package python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:19.184 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:19.185 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:19.185 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:19.207 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-cephfs 2026-02-12T12:50:19.508 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:19.575 INFO:teuthology.orchestra.run.trial049.stdout:Package python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:19.593 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:19.593 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:19.593 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:19.615 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-rbd 2026-02-12T12:50:19.917 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:19.983 INFO:teuthology.orchestra.run.trial049.stdout:Package python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:20.002 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:20.003 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:20.003 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:20.024 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install rbd-fuse 2026-02-12T12:50:20.326 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:11 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:20.390 INFO:teuthology.orchestra.run.trial049.stdout:Package rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:20.408 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:20.408 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:20.408 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:20.430 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install rbd-mirror 2026-02-12T12:50:20.731 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:11 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:20.796 INFO:teuthology.orchestra.run.trial049.stdout:Package rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:20.813 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:20.814 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:20.814 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:20.835 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install rbd-nbd 2026-02-12T12:50:21.132 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:12 ago on Thu 12 Feb 2026 12:50:09 PM UTC. 2026-02-12T12:50:21.198 INFO:teuthology.orchestra.run.trial049.stdout:Package rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T12:50:21.215 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T12:50:21.216 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T12:50:21.216 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T12:50:21.240 DEBUG:teuthology.parallel:result is None 2026-02-12T12:50:21.241 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T12:50:21.403 DEBUG:teuthology.orchestra.run.trial049:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T12:50:21.425 INFO:teuthology.orchestra.run.trial049.stdout:20.3.0-5145.g5fdb7d8f.el9 2026-02-12T12:50:21.425 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5145.g5fdb7d8f.el9 2026-02-12T12:50:21.425 INFO:teuthology.task.install:The correct ceph version 20.3.0-5145.g5fdb7d8f is installed. 2026-02-12T12:50:21.427 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-12T12:50:21.427 INFO:teuthology.run_tasks:Running task ceph... 2026-02-12T12:50:21.519 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-12T12:50:21.519 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod 777 /var/log/ceph 2026-02-12T12:50:21.544 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-12T12:50:21.544 DEBUG:teuthology.orchestra.run.trial049:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T12:50:21.607 INFO:tasks.ceph:Creating extra log directories... 2026-02-12T12:50:21.607 DEBUG:teuthology.orchestra.run.trial049:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T12:50:21.682 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-12T12:50:21.683 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-12T12:50:21.683 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial/45939', 'branch': 'main', 'description': 'crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} perf_ignorelist settings/optimized workloads/radosbench_omap_write}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '45939', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}}, 'workunit': {'branch': 'seastore_io_uring', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}}, 'owner': 'scheduled_moagrawa@soko04.front.sepia.ceph.com', 'priority': 1000, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 4100, 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'seastore_io_uring', 'suite_path': '/home/teuthworker/src/github.com_mohit84_ceph_5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/mohit84/ceph.git', 'suite_sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0', 'targets': {'trial049.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA60v2LlW/aTSD+AqfHY/hr6JeKVvvZRx4fgPPg6gDtKKmeuK9msrMvKtfD7Qg7lR6ADJAkPXJ4j3Eu3U5Ee0Vc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}}, 'wait-for-scrub': False, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0', 'cluster': 'ceph'}}, {'ssh_keys': None}, {'radosbench': {'clients': ['client.0'], 'objectsize': 4096, 'size': 4096, 'time': 300, 'write-omap': True}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8bec0da71becad44414c54979f64c9ef0e7099c6', 'timestamp': '2026-02-12_06:08:11', 'tube': 'trial', 'user': 'moagrawa', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.2161924'} 2026-02-12T12:50:21.684 DEBUG:teuthology.orchestra.run.trial049:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T12:50:21.727 DEBUG:teuthology.orchestra.run.trial049:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T12:50:21.793 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:50:21.793 DEBUG:teuthology.orchestra.run.trial049:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T12:50:21.850 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T12:50:21.851 DEBUG:teuthology.orchestra.run.trial049:> stat /dev/vg_nvme/lv_1 2026-02-12T12:50:21.909 INFO:teuthology.orchestra.run.trial049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T12:50:21.909 INFO:teuthology.orchestra.run.trial049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T12:50:21.909 INFO:teuthology.orchestra.run.trial049.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-12T12:50:21.909 INFO:teuthology.orchestra.run.trial049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T12:50:21.909 INFO:teuthology.orchestra.run.trial049.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T12:50:21.909 INFO:teuthology.orchestra.run.trial049.stdout:Access: 2026-02-12 12:48:46.571284502 +0000 2026-02-12T12:50:21.909 INFO:teuthology.orchestra.run.trial049.stdout:Modify: 2026-02-12 12:46:41.092253980 +0000 2026-02-12T12:50:21.910 INFO:teuthology.orchestra.run.trial049.stdout:Change: 2026-02-12 12:46:41.092253980 +0000 2026-02-12T12:50:21.910 INFO:teuthology.orchestra.run.trial049.stdout: Birth: 2026-02-12 12:46:41.092253980 +0000 2026-02-12T12:50:21.910 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T12:50:21.972 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records in 2026-02-12T12:50:21.972 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records out 2026-02-12T12:50:21.972 INFO:teuthology.orchestra.run.trial049.stderr:512 bytes copied, 0.000154528 s, 3.3 MB/s 2026-02-12T12:50:21.973 DEBUG:teuthology.orchestra.run.trial049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T12:50:22.032 DEBUG:teuthology.orchestra.run.trial049:> stat /dev/vg_nvme/lv_2 2026-02-12T12:50:22.087 INFO:teuthology.orchestra.run.trial049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T12:50:22.088 INFO:teuthology.orchestra.run.trial049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T12:50:22.088 INFO:teuthology.orchestra.run.trial049.stdout:Device: 6h/6d Inode: 1305 Links: 1 2026-02-12T12:50:22.088 INFO:teuthology.orchestra.run.trial049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T12:50:22.088 INFO:teuthology.orchestra.run.trial049.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T12:50:22.088 INFO:teuthology.orchestra.run.trial049.stdout:Access: 2026-02-12 12:48:46.572284526 +0000 2026-02-12T12:50:22.088 INFO:teuthology.orchestra.run.trial049.stdout:Modify: 2026-02-12 12:46:41.091253998 +0000 2026-02-12T12:50:22.088 INFO:teuthology.orchestra.run.trial049.stdout:Change: 2026-02-12 12:46:41.091253998 +0000 2026-02-12T12:50:22.088 INFO:teuthology.orchestra.run.trial049.stdout: Birth: 2026-02-12 12:46:41.091253998 +0000 2026-02-12T12:50:22.089 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T12:50:22.149 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records in 2026-02-12T12:50:22.150 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records out 2026-02-12T12:50:22.150 INFO:teuthology.orchestra.run.trial049.stderr:512 bytes copied, 0.000144209 s, 3.6 MB/s 2026-02-12T12:50:22.151 DEBUG:teuthology.orchestra.run.trial049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T12:50:22.208 DEBUG:teuthology.orchestra.run.trial049:> stat /dev/vg_nvme/lv_3 2026-02-12T12:50:22.265 INFO:teuthology.orchestra.run.trial049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T12:50:22.265 INFO:teuthology.orchestra.run.trial049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T12:50:22.265 INFO:teuthology.orchestra.run.trial049.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-12T12:50:22.265 INFO:teuthology.orchestra.run.trial049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T12:50:22.265 INFO:teuthology.orchestra.run.trial049.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T12:50:22.265 INFO:teuthology.orchestra.run.trial049.stdout:Access: 2026-02-12 12:48:46.572284526 +0000 2026-02-12T12:50:22.265 INFO:teuthology.orchestra.run.trial049.stdout:Modify: 2026-02-12 12:46:41.091253998 +0000 2026-02-12T12:50:22.265 INFO:teuthology.orchestra.run.trial049.stdout:Change: 2026-02-12 12:46:41.091253998 +0000 2026-02-12T12:50:22.265 INFO:teuthology.orchestra.run.trial049.stdout: Birth: 2026-02-12 12:46:41.091253998 +0000 2026-02-12T12:50:22.266 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T12:50:22.330 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records in 2026-02-12T12:50:22.330 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records out 2026-02-12T12:50:22.330 INFO:teuthology.orchestra.run.trial049.stderr:512 bytes copied, 0.000143929 s, 3.6 MB/s 2026-02-12T12:50:22.331 DEBUG:teuthology.orchestra.run.trial049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T12:50:22.387 DEBUG:teuthology.orchestra.run.trial049:> stat /dev/vg_nvme/lv_4 2026-02-12T12:50:22.445 INFO:teuthology.orchestra.run.trial049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T12:50:22.445 INFO:teuthology.orchestra.run.trial049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T12:50:22.445 INFO:teuthology.orchestra.run.trial049.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-12T12:50:22.445 INFO:teuthology.orchestra.run.trial049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T12:50:22.445 INFO:teuthology.orchestra.run.trial049.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T12:50:22.445 INFO:teuthology.orchestra.run.trial049.stdout:Access: 2026-02-12 12:48:46.572284526 +0000 2026-02-12T12:50:22.445 INFO:teuthology.orchestra.run.trial049.stdout:Modify: 2026-02-12 12:46:41.091253998 +0000 2026-02-12T12:50:22.446 INFO:teuthology.orchestra.run.trial049.stdout:Change: 2026-02-12 12:46:41.091253998 +0000 2026-02-12T12:50:22.446 INFO:teuthology.orchestra.run.trial049.stdout: Birth: 2026-02-12 12:46:41.091253998 +0000 2026-02-12T12:50:22.446 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T12:50:22.508 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records in 2026-02-12T12:50:22.508 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records out 2026-02-12T12:50:22.508 INFO:teuthology.orchestra.run.trial049.stderr:512 bytes copied, 0.000151373 s, 3.4 MB/s 2026-02-12T12:50:22.509 DEBUG:teuthology.orchestra.run.trial049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T12:50:22.565 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T12:50:22.566 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-12T12:50:22.566 INFO:tasks.ceph:Generating config... 2026-02-12T12:50:22.568 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-12T12:50:22.568 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-12T12:50:22.568 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-12T12:50:22.568 INFO:tasks.ceph:[osd] debug filestore = 0/0 2026-02-12T12:50:22.568 INFO:tasks.ceph:[osd] debug journal = 0/0 2026-02-12T12:50:22.568 INFO:tasks.ceph:[osd] debug ms = 0/0 2026-02-12T12:50:22.568 INFO:tasks.ceph:[osd] debug osd = 0/0 2026-02-12T12:50:22.569 INFO:tasks.ceph:[osd] debug seastore = 20 2026-02-12T12:50:22.569 INFO:tasks.ceph:[osd] debug seastore backref = 20 2026-02-12T12:50:22.569 INFO:tasks.ceph:[osd] debug seastore cache = 20 2026-02-12T12:50:22.569 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2026-02-12T12:50:22.569 INFO:tasks.ceph:[osd] debug seastore device = 20 2026-02-12T12:50:22.569 INFO:tasks.ceph:[osd] debug seastore epm = 20 2026-02-12T12:50:22.569 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2026-02-12T12:50:22.569 INFO:tasks.ceph:[osd] debug seastore journal = 20 2026-02-12T12:50:22.569 INFO:tasks.ceph:[osd] debug seastore lba = 20 2026-02-12T12:50:22.569 INFO:tasks.ceph:[osd] debug seastore odata = 20 2026-02-12T12:50:22.569 INFO:tasks.ceph:[osd] debug seastore omap = 20 2026-02-12T12:50:22.569 INFO:tasks.ceph:[osd] debug seastore onode = 20 2026-02-12T12:50:22.570 INFO:tasks.ceph:[osd] debug seastore t = 20 2026-02-12T12:50:22.570 INFO:tasks.ceph:[osd] debug seastore tm = 20 2026-02-12T12:50:22.570 INFO:tasks.ceph:[osd] osd objectstore = seastore 2026-02-12T12:50:22.570 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-12T12:50:22.570 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-12T12:50:22.570 INFO:tasks.ceph:[osd] seastore main device type = RANDOM_BLOCK_SSD 2026-02-12T12:50:22.570 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-12T12:50:22.570 INFO:tasks.ceph:[global] auth client required = none 2026-02-12T12:50:22.570 INFO:tasks.ceph:[global] auth cluster required = none 2026-02-12T12:50:22.570 INFO:tasks.ceph:[global] auth service required = none 2026-02-12T12:50:22.570 INFO:tasks.ceph:[global] auth supported = none 2026-02-12T12:50:22.570 INFO:tasks.ceph:[global] debug asok = 0/0 2026-02-12T12:50:22.570 INFO:tasks.ceph:[global] debug auth = 0/0 2026-02-12T12:50:22.571 INFO:tasks.ceph:[global] debug bdev = 0/0 2026-02-12T12:50:22.571 INFO:tasks.ceph:[global] debug bluefs = 0/0 2026-02-12T12:50:22.571 INFO:tasks.ceph:[global] debug bluestore = 0/0 2026-02-12T12:50:22.571 INFO:tasks.ceph:[global] debug buffer = 0/0 2026-02-12T12:50:22.571 INFO:tasks.ceph:[global] debug civetweb = 0/0 2026-02-12T12:50:22.571 INFO:tasks.ceph:[global] debug client = 0/0 2026-02-12T12:50:22.571 INFO:tasks.ceph:[global] debug compressor = 0/0 2026-02-12T12:50:22.571 INFO:tasks.ceph:[global] debug context = 0/0 2026-02-12T12:50:22.571 INFO:tasks.ceph:[global] debug crush = 0/0 2026-02-12T12:50:22.571 INFO:tasks.ceph:[global] debug crypto = 0/0 2026-02-12T12:50:22.571 INFO:tasks.ceph:[global] debug dpdk = 0/0 2026-02-12T12:50:22.571 INFO:tasks.ceph:[global] debug eventtrace = 0/0 2026-02-12T12:50:22.571 INFO:tasks.ceph:[global] debug filer = 0/0 2026-02-12T12:50:22.572 INFO:tasks.ceph:[global] debug filestore = 0/0 2026-02-12T12:50:22.572 INFO:tasks.ceph:[global] debug finisher = 0/0 2026-02-12T12:50:22.572 INFO:tasks.ceph:[global] debug fuse = 0/0 2026-02-12T12:50:22.572 INFO:tasks.ceph:[global] debug heartbeatmap = 0/0 2026-02-12T12:50:22.572 INFO:tasks.ceph:[global] debug javaclient = 0/0 2026-02-12T12:50:22.572 INFO:tasks.ceph:[global] debug journal = 0/0 2026-02-12T12:50:22.572 INFO:tasks.ceph:[global] debug journaler = 0/0 2026-02-12T12:50:22.572 INFO:tasks.ceph:[global] debug kstore = 0/0 2026-02-12T12:50:22.572 INFO:tasks.ceph:[global] debug leveldb = 0/0 2026-02-12T12:50:22.572 INFO:tasks.ceph:[global] debug lockdep = 0/0 2026-02-12T12:50:22.572 INFO:tasks.ceph:[global] debug mds = 0/0 2026-02-12T12:50:22.572 INFO:tasks.ceph:[global] debug mds balancer = 0/0 2026-02-12T12:50:22.573 INFO:tasks.ceph:[global] debug mds locker = 0/0 2026-02-12T12:50:22.573 INFO:tasks.ceph:[global] debug mds log = 0/0 2026-02-12T12:50:22.573 INFO:tasks.ceph:[global] debug mds log expire = 0/0 2026-02-12T12:50:22.573 INFO:tasks.ceph:[global] debug mds migrator = 0/0 2026-02-12T12:50:22.573 INFO:tasks.ceph:[global] debug memdb = 0/0 2026-02-12T12:50:22.573 INFO:tasks.ceph:[global] debug mgr = 0/0 2026-02-12T12:50:22.573 INFO:tasks.ceph:[global] debug mgrc = 0/0 2026-02-12T12:50:22.573 INFO:tasks.ceph:[global] debug mon = 0/0 2026-02-12T12:50:22.573 INFO:tasks.ceph:[global] debug monc = 0/0 2026-02-12T12:50:22.573 INFO:tasks.ceph:[global] debug ms = 0/0 2026-02-12T12:50:22.573 INFO:tasks.ceph:[global] debug objclass = 0/0 2026-02-12T12:50:22.573 INFO:tasks.ceph:[global] debug objectcacher = 0/0 2026-02-12T12:50:22.573 INFO:tasks.ceph:[global] debug objecter = 0/0 2026-02-12T12:50:22.573 INFO:tasks.ceph:[global] debug optracker = 0/0 2026-02-12T12:50:22.574 INFO:tasks.ceph:[global] debug osd = 0/0 2026-02-12T12:50:22.574 INFO:tasks.ceph:[global] debug paxos = 0/0 2026-02-12T12:50:22.574 INFO:tasks.ceph:[global] debug perfcounter = 0/0 2026-02-12T12:50:22.574 INFO:tasks.ceph:[global] debug rados = 0/0 2026-02-12T12:50:22.574 INFO:tasks.ceph:[global] debug rbd = 0/0 2026-02-12T12:50:22.574 INFO:tasks.ceph:[global] debug rbd mirror = 0/0 2026-02-12T12:50:22.574 INFO:tasks.ceph:[global] debug rbd replay = 0/0 2026-02-12T12:50:22.574 INFO:tasks.ceph:[global] debug refs = 0/0 2026-02-12T12:50:22.574 INFO:tasks.ceph:[global] debug rgw = 0/0 2026-02-12T12:50:22.574 INFO:tasks.ceph:[global] debug rgw lifecycle = 0/0 2026-02-12T12:50:22.574 INFO:tasks.ceph:[global] debug rgw notification = 0/0 2026-02-12T12:50:22.574 INFO:tasks.ceph:[global] debug rgw sync = 0/0 2026-02-12T12:50:22.574 INFO:tasks.ceph:[global] debug rocksdb = 0/0 2026-02-12T12:50:22.575 INFO:tasks.ceph:[global] debug striper = 0/0 2026-02-12T12:50:22.575 INFO:tasks.ceph:[global] debug throttle = 0/0 2026-02-12T12:50:22.575 INFO:tasks.ceph:[global] debug timer = 0/0 2026-02-12T12:50:22.575 INFO:tasks.ceph:[global] debug tp = 0/0 2026-02-12T12:50:22.575 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-12T12:50:22.575 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-12T12:50:22.575 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-12T12:50:22.575 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-12T12:50:22.575 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-12T12:50:22.575 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-12T12:50:22.575 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-12T12:50:22.575 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-12T12:50:22.575 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-12T12:50:22.576 INFO:tasks.ceph:[mon] debug mon = 0/0 2026-02-12T12:50:22.576 INFO:tasks.ceph:[mon] debug ms = 0/0 2026-02-12T12:50:22.576 INFO:tasks.ceph:[mon] debug paxos = 0/0 2026-02-12T12:50:22.576 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-12T12:50:22.576 INFO:tasks.ceph:Setting up mon.a... 2026-02-12T12:50:22.576 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-12T12:50:22.647 INFO:teuthology.orchestra.run.trial049.stdout:creating /etc/ceph/ceph.keyring 2026-02-12T12:50:22.650 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-12T12:50:22.734 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T12:50:22.800 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.49')] 2026-02-12T12:50:22.801 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'none', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.49', 'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': '0/0', 'debug mon': '0/0', 'debug paxos': '0/0', 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-12T12:50:22.803 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:50:22.803 DEBUG:teuthology.orchestra.run.trial049:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T12:50:22.857 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.49 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-12T12:50:22.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:22.938+0000 7fb45f4d5f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:22.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:22.938+0000 7fb45f4d5f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:22.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:22.939+0000 7fb45f4d5f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:22.939 INFO:teuthology.orchestra.run.trial049.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-12T12:50:22.940 INFO:teuthology.orchestra.run.trial049.stdout:monmaptool: generated fsid e0447ae7-4fae-4090-a89b-5b6943627aef 2026-02-12T12:50:22.940 INFO:teuthology.orchestra.run.trial049.stdout:setting min_mon_release = tentacle 2026-02-12T12:50:22.940 INFO:teuthology.orchestra.run.trial049.stdout:epoch 0 2026-02-12T12:50:22.940 INFO:teuthology.orchestra.run.trial049.stdout:fsid e0447ae7-4fae-4090-a89b-5b6943627aef 2026-02-12T12:50:22.940 INFO:teuthology.orchestra.run.trial049.stdout:last_changed 2026-02-12T12:50:22.940044+0000 2026-02-12T12:50:22.940 INFO:teuthology.orchestra.run.trial049.stdout:created 2026-02-12T12:50:22.940044+0000 2026-02-12T12:50:22.940 INFO:teuthology.orchestra.run.trial049.stdout:min_mon_release 20 (tentacle) 2026-02-12T12:50:22.940 INFO:teuthology.orchestra.run.trial049.stdout:election_strategy: 1 2026-02-12T12:50:22.940 INFO:teuthology.orchestra.run.trial049.stdout:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-12T12:50:22.940 INFO:teuthology.orchestra.run.trial049.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-12T12:50:22.941 DEBUG:teuthology.orchestra.run.trial049:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T12:50:22.996 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e0447ae7-4fae-4090-a89b-5b6943627aef... 2026-02-12T12:50:22.998 DEBUG:teuthology.orchestra.run.trial049:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T12:50:23.078 INFO:teuthology.orchestra.run.trial049.stdout:[global] 2026-02-12T12:50:23.078 INFO:teuthology.orchestra.run.trial049.stdout: chdir = "" 2026-02-12T12:50:23.078 INFO:teuthology.orchestra.run.trial049.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T12:50:23.078 INFO:teuthology.orchestra.run.trial049.stdout: auth supported = none 2026-02-12T12:50:23.078 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.078 INFO:teuthology.orchestra.run.trial049.stdout: filestore xattr use omap = true 2026-02-12T12:50:23.078 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.078 INFO:teuthology.orchestra.run.trial049.stdout: mon clock drift allowed = 1.000 2026-02-12T12:50:23.078 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.079 INFO:teuthology.orchestra.run.trial049.stdout: osd crush chooseleaf type = 0 2026-02-12T12:50:23.079 INFO:teuthology.orchestra.run.trial049.stdout: auth debug = true 2026-02-12T12:50:23.079 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.079 INFO:teuthology.orchestra.run.trial049.stdout: ms die on old message = true 2026-02-12T12:50:23.079 INFO:teuthology.orchestra.run.trial049.stdout: ms die on bug = true 2026-02-12T12:50:23.079 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.079 INFO:teuthology.orchestra.run.trial049.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T12:50:23.079 INFO:teuthology.orchestra.run.trial049.stdout: mon pg warn max object skew = 0 2026-02-12T12:50:23.079 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.079 INFO:teuthology.orchestra.run.trial049.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T12:50:23.079 INFO:teuthology.orchestra.run.trial049.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T12:50:23.079 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.080 INFO:teuthology.orchestra.run.trial049.stdout: osd pool default size = 2 2026-02-12T12:50:23.080 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.080 INFO:teuthology.orchestra.run.trial049.stdout: mon osd allow primary affinity = true 2026-02-12T12:50:23.080 INFO:teuthology.orchestra.run.trial049.stdout: mon osd allow pg remap = true 2026-02-12T12:50:23.080 INFO:teuthology.orchestra.run.trial049.stdout: mon warn on legacy crush tunables = false 2026-02-12T12:50:23.080 INFO:teuthology.orchestra.run.trial049.stdout: mon warn on crush straw calc version zero = false 2026-02-12T12:50:23.080 INFO:teuthology.orchestra.run.trial049.stdout: mon warn on no sortbitwise = false 2026-02-12T12:50:23.080 INFO:teuthology.orchestra.run.trial049.stdout: mon warn on osd down out interval zero = false 2026-02-12T12:50:23.080 INFO:teuthology.orchestra.run.trial049.stdout: mon warn on too few osds = false 2026-02-12T12:50:23.080 INFO:teuthology.orchestra.run.trial049.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T12:50:23.080 INFO:teuthology.orchestra.run.trial049.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T12:50:23.080 INFO:teuthology.orchestra.run.trial049.stdout: mon_allow_pool_size_one = true 2026-02-12T12:50:23.081 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.081 INFO:teuthology.orchestra.run.trial049.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T12:50:23.081 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.081 INFO:teuthology.orchestra.run.trial049.stdout: osd default data pool replay window = 5 2026-02-12T12:50:23.081 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.081 INFO:teuthology.orchestra.run.trial049.stdout: mon allow pool delete = true 2026-02-12T12:50:23.081 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.081 INFO:teuthology.orchestra.run.trial049.stdout: mon cluster log file level = debug 2026-02-12T12:50:23.081 INFO:teuthology.orchestra.run.trial049.stdout: debug asserts on shutdown = true 2026-02-12T12:50:23.081 INFO:teuthology.orchestra.run.trial049.stdout: mon health detail to clog = false 2026-02-12T12:50:23.081 INFO:teuthology.orchestra.run.trial049.stdout: mon host = 10.20.193.49 2026-02-12T12:50:23.081 INFO:teuthology.orchestra.run.trial049.stdout: auth client required = none 2026-02-12T12:50:23.081 INFO:teuthology.orchestra.run.trial049.stdout: auth cluster required = none 2026-02-12T12:50:23.082 INFO:teuthology.orchestra.run.trial049.stdout: auth service required = none 2026-02-12T12:50:23.082 INFO:teuthology.orchestra.run.trial049.stdout: debug asok = 0/0 2026-02-12T12:50:23.082 INFO:teuthology.orchestra.run.trial049.stdout: debug auth = 0/0 2026-02-12T12:50:23.082 INFO:teuthology.orchestra.run.trial049.stdout: debug bdev = 0/0 2026-02-12T12:50:23.082 INFO:teuthology.orchestra.run.trial049.stdout: debug bluefs = 0/0 2026-02-12T12:50:23.082 INFO:teuthology.orchestra.run.trial049.stdout: debug bluestore = 0/0 2026-02-12T12:50:23.082 INFO:teuthology.orchestra.run.trial049.stdout: debug buffer = 0/0 2026-02-12T12:50:23.082 INFO:teuthology.orchestra.run.trial049.stdout: debug civetweb = 0/0 2026-02-12T12:50:23.082 INFO:teuthology.orchestra.run.trial049.stdout: debug client = 0/0 2026-02-12T12:50:23.082 INFO:teuthology.orchestra.run.trial049.stdout: debug compressor = 0/0 2026-02-12T12:50:23.082 INFO:teuthology.orchestra.run.trial049.stdout: debug context = 0/0 2026-02-12T12:50:23.082 INFO:teuthology.orchestra.run.trial049.stdout: debug crush = 0/0 2026-02-12T12:50:23.083 INFO:teuthology.orchestra.run.trial049.stdout: debug crypto = 0/0 2026-02-12T12:50:23.083 INFO:teuthology.orchestra.run.trial049.stdout: debug dpdk = 0/0 2026-02-12T12:50:23.083 INFO:teuthology.orchestra.run.trial049.stdout: debug eventtrace = 0/0 2026-02-12T12:50:23.083 INFO:teuthology.orchestra.run.trial049.stdout: debug filer = 0/0 2026-02-12T12:50:23.083 INFO:teuthology.orchestra.run.trial049.stdout: debug filestore = 0/0 2026-02-12T12:50:23.083 INFO:teuthology.orchestra.run.trial049.stdout: debug finisher = 0/0 2026-02-12T12:50:23.083 INFO:teuthology.orchestra.run.trial049.stdout: debug fuse = 0/0 2026-02-12T12:50:23.083 INFO:teuthology.orchestra.run.trial049.stdout: debug heartbeatmap = 0/0 2026-02-12T12:50:23.083 INFO:teuthology.orchestra.run.trial049.stdout: debug javaclient = 0/0 2026-02-12T12:50:23.083 INFO:teuthology.orchestra.run.trial049.stdout: debug journal = 0/0 2026-02-12T12:50:23.083 INFO:teuthology.orchestra.run.trial049.stdout: debug journaler = 0/0 2026-02-12T12:50:23.083 INFO:teuthology.orchestra.run.trial049.stdout: debug kstore = 0/0 2026-02-12T12:50:23.083 INFO:teuthology.orchestra.run.trial049.stdout: debug leveldb = 0/0 2026-02-12T12:50:23.083 INFO:teuthology.orchestra.run.trial049.stdout: debug lockdep = 0/0 2026-02-12T12:50:23.084 INFO:teuthology.orchestra.run.trial049.stdout: debug mds = 0/0 2026-02-12T12:50:23.084 INFO:teuthology.orchestra.run.trial049.stdout: debug mds balancer = 0/0 2026-02-12T12:50:23.084 INFO:teuthology.orchestra.run.trial049.stdout: debug mds locker = 0/0 2026-02-12T12:50:23.084 INFO:teuthology.orchestra.run.trial049.stdout: debug mds log = 0/0 2026-02-12T12:50:23.084 INFO:teuthology.orchestra.run.trial049.stdout: debug mds log expire = 0/0 2026-02-12T12:50:23.084 INFO:teuthology.orchestra.run.trial049.stdout: debug mds migrator = 0/0 2026-02-12T12:50:23.084 INFO:teuthology.orchestra.run.trial049.stdout: debug memdb = 0/0 2026-02-12T12:50:23.084 INFO:teuthology.orchestra.run.trial049.stdout: debug mgr = 0/0 2026-02-12T12:50:23.084 INFO:teuthology.orchestra.run.trial049.stdout: debug mgrc = 0/0 2026-02-12T12:50:23.084 INFO:teuthology.orchestra.run.trial049.stdout: debug mon = 0/0 2026-02-12T12:50:23.084 INFO:teuthology.orchestra.run.trial049.stdout: debug monc = 0/0 2026-02-12T12:50:23.084 INFO:teuthology.orchestra.run.trial049.stdout: debug ms = 0/0 2026-02-12T12:50:23.084 INFO:teuthology.orchestra.run.trial049.stdout: debug objclass = 0/0 2026-02-12T12:50:23.085 INFO:teuthology.orchestra.run.trial049.stdout: debug objectcacher = 0/0 2026-02-12T12:50:23.085 INFO:teuthology.orchestra.run.trial049.stdout: debug objecter = 0/0 2026-02-12T12:50:23.085 INFO:teuthology.orchestra.run.trial049.stdout: debug optracker = 0/0 2026-02-12T12:50:23.085 INFO:teuthology.orchestra.run.trial049.stdout: debug osd = 0/0 2026-02-12T12:50:23.085 INFO:teuthology.orchestra.run.trial049.stdout: debug paxos = 0/0 2026-02-12T12:50:23.085 INFO:teuthology.orchestra.run.trial049.stdout: debug perfcounter = 0/0 2026-02-12T12:50:23.085 INFO:teuthology.orchestra.run.trial049.stdout: debug rados = 0/0 2026-02-12T12:50:23.085 INFO:teuthology.orchestra.run.trial049.stdout: debug rbd = 0/0 2026-02-12T12:50:23.085 INFO:teuthology.orchestra.run.trial049.stdout: debug rbd mirror = 0/0 2026-02-12T12:50:23.085 INFO:teuthology.orchestra.run.trial049.stdout: debug rbd replay = 0/0 2026-02-12T12:50:23.085 INFO:teuthology.orchestra.run.trial049.stdout: debug refs = 0/0 2026-02-12T12:50:23.085 INFO:teuthology.orchestra.run.trial049.stdout: debug rgw = 0/0 2026-02-12T12:50:23.085 INFO:teuthology.orchestra.run.trial049.stdout: debug rgw lifecycle = 0/0 2026-02-12T12:50:23.086 INFO:teuthology.orchestra.run.trial049.stdout: debug rgw notification = 0/0 2026-02-12T12:50:23.086 INFO:teuthology.orchestra.run.trial049.stdout: debug rgw sync = 0/0 2026-02-12T12:50:23.086 INFO:teuthology.orchestra.run.trial049.stdout: debug rocksdb = 0/0 2026-02-12T12:50:23.086 INFO:teuthology.orchestra.run.trial049.stdout: debug striper = 0/0 2026-02-12T12:50:23.086 INFO:teuthology.orchestra.run.trial049.stdout: debug throttle = 0/0 2026-02-12T12:50:23.086 INFO:teuthology.orchestra.run.trial049.stdout: debug timer = 0/0 2026-02-12T12:50:23.086 INFO:teuthology.orchestra.run.trial049.stdout: debug tp = 0/0 2026-02-12T12:50:23.086 INFO:teuthology.orchestra.run.trial049.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-12T12:50:23.086 INFO:teuthology.orchestra.run.trial049.stdout: ms client mode = crc 2026-02-12T12:50:23.086 INFO:teuthology.orchestra.run.trial049.stdout: ms cluster mode = crc 2026-02-12T12:50:23.086 INFO:teuthology.orchestra.run.trial049.stdout: ms mon client mode = crc 2026-02-12T12:50:23.086 INFO:teuthology.orchestra.run.trial049.stdout: ms mon cluster mode = crc 2026-02-12T12:50:23.086 INFO:teuthology.orchestra.run.trial049.stdout: ms mon service mode = crc 2026-02-12T12:50:23.087 INFO:teuthology.orchestra.run.trial049.stdout: ms service mode = crc 2026-02-12T12:50:23.087 INFO:teuthology.orchestra.run.trial049.stdout: fsid = e0447ae7-4fae-4090-a89b-5b6943627aef 2026-02-12T12:50:23.087 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.087 INFO:teuthology.orchestra.run.trial049.stdout:[osd] 2026-02-12T12:50:23.087 INFO:teuthology.orchestra.run.trial049.stdout: osd journal size = 100 2026-02-12T12:50:23.087 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.087 INFO:teuthology.orchestra.run.trial049.stdout: osd scrub load threshold = 5.0 2026-02-12T12:50:23.087 INFO:teuthology.orchestra.run.trial049.stdout: osd scrub max interval = 600 2026-02-12T12:50:23.087 INFO:teuthology.orchestra.run.trial049.stdout: osd mclock profile = high_recovery_ops 2026-02-12T12:50:23.087 INFO:teuthology.orchestra.run.trial049.stdout: osd mclock skip benchmark = true 2026-02-12T12:50:23.087 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.087 INFO:teuthology.orchestra.run.trial049.stdout: osd recover clone overlap = true 2026-02-12T12:50:23.087 INFO:teuthology.orchestra.run.trial049.stdout: osd recovery max chunk = 1048576 2026-02-12T12:50:23.088 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.088 INFO:teuthology.orchestra.run.trial049.stdout: osd debug shutdown = true 2026-02-12T12:50:23.088 INFO:teuthology.orchestra.run.trial049.stdout: osd debug op order = true 2026-02-12T12:50:23.088 INFO:teuthology.orchestra.run.trial049.stdout: osd debug verify stray on activate = true 2026-02-12T12:50:23.088 INFO:teuthology.orchestra.run.trial049.stdout: osd debug trim objects = true 2026-02-12T12:50:23.088 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.088 INFO:teuthology.orchestra.run.trial049.stdout: osd open classes on start = true 2026-02-12T12:50:23.088 INFO:teuthology.orchestra.run.trial049.stdout: osd debug pg log writeout = true 2026-02-12T12:50:23.088 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.088 INFO:teuthology.orchestra.run.trial049.stdout: osd deep scrub update digest min age = 30 2026-02-12T12:50:23.088 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.088 INFO:teuthology.orchestra.run.trial049.stdout: osd map max advance = 10 2026-02-12T12:50:23.089 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.089 INFO:teuthology.orchestra.run.trial049.stdout: journal zero on create = true 2026-02-12T12:50:23.089 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.089 INFO:teuthology.orchestra.run.trial049.stdout: filestore ondisk finisher threads = 3 2026-02-12T12:50:23.089 INFO:teuthology.orchestra.run.trial049.stdout: filestore apply finisher threads = 3 2026-02-12T12:50:23.089 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.089 INFO:teuthology.orchestra.run.trial049.stdout: bdev debug aio = true 2026-02-12T12:50:23.089 INFO:teuthology.orchestra.run.trial049.stdout: osd debug misdirected ops = true 2026-02-12T12:50:23.089 INFO:teuthology.orchestra.run.trial049.stdout: debug monc = 20 2026-02-12T12:50:23.089 INFO:teuthology.orchestra.run.trial049.stdout: crimson cpu num = 4 2026-02-12T12:50:23.089 INFO:teuthology.orchestra.run.trial049.stdout: crimson osd obc lru size = 10 2026-02-12T12:50:23.090 INFO:teuthology.orchestra.run.trial049.stdout: debug filestore = 0/0 2026-02-12T12:50:23.090 INFO:teuthology.orchestra.run.trial049.stdout: debug journal = 0/0 2026-02-12T12:50:23.090 INFO:teuthology.orchestra.run.trial049.stdout: debug ms = 0/0 2026-02-12T12:50:23.090 INFO:teuthology.orchestra.run.trial049.stdout: debug osd = 0/0 2026-02-12T12:50:23.090 INFO:teuthology.orchestra.run.trial049.stdout: debug seastore = 20 2026-02-12T12:50:23.090 INFO:teuthology.orchestra.run.trial049.stdout: debug seastore backref = 20 2026-02-12T12:50:23.090 INFO:teuthology.orchestra.run.trial049.stdout: debug seastore cache = 20 2026-02-12T12:50:23.090 INFO:teuthology.orchestra.run.trial049.stdout: debug seastore cleaner = 20 2026-02-12T12:50:23.090 INFO:teuthology.orchestra.run.trial049.stdout: debug seastore device = 20 2026-02-12T12:50:23.090 INFO:teuthology.orchestra.run.trial049.stdout: debug seastore epm = 20 2026-02-12T12:50:23.090 INFO:teuthology.orchestra.run.trial049.stdout: debug seastore fixedkv tree = 20 2026-02-12T12:50:23.090 INFO:teuthology.orchestra.run.trial049.stdout: debug seastore journal = 20 2026-02-12T12:50:23.090 INFO:teuthology.orchestra.run.trial049.stdout: debug seastore lba = 20 2026-02-12T12:50:23.091 INFO:teuthology.orchestra.run.trial049.stdout: debug seastore odata = 20 2026-02-12T12:50:23.091 INFO:teuthology.orchestra.run.trial049.stdout: debug seastore omap = 20 2026-02-12T12:50:23.091 INFO:teuthology.orchestra.run.trial049.stdout: debug seastore onode = 20 2026-02-12T12:50:23.091 INFO:teuthology.orchestra.run.trial049.stdout: debug seastore t = 20 2026-02-12T12:50:23.091 INFO:teuthology.orchestra.run.trial049.stdout: debug seastore tm = 20 2026-02-12T12:50:23.091 INFO:teuthology.orchestra.run.trial049.stdout: osd objectstore = seastore 2026-02-12T12:50:23.091 INFO:teuthology.orchestra.run.trial049.stdout: osd shutdown pgref assert = True 2026-02-12T12:50:23.091 INFO:teuthology.orchestra.run.trial049.stdout: seastore cachepin size pershard = 64M 2026-02-12T12:50:23.091 INFO:teuthology.orchestra.run.trial049.stdout: seastore main device type = RANDOM_BLOCK_SSD 2026-02-12T12:50:23.091 INFO:teuthology.orchestra.run.trial049.stdout: seastore max concurrent transactions = 8 2026-02-12T12:50:23.091 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.091 INFO:teuthology.orchestra.run.trial049.stdout:[mgr] 2026-02-12T12:50:23.091 INFO:teuthology.orchestra.run.trial049.stdout: debug ms = 1 2026-02-12T12:50:23.092 INFO:teuthology.orchestra.run.trial049.stdout: debug mgr = 20 2026-02-12T12:50:23.092 INFO:teuthology.orchestra.run.trial049.stdout: debug mon = 20 2026-02-12T12:50:23.092 INFO:teuthology.orchestra.run.trial049.stdout: debug auth = 20 2026-02-12T12:50:23.092 INFO:teuthology.orchestra.run.trial049.stdout: mon reweight min pgs per osd = 4 2026-02-12T12:50:23.092 INFO:teuthology.orchestra.run.trial049.stdout: mon reweight min bytes per osd = 10 2026-02-12T12:50:23.092 INFO:teuthology.orchestra.run.trial049.stdout: mgr/telemetry/nag = false 2026-02-12T12:50:23.092 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.092 INFO:teuthology.orchestra.run.trial049.stdout:[mon] 2026-02-12T12:50:23.092 INFO:teuthology.orchestra.run.trial049.stdout: debug ms = 0/0 2026-02-12T12:50:23.092 INFO:teuthology.orchestra.run.trial049.stdout: debug mon = 0/0 2026-02-12T12:50:23.092 INFO:teuthology.orchestra.run.trial049.stdout: debug paxos = 0/0 2026-02-12T12:50:23.093 INFO:teuthology.orchestra.run.trial049.stdout: debug auth = 20 2026-02-12T12:50:23.093 INFO:teuthology.orchestra.run.trial049.stdout: mon data avail warn = 5 2026-02-12T12:50:23.093 INFO:teuthology.orchestra.run.trial049.stdout: mon mgr mkfs grace = 240 2026-02-12T12:50:23.093 INFO:teuthology.orchestra.run.trial049.stdout: mon reweight min pgs per osd = 4 2026-02-12T12:50:23.093 INFO:teuthology.orchestra.run.trial049.stdout: mon osd reporter subtree level = osd 2026-02-12T12:50:23.093 INFO:teuthology.orchestra.run.trial049.stdout: mon osd prime pg temp = true 2026-02-12T12:50:23.093 INFO:teuthology.orchestra.run.trial049.stdout: mon reweight min bytes per osd = 10 2026-02-12T12:50:23.093 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.093 INFO:teuthology.orchestra.run.trial049.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T12:50:23.093 INFO:teuthology.orchestra.run.trial049.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T12:50:23.093 INFO:teuthology.orchestra.run.trial049.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T12:50:23.094 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.094 INFO:teuthology.orchestra.run.trial049.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T12:50:23.094 INFO:teuthology.orchestra.run.trial049.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T12:50:23.094 INFO:teuthology.orchestra.run.trial049.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T12:50:23.094 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.094 INFO:teuthology.orchestra.run.trial049.stdout: # 1m isn't quite enough 2026-02-12T12:50:23.094 INFO:teuthology.orchestra.run.trial049.stdout: mon_down_mkfs_grace = 2m 2026-02-12T12:50:23.094 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.094 INFO:teuthology.orchestra.run.trial049.stdout: mon_warn_on_filestore_osds = false 2026-02-12T12:50:23.094 INFO:teuthology.orchestra.run.trial049.stdout: osd pool default crimson = True 2026-02-12T12:50:23.094 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:23.094 INFO:teuthology.orchestra.run.trial049.stdout:[client] 2026-02-12T12:50:23.094 INFO:teuthology.orchestra.run.trial049.stdout: rgw cache enabled = true 2026-02-12T12:50:23.095 INFO:teuthology.orchestra.run.trial049.stdout: rgw enable ops log = true 2026-02-12T12:50:23.095 INFO:teuthology.orchestra.run.trial049.stdout: rgw enable usage log = true 2026-02-12T12:50:23.095 INFO:teuthology.orchestra.run.trial049.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T12:50:23.095 INFO:teuthology.orchestra.run.trial049.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T12:50:23.095 INFO:teuthology.orchestra.run.trial049.stdout:[mon.a] 2026-02-12T12:50:23.096 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-12T12:50:23.096 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-12T12:50:23.187 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-12T12:50:23.187 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:50:23.188 DEBUG:teuthology.orchestra.run.trial049:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-12T12:50:23.204 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:50:23.204 DEBUG:teuthology.orchestra.run.trial049:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-12T12:50:23.261 INFO:tasks.ceph:Sending monmap to node ubuntu@trial049.front.sepia.ceph.com 2026-02-12T12:50:23.261 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:50:23.261 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T12:50:23.261 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T12:50:23.333 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:50:23.333 DEBUG:teuthology.orchestra.run.trial049:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T12:50:23.390 INFO:tasks.ceph:Setting up mon nodes... 2026-02-12T12:50:23.390 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-12T12:50:23.391 DEBUG:teuthology.orchestra.run.trial049:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T12:50:23.480 INFO:teuthology.orchestra.run.trial049.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T12:50:23.483 INFO:tasks.ceph:Setting up mds nodes... 2026-02-12T12:50:23.483 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-12T12:50:23.484 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-12T12:50:23.525 INFO:teuthology.orchestra.run.trial049.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-12T12:50:23.538 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-12T12:50:23.538 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-12T12:50:23.538 DEBUG:teuthology.orchestra.run.trial049:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-12T12:50:23.603 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T12:50:23.603 INFO:tasks.ceph:role: osd.0 2026-02-12T12:50:23.603 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial049.front.sepia.ceph.com 2026-02-12T12:50:23.603 DEBUG:teuthology.orchestra.run.trial049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T12:50:23.667 INFO:teuthology.orchestra.run.trial049.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T12:50:23.667 INFO:teuthology.orchestra.run.trial049.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T12:50:23.667 INFO:teuthology.orchestra.run.trial049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T12:50:23.667 INFO:teuthology.orchestra.run.trial049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T12:50:23.667 INFO:teuthology.orchestra.run.trial049.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T12:50:23.667 INFO:teuthology.orchestra.run.trial049.stdout: = sunit=0 swidth=0 blks 2026-02-12T12:50:23.667 INFO:teuthology.orchestra.run.trial049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T12:50:23.667 INFO:teuthology.orchestra.run.trial049.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T12:50:23.668 INFO:teuthology.orchestra.run.trial049.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T12:50:23.668 INFO:teuthology.orchestra.run.trial049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T12:50:24.239 INFO:teuthology.orchestra.run.trial049.stdout:Discarding blocks...Done. 2026-02-12T12:50:24.241 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial049.front.sepia.ceph.com -o noatime 2026-02-12T12:50:24.241 DEBUG:teuthology.orchestra.run.trial049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-12T12:50:24.312 DEBUG:teuthology.orchestra.run.trial049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-12T12:50:24.379 DEBUG:teuthology.orchestra.run.trial049:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-12T12:50:24.443 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T12:50:24.443 INFO:tasks.ceph:role: osd.1 2026-02-12T12:50:24.443 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial049.front.sepia.ceph.com 2026-02-12T12:50:24.444 DEBUG:teuthology.orchestra.run.trial049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T12:50:24.508 INFO:teuthology.orchestra.run.trial049.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T12:50:24.508 INFO:teuthology.orchestra.run.trial049.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T12:50:24.509 INFO:teuthology.orchestra.run.trial049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T12:50:24.509 INFO:teuthology.orchestra.run.trial049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T12:50:24.509 INFO:teuthology.orchestra.run.trial049.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T12:50:24.509 INFO:teuthology.orchestra.run.trial049.stdout: = sunit=0 swidth=0 blks 2026-02-12T12:50:24.509 INFO:teuthology.orchestra.run.trial049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T12:50:24.509 INFO:teuthology.orchestra.run.trial049.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T12:50:24.509 INFO:teuthology.orchestra.run.trial049.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T12:50:24.509 INFO:teuthology.orchestra.run.trial049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T12:50:25.069 INFO:teuthology.orchestra.run.trial049.stdout:Discarding blocks...Done. 2026-02-12T12:50:25.071 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial049.front.sepia.ceph.com -o noatime 2026-02-12T12:50:25.072 DEBUG:teuthology.orchestra.run.trial049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-12T12:50:25.139 DEBUG:teuthology.orchestra.run.trial049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-12T12:50:25.206 DEBUG:teuthology.orchestra.run.trial049:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-12T12:50:25.270 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T12:50:25.271 INFO:tasks.ceph:role: osd.2 2026-02-12T12:50:25.271 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial049.front.sepia.ceph.com 2026-02-12T12:50:25.271 DEBUG:teuthology.orchestra.run.trial049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-12T12:50:25.335 INFO:teuthology.orchestra.run.trial049.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T12:50:25.335 INFO:teuthology.orchestra.run.trial049.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T12:50:25.335 INFO:teuthology.orchestra.run.trial049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T12:50:25.335 INFO:teuthology.orchestra.run.trial049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T12:50:25.335 INFO:teuthology.orchestra.run.trial049.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T12:50:25.335 INFO:teuthology.orchestra.run.trial049.stdout: = sunit=0 swidth=0 blks 2026-02-12T12:50:25.335 INFO:teuthology.orchestra.run.trial049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T12:50:25.335 INFO:teuthology.orchestra.run.trial049.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T12:50:25.336 INFO:teuthology.orchestra.run.trial049.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T12:50:25.336 INFO:teuthology.orchestra.run.trial049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T12:50:25.892 INFO:teuthology.orchestra.run.trial049.stdout:Discarding blocks...Done. 2026-02-12T12:50:25.894 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial049.front.sepia.ceph.com -o noatime 2026-02-12T12:50:25.895 DEBUG:teuthology.orchestra.run.trial049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-12T12:50:25.964 DEBUG:teuthology.orchestra.run.trial049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-12T12:50:26.031 DEBUG:teuthology.orchestra.run.trial049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T12:50:26.179 INFO:teuthology.orchestra.run.trial049.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T12:50:26.237 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:26,238 seastar - Reactor backend: linux-aio 2026-02-12T12:50:26.255 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:26,256 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:50:26.255 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:26,256 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:50:26.257 INFO:teuthology.orchestra.run.trial049.stderr:==21084==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T12:50:26.316 INFO:teuthology.orchestra.run.trial049.stderr:DEBUG 2026-02-12 12:50:26,318 [shard 0:main] seastar - reactor::drain 2026-02-12T12:50:28.413 INFO:teuthology.orchestra.run.trial049.stderr:----------------------------------------------------- 2026-02-12T12:50:28.414 INFO:teuthology.orchestra.run.trial049.stderr:Suppressions used: 2026-02-12T12:50:28.414 INFO:teuthology.orchestra.run.trial049.stderr: count bytes template 2026-02-12T12:50:28.414 INFO:teuthology.orchestra.run.trial049.stderr: 1 8 MallocExtension::Register 2026-02-12T12:50:28.414 INFO:teuthology.orchestra.run.trial049.stderr:----------------------------------------------------- 2026-02-12T12:50:28.414 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-12T12:50:28.434 INFO:teuthology.orchestra.run.trial049.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T12:50:28.434 INFO:teuthology.orchestra.run.trial049.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T12:50:28.479 INFO:teuthology.orchestra.run.trial049.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T12:50:28.479 INFO:teuthology.orchestra.run.trial049.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T12:50:28.486 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:28,487 seastar - Reactor backend: linux-aio 2026-02-12T12:50:28.494 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:28,495 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:50:28.494 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:28,495 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:50:28.498 INFO:teuthology.orchestra.run.trial049.stderr:==21082==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T12:50:28.498 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:28,499 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T12:50:28.641 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297e4 /lib64/libasan.so.8+0xc6631 /lib64/libasan.so.8+0x157e7 0xc96a72 0xca7fdd 0x9d672df 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:28.641 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x8eea /lib64/libasan.so.8+0xedc65 0xe1e15b 0xe1e4b2 0x73cb88c 0x73cb989 0x73cbcdc 0x78a0b4d 0x7bb280e 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:28.642 INFO:teuthology.orchestra.run.trial049.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff9781f6fb 0xffffffff9781fb70 0xffffffff9769525e 0xffffffff979e6239 0xffffffff979c97a5 0xffffffff979d3b7b 0xffffffff979d3fdb 0xffffffff976910d2 0xffffffff9834d451 0xffffffff98400ba2 2026-02-12T12:50:28.642 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7fc 0x9cc9255 0x9cc9314 0x9cc95bc 0x9d57bab 0x9d5836a 0x9d588b0 0x9d62b3e 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:28.642 INFO:teuthology.orchestra.run.trial049.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff97d280f7 0xffffffff979f7fa6 0xffffffff979fb960 0xffffffff979fccc1 0xffffffff97a24923 0xffffffff97a24ae5 0xffffffff979c9858 0xffffffff979d3b7b 0xffffffff979d3fdb 0xffffffff976910d2 0xffffffff9834d451 0xffffffff98400ba2 2026-02-12T12:50:28.789 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0x35db29b 0x3608dff 0x360924f 0x9d45608 0x9d45a44 0x9d622cf 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:28.789 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0xe1e10a 0x78a0a37 0x7bb2209 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:28.789 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0x35eac6b 0x3606a88 0x9c8294b 0x9c82a0d 0x9d427fb 0x9d42990 0x9d42d22 0x9d44309 0x9d45624 0x9d45a44 0x9d622cf 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:30.977 INFO:teuthology.orchestra.run.trial049.stderr:----------------------------------------------------- 2026-02-12T12:50:30.977 INFO:teuthology.orchestra.run.trial049.stderr:Suppressions used: 2026-02-12T12:50:30.977 INFO:teuthology.orchestra.run.trial049.stderr: count bytes template 2026-02-12T12:50:30.977 INFO:teuthology.orchestra.run.trial049.stderr: 1 8 MallocExtension::Register 2026-02-12T12:50:30.977 INFO:teuthology.orchestra.run.trial049.stderr:----------------------------------------------------- 2026-02-12T12:50:30.977 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-12T12:50:31.008 DEBUG:teuthology.orchestra.run.trial049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-12T12:50:31.033 DEBUG:teuthology.orchestra.run.trial049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T12:50:31.181 INFO:teuthology.orchestra.run.trial049.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T12:50:31.233 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:31,235 seastar - Reactor backend: linux-aio 2026-02-12T12:50:31.251 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:31,252 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:50:31.251 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:31,252 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:50:31.253 INFO:teuthology.orchestra.run.trial049.stderr:==21149==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T12:50:31.314 INFO:teuthology.orchestra.run.trial049.stderr:DEBUG 2026-02-12 12:50:31,316 [shard 0:main] seastar - reactor::drain 2026-02-12T12:50:33.432 INFO:teuthology.orchestra.run.trial049.stderr:----------------------------------------------------- 2026-02-12T12:50:33.433 INFO:teuthology.orchestra.run.trial049.stderr:Suppressions used: 2026-02-12T12:50:33.433 INFO:teuthology.orchestra.run.trial049.stderr: count bytes template 2026-02-12T12:50:33.433 INFO:teuthology.orchestra.run.trial049.stderr: 1 8 MallocExtension::Register 2026-02-12T12:50:33.433 INFO:teuthology.orchestra.run.trial049.stderr:----------------------------------------------------- 2026-02-12T12:50:33.433 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-12T12:50:33.453 INFO:teuthology.orchestra.run.trial049.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T12:50:33.453 INFO:teuthology.orchestra.run.trial049.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T12:50:33.501 INFO:teuthology.orchestra.run.trial049.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T12:50:33.501 INFO:teuthology.orchestra.run.trial049.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T12:50:33.508 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:33,510 seastar - Reactor backend: linux-aio 2026-02-12T12:50:33.517 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:33,518 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:50:33.517 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:33,518 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:50:33.522 INFO:teuthology.orchestra.run.trial049.stderr:==21147==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T12:50:33.522 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:33,523 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T12:50:33.664 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libstdc++.so.6+0xc6247 0x316b41d 0x9c706bd 0x9c709c0 0x9c70c76 0x9c71725 0x9c71c23 0x9c72253 0x9c723bd 0x9d5272d 0x9d65530 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:33.664 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cc25 /lib64/libasan.so.8+0x1006bc /lib64/libasan.so.8+0xc6619 /lib64/libasan.so.8+0x151b7 0x36069cd 0x9c8294b 0x9c82a53 0x9d427fb 0x9d42990 0x9d42d22 0x9d44309 0x9d45624 0x9d45a44 0x9d622cf 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:33.664 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xfcb33 /lib64/libasan.so.8+0xb142f 0xb6a317 0x1092c80 0xf2fdae 0x9c70450 0x9c7074d 0x9c709c0 0x9c70c76 0x9c71238 0x9c796df 0x9c79dbf 0x9d6290c 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:33.811 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6622 /lib64/libasan.so.8+0x151b7 0x112781c 0xf2fda3 0x9c70283 0x9c7074d 0x9c709c0 0x9c726e7 0x9c72c34 0x9c72e33 0x9d58155 0x9d588b0 0x9d62b3e 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:33.811 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libstdc++.so.6+0xc6247 0x316b41d 0x9c706bd 0x9c709c0 0x9c70c76 0x9c71725 0x9c71c23 0x9c72253 0x9c723bd 0x9d5272d 0x9d65530 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:33.811 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/ld-linux-x86-64.so.2+0x16ebc /lib64/libasan.so.8+0xc6611 /lib64/libasan.so.8+0x151b7 0x112781c 0xf2fda3 0x9c70450 0x9c7074d 0x9c709c0 0x9c726e7 0x9c72c34 0x9c72e33 0x9d58155 0x9d588b0 0x9d62b3e 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:35.979 INFO:teuthology.orchestra.run.trial049.stderr:----------------------------------------------------- 2026-02-12T12:50:35.979 INFO:teuthology.orchestra.run.trial049.stderr:Suppressions used: 2026-02-12T12:50:35.979 INFO:teuthology.orchestra.run.trial049.stderr: count bytes template 2026-02-12T12:50:35.979 INFO:teuthology.orchestra.run.trial049.stderr: 1 8 MallocExtension::Register 2026-02-12T12:50:35.979 INFO:teuthology.orchestra.run.trial049.stderr:----------------------------------------------------- 2026-02-12T12:50:35.980 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-12T12:50:36.009 DEBUG:teuthology.orchestra.run.trial049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-12T12:50:36.034 DEBUG:teuthology.orchestra.run.trial049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T12:50:36.184 INFO:teuthology.orchestra.run.trial049.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T12:50:36.240 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:36,241 seastar - Reactor backend: linux-aio 2026-02-12T12:50:36.255 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:36,256 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:50:36.255 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:36,256 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:50:36.257 INFO:teuthology.orchestra.run.trial049.stderr:==21212==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T12:50:36.318 INFO:teuthology.orchestra.run.trial049.stderr:DEBUG 2026-02-12 12:50:36,319 [shard 0:main] seastar - reactor::drain 2026-02-12T12:50:38.411 INFO:teuthology.orchestra.run.trial049.stderr:----------------------------------------------------- 2026-02-12T12:50:38.411 INFO:teuthology.orchestra.run.trial049.stderr:Suppressions used: 2026-02-12T12:50:38.411 INFO:teuthology.orchestra.run.trial049.stderr: count bytes template 2026-02-12T12:50:38.411 INFO:teuthology.orchestra.run.trial049.stderr: 1 8 MallocExtension::Register 2026-02-12T12:50:38.411 INFO:teuthology.orchestra.run.trial049.stderr:----------------------------------------------------- 2026-02-12T12:50:38.411 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-12T12:50:38.430 INFO:teuthology.orchestra.run.trial049.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T12:50:38.430 INFO:teuthology.orchestra.run.trial049.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T12:50:38.474 INFO:teuthology.orchestra.run.trial049.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T12:50:38.475 INFO:teuthology.orchestra.run.trial049.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T12:50:38.481 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:38,483 seastar - Reactor backend: linux-aio 2026-02-12T12:50:38.491 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:38,493 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:50:38.491 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:38,493 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T12:50:38.496 INFO:teuthology.orchestra.run.trial049.stderr:==21210==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T12:50:38.496 INFO:teuthology.orchestra.run.trial049.stderr:INFO 2026-02-12 12:50:38,498 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T12:50:38.528 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297e4 /lib64/libasan.so.8+0xc6631 /lib64/libasan.so.8+0x157e7 0x1545af7 0x356fbff 0x3571a5f 0x33d87b5 0x34573a7 0x467a70c 0x46a4863 0x46a5d29 0x46a5dae 0x46a5eb0 0x46a5fa8 0x46a61b3 0x46a6399 0x46a6414 0x46a648f 0x46a650a 0x46a6e77 0x46a7218 0x46a7443 0x46a76aa 0x46a7975 0x46a7b93 0x46a7c4b 0x46a7d03 0x46a7dbc 0x46a7e74 0x46a7f3a 0x46a801b 0x310eb18 0x310ec1e 0x310ecd6 0x310ed8e 0x310ee46 0x3143221 0x31a29f1 0x31a2db2 0x31a2ef4 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9f99f2c 0x9c17b31 0x9c1836c 0xed0853 /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb47b04 2026-02-12T12:50:38.638 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0x3165ca1 0x4d0ce63 0x4d43b66 0x9d453ab 0x9d45550 0x9d45a44 0x9d622cf 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:38.638 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0x1092c92 0xf2fdae 0x9d5308d 0x9d5367a 0x9d539fd 0x9d63b54 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:38.638 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cbef /lib64/libasan.so.8+0x1006bc /lib64/libasan.so.8+0xc6619 /lib64/libasan.so.8+0x151b7 0x36069cd 0x9c8294b 0x9c82a0d 0x9d427fb 0x9d42990 0x9d42d22 0x9d44309 0x9d45624 0x9d45a44 0x9d622cf 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:38.787 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0xe075de 0x11277c5 0xf2fda3 0x9d5308d 0x9d5367a 0x9d539fd 0x9d63b54 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:38.787 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0xcb11e3 0x1092bd4 0xf2fdae 0x9c70283 0x9c7074d 0x9c709c0 0x9c70c76 0x9c71238 0x9c796df 0x9c79dbf 0x9d6290c 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:38.787 INFO:teuthology.orchestra.run.trial049.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6639 /lib64/libasan.so.8+0x151b7 0x360928b 0x9d45608 0x9d45a44 0x9d622cf 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T12:50:40.979 INFO:teuthology.orchestra.run.trial049.stderr:----------------------------------------------------- 2026-02-12T12:50:40.979 INFO:teuthology.orchestra.run.trial049.stderr:Suppressions used: 2026-02-12T12:50:40.979 INFO:teuthology.orchestra.run.trial049.stderr: count bytes template 2026-02-12T12:50:40.979 INFO:teuthology.orchestra.run.trial049.stderr: 1 8 MallocExtension::Register 2026-02-12T12:50:40.979 INFO:teuthology.orchestra.run.trial049.stderr:----------------------------------------------------- 2026-02-12T12:50:40.979 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-12T12:50:41.012 DEBUG:teuthology.orchestra.run.trial049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-12T12:50:41.038 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-12T12:50:41.038 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:50:41.038 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-12T12:50:41.102 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:50:41.102 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-12T12:50:41.166 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:50:41.166 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-12T12:50:41.229 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:50:41.230 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-12T12:50:41.293 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:50:41.293 DEBUG:teuthology.orchestra.run.trial049:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-12T12:50:41.350 INFO:tasks.ceph:Adding keys to all mons... 2026-02-12T12:50:41.350 DEBUG:teuthology.orchestra.run.trial049:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-12T12:50:41.414 INFO:teuthology.orchestra.run.trial049.stdout:[mgr.x] 2026-02-12T12:50:41.414 INFO:teuthology.orchestra.run.trial049.stdout: key = AQCPzI1p8fe/HBAAMKeVSUDBC3dGMh4sZhZYMg== 2026-02-12T12:50:41.414 INFO:teuthology.orchestra.run.trial049.stdout:[osd.0] 2026-02-12T12:50:41.414 INFO:teuthology.orchestra.run.trial049.stdout: key = AQCUzI1pUt3eIRAA/pLxPMU/xnAU7Voexy77dA== 2026-02-12T12:50:41.414 INFO:teuthology.orchestra.run.trial049.stdout:[osd.1] 2026-02-12T12:50:41.414 INFO:teuthology.orchestra.run.trial049.stdout: key = AQCZzI1pQtwyIxAAsvA6BaksSTQrZrys1G8p2w== 2026-02-12T12:50:41.415 INFO:teuthology.orchestra.run.trial049.stdout:[osd.2] 2026-02-12T12:50:41.415 INFO:teuthology.orchestra.run.trial049.stdout: key = AQCezI1pmmGnIRAANFwvKQLALeVbSxnp1D/kQg== 2026-02-12T12:50:41.415 INFO:teuthology.orchestra.run.trial049.stdout:[client.0] 2026-02-12T12:50:41.415 INFO:teuthology.orchestra.run.trial049.stdout: key = AQCPzI1pd4BwHxAAa3iDLS0xrDpMfdsazzWJvg== 2026-02-12T12:50:41.416 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-12T12:50:41.504 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T12:50:41.552 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T12:50:41.601 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T12:50:41.649 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-12T12:50:41.698 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-12T12:50:41.698 DEBUG:teuthology.orchestra.run.trial049:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-12T12:50:41.723 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T12:50:41.809 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:41.810+0000 7fae9ea81c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:41.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:41.810+0000 7fae9ea81c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:41.817 DEBUG:teuthology.orchestra.run.trial049:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-12T12:50:41.842 DEBUG:teuthology.orchestra.run.trial049:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-12T12:50:41.898 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-12T12:50:41.899 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-12T12:50:41.899 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-12T12:50:41.940 INFO:tasks.ceph.mon.a:Started 2026-02-12T12:50:41.940 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-12T12:50:41.941 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-12T12:50:41.941 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-12T12:50:41.943 INFO:tasks.ceph.mgr.x:Started 2026-02-12T12:50:41.943 DEBUG:tasks.ceph:set 0 configs 2026-02-12T12:50:41.943 DEBUG:teuthology.orchestra.run.trial049:> sudo ceph --cluster ceph config dump 2026-02-12T12:50:42.003 INFO:tasks.ceph.mon.a.trial049.stderr:2026-02-12T12:50:42.003+0000 7f7a5be36c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:42.003 INFO:tasks.ceph.mon.a.trial049.stderr:2026-02-12T12:50:42.003+0000 7f7a5be36c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:42.003 INFO:tasks.ceph.mon.a.trial049.stderr:2026-02-12T12:50:42.004+0000 7f7a5be36c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:42.005 INFO:tasks.ceph.mgr.x.trial049.stderr:2026-02-12T12:50:42.006+0000 7f40695cbfc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:42.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:42.016+0000 7f10ca10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:42.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:42.020+0000 7f10ca10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:42.050 INFO:teuthology.orchestra.run.trial049.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-12T12:50:42.058 INFO:tasks.ceph:Setting crush tunables to default 2026-02-12T12:50:42.058 DEBUG:teuthology.orchestra.run.trial049:> sudo ceph --cluster ceph osd crush tunables default 2026-02-12T12:50:42.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:42.129+0000 7ffa5ff5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:42.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:42.133+0000 7ffa5ff5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:42.165 INFO:teuthology.orchestra.run.trial049.stderr:adjusted tunables profile to default 2026-02-12T12:50:42.173 INFO:tasks.ceph:check_enable_crimson: True 2026-02-12T12:50:42.174 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-12T12:50:42.174 DEBUG:teuthology.orchestra.run.trial049:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-12T12:50:42.208 INFO:tasks.ceph.mgr.x.trial049.stderr:2026-02-12T12:50:42.209+0000 7f40695cbfc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:42.209 INFO:tasks.ceph.mgr.x.trial049.stderr:2026-02-12T12:50:42.209+0000 7f40695cbfc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:42.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:42.246+0000 7fa539f93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:42.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:42.250+0000 7fa539f93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:42.285 INFO:tasks.ceph.mon.a.trial049.stderr:2026-02-12T12:50:42.286+0000 7f7a531f1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-12T12:50:42.285 INFO:tasks.ceph.mon.a.trial049.stderr:Please be aware that this feature is experimental, untested, 2026-02-12T12:50:42.286 INFO:tasks.ceph.mon.a.trial049.stderr:unsupported, and may result in data corruption, data loss, 2026-02-12T12:50:42.286 INFO:tasks.ceph.mon.a.trial049.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-12T12:50:42.286 INFO:tasks.ceph.mon.a.trial049.stderr:feature with important data. 2026-02-12T12:50:42.286 INFO:tasks.ceph.mon.a.trial049.stderr: 2026-02-12T12:50:43.064 INFO:tasks.ceph.mgr.x.trial049.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-12T12:50:43.064 INFO:tasks.ceph.mgr.x.trial049.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-12T12:50:43.064 INFO:tasks.ceph.mgr.x.trial049.stderr: from numpy import show_config as show_numpy_config 2026-02-12T12:50:43.176 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-12T12:50:43.177 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:50:43.177 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-12T12:50:43.242 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:50:43.242 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-12T12:50:43.306 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:50:43.306 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-12T12:50:43.369 DEBUG:teuthology.orchestra.run.trial049:> sudo ceph --cluster ceph osd new 8b9a9af1-5c2b-46f6-b516-dd9251287261 0 2026-02-12T12:50:43.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:43.480+0000 7f9d4f006640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:43.483 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:43.484+0000 7f9d4f006640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:43.521 INFO:teuthology.orchestra.run.trial049.stdout:0 2026-02-12T12:50:43.531 DEBUG:teuthology.orchestra.run.trial049:> sudo ceph --cluster ceph osd new 5805b085-64b5-470c-9b07-ce8c389a1f10 1 2026-02-12T12:50:43.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:43.602+0000 7f0a232c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:43.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:43.607+0000 7f0a232c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:43.642 INFO:teuthology.orchestra.run.trial049.stdout:1 2026-02-12T12:50:43.650 DEBUG:teuthology.orchestra.run.trial049:> sudo ceph --cluster ceph osd new 066ebbf0-05df-4d2d-adbf-93ce376e90df 2 2026-02-12T12:50:43.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:43.723+0000 7efd4403d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:43.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:43.727+0000 7efd4403d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:43.765 INFO:teuthology.orchestra.run.trial049.stdout:2 2026-02-12T12:50:43.775 DEBUG:teuthology.orchestra.run.trial049:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-12T12:50:43.804 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-12T12:50:43.804 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-12T12:50:43.846 INFO:tasks.ceph.osd.0:Started 2026-02-12T12:50:43.846 DEBUG:teuthology.orchestra.run.trial049:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-12T12:50:43.875 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-12T12:50:43.875 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-12T12:50:43.918 INFO:tasks.ceph.osd.1:Started 2026-02-12T12:50:43.919 DEBUG:teuthology.orchestra.run.trial049:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-12T12:50:43.947 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-12T12:50:43.947 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-12T12:50:43.989 INFO:tasks.ceph.osd.2:Started 2026-02-12T12:50:43.989 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T12:50:44.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:44.065+0000 7f4c0e83d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:44.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:44.069+0000 7f4c0e83d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:44.100 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:50:44.101 INFO:teuthology.orchestra.run.trial049.stdout:{"epoch":6,"fsid":"e0447ae7-4fae-4090-a89b-5b6943627aef","created":"2026-02-12T12:50:42.016455+0000","modified":"2026-02-12T12:50:43.766625+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T12:50:43.766625+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"8b9a9af1-5c2b-46f6-b516-dd9251287261","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5805b085-64b5-470c-9b07-ce8c389a1f10","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"066ebbf0-05df-4d2d-adbf-93ce376e90df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T12:50:44.110 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-12T12:50:44.110 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-12T12:50:44.412 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T12:50:44.479 INFO:teuthology.misc.health.trial049.stderr:2026-02-12T12:50:44.478+0000 7fe8756cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:44.480 INFO:teuthology.misc.health.trial049.stderr:2026-02-12T12:50:44.482+0000 7fe8756cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:44.511 INFO:teuthology.misc.health.trial049.stdout: 2026-02-12T12:50:44.511 INFO:teuthology.misc.health.trial049.stdout:{"epoch":6,"fsid":"e0447ae7-4fae-4090-a89b-5b6943627aef","created":"2026-02-12T12:50:42.016455+0000","modified":"2026-02-12T12:50:43.766625+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T12:50:43.766625+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"8b9a9af1-5c2b-46f6-b516-dd9251287261","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5805b085-64b5-470c-9b07-ce8c389a1f10","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"066ebbf0-05df-4d2d-adbf-93ce376e90df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T12:50:44.519 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-12T12:50:45.467 INFO:tasks.ceph.mgr.x.trial049.stderr:2026-02-12T12:50:45.468+0000 7f3f84647640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-12T12:50:50.821 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T12:50:50.891 INFO:teuthology.misc.health.trial049.stderr:2026-02-12T12:50:50.889+0000 7f7d87fa4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:50.892 INFO:teuthology.misc.health.trial049.stderr:2026-02-12T12:50:50.893+0000 7f7d87fa4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:51.001 INFO:teuthology.misc.health.trial049.stdout: 2026-02-12T12:50:51.002 INFO:teuthology.misc.health.trial049.stdout:{"epoch":7,"fsid":"e0447ae7-4fae-4090-a89b-5b6943627aef","created":"2026-02-12T12:50:42.016455+0000","modified":"2026-02-12T12:50:50.029882+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T12:50:43.766625+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"8b9a9af1-5c2b-46f6-b516-dd9251287261","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5805b085-64b5-470c-9b07-ce8c389a1f10","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"066ebbf0-05df-4d2d-adbf-93ce376e90df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T12:50:51.009 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-12T12:50:57.311 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T12:50:57.383 INFO:teuthology.misc.health.trial049.stderr:2026-02-12T12:50:57.382+0000 7fefe430b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:57.384 INFO:teuthology.misc.health.trial049.stderr:2026-02-12T12:50:57.385+0000 7fefe430b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:57.495 INFO:teuthology.misc.health.trial049.stdout: 2026-02-12T12:50:57.495 INFO:teuthology.misc.health.trial049.stdout:{"epoch":13,"fsid":"e0447ae7-4fae-4090-a89b-5b6943627aef","created":"2026-02-12T12:50:42.016455+0000","modified":"2026-02-12T12:50:57.052435+0000","last_up_change":"2026-02-12T12:50:53.038701+0000","last_in_change":"2026-02-12T12:50:43.766625+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T12:50:54.478024+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b9a9af1-5c2b-46f6-b516-dd9251287261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6806","nonce":2069299584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6805","nonce":2069299584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6812","nonce":2069299584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6813","nonce":2069299584}]},"public_addr":"10.20.193.49:6806/2069299584","cluster_addr":"10.20.193.49:6805/2069299584","heartbeat_back_addr":"10.20.193.49:6812/2069299584","heartbeat_front_addr":"10.20.193.49:6813/2069299584","state":["exists","up"]},{"osd":1,"uuid":"5805b085-64b5-470c-9b07-ce8c389a1f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6807","nonce":4206527385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6804","nonce":4206527385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6810","nonce":4206527385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6811","nonce":4206527385}]},"public_addr":"10.20.193.49:6807/4206527385","cluster_addr":"10.20.193.49:6804/4206527385","heartbeat_back_addr":"10.20.193.49:6810/4206527385","heartbeat_front_addr":"10.20.193.49:6811/4206527385","state":["exists","up"]},{"osd":2,"uuid":"066ebbf0-05df-4d2d-adbf-93ce376e90df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6803","nonce":583738936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6802","nonce":583738936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6808","nonce":583738936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6809","nonce":583738936}]},"public_addr":"10.20.193.49:6803/583738936","cluster_addr":"10.20.193.49:6802/583738936","heartbeat_back_addr":"10.20.193.49:6808/583738936","heartbeat_front_addr":"10.20.193.49:6809/583738936","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T12:50:57.504 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-12T12:50:57.504 INFO:tasks.ceph:Creating RBD pool 2026-02-12T12:50:57.504 DEBUG:teuthology.orchestra.run.trial049:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-12T12:50:57.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:57.578+0000 7fe1dd21a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:57.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:57.583+0000 7fe1dd21a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:58.392 INFO:teuthology.orchestra.run.trial049.stderr:pool 'rbd' created 2026-02-12T12:50:58.405 DEBUG:teuthology.orchestra.run.trial049:> rbd --cluster ceph pool init rbd 2026-02-12T12:50:58.448 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:58.449+0000 7ff3bda18240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:58.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:58.449+0000 7ff3bda18240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:50:58.450 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:50:58.451+0000 7ff3bda18240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:01.428 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-12T12:51:01.428 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-12T12:51:01.428 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-12T12:51:01.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:01.543+0000 7ff7d04cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:01.545 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:01.546+0000 7ff7d04cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:01.656 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:51:01.665 INFO:teuthology.orchestra.run.trial049.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-12T12:51:01.665 INFO:tasks.ceph_manager:config epoch is 1 2026-02-12T12:51:01.665 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-12T12:51:01.665 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-12T12:51:01.666 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-12T12:51:01.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:01.742+0000 7f74b070b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:01.744 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:01.745+0000 7f74b070b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:01.892 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:51:01.902 INFO:teuthology.orchestra.run.trial049.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6800","nonce":2379423743},{"type":"v1","addr":"10.20.193.49:6801","nonce":2379423743}]},"active_addr":"10.20.193.49:6801/2379423743","active_change":"2026-02-12T12:50:44.463449+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.49:0","nonce":2625285211}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.49:0","nonce":3281918557}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.49:0","nonce":1106329902}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.49:0","nonce":2848541755}]}]} 2026-02-12T12:51:01.903 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-12T12:51:01.904 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-12T12:51:01.904 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T12:51:01.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:01.980+0000 7fa9ca1a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:01.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:01.983+0000 7fa9ca1a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.097 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:51:02.097 INFO:teuthology.orchestra.run.trial049.stdout:{"epoch":17,"fsid":"e0447ae7-4fae-4090-a89b-5b6943627aef","created":"2026-02-12T12:50:42.016455+0000","modified":"2026-02-12T12:51:01.401783+0000","last_up_change":"2026-02-12T12:50:53.038701+0000","last_in_change":"2026-02-12T12:50:43.766625+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T12:50:54.478024+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T12:50:57.697638+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b9a9af1-5c2b-46f6-b516-dd9251287261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6806","nonce":2069299584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6805","nonce":2069299584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6812","nonce":2069299584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6813","nonce":2069299584}]},"public_addr":"10.20.193.49:6806/2069299584","cluster_addr":"10.20.193.49:6805/2069299584","heartbeat_back_addr":"10.20.193.49:6812/2069299584","heartbeat_front_addr":"10.20.193.49:6813/2069299584","state":["exists","up"]},{"osd":1,"uuid":"5805b085-64b5-470c-9b07-ce8c389a1f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6807","nonce":4206527385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6804","nonce":4206527385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6810","nonce":4206527385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6811","nonce":4206527385}]},"public_addr":"10.20.193.49:6807/4206527385","cluster_addr":"10.20.193.49:6804/4206527385","heartbeat_back_addr":"10.20.193.49:6810/4206527385","heartbeat_front_addr":"10.20.193.49:6811/4206527385","state":["exists","up"]},{"osd":2,"uuid":"066ebbf0-05df-4d2d-adbf-93ce376e90df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6803","nonce":583738936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6802","nonce":583738936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6808","nonce":583738936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6809","nonce":583738936}]},"public_addr":"10.20.193.49:6803/583738936","cluster_addr":"10.20.193.49:6802/583738936","heartbeat_back_addr":"10.20.193.49:6808/583738936","heartbeat_front_addr":"10.20.193.49:6809/583738936","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T12:51:02.108 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-12T12:51:02.108 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T12:51:02.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.183+0000 7f7fdb97b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.186+0000 7f7fdb97b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.294 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:51:02.295 INFO:teuthology.orchestra.run.trial049.stdout:{"epoch":17,"fsid":"e0447ae7-4fae-4090-a89b-5b6943627aef","created":"2026-02-12T12:50:42.016455+0000","modified":"2026-02-12T12:51:01.401783+0000","last_up_change":"2026-02-12T12:50:53.038701+0000","last_in_change":"2026-02-12T12:50:43.766625+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T12:50:54.478024+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T12:50:57.697638+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b9a9af1-5c2b-46f6-b516-dd9251287261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6806","nonce":2069299584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6805","nonce":2069299584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6812","nonce":2069299584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6813","nonce":2069299584}]},"public_addr":"10.20.193.49:6806/2069299584","cluster_addr":"10.20.193.49:6805/2069299584","heartbeat_back_addr":"10.20.193.49:6812/2069299584","heartbeat_front_addr":"10.20.193.49:6813/2069299584","state":["exists","up"]},{"osd":1,"uuid":"5805b085-64b5-470c-9b07-ce8c389a1f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6807","nonce":4206527385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6804","nonce":4206527385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6810","nonce":4206527385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6811","nonce":4206527385}]},"public_addr":"10.20.193.49:6807/4206527385","cluster_addr":"10.20.193.49:6804/4206527385","heartbeat_back_addr":"10.20.193.49:6810/4206527385","heartbeat_front_addr":"10.20.193.49:6811/4206527385","state":["exists","up"]},{"osd":2,"uuid":"066ebbf0-05df-4d2d-adbf-93ce376e90df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6803","nonce":583738936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6802","nonce":583738936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6808","nonce":583738936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6809","nonce":583738936}]},"public_addr":"10.20.193.49:6803/583738936","cluster_addr":"10.20.193.49:6802/583738936","heartbeat_back_addr":"10.20.193.49:6808/583738936","heartbeat_front_addr":"10.20.193.49:6809/583738936","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T12:51:02.304 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-12T12:51:02.304 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-12T12:51:02.305 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-12T12:51:02.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.383+0000 7f83ee70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.383+0000 7f774eeb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.384+0000 7f9f74d83640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.387+0000 7f83ee70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.387+0000 7f774eeb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.387+0000 7f9f74d83640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.400 INFO:teuthology.orchestra.run.trial049.stdout:42949672969 2026-02-12T12:51:02.401 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T12:51:02.402 INFO:teuthology.orchestra.run.trial049.stdout:38654705674 2026-02-12T12:51:02.402 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T12:51:02.403 INFO:teuthology.orchestra.run.trial049.stdout:42949672969 2026-02-12T12:51:02.404 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T12:51:02.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.520+0000 7fd696635640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.520+0000 7f99169d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.524+0000 7fd696635640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.524+0000 7f99169d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.524+0000 7f828745a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.533+0000 7f828745a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.634 INFO:teuthology.orchestra.run.trial049.stdout:42949672969 2026-02-12T12:51:02.638 INFO:teuthology.orchestra.run.trial049.stdout:42949672969 2026-02-12T12:51:02.643 INFO:teuthology.orchestra.run.trial049.stdout:38654705674 2026-02-12T12:51:02.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672969 got 42949672969 for osd.1 2026-02-12T12:51:02.646 DEBUG:teuthology.parallel:result is None 2026-02-12T12:51:02.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672969 got 42949672969 for osd.0 2026-02-12T12:51:02.651 DEBUG:teuthology.parallel:result is None 2026-02-12T12:51:02.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705674 got 38654705674 for osd.2 2026-02-12T12:51:02.654 DEBUG:teuthology.parallel:result is None 2026-02-12T12:51:02.654 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-12T12:51:02.655 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T12:51:02.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.770+0000 7f36c7dd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.773+0000 7f36c7dd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.882 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:51:02.882 INFO:teuthology.orchestra.run.trial049.stderr:dumped all 2026-02-12T12:51:02.891 INFO:teuthology.orchestra.run.trial049.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-12T12:51:02.467471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":157286352,"kb_used":62917052,"kb_used_data":62917052,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":94369300,"statfs":{"total":161061224448,"available":96634163200,"internally_reserved":0,"allocated":64427061248,"data_stored":64427061248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.071002"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.417331+0000","last_change":"2026-02-12T12:51:01.420513+0000","last_active":"2026-02-12T12:51:01.417331+0000","last_peered":"2026-02-12T12:51:01.417331+0000","last_clean":"2026-02-12T12:51:01.417331+0000","last_became_active":"2026-02-12T12:50:59.431934+0000","last_became_peered":"2026-02-12T12:50:59.431934+0000","last_unstale":"2026-02-12T12:51:01.417331+0000","last_undegraded":"2026-02-12T12:51:01.417331+0000","last_fullsized":"2026-02-12T12:51:01.417331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_clean_scrub_stamp":"2026-02-12T12:50:58.393256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.419178+0000","last_change":"2026-02-12T12:51:01.421484+0000","last_active":"2026-02-12T12:51:01.419178+0000","last_peered":"2026-02-12T12:51:01.419178+0000","last_clean":"2026-02-12T12:51:01.419178+0000","last_became_active":"2026-02-12T12:50:59.429417+0000","last_became_peered":"2026-02-12T12:50:59.429417+0000","last_unstale":"2026-02-12T12:51:01.419178+0000","last_undegraded":"2026-02-12T12:51:01.419178+0000","last_fullsized":"2026-02-12T12:51:01.419178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_clean_scrub_stamp":"2026-02-12T12:50:58.393256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.419790+0000","last_change":"2026-02-12T12:51:01.424369+0000","last_active":"2026-02-12T12:51:01.419790+0000","last_peered":"2026-02-12T12:51:01.419790+0000","last_clean":"2026-02-12T12:51:01.419790+0000","last_became_active":"2026-02-12T12:50:59.437259+0000","last_became_peered":"2026-02-12T12:50:59.437259+0000","last_unstale":"2026-02-12T12:51:01.419790+0000","last_undegraded":"2026-02-12T12:51:01.419790+0000","last_fullsized":"2026-02-12T12:51:01.419790+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_clean_scrub_stamp":"2026-02-12T12:50:58.393256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.419147+0000","last_change":"2026-02-12T12:51:01.420799+0000","last_active":"2026-02-12T12:51:01.419147+0000","last_peered":"2026-02-12T12:51:01.419147+0000","last_clean":"2026-02-12T12:51:01.419147+0000","last_became_active":"2026-02-12T12:50:59.434967+0000","last_became_peered":"2026-02-12T12:50:59.434967+0000","last_unstale":"2026-02-12T12:51:01.419147+0000","last_undegraded":"2026-02-12T12:51:01.419147+0000","last_fullsized":"2026-02-12T12:51:01.419147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_clean_scrub_stamp":"2026-02-12T12:50:58.393256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.417486+0000","last_change":"2026-02-12T12:51:01.417486+0000","last_active":"2026-02-12T12:51:01.417486+0000","last_peered":"2026-02-12T12:51:01.417486+0000","last_clean":"2026-02-12T12:51:01.417486+0000","last_became_active":"2026-02-12T12:50:59.447148+0000","last_became_peered":"2026-02-12T12:50:59.447148+0000","last_unstale":"2026-02-12T12:51:01.417486+0000","last_undegraded":"2026-02-12T12:51:01.417486+0000","last_fullsized":"2026-02-12T12:51:01.417486+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_clean_scrub_stamp":"2026-02-12T12:50:58.393256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.416119+0000","last_change":"2026-02-12T12:51:01.418067+0000","last_active":"2026-02-12T12:51:01.416119+0000","last_peered":"2026-02-12T12:51:01.416119+0000","last_clean":"2026-02-12T12:51:01.416119+0000","last_became_active":"2026-02-12T12:50:59.436664+0000","last_became_peered":"2026-02-12T12:50:59.436664+0000","last_unstale":"2026-02-12T12:51:01.416119+0000","last_undegraded":"2026-02-12T12:51:01.416119+0000","last_fullsized":"2026-02-12T12:51:01.416119+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_clean_scrub_stamp":"2026-02-12T12:50:58.393256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.414379+0000","last_change":"2026-02-12T12:51:01.416505+0000","last_active":"2026-02-12T12:51:01.414379+0000","last_peered":"2026-02-12T12:51:01.414379+0000","last_clean":"2026-02-12T12:51:01.414379+0000","last_became_active":"2026-02-12T12:50:59.441807+0000","last_became_peered":"2026-02-12T12:50:59.441807+0000","last_unstale":"2026-02-12T12:51:01.414379+0000","last_undegraded":"2026-02-12T12:51:01.414379+0000","last_fullsized":"2026-02-12T12:51:01.414379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_clean_scrub_stamp":"2026-02-12T12:50:58.393256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.419663+0000","last_change":"2026-02-12T12:51:01.424060+0000","last_active":"2026-02-12T12:51:01.419663+0000","last_peered":"2026-02-12T12:51:01.419663+0000","last_clean":"2026-02-12T12:51:01.419663+0000","last_became_active":"2026-02-12T12:50:59.428617+0000","last_became_peered":"2026-02-12T12:50:59.428617+0000","last_unstale":"2026-02-12T12:51:01.419663+0000","last_undegraded":"2026-02-12T12:51:01.419663+0000","last_fullsized":"2026-02-12T12:51:01.419663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_clean_scrub_stamp":"2026-02-12T12:50:58.393256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":90,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.418016+0000","last_change":"2026-02-12T12:50:56.083009+0000","last_active":"2026-02-12T12:51:01.418016+0000","last_peered":"2026-02-12T12:51:01.418016+0000","last_clean":"2026-02-12T12:51:01.418016+0000","last_became_active":"2026-02-12T12:50:56.075743+0000","last_became_peered":"2026-02-12T12:50:56.075743+0000","last_unstale":"2026-02-12T12:51:01.418016+0000","last_undegraded":"2026-02-12T12:51:01.418016+0000","last_fullsized":"2026-02-12T12:51:01.418016+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:55.044269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:55.044269+0000","last_clean_scrub_stamp":"2026-02-12T12:50:55.044269+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96634163200,"internally_reserved":0,"allocated":64427061248,"data_stored":64427061248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211079168,"internally_reserved":0,"allocated":21475995648,"data_stored":21475995648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972652,"kb_used_data":20972652,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456132,"statfs":{"total":53687074816,"available":32211079168,"internally_reserved":0,"allocated":21475995648,"data_stored":21475995648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972580,"kb_used_data":20972580,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456204,"statfs":{"total":53687074816,"available":32211152896,"internally_reserved":0,"allocated":21475921920,"data_stored":21475921920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971820,"kb_used_data":20971820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456964,"statfs":{"total":53687074816,"available":32211931136,"internally_reserved":0,"allocated":21475143680,"data_stored":21475143680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211079168,"internally_reserved":0,"allocated":21475995648,"data_stored":21475995648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53687074816,"available":32211152896,"internally_reserved":0,"allocated":21475921920,"data_stored":21475921920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53687074816,"available":32211079168,"internally_reserved":0,"allocated":21475995648,"data_stored":21475995648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53687074816,"available":32211931136,"internally_reserved":0,"allocated":21475143680,"data_stored":21475143680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T12:51:02.893 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T12:51:02.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.967+0000 7f3d2b65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:02.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:02.970+0000 7f3d2b65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:03.079 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:51:03.080 INFO:teuthology.orchestra.run.trial049.stderr:dumped all 2026-02-12T12:51:03.090 INFO:teuthology.orchestra.run.trial049.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-12T12:51:02.467471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":157286352,"kb_used":62917052,"kb_used_data":62917052,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":94369300,"statfs":{"total":161061224448,"available":96634163200,"internally_reserved":0,"allocated":64427061248,"data_stored":64427061248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.071002"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.417331+0000","last_change":"2026-02-12T12:51:01.420513+0000","last_active":"2026-02-12T12:51:01.417331+0000","last_peered":"2026-02-12T12:51:01.417331+0000","last_clean":"2026-02-12T12:51:01.417331+0000","last_became_active":"2026-02-12T12:50:59.431934+0000","last_became_peered":"2026-02-12T12:50:59.431934+0000","last_unstale":"2026-02-12T12:51:01.417331+0000","last_undegraded":"2026-02-12T12:51:01.417331+0000","last_fullsized":"2026-02-12T12:51:01.417331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_clean_scrub_stamp":"2026-02-12T12:50:58.393256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.419178+0000","last_change":"2026-02-12T12:51:01.421484+0000","last_active":"2026-02-12T12:51:01.419178+0000","last_peered":"2026-02-12T12:51:01.419178+0000","last_clean":"2026-02-12T12:51:01.419178+0000","last_became_active":"2026-02-12T12:50:59.429417+0000","last_became_peered":"2026-02-12T12:50:59.429417+0000","last_unstale":"2026-02-12T12:51:01.419178+0000","last_undegraded":"2026-02-12T12:51:01.419178+0000","last_fullsized":"2026-02-12T12:51:01.419178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_clean_scrub_stamp":"2026-02-12T12:50:58.393256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.419790+0000","last_change":"2026-02-12T12:51:01.424369+0000","last_active":"2026-02-12T12:51:01.419790+0000","last_peered":"2026-02-12T12:51:01.419790+0000","last_clean":"2026-02-12T12:51:01.419790+0000","last_became_active":"2026-02-12T12:50:59.437259+0000","last_became_peered":"2026-02-12T12:50:59.437259+0000","last_unstale":"2026-02-12T12:51:01.419790+0000","last_undegraded":"2026-02-12T12:51:01.419790+0000","last_fullsized":"2026-02-12T12:51:01.419790+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_clean_scrub_stamp":"2026-02-12T12:50:58.393256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.419147+0000","last_change":"2026-02-12T12:51:01.420799+0000","last_active":"2026-02-12T12:51:01.419147+0000","last_peered":"2026-02-12T12:51:01.419147+0000","last_clean":"2026-02-12T12:51:01.419147+0000","last_became_active":"2026-02-12T12:50:59.434967+0000","last_became_peered":"2026-02-12T12:50:59.434967+0000","last_unstale":"2026-02-12T12:51:01.419147+0000","last_undegraded":"2026-02-12T12:51:01.419147+0000","last_fullsized":"2026-02-12T12:51:01.419147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_clean_scrub_stamp":"2026-02-12T12:50:58.393256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.417486+0000","last_change":"2026-02-12T12:51:01.417486+0000","last_active":"2026-02-12T12:51:01.417486+0000","last_peered":"2026-02-12T12:51:01.417486+0000","last_clean":"2026-02-12T12:51:01.417486+0000","last_became_active":"2026-02-12T12:50:59.447148+0000","last_became_peered":"2026-02-12T12:50:59.447148+0000","last_unstale":"2026-02-12T12:51:01.417486+0000","last_undegraded":"2026-02-12T12:51:01.417486+0000","last_fullsized":"2026-02-12T12:51:01.417486+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_clean_scrub_stamp":"2026-02-12T12:50:58.393256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.416119+0000","last_change":"2026-02-12T12:51:01.418067+0000","last_active":"2026-02-12T12:51:01.416119+0000","last_peered":"2026-02-12T12:51:01.416119+0000","last_clean":"2026-02-12T12:51:01.416119+0000","last_became_active":"2026-02-12T12:50:59.436664+0000","last_became_peered":"2026-02-12T12:50:59.436664+0000","last_unstale":"2026-02-12T12:51:01.416119+0000","last_undegraded":"2026-02-12T12:51:01.416119+0000","last_fullsized":"2026-02-12T12:51:01.416119+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_clean_scrub_stamp":"2026-02-12T12:50:58.393256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.414379+0000","last_change":"2026-02-12T12:51:01.416505+0000","last_active":"2026-02-12T12:51:01.414379+0000","last_peered":"2026-02-12T12:51:01.414379+0000","last_clean":"2026-02-12T12:51:01.414379+0000","last_became_active":"2026-02-12T12:50:59.441807+0000","last_became_peered":"2026-02-12T12:50:59.441807+0000","last_unstale":"2026-02-12T12:51:01.414379+0000","last_undegraded":"2026-02-12T12:51:01.414379+0000","last_fullsized":"2026-02-12T12:51:01.414379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_clean_scrub_stamp":"2026-02-12T12:50:58.393256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.419663+0000","last_change":"2026-02-12T12:51:01.424060+0000","last_active":"2026-02-12T12:51:01.419663+0000","last_peered":"2026-02-12T12:51:01.419663+0000","last_clean":"2026-02-12T12:51:01.419663+0000","last_became_active":"2026-02-12T12:50:59.428617+0000","last_became_peered":"2026-02-12T12:50:59.428617+0000","last_unstale":"2026-02-12T12:51:01.419663+0000","last_undegraded":"2026-02-12T12:51:01.419663+0000","last_fullsized":"2026-02-12T12:51:01.419663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:58.393256+0000","last_clean_scrub_stamp":"2026-02-12T12:50:58.393256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":90,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T12:51:01.418016+0000","last_change":"2026-02-12T12:50:56.083009+0000","last_active":"2026-02-12T12:51:01.418016+0000","last_peered":"2026-02-12T12:51:01.418016+0000","last_clean":"2026-02-12T12:51:01.418016+0000","last_became_active":"2026-02-12T12:50:56.075743+0000","last_became_peered":"2026-02-12T12:50:56.075743+0000","last_unstale":"2026-02-12T12:51:01.418016+0000","last_undegraded":"2026-02-12T12:51:01.418016+0000","last_fullsized":"2026-02-12T12:51:01.418016+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T12:50:55.044269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T12:50:55.044269+0000","last_clean_scrub_stamp":"2026-02-12T12:50:55.044269+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96634163200,"internally_reserved":0,"allocated":64427061248,"data_stored":64427061248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211079168,"internally_reserved":0,"allocated":21475995648,"data_stored":21475995648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972652,"kb_used_data":20972652,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456132,"statfs":{"total":53687074816,"available":32211079168,"internally_reserved":0,"allocated":21475995648,"data_stored":21475995648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972580,"kb_used_data":20972580,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456204,"statfs":{"total":53687074816,"available":32211152896,"internally_reserved":0,"allocated":21475921920,"data_stored":21475921920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971820,"kb_used_data":20971820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456964,"statfs":{"total":53687074816,"available":32211931136,"internally_reserved":0,"allocated":21475143680,"data_stored":21475143680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211079168,"internally_reserved":0,"allocated":21475995648,"data_stored":21475995648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53687074816,"available":32211152896,"internally_reserved":0,"allocated":21475921920,"data_stored":21475921920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53687074816,"available":32211079168,"internally_reserved":0,"allocated":21475995648,"data_stored":21475995648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53687074816,"available":32211931136,"internally_reserved":0,"allocated":21475143680,"data_stored":21475143680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T12:51:03.092 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-12T12:51:03.092 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-12T12:51:03.092 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-12T12:51:03.092 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-12T12:51:03.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:03.167+0000 7fd508a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:03.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:03.170+0000 7fd508a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:03.311 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T12:51:03.311 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-12T12:51:03.320 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-12T12:51:03.320 INFO:teuthology.run_tasks:Running task ssh_keys... 2026-02-12T12:51:03.396 DEBUG:teuthology.orchestra.run.trial049:> echo 'StrictHostKeyChecking no 2026-02-12T12:51:03.396 DEBUG:teuthology.orchestra.run.trial049:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2026-02-12T12:51:03.412 INFO:teuthology.task.ssh_keys:generated public key AAAAB3NzaC1yc2EAAAADAQABAAABAQCZr+F+MDkVfGKMqSluG11M/vm8uxf68oRjs+7S3QyBtWtdV9xLWGii8nudmPyZeOcMdSqiytBttoWMYBZY/9pOEuS8WX9ZD8DdvhmobOpDHr+pi+pInaan57Cxy+bMOT+ysXEAhOlTC8wiVP1STPXCGCgKGJeIi9DyFkodm/G67V3v5STKZHjH91a9nILfSOotmcAm+gXYiD6Qgj1z84i8BvlxWDAxhl0/7YVFJ3KrFB1xhPXCfu6IYRML4c7Q6EQrqAsS7gbDGh7h+z7+jktOMSgXXXnt8KnO28emH0Ax+7ROcWVRkr5pJc5Ee34PAhD4Gkl9OkMlCboDC/j018aH 2026-02-12T12:51:03.412 INFO:teuthology.task.ssh_keys:pushing keys to trial049.front.sepia.ceph.com for ubuntu 2026-02-12T12:51:03.412 DEBUG:teuthology.orchestra.run.trial049:> rm -f -- /home/ubuntu/.ssh/id_rsa 2026-02-12T12:51:03.467 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:51:03.467 DEBUG:teuthology.orchestra.run.trial049:> dd of=/home/ubuntu/.ssh/id_rsa 2026-02-12T12:51:03.468 DEBUG:teuthology.orchestra.run.trial049:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2026-02-12T12:51:03.525 DEBUG:teuthology.orchestra.run.trial049:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2026-02-12T12:51:03.580 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:51:03.581 DEBUG:teuthology.orchestra.run.trial049:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2026-02-12T12:51:03.637 DEBUG:teuthology.orchestra.run.trial049:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2026-02-12_12:51:03:637343 2026-02-12T12:51:03.693 INFO:teuthology.orchestra.run.trial049.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2026-02-12_12:51:03:637343' 2026-02-12T12:51:03.694 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T12:51:03.694 DEBUG:teuthology.orchestra.run.trial049:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2026-02-12T12:51:03.750 INFO:teuthology.run_tasks:Running task radosbench... 2026-02-12T12:51:03.768 INFO:tasks.radosbench:Beginning radosbench... 2026-02-12T12:51:03.768 INFO:tasks.radosbench:omap writes 2026-02-12T12:51:03.768 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-12T12:51:03.769 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2026-02-12T12:51:03.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:03.865+0000 7faa813ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:03.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:03.869+0000 7faa813ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:04.409 INFO:teuthology.orchestra.run.trial049.stderr:pool 'unique_pool_0' created 2026-02-12T12:51:04.423 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-12T12:51:04.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:04.505+0000 7efc62dcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:04.510 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T12:51:04.511+0000 7efc62dcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T12:51:05.413 INFO:teuthology.orchestra.run.trial049.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-12T12:51:06.429 DEBUG:teuthology.orchestra.run.trial049:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 16 -b 4096 --object-size 4096 -p unique_pool_0 bench 300 write --write-omap' 2026-02-12T12:51:06.432 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2026-02-12T12:51:06.447 INFO:tasks.radosbench:joining radosbench (timing out after 9300s) 2026-02-12T12:51:06.447 INFO:teuthology.orchestra.run:waiting for 9300 2026-02-12T12:51:06.478 INFO:tasks.radosbench.radosbench.0.trial049.stdout:hints = 1 2026-02-12T12:51:06.478 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 300 seconds or 0 objects 2026-02-12T12:51:06.478 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Object prefix: benchmark_data_trial049_23606 2026-02-12T12:51:06.478 INFO:tasks.radosbench.radosbench.0.trial049.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T12:51:06.478 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 0 0 0 0 0 0 - 0 2026-02-12T12:51:07.478 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 1 16 318 302 1.17958 1.17969 0.0166635 0.0502788 2026-02-12T12:51:08.478 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 2 16 643 627 1.2245 1.26953 0.0671614 0.0501764 2026-02-12T12:51:09.478 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 3 16 943 927 1.20693 1.17188 0.0354115 0.0490984 2026-02-12T12:51:10.478 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 4 16 1241 1225 1.19619 1.16406 0.0312349 0.0516623 2026-02-12T12:51:11.478 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 5 16 1517 1501 1.17257 1.07812 0.0226753 0.0524802 2026-02-12T12:51:12.478 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 6 16 1842 1826 1.18871 1.26953 0.0307149 0.052337 2026-02-12T12:51:13.478 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 7 16 2174 2158 1.20415 1.29688 0.041078 0.0513941 2026-02-12T12:51:14.478 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 8 16 2479 2463 1.20254 1.19141 0.0207172 0.0517425 2026-02-12T12:51:15.478 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 9 16 2795 2779 1.20607 1.23438 0.0549102 0.051634 2026-02-12T12:51:16.478 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 10 16 3131 3115 1.21671 1.3125 0.0265591 0.0511929 2026-02-12T12:51:17.479 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 11 16 3487 3471 1.23251 1.39062 0.0739686 0.0506086 2026-02-12T12:51:18.479 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 12 16 3821 3805 1.23851 1.30469 0.0346293 0.05032 2026-02-12T12:51:19.479 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 13 16 4161 4145 1.2454 1.32812 0.0494694 0.0500449 2026-02-12T12:51:20.479 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 14 16 4483 4467 1.24628 1.25781 0.0295513 0.0500341 2026-02-12T12:51:21.479 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 15 16 4836 4820 1.25511 1.37891 0.0698868 0.0496581 2026-02-12T12:51:22.479 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 16 16 5180 5164 1.26065 1.34375 0.0660748 0.0495049 2026-02-12T12:51:23.479 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 17 16 5524 5508 1.26553 1.34375 0.0225072 0.0492685 2026-02-12T12:51:24.479 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 18 16 5862 5846 1.26857 1.32031 0.0340592 0.0492233 2026-02-12T12:51:25.479 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 19 16 6199 6183 1.27108 1.31641 0.0597427 0.049099 2026-02-12T12:51:26.479 INFO:tasks.radosbench.radosbench.0.trial049.stdout:2026-02-12T12:51:26.481591+0000 min lat: 0.0106526 max lat: 0.489923 avg lat: 0.0489772 2026-02-12T12:51:26.479 INFO:tasks.radosbench.radosbench.0.trial049.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T12:51:26.480 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 20 16 6538 6522 1.27373 1.32422 0.0625451 0.0489772 2026-02-12T12:51:27.479 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 21 16 6898 6882 1.28003 1.40625 0.042069 0.0487666 2026-02-12T12:51:28.479 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 22 16 7260 7244 1.28612 1.41406 0.0481611 0.0485249 2026-02-12T12:51:29.479 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 23 16 7579 7563 1.28438 1.24609 0.0333339 0.0486026 2026-02-12T12:51:30.480 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 24 16 7902 7886 1.28343 1.26172 0.0331506 0.0486492 2026-02-12T12:51:31.480 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 25 16 8258 8242 1.28769 1.39062 0.0803569 0.0484771 2026-02-12T12:51:32.480 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 26 16 8597 8581 1.28909 1.32422 0.0328961 0.0484155 2026-02-12T12:51:33.480 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 27 16 8918 8902 1.28778 1.25391 0.0420039 0.0484789 2026-02-12T12:51:34.480 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 28 16 9251 9235 1.28824 1.30078 0.0291459 0.0484587 2026-02-12T12:51:35.480 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 29 16 9579 9563 1.288 1.28125 0.0166407 0.0484604 2026-02-12T12:51:36.480 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 30 16 9893 9877 1.28595 1.22656 0.0302042 0.0485503 2026-02-12T12:51:37.480 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 31 16 10227 10211 1.28655 1.30469 0.131605 0.0485386 2026-02-12T12:51:38.480 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 32 16 10556 10540 1.2865 1.28516 0.0393663 0.0485384 2026-02-12T12:51:39.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 33 16 10891 10875 1.28717 1.30859 0.0647227 0.048501 2026-02-12T12:51:40.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 34 16 11204 11188 1.28527 1.22266 0.0592474 0.0485612 2026-02-12T12:51:41.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 35 16 11537 11521 1.28571 1.30078 0.0433288 0.0485646 2026-02-12T12:51:42.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 36 16 11861 11845 1.28515 1.26562 0.0334947 0.0485943 2026-02-12T12:51:43.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 37 16 12184 12168 1.28451 1.26172 0.131615 0.0485989 2026-02-12T12:51:44.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 38 16 12509 12493 1.28411 1.26953 0.0269643 0.0486298 2026-02-12T12:51:45.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 39 16 12828 12812 1.28314 1.24609 0.0257906 0.0486752 2026-02-12T12:51:46.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout:2026-02-12T12:51:46.483646+0000 min lat: 0.0106526 max lat: 0.489923 avg lat: 0.0486764 2026-02-12T12:51:46.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T12:51:46.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 40 16 13156 13140 1.28309 1.28125 0.0404518 0.0486764 2026-02-12T12:51:47.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 41 16 13501 13485 1.28466 1.34766 0.0530218 0.0486116 2026-02-12T12:51:48.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 42 16 13824 13808 1.28411 1.26172 0.153465 0.0486346 2026-02-12T12:51:49.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 43 16 14133 14117 1.28232 1.20703 0.0513428 0.0486901 2026-02-12T12:51:50.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 44 16 14450 14434 1.28131 1.23828 0.0425019 0.0487385 2026-02-12T12:51:51.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 45 16 14760 14744 1.27975 1.21094 0.0381789 0.0487994 2026-02-12T12:51:52.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 46 16 15061 15045 1.27749 1.17578 0.0447861 0.0488769 2026-02-12T12:51:53.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 47 16 15366 15350 1.27565 1.19141 0.07747 0.0489608 2026-02-12T12:51:54.481 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 48 16 15665 15649 1.27341 1.16797 0.0592478 0.049042 2026-02-12T12:51:55.482 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 49 16 15981 15965 1.27261 1.23438 0.0459217 0.0490736 2026-02-12T12:51:56.482 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 50 16 16281 16265 1.27059 1.17188 0.0360817 0.0491433 2026-02-12T12:51:57.482 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 51 16 16600 16584 1.27011 1.24609 0.0497351 0.0491721 2026-02-12T12:51:58.482 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 52 16 16918 16902 1.26957 1.24219 0.0307618 0.0491941 2026-02-12T12:51:59.482 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 53 16 17220 17204 1.26787 1.17969 0.0950227 0.0492647 2026-02-12T12:52:00.482 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 54 16 17528 17512 1.26667 1.20312 0.0409625 0.0493039 2026-02-12T12:52:01.482 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 55 16 17811 17795 1.26374 1.10547 0.0808709 0.0494191 2026-02-12T12:52:02.482 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 56 16 18113 18097 1.26224 1.17969 0.0303667 0.0494872 2026-02-12T12:52:03.482 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 57 16 18422 18406 1.26127 1.20703 0.0654033 0.049521 2026-02-12T12:52:04.482 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 58 16 18700 18684 1.25824 1.08594 0.142354 0.0496398 2026-02-12T12:52:05.482 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 59 16 19016 19000 1.25784 1.23438 0.0359879 0.0496679 2026-02-12T12:52:06.482 INFO:tasks.radosbench.radosbench.0.trial049.stdout:2026-02-12T12:52:06.485187+0000 min lat: 0.0106526 max lat: 0.489923 avg lat: 0.0497058 2026-02-12T12:52:06.483 INFO:tasks.radosbench.radosbench.0.trial049.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T12:52:06.483 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 60 16 19318 19302 1.25653 1.17969 0.0429253 0.0497058 2026-02-12T12:52:07.482 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 61 16 19630 19614 1.25591 1.21875 0.0841203 0.0497361 2026-02-12T12:52:08.482 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 62 16 19914 19898 1.25355 1.10938 0.052526 0.0498294 2026-02-12T12:52:09.483 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 63 16 20217 20201 1.25244 1.18359 0.0412267 0.0498744 2026-02-12T12:52:10.483 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 64 16 20527 20511 1.25179 1.21094 0.0407549 0.0499074 2026-02-12T12:52:11.483 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 65 16 20819 20803 1.25007 1.14062 0.0956504 0.0499604 2026-02-12T12:52:12.483 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 66 16 21115 21099 1.24865 1.15625 0.0297734 0.0500304 2026-02-12T12:52:13.483 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 67 16 21411 21395 1.24727 1.15625 0.0356144 0.0500849 2026-02-12T12:52:14.483 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 68 16 21698 21682 1.24541 1.12109 0.0460363 0.0501572 2026-02-12T12:52:15.483 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 69 16 21989 21973 1.24384 1.13672 0.0700422 0.0502235 2026-02-12T12:52:16.483 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 70 16 22291 22275 1.24292 1.17969 0.0619778 0.0502568 2026-02-12T12:52:17.483 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 71 16 22575 22559 1.24104 1.10938 0.040449 0.0503388 2026-02-12T12:52:18.483 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 72 16 22877 22861 1.24018 1.17969 0.0354916 0.0503787 2026-02-12T12:52:19.483 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 73 16 23178 23162 1.2393 1.17578 0.100255 0.0504096 2026-02-12T12:52:20.483 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 74 16 23477 23461 1.23833 1.16797 0.0385259 0.0504434 2026-02-12T12:52:21.483 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 75 16 23753 23737 1.2362 1.07812 0.0872404 0.0505224 2026-02-12T12:52:22.484 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 76 16 24017 24001 1.2335 1.03125 0.0517351 0.0506289 2026-02-12T12:52:23.484 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 77 16 24314 24298 1.23255 1.16016 0.0424766 0.0506827 2026-02-12T12:52:24.484 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 78 16 24609 24593 1.23152 1.15234 0.0728243 0.0507231 2026-02-12T12:52:25.484 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 79 16 24911 24895 1.23086 1.17969 0.0859427 0.0507566 2026-02-12T12:52:26.484 INFO:tasks.radosbench.radosbench.0.trial049.stdout:2026-02-12T12:52:26.486801+0000 min lat: 0.0106526 max lat: 0.489923 avg lat: 0.0508404 2026-02-12T12:52:26.484 INFO:tasks.radosbench.radosbench.0.trial049.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T12:52:26.484 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 80 16 25184 25168 1.2288 1.06641 0.108424 0.0508404 2026-02-12T12:52:27.484 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 81 16 25464 25448 1.22713 1.09375 0.066038 0.050905 2026-02-12T12:52:28.484 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 82 16 25761 25745 1.22632 1.16016 0.0638775 0.0509417 2026-02-12T12:52:29.484 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 83 16 26047 26031 1.225 1.11719 0.0648887 0.0509958 2026-02-12T12:52:30.484 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 84 16 26313 26297 1.22279 1.03906 0.0627982 0.0510902 2026-02-12T12:52:31.484 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 85 16 26604 26588 1.22177 1.13672 0.0831227 0.0511327 2026-02-12T12:52:32.484 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 86 16 26890 26874 1.22056 1.11719 0.0460729 0.0511812 2026-02-12T12:52:33.484 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 87 16 27173 27157 1.21923 1.10547 0.0429258 0.0512285 2026-02-12T12:52:34.484 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 88 16 27472 27456 1.21865 1.16797 0.0280314 0.0512618 2026-02-12T12:52:35.484 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 89 16 27754 27738 1.21733 1.10156 0.120995 0.0513171 2026-02-12T12:52:36.485 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 90 16 28033 28017 1.21591 1.08984 0.0505212 0.0513731 2026-02-12T12:52:37.485 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 91 16 28323 28307 1.215 1.13281 0.0799278 0.0514197 2026-02-12T12:52:38.485 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 92 16 28600 28584 1.21355 1.08203 0.0571766 0.0514782 2026-02-12T12:52:39.485 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 93 16 28879 28863 1.21222 1.08984 0.113727 0.0515358 2026-02-12T12:52:40.485 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 94 16 29155 29139 1.21079 1.07812 0.0701377 0.0515918 2026-02-12T12:52:41.485 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 95 16 29410 29394 1.20853 0.996094 0.0332011 0.0516775 2026-02-12T12:52:42.485 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 96 16 29699 29683 1.2077 1.12891 0.0278835 0.0517328 2026-02-12T12:52:43.485 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 97 16 29986 29970 1.20681 1.12109 0.0378394 0.0517634 2026-02-12T12:52:44.485 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 98 16 30267 30251 1.2057 1.09766 0.0444822 0.0518092 2026-02-12T12:52:45.485 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 99 16 30518 30502 1.20342 0.980469 0.0953624 0.0519032 2026-02-12T12:52:46.485 INFO:tasks.radosbench.radosbench.0.trial049.stdout:2026-02-12T12:52:46.488355+0000 min lat: 0.0106526 max lat: 0.489923 avg lat: 0.0519613 2026-02-12T12:52:46.486 INFO:tasks.radosbench.radosbench.0.trial049.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T12:52:46.486 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 100 16 30800 30784 1.2024 1.10156 0.0444157 0.0519613 2026-02-12T12:52:47.485 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 101 16 31066 31050 1.20078 1.03906 0.0605854 0.0520249 2026-02-12T12:52:48.485 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 102 16 31329 31313 1.19908 1.02734 0.0819555 0.0521047 2026-02-12T12:52:49.485 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 103 16 31587 31571 1.19722 1.00781 0.033724 0.0521731 2026-02-12T12:52:50.485 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 104 16 31853 31837 1.1957 1.03906 0.0364046 0.0522411 2026-02-12T12:52:51.486 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 105 16 32124 32108 1.19439 1.05859 0.0458336 0.0523079 2026-02-12T12:52:52.486 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 106 16 32401 32385 1.19333 1.08203 0.0615263 0.0523508 2026-02-12T12:52:53.486 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 107 16 32649 32633 1.19123 0.96875 0.0524158 0.0524333 2026-02-12T12:52:54.486 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 108 16 32918 32902 1.18993 1.05078 0.0538231 0.0525048 2026-02-12T12:52:55.486 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 109 16 33201 33185 1.18916 1.10547 0.0559184 0.0525422 2026-02-12T12:52:56.486 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 110 16 33457 33441 1.18744 1 0.0324195 0.0526128 2026-02-12T12:52:57.486 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 111 16 33720 33704 1.18599 1.02734 0.0649852 0.052679 2026-02-12T12:52:58.486 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 112 16 33989 33973 1.18479 1.05078 0.0360184 0.0527294 2026-02-12T12:52:59.486 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 113 16 34249 34233 1.18329 1.01562 0.0920415 0.0527999 2026-02-12T12:53:00.486 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 114 16 34524 34508 1.18233 1.07422 0.0408204 0.0528468 2026-02-12T12:53:01.486 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 115 16 34782 34766 1.18081 1.00781 0.0790761 0.0529079 2026-02-12T12:53:02.486 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 116 16 35055 35039 1.17983 1.06641 0.0400177 0.0529553 2026-02-12T12:53:03.486 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 117 16 35325 35309 1.17876 1.05469 0.037124 0.0530006 2026-02-12T12:53:04.487 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 118 16 35582 35566 1.17727 1.00391 0.0605082 0.0530714 2026-02-12T12:53:05.487 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 119 16 35835 35819 1.17568 0.988281 0.0601803 0.0531406 2026-02-12T12:53:06.487 INFO:tasks.radosbench.radosbench.0.trial049.stdout:2026-02-12T12:53:06.489918+0000 min lat: 0.0106526 max lat: 0.489923 avg lat: 0.0532098 2026-02-12T12:53:06.487 INFO:tasks.radosbench.radosbench.0.trial049.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T12:53:06.487 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 120 16 36088 36072 1.17412 0.988281 0.0529101 0.0532098 2026-02-12T12:53:07.487 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 121 16 36345 36329 1.17271 1.00391 0.0354575 0.0532795 2026-02-12T12:53:08.487 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 122 16 36605 36589 1.17143 1.01562 0.0461021 0.0533361 2026-02-12T12:53:09.487 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 123 16 36865 36849 1.17016 1.01562 0.0419551 0.0533951 2026-02-12T12:53:10.487 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 124 16 37112 37096 1.1685 0.964844 0.075448 0.0534726 2026-02-12T12:53:11.487 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 125 16 37373 37357 1.16731 1.01953 0.0800876 0.0535243 2026-02-12T12:53:12.487 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 126 16 37635 37619 1.16617 1.02344 0.0550586 0.0535741 2026-02-12T12:53:13.487 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 127 16 37900 37884 1.16514 1.03516 0.0397001 0.05363 2026-02-12T12:53:14.487 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 128 16 38162 38146 1.16403 1.02344 0.0744825 0.0536792 2026-02-12T12:53:15.487 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 129 16 38415 38399 1.16267 0.988281 0.0582489 0.0537287 2026-02-12T12:53:16.487 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 130 16 38675 38659 1.16153 1.01562 0.0324248 0.0537956 2026-02-12T12:53:17.487 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 131 16 38910 38894 1.15967 0.917969 0.0361682 0.0538717 2026-02-12T12:53:18.488 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 132 16 39166 39150 1.15846 1 0.0974396 0.0539375 2026-02-12T12:53:19.488 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 133 16 39426 39410 1.15739 1.01562 0.0387734 0.0539816 2026-02-12T12:53:20.488 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 134 16 39673 39657 1.15595 0.964844 0.0976665 0.0540477 2026-02-12T12:53:21.488 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 135 16 39924 39908 1.15465 0.980469 0.0734903 0.0541154 2026-02-12T12:53:22.488 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 136 16 40190 40174 1.1538 1.03906 0.0436462 0.0541578 2026-02-12T12:53:23.488 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 137 16 40451 40435 1.15282 1.01953 0.0872244 0.0541892 2026-02-12T12:53:24.488 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 138 16 40714 40698 1.15191 1.02734 0.0452796 0.0542398 2026-02-12T12:53:25.488 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 139 16 40977 40961 1.15101 1.02734 0.0311052 0.0542819 2026-02-12T12:53:26.488 INFO:tasks.radosbench.radosbench.0.trial049.stdout:2026-02-12T12:53:26.491445+0000 min lat: 0.0106526 max lat: 0.489923 avg lat: 0.0543415 2026-02-12T12:53:26.488 INFO:tasks.radosbench.radosbench.0.trial049.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T12:53:26.488 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 140 16 41230 41214 1.14985 0.988281 0.0810349 0.0543415 2026-02-12T12:53:27.488 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 141 16 41473 41457 1.14843 0.949219 0.0760877 0.0544038 2026-02-12T12:53:28.488 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 142 16 41722 41706 1.14719 0.972656 0.111335 0.0544592 2026-02-12T12:53:29.488 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 143 16 41989 41973 1.14646 1.04297 0.0422385 0.0545025 2026-02-12T12:53:30.488 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 144 16 42227 42211 1.14495 0.929688 0.0551181 0.0545698 2026-02-12T12:53:31.488 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 145 16 42477 42461 1.14379 0.976562 0.0771879 0.0546253 2026-02-12T12:53:32.488 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 146 16 42731 42715 1.14275 0.992188 0.0877499 0.0546734 2026-02-12T12:53:33.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 147 16 42981 42965 1.14162 0.976562 0.0547225 0.0547284 2026-02-12T12:53:34.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 148 16 43240 43224 1.14074 1.01172 0.0737931 0.0547745 2026-02-12T12:53:35.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 149 16 43491 43475 1.13967 0.980469 0.0907998 0.0548215 2026-02-12T12:53:36.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 150 16 43742 43726 1.13861 0.980469 0.0548803 0.0548758 2026-02-12T12:53:37.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 151 16 43977 43961 1.13714 0.917969 0.179964 0.0549448 2026-02-12T12:53:38.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 152 16 44216 44200 1.1358 0.933594 0.131001 0.055013 2026-02-12T12:53:39.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 153 16 44475 44459 1.13499 1.01172 0.122116 0.0550476 2026-02-12T12:53:40.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 154 16 44726 44710 1.13399 0.980469 0.0807908 0.0550979 2026-02-12T12:53:41.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 155 16 44978 44962 1.13302 0.984375 0.0397184 0.0551506 2026-02-12T12:53:42.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 156 16 45223 45207 1.1319 0.957031 0.0433835 0.0551966 2026-02-12T12:53:43.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 157 16 45468 45452 1.13078 0.957031 0.0416805 0.0552542 2026-02-12T12:53:44.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 158 16 45709 45693 1.12958 0.941406 0.0750795 0.0553101 2026-02-12T12:53:45.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 159 16 45954 45938 1.1285 0.957031 0.100393 0.0553674 2026-02-12T12:53:46.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout:2026-02-12T12:53:46.492862+0000 min lat: 0.0106526 max lat: 0.489923 avg lat: 0.0554253 2026-02-12T12:53:46.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T12:53:46.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 160 16 46195 46179 1.12733 0.941406 0.0537506 0.0554253 2026-02-12T12:53:47.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 161 16 46440 46424 1.12627 0.957031 0.0695519 0.0554733 2026-02-12T12:53:48.490 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 162 16 46682 46666 1.12515 0.945312 0.0369262 0.0555339 2026-02-12T12:53:49.490 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 163 16 46935 46919 1.12431 0.988281 0.0613262 0.0555707 2026-02-12T12:53:50.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 164 16 47168 47152 1.123 0.910156 0.11796 0.0556402 2026-02-12T12:53:51.490 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 165 16 47404 47388 1.12179 0.921875 0.108041 0.0556923 2026-02-12T12:53:52.490 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 166 16 47643 47627 1.12065 0.933594 0.133681 0.0557488 2026-02-12T12:53:53.490 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 167 16 47885 47869 1.1196 0.945312 0.103332 0.0558088 2026-02-12T12:53:54.490 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 168 16 48133 48117 1.1187 0.96875 0.0367452 0.0558529 2026-02-12T12:53:55.490 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 169 16 48373 48357 1.11763 0.9375 0.0802799 0.0559057 2026-02-12T12:53:56.490 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 170 16 48606 48590 1.11641 0.910156 0.069005 0.0559683 2026-02-12T12:53:57.490 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 171 16 48853 48837 1.11552 0.964844 0.112221 0.0560108 2026-02-12T12:53:58.490 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 172 16 49088 49072 1.11437 0.917969 0.0690018 0.0560669 2026-02-12T12:53:59.490 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 173 16 49331 49315 1.11342 0.949219 0.0503007 0.0561151 2026-02-12T12:54:00.490 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 174 16 49569 49553 1.11236 0.929688 0.106204 0.0561698 2026-02-12T12:54:01.490 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 175 16 49819 49803 1.11159 0.976562 0.0606787 0.0562118 2026-02-12T12:54:02.491 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 176 16 50067 50051 1.11077 0.96875 0.0390198 0.0562523 2026-02-12T12:54:03.491 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 177 16 50313 50297 1.10993 0.960938 0.0381163 0.0562921 2026-02-12T12:54:04.491 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 178 16 50552 50536 1.10894 0.933594 0.0951471 0.0563401 2026-02-12T12:54:05.491 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 179 16 50787 50771 1.10787 0.917969 0.028065 0.0563931 2026-02-12T12:54:06.491 INFO:tasks.radosbench.radosbench.0.trial049.stdout:2026-02-12T12:54:06.494388+0000 min lat: 0.0106526 max lat: 0.489923 avg lat: 0.0564513 2026-02-12T12:54:06.491 INFO:tasks.radosbench.radosbench.0.trial049.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T12:54:06.491 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 180 16 51020 51004 1.10677 0.910156 0.143625 0.0564513 2026-02-12T12:54:07.491 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 181 16 51266 51250 1.10596 0.960938 0.0635969 0.0564989 2026-02-12T12:54:08.491 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 182 16 51513 51497 1.10519 0.964844 0.0930425 0.0565352 2026-02-12T12:54:09.491 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 183 16 51757 51741 1.10436 0.953125 0.0816545 0.0565758 2026-02-12T12:54:10.491 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 184 16 51994 51978 1.10339 0.925781 0.0522086 0.0566335 2026-02-12T12:54:11.491 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 185 16 52224 52208 1.10228 0.898438 0.111466 0.0566819 2026-02-12T12:54:12.491 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 186 16 52459 52443 1.10129 0.917969 0.062424 0.0567382 2026-02-12T12:54:13.491 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 187 15 52699 52684 1.10043 0.941406 0.0312837 0.0567828 2026-02-12T12:54:14.491 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 188 16 52936 52920 1.09948 0.921875 0.104424 0.0568251 2026-02-12T12:54:15.492 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 189 16 53186 53170 1.09883 0.976562 0.0513537 0.0568647 2026-02-12T12:54:16.492 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 190 16 53408 53392 1.09761 0.867188 0.0500969 0.0569243 2026-02-12T12:54:17.492 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 191 16 53647 53631 1.09675 0.933594 0.0860677 0.0569676 2026-02-12T12:54:18.492 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 192 16 53882 53866 1.09582 0.917969 0.0816162 0.057021 2026-02-12T12:54:19.492 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 193 16 54101 54085 1.09457 0.855469 0.0507239 0.0570872 2026-02-12T12:54:20.492 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 194 16 54330 54314 1.09354 0.894531 0.0850189 0.0571387 2026-02-12T12:54:21.492 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 195 16 54560 54544 1.09254 0.898438 0.0641518 0.05719 2026-02-12T12:54:22.492 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 196 16 54786 54770 1.09147 0.882812 0.104983 0.0572449 2026-02-12T12:54:23.492 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 197 16 55014 54998 1.09045 0.890625 0.0253339 0.0573009 2026-02-12T12:54:24.492 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 198 16 55236 55220 1.08932 0.867188 0.0722165 0.0573593 2026-02-12T12:54:25.492 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 199 16 55471 55455 1.08846 0.917969 0.0674032 0.0574045 2026-02-12T12:54:26.492 INFO:tasks.radosbench.radosbench.0.trial049.stdout:2026-02-12T12:54:26.495965+0000 min lat: 0.0106526 max lat: 0.489923 avg lat: 0.0574579 2026-02-12T12:54:26.493 INFO:tasks.radosbench.radosbench.0.trial049.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T12:54:26.493 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 200 16 55700 55684 1.08749 0.894531 0.0613118 0.0574579 2026-02-12T12:54:27.492 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 201 16 55935 55919 1.08665 0.917969 0.101928 0.057502 2026-02-12T12:54:28.492 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 202 16 56152 56136 1.08546 0.847656 0.102495 0.057563 2026-02-12T12:54:29.493 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 203 16 56378 56362 1.08447 0.882812 0.0995693 0.0576178 2026-02-12T12:54:30.493 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 204 16 56604 56588 1.08348 0.882812 0.0764335 0.0576668 2026-02-12T12:54:31.493 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 205 16 56840 56824 1.08269 0.921875 0.0894603 0.0577095 2026-02-12T12:54:32.493 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 206 16 57076 57060 1.08191 0.921875 0.0622678 0.0577545 2026-02-12T12:54:33.493 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 207 16 57296 57280 1.08083 0.859375 0.0543824 0.0578079 2026-02-12T12:54:34.493 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 208 16 57525 57509 1.07994 0.894531 0.036493 0.0578592 2026-02-12T12:54:35.493 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 209 16 57751 57735 1.07899 0.882812 0.10515 0.0579076 2026-02-12T12:54:36.493 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 210 16 57984 57968 1.07819 0.910156 0.0512626 0.0579509 2026-02-12T12:54:37.493 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 211 16 58216 58200 1.07737 0.90625 0.0870389 0.0579946 2026-02-12T12:54:38.493 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 212 16 58451 58435 1.07662 0.917969 0.0634332 0.058039 2026-02-12T12:54:39.493 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 213 16 58678 58662 1.07573 0.886719 0.0418392 0.058084 2026-02-12T12:54:40.493 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 214 16 58909 58893 1.07492 0.902344 0.0710815 0.0581278 2026-02-12T12:54:41.493 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 215 16 59137 59121 1.07406 0.890625 0.0539137 0.0581767 2026-02-12T12:54:42.494 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 216 16 59355 59339 1.07303 0.851562 0.0812965 0.0582364 2026-02-12T12:54:43.494 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 217 16 59583 59567 1.07219 0.890625 0.0784442 0.0582771 2026-02-12T12:54:44.494 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 218 16 59818 59802 1.07148 0.917969 0.119118 0.0583196 2026-02-12T12:54:45.494 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 219 16 60043 60027 1.0706 0.878906 0.0440555 0.0583651 2026-02-12T12:54:46.494 INFO:tasks.radosbench.radosbench.0.trial049.stdout:2026-02-12T12:54:46.497481+0000 min lat: 0.0106526 max lat: 0.489923 avg lat: 0.0584205 2026-02-12T12:54:46.494 INFO:tasks.radosbench.radosbench.0.trial049.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T12:54:46.494 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 220 16 60257 60241 1.06954 0.835938 0.032622 0.0584205 2026-02-12T12:54:47.494 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 221 16 60472 60456 1.0685 0.839844 0.0383246 0.0584771 2026-02-12T12:54:48.494 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 222 16 60694 60678 1.06759 0.867188 0.0674999 0.0585287 2026-02-12T12:54:49.494 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 223 16 60909 60893 1.06657 0.839844 0.0577099 0.0585812 2026-02-12T12:54:50.494 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 224 16 61118 61102 1.06545 0.816406 0.0668642 0.0586456 2026-02-12T12:54:51.494 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 225 16 61335 61319 1.06448 0.847656 0.0660615 0.0586977 2026-02-12T12:54:52.494 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 226 16 61545 61529 1.0634 0.820312 0.0735844 0.058759 2026-02-12T12:54:53.494 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 227 16 61764 61748 1.06249 0.855469 0.0643251 0.0588119 2026-02-12T12:54:54.494 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 228 16 61984 61968 1.06159 0.859375 0.0948693 0.0588547 2026-02-12T12:54:55.494 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 229 16 62198 62182 1.06061 0.835938 0.0513657 0.0589114 2026-02-12T12:54:56.494 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 230 16 62421 62405 1.05978 0.871094 0.0850496 0.0589577 2026-02-12T12:54:57.495 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 231 16 62637 62621 1.05885 0.84375 0.102328 0.0590118 2026-02-12T12:54:58.495 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 232 16 62843 62827 1.05775 0.804688 0.168018 0.059073 2026-02-12T12:54:59.495 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 233 16 63059 63043 1.05683 0.84375 0.04366 0.0591225 2026-02-12T12:55:00.495 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 234 16 63270 63254 1.05584 0.824219 0.0973395 0.0591831 2026-02-12T12:55:01.495 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 235 16 63497 63481 1.05512 0.886719 0.0509634 0.0592219 2026-02-12T12:55:02.495 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 236 16 63703 63687 1.05406 0.804688 0.0841133 0.0592825 2026-02-12T12:55:03.495 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 237 16 63920 63904 1.05319 0.847656 0.0471113 0.059331 2026-02-12T12:55:04.495 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 238 16 64143 64127 1.05242 0.871094 0.0827466 0.0593747 2026-02-12T12:55:05.495 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 239 16 64364 64348 1.05163 0.863281 0.0725675 0.0594139 2026-02-12T12:55:06.495 INFO:tasks.radosbench.radosbench.0.trial049.stdout:2026-02-12T12:55:06.498892+0000 min lat: 0.0106526 max lat: 0.489923 avg lat: 0.0594618 2026-02-12T12:55:06.495 INFO:tasks.radosbench.radosbench.0.trial049.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T12:55:06.495 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 240 16 64586 64570 1.05086 0.867188 0.0639349 0.0594618 2026-02-12T12:55:07.495 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 241 16 64791 64775 1.04982 0.800781 0.180961 0.059512 2026-02-12T12:55:08.495 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 242 16 65009 64993 1.049 0.851562 0.0864764 0.0595632 2026-02-12T12:55:09.495 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 243 16 65229 65213 1.04822 0.859375 0.0874629 0.0596105 2026-02-12T12:55:10.495 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 244 16 65450 65434 1.04747 0.863281 0.112907 0.0596531 2026-02-12T12:55:11.495 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 245 16 65666 65650 1.04663 0.84375 0.103726 0.0597 2026-02-12T12:55:12.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 246 16 65883 65867 1.04582 0.847656 0.0656785 0.0597458 2026-02-12T12:55:13.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 247 16 66090 66074 1.04486 0.808594 0.0959956 0.0598016 2026-02-12T12:55:14.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 248 16 66305 66289 1.04404 0.839844 0.0942309 0.0598478 2026-02-12T12:55:15.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 249 16 66518 66502 1.04319 0.832031 0.0310246 0.0598926 2026-02-12T12:55:16.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 250 16 66711 66695 1.04203 0.753906 0.0977616 0.0599629 2026-02-12T12:55:17.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 251 16 66928 66912 1.04125 0.847656 0.0814773 0.0600087 2026-02-12T12:55:18.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 252 16 67146 67130 1.0405 0.851562 0.0865658 0.0600546 2026-02-12T12:55:19.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 253 16 67358 67342 1.03966 0.828125 0.0845999 0.0601007 2026-02-12T12:55:20.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 254 16 67570 67554 1.03883 0.828125 0.0811163 0.0601514 2026-02-12T12:55:21.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 255 16 67786 67770 1.03806 0.84375 0.0611051 0.0601947 2026-02-12T12:55:22.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 256 16 67991 67975 1.03714 0.800781 0.0474198 0.060246 2026-02-12T12:55:23.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 257 16 68201 68185 1.03629 0.820312 0.0691278 0.0602958 2026-02-12T12:55:24.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 258 16 68415 68399 1.03551 0.835938 0.0530788 0.0603442 2026-02-12T12:55:25.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 259 16 68624 68608 1.03467 0.816406 0.0735382 0.0603939 2026-02-12T12:55:26.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout:2026-02-12T12:55:26.500366+0000 min lat: 0.0106526 max lat: 0.489923 avg lat: 0.0604366 2026-02-12T12:55:26.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T12:55:26.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 260 16 68841 68825 1.03395 0.847656 0.121857 0.0604366 2026-02-12T12:55:27.496 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 261 16 69036 69020 1.03291 0.761719 0.109269 0.0604974 2026-02-12T12:55:28.497 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 262 16 69237 69221 1.03196 0.785156 0.0959827 0.0605517 2026-02-12T12:55:29.497 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 263 16 69439 69423 1.03104 0.789062 0.192557 0.0605981 2026-02-12T12:55:30.497 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 264 16 69628 69612 1.02993 0.738281 0.0384427 0.0606636 2026-02-12T12:55:31.497 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 265 16 69844 69828 1.02922 0.84375 0.0877294 0.0607102 2026-02-12T12:55:32.497 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 266 16 70051 70035 1.02839 0.808594 0.0653558 0.0607624 2026-02-12T12:55:33.497 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 267 16 70258 70242 1.02757 0.808594 0.0380614 0.0608057 2026-02-12T12:55:34.497 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 268 16 70470 70454 1.02683 0.828125 0.0491511 0.0608545 2026-02-12T12:55:35.498 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 269 16 70678 70662 1.02603 0.8125 0.0557314 0.0608998 2026-02-12T12:55:36.497 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 270 16 70886 70870 1.02524 0.8125 0.0621005 0.0609505 2026-02-12T12:55:37.497 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 271 16 71102 71086 1.02457 0.84375 0.0515172 0.0609891 2026-02-12T12:55:38.498 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 272 16 71326 71310 1.02402 0.875 0.112432 0.0610222 2026-02-12T12:55:39.498 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 273 16 71534 71518 1.02324 0.8125 0.0546666 0.0610675 2026-02-12T12:55:40.498 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 274 16 71743 71727 1.02249 0.816406 0.0592784 0.0611133 2026-02-12T12:55:41.497 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 275 16 71960 71944 1.02185 0.847656 0.0841902 0.0611509 2026-02-12T12:55:42.498 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 276 16 72167 72151 1.02108 0.808594 0.0436935 0.0611951 2026-02-12T12:55:43.498 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 277 16 72363 72347 1.02016 0.765625 0.0510975 0.0612548 2026-02-12T12:55:44.498 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 278 16 72568 72552 1.01937 0.800781 0.0717702 0.061301 2026-02-12T12:55:45.498 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 279 16 72764 72748 1.01846 0.765625 0.12092 0.0613504 2026-02-12T12:55:46.498 INFO:tasks.radosbench.radosbench.0.trial049.stdout:2026-02-12T12:55:46.501935+0000 min lat: 0.0106526 max lat: 0.489923 avg lat: 0.061402 2026-02-12T12:55:46.498 INFO:tasks.radosbench.radosbench.0.trial049.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T12:55:46.498 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 280 16 72966 72950 1.01764 0.789062 0.0750968 0.061402 2026-02-12T12:55:47.498 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 281 16 73170 73154 1.01685 0.796875 0.0903137 0.0614523 2026-02-12T12:55:48.498 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 282 16 73377 73361 1.01611 0.808594 0.0349542 0.0614963 2026-02-12T12:55:49.498 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 283 16 73568 73552 1.01516 0.746094 0.0863 0.0615536 2026-02-12T12:55:50.498 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 284 16 73770 73754 1.01436 0.789062 0.152901 0.0615998 2026-02-12T12:55:51.498 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 285 16 73975 73959 1.01361 0.800781 0.0468431 0.061648 2026-02-12T12:55:52.499 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 286 16 74180 74164 1.01287 0.800781 0.0563268 0.0616967 2026-02-12T12:55:53.499 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 287 16 74378 74362 1.01203 0.773438 0.095811 0.0617423 2026-02-12T12:55:54.499 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 288 16 74578 74562 1.01123 0.78125 0.113752 0.0617912 2026-02-12T12:55:55.499 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 289 16 74774 74758 1.01038 0.765625 0.0902812 0.0618456 2026-02-12T12:55:56.499 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 290 16 74967 74951 1.0095 0.753906 0.125523 0.0618943 2026-02-12T12:55:57.499 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 291 16 75174 75158 1.00881 0.808594 0.0979007 0.0619456 2026-02-12T12:55:58.499 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 292 16 75371 75355 1.00799 0.769531 0.0644676 0.0619927 2026-02-12T12:55:59.499 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 293 16 75571 75555 1.00721 0.78125 0.0481754 0.062039 2026-02-12T12:56:00.499 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 294 16 75766 75750 1.00638 0.761719 0.0720103 0.0620876 2026-02-12T12:56:01.499 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 295 16 75950 75934 1.0054 0.71875 0.145824 0.0621486 2026-02-12T12:56:02.499 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 296 16 76146 76130 1.00459 0.765625 0.100759 0.0622029 2026-02-12T12:56:03.499 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 297 16 76351 76335 1.00391 0.800781 0.0892794 0.062245 2026-02-12T12:56:04.499 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 298 16 76544 76528 1.00307 0.753906 0.0454142 0.0622925 2026-02-12T12:56:05.499 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 299 16 76753 76737 1.00244 0.816406 0.0925439 0.0623337 2026-02-12T12:56:06.500 INFO:tasks.radosbench.radosbench.0.trial049.stdout:2026-02-12T12:56:06.503503+0000 min lat: 0.0106526 max lat: 0.489923 avg lat: 0.0623776 2026-02-12T12:56:06.500 INFO:tasks.radosbench.radosbench.0.trial049.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T12:56:06.500 INFO:tasks.radosbench.radosbench.0.trial049.stdout: 300 13 76953 76940 1.00174 0.792969 0.0639661 0.0623776 2026-02-12T12:56:07.500 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Total time run: 300.073 2026-02-12T12:56:07.500 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Total writes made: 76953 2026-02-12T12:56:07.500 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Write size: 4096 2026-02-12T12:56:07.500 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Object size: 4096 2026-02-12T12:56:07.500 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Bandwidth (MB/sec): 1.00175 2026-02-12T12:56:07.500 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Stddev Bandwidth: 0.167736 2026-02-12T12:56:07.500 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Max bandwidth (MB/sec): 1.41406 2026-02-12T12:56:07.501 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Min bandwidth (MB/sec): 0.71875 2026-02-12T12:56:07.501 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Average IOPS: 256 2026-02-12T12:56:07.501 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Stddev IOPS: 42.9405 2026-02-12T12:56:07.501 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Max IOPS: 362 2026-02-12T12:56:07.501 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Min IOPS: 184 2026-02-12T12:56:07.501 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Average Latency(s): 0.0623809 2026-02-12T12:56:07.501 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Stddev Latency(s): 0.0299242 2026-02-12T12:56:07.501 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Max latency(s): 0.489923 2026-02-12T12:56:07.501 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Min latency(s): 0.0106526 2026-02-12T12:56:07.526 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Cleaning up (deleting benchmark objects) 2026-02-12T13:03:51.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Removed 76953 objects 2026-02-12T13:03:51.489 INFO:tasks.radosbench.radosbench.0.trial049.stdout:Clean up completed and total clean up time :463.964 2026-02-12T13:03:55.177 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2026-02-12T13:03:55.177 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2026-02-12T13:03:55.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T13:03:55.259+0000 7f6e89446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T13:03:55.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T13:03:55.264+0000 7f6e89446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T13:03:56.246 INFO:teuthology.orchestra.run.trial049.stderr:pool 'unique_pool_0' removed 2026-02-12T13:03:56.264 DEBUG:teuthology.run_tasks:Unwinding manager ssh_keys 2026-02-12T13:03:56.284 INFO:teuthology.task.ssh_keys:Cleaning up SSH keys 2026-02-12T13:03:56.284 INFO:teuthology.task.ssh_keys:cleaning up keys added for testing 2026-02-12T13:03:56.284 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on trial049.front.sepia.ceph.com 2026-02-12T13:03:56.284 DEBUG:teuthology.orchestra.run.trial049:> rm -- /home/ubuntu/.ssh/id_rsa 2026-02-12T13:03:56.299 DEBUG:teuthology.orchestra.run.trial049:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2026-02-12T13:03:56.355 DEBUG:teuthology.orchestra.run.trial049:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2026-02-12T13:03:56.413 INFO:teuthology.orchestra.run.trial049.stdout:"600" 2026-02-12T13:03:56.414 DEBUG:teuthology.orchestra.run.trial049:> mv -- /home/ubuntu/.ssh/authorized_keys_2026-02-12_12:51:03:637343 /home/ubuntu/.ssh/authorized_keys 2026-02-12T13:03:56.481 DEBUG:teuthology.orchestra.run.trial049:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2026-02-12T13:03:56.545 DEBUG:teuthology.orchestra.run.trial049:> rm /home/ubuntu/.ssh/config 2026-02-12T13:03:56.612 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-12T13:03:56.627 DEBUG:teuthology.orchestra.run.trial049:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-12T13:03:56.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T13:03:56.736+0000 7fa1e045a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T13:03:56.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-12T13:03:56.742+0000 7fa1e045a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T13:03:56.883 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-12T13:03:56.883 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-12T13:03:56.883 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-12T13:03:56.884 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T13:03:57.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2026-02-12T13:04:02.985 INFO:tasks.ceph.osd.0:Stopped 2026-02-12T13:04:02.986 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-12T13:04:02.986 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T13:04:03.049 INFO:tasks.ceph.osd.1:Stopped 2026-02-12T13:04:03.049 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-12T13:04:03.049 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T13:04:03.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~5s 2026-02-12T13:04:03.133 INFO:tasks.ceph.osd.2:Stopped 2026-02-12T13:04:03.133 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-12T13:04:03.134 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-12T13:04:03.134 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T13:04:03.167 INFO:tasks.ceph.mgr.x:Stopped 2026-02-12T13:04:03.168 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-12T13:04:03.168 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-12T13:04:03.168 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T13:04:03.220 INFO:tasks.ceph.mon.a:Stopped 2026-02-12T13:04:03.220 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-12T13:04:03.220 DEBUG:teuthology.orchestra.run.trial049:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v '\(PG_' | grep -E -v '\(OSD_' | grep -E -v '\(OBJECT_' | grep -E -v 'overall HEALTH' | head -n 1 2026-02-12T13:04:03.287 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial049.front.sepia.ceph.com 2026-02-12T13:04:03.287 DEBUG:teuthology.orchestra.run.trial049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-12T13:04:03.430 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial049.front.sepia.ceph.com 2026-02-12T13:04:03.430 DEBUG:teuthology.orchestra.run.trial049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-12T13:04:03.462 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial049.front.sepia.ceph.com 2026-02-12T13:04:03.463 DEBUG:teuthology.orchestra.run.trial049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-12T13:04:03.535 INFO:tasks.ceph:Archiving mon data... 2026-02-12T13:04:03.537 DEBUG:teuthology.misc:Transferring archived files from trial049:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial/45939/data/mon.a.tgz 2026-02-12T13:04:03.537 DEBUG:teuthology.orchestra.run.trial049:> mktemp 2026-02-12T13:04:03.591 INFO:teuthology.orchestra.run.trial049.stdout:/tmp/tmp.QcDvNSbVVo 2026-02-12T13:04:03.592 DEBUG:teuthology.orchestra.run.trial049:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.QcDvNSbVVo 2026-02-12T13:04:03.681 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod 0666 /tmp/tmp.QcDvNSbVVo 2026-02-12T13:04:03.762 DEBUG:teuthology.orchestra.remote:trial049:/tmp/tmp.QcDvNSbVVo is 203KB 2026-02-12T13:04:03.815 DEBUG:teuthology.orchestra.run.trial049:> rm -fr /tmp/tmp.QcDvNSbVVo 2026-02-12T13:04:03.831 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-12T13:04:03.831 DEBUG:teuthology.orchestra.run.trial049:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T13:04:03.951 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T13:04:03.951 INFO:tasks.ceph:Archiving crash dumps... 2026-02-12T13:04:03.954 DEBUG:teuthology.misc:Transferring archived files from trial049:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial/45939/remote/trial049/crash 2026-02-12T13:04:03.956 DEBUG:teuthology.orchestra.run.trial049:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T13:04:04.014 INFO:tasks.ceph:Compressing logs... 2026-02-12T13:04:04.015 DEBUG:teuthology.orchestra.run.trial049:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T13:04:04.078 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-12T13:04:04.082 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-12T13:04:04.082 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-12T13:04:04.082 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22108.log 2026-02-12T13:04:04.082 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23801.log 2026-02-12T13:04:04.082 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.22108.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22108.log.gz 2026-02-12T13:04:04.082 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22358.log 2026-02-12T13:04:04.082 INFO:teuthology.orchestra.run.trial049.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-12T13:04:04.082 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.23801.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23801.log.gz -5 2026-02-12T13:04:04.083 INFO:teuthology.orchestra.run.trial049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.21735.log 2026-02-12T13:04:04.083 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.22358.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22358.log.gz 2026-02-12T13:04:04.083 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22981.log 2026-02-12T13:04:04.083 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.21735.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.21735.log.gz 2026-02-12T13:04:04.083 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23129.log 2026-02-12T13:04:04.083 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.22981.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22981.log.gz 2026-02-12T13:04:04.083 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23320.log 2026-02-12T13:04:04.083 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.23129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22830.log 2026-02-12T13:04:04.083 INFO:teuthology.orchestra.run.trial049.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23129.log.gz 2026-02-12T13:04:04.083 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.23320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23583.log 2026-02-12T13:04:04.083 INFO:teuthology.orchestra.run.trial049.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23320.log.gz 2026-02-12T13:04:04.083 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22571.log 2026-02-12T13:04:04.091 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.22830.log: /var/log/ceph/ceph-client.admin.23583.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22830.log.gz 2026-02-12T13:04:04.091 INFO:teuthology.orchestra.run.trial049.stderr:gzip 50.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.23583.log.gz --verbose 2026-02-12T13:04:04.091 INFO:teuthology.orchestra.run.trial049.stderr: -- /var/log/ceph/ceph-client.admin.22061.log 2026-02-12T13:04:04.092 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.22571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21877.log 2026-02-12T13:04:04.092 INFO:teuthology.orchestra.run.trial049.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22571.log.gz 2026-02-12T13:04:04.092 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.22061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22980.log 2026-02-12T13:04:04.092 INFO:teuthology.orchestra.run.trial049.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22061.log.gz 2026-02-12T13:04:04.092 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.21877.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.21877.log.gz 2026-02-12T13:04:04.092 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23128.log 2026-02-12T13:04:04.092 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.22980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22732.log 2026-02-12T13:04:04.092 INFO:teuthology.orchestra.run.trial049.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22980.log.gz 2026-02-12T13:04:04.092 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.23128.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23128.log.gz 2026-02-12T13:04:04.092 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-12T13:04:04.092 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.22732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23127.log 2026-02-12T13:04:04.093 INFO:teuthology.orchestra.run.trial049.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22732.log.gz 2026-02-12T13:04:04.093 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-12T13:04:04.093 INFO:teuthology.orchestra.run.trial049.stderr: 86.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-12T13:04:04.093 INFO:teuthology.orchestra.run.trial049.stderr:gzip/var/log/ceph/ceph-client.admin.23127.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23531.log 2026-02-12T13:04:04.093 INFO:teuthology.orchestra.run.trial049.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23127.log.gz 2026-02-12T13:04:04.093 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23986.log 2026-02-12T13:04:04.093 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.23531.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23531.log.gz 2026-02-12T13:04:04.093 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22504.log 2026-02-12T13:04:04.093 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.23986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22781.log 2026-02-12T13:04:04.093 INFO:teuthology.orchestra.run.trial049.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23986.log.gz 2026-02-12T13:04:04.093 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.22504.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22504.log.gz 2026-02-12T13:04:04.093 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.23606.log 2026-02-12T13:04:04.093 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.22781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23222.log 2026-02-12T13:04:04.094 INFO:teuthology.orchestra.run.trial049.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22781.log.gz 2026-02-12T13:04:04.094 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.0.23606.log: 66.7% -- replaced with /var/log/ceph/ceph-client.0.23606.log.gz 2026-02-12T13:04:04.094 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-12T13:04:04.094 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.23222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21830.log 2026-02-12T13:04:04.094 INFO:teuthology.orchestra.run.trial049.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23222.log.gz 2026-02-12T13:04:04.094 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23271.log 2026-02-12T13:04:04.094 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.21830.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.21830.log.gzgzip 2026-02-12T13:04:04.094 INFO:teuthology.orchestra.run.trial049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22982.log 2026-02-12T13:04:04.094 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.23271.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23271.log.gz 2026-02-12T13:04:04.094 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22327.log 2026-02-12T13:04:04.094 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.22982.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22982.log.gz 2026-02-12T13:04:04.094 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22666.log 2026-02-12T13:04:04.095 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.22327.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22327.log.gz 2026-02-12T13:04:04.095 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-12T13:04:04.095 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.22666.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20449.log 2026-02-12T13:04:04.095 INFO:teuthology.orchestra.run.trial049.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.22666.log.gz 2026-02-12T13:04:04.095 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22014.log 2026-02-12T13:04:04.095 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph.tmp-client.admin.20449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22641.log 2026-02-12T13:04:04.095 INFO:teuthology.orchestra.run.trial049.stderr: 66.9% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20449.log.gz 2026-02-12T13:04:04.095 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.22014.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22014.log.gz 2026-02-12T13:04:04.095 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22879.log 2026-02-12T13:04:04.095 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.22641.log: 88.5% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-12T13:04:04.095 INFO:teuthology.orchestra.run.trial049.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22641.log.gz 2026-02-12T13:04:04.095 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.22879.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22879.log.gz 2026-02-12T13:04:04.107 INFO:teuthology.orchestra.run.trial049.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-12T13:04:08.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2026-02-12T13:04:43.170 INFO:teuthology.orchestra.run.trial049.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-12T13:04:44.116 INFO:teuthology.orchestra.run.trial049.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-12T13:04:51.603 INFO:teuthology.orchestra.run.trial049.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-12T13:04:51.605 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-12T13:04:51.605 INFO:teuthology.orchestra.run.trial049.stderr:real 0m47.534s 2026-02-12T13:04:51.605 INFO:teuthology.orchestra.run.trial049.stderr:user 2m0.777s 2026-02-12T13:04:51.605 INFO:teuthology.orchestra.run.trial049.stderr:sys 0m5.650s 2026-02-12T13:04:51.605 INFO:tasks.ceph:Archiving logs... 2026-02-12T13:04:51.606 DEBUG:teuthology.misc:Transferring archived files from trial049:/var/log/ceph to /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial/45939/remote/trial049/log 2026-02-12T13:04:51.607 DEBUG:teuthology.orchestra.run.trial049:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T13:05:00.968 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T13:05:01.037 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T13:05:01.048 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-12T13:05:01.048 DEBUG:teuthology.orchestra.run.trial049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T13:05:01.073 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-12T13:05:01.085 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-12T13:05:01.085 DEBUG:teuthology.orchestra.run.trial049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T13:05:01.128 INFO:teuthology.orchestra.run.trial049.stderr:bash: line 1: ntpq: command not found 2026-02-12T13:05:01.151 INFO:teuthology.orchestra.run.trial049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T13:05:01.151 INFO:teuthology.orchestra.run.trial049.stdout:=============================================================================== 2026-02-12T13:05:01.152 INFO:teuthology.orchestra.run.trial049.stdout:^+ 23.157.160.168 2 6 377 56 +6632us[+6632us] +/- 31ms 2026-02-12T13:05:01.152 INFO:teuthology.orchestra.run.trial049.stdout:^x time-h.den.codehof.net 2 6 377 57 +138ms[ +138ms] +/- 90ms 2026-02-12T13:05:01.152 INFO:teuthology.orchestra.run.trial049.stdout:^+ t2.time.gq1.yahoo.com 2 7 377 55 -31ms[ -31ms] +/- 70ms 2026-02-12T13:05:01.152 INFO:teuthology.orchestra.run.trial049.stdout:^* kjsl-fmt2-net.fmt2.kjsl.> 2 6 377 59 +7027us[+8496us] +/- 34ms 2026-02-12T13:05:01.152 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-12T13:05:01.164 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-12T13:05:01.164 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-12T13:05:01.179 DEBUG:teuthology.orchestra.run.trial049:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T13:05:01.237 DEBUG:teuthology.orchestra.run.trial049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T13:05:01.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T13:05:01.303 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-12T13:05:01.319 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-12T13:05:01.335 INFO:teuthology.task.internal:Duration was 1230.080142 seconds 2026-02-12T13:05:01.335 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-12T13:05:01.351 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-12T13:05:01.351 DEBUG:teuthology.orchestra.run.trial049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T13:05:01.387 INFO:teuthology.orchestra.run.trial049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T13:05:01.731 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-12T13:05:01.732 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial049.front.sepia.ceph.com 2026-02-12T13:05:01.732 DEBUG:teuthology.orchestra.run.trial049:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T13:05:01.792 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-12T13:05:01.792 DEBUG:teuthology.orchestra.run.trial049:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T13:05:01.875 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-12T13:05:01.875 DEBUG:teuthology.orchestra.run.trial049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T13:05:01.938 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T13:05:01.938 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T13:05:01.939 INFO:teuthology.orchestra.run.trial049.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T13:05:01.940 INFO:teuthology.orchestra.run.trial049.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T13:05:01.940 INFO:teuthology.orchestra.run.trial049.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T13:05:01.942 INFO:teuthology.orchestra.run.trial049.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T13:05:01.945 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-12T13:05:01.962 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-12T13:05:01.963 DEBUG:teuthology.orchestra.run.trial049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T13:05:02.010 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-12T13:05:02.028 DEBUG:teuthology.orchestra.run.trial049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T13:05:02.076 INFO:teuthology.orchestra.run.trial049.stdout:kernel.core_pattern = core 2026-02-12T13:05:02.093 DEBUG:teuthology.orchestra.run.trial049:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T13:05:02.148 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T13:05:02.149 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-12T13:05:02.166 INFO:teuthology.task.internal:Transferring archived files... 2026-02-12T13:05:02.167 DEBUG:teuthology.misc:Transferring archived files from trial049:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial/45939/remote/trial049 2026-02-12T13:05:02.168 DEBUG:teuthology.orchestra.run.trial049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T13:05:02.223 INFO:teuthology.task.internal:Removing archive directory... 2026-02-12T13:05:02.223 DEBUG:teuthology.orchestra.run.trial049:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T13:05:02.272 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-12T13:05:02.291 INFO:teuthology.task.internal:Not uploading archives. 2026-02-12T13:05:02.291 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-12T13:05:02.308 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-12T13:05:02.309 DEBUG:teuthology.orchestra.run.trial049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T13:05:02.329 INFO:teuthology.orchestra.run.trial049.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 13:05 /home/ubuntu/cephtest 2026-02-12T13:05:02.331 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T13:05:02.349 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T13:05:02.388 INFO:teuthology.run:Summary data: description: crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} perf_ignorelist settings/optimized workloads/radosbench_omap_write} duration: 1230.0801424980164 flavor: debug owner: scheduled_moagrawa@soko04.front.sepia.ceph.com success: true 2026-02-12T13:05:02.388 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:05:02.518 INFO:teuthology.run:pass