2026-02-17T09:44:03.014 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T09:44:03.029 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T09:44:03.110 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/matan-2026-02-17_08:51:22-crimson-rados-wip-sjust-seastore-2026-02-16-1771285632-distro-debug-trial/52078 branch: wip-sjust-seastore-2026-02-16-1771285632 description: crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} perf_ignorelist settings/optimized workloads/radosbench_4M_write} email: null first_in_suite: false flavor: debug job_id: '52078' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: matan-2026-02-17_08:51:22-crimson-rados-wip-sjust-seastore-2026-02-16-1771285632-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-sjust-seastore-2026-02-16-1771285632 ceph: conf: global: auth client required: none auth cluster required: none auth service required: none auth supported: none debug asok: 0/0 debug auth: 0/0 debug bdev: 0/0 debug bluefs: 0/0 debug bluestore: 0/0 debug buffer: 0/0 debug civetweb: 0/0 debug client: 0/0 debug compressor: 0/0 debug context: 0/0 debug crush: 0/0 debug crypto: 0/0 debug dpdk: 0/0 debug eventtrace: 0/0 debug filer: 0/0 debug filestore: 0/0 debug finisher: 0/0 debug fuse: 0/0 debug heartbeatmap: 0/0 debug javaclient: 0/0 debug journal: 0/0 debug journaler: 0/0 debug kstore: 0/0 debug leveldb: 0/0 debug lockdep: 0/0 debug mds: 0/0 debug mds balancer: 0/0 debug mds locker: 0/0 debug mds log: 0/0 debug mds log expire: 0/0 debug mds migrator: 0/0 debug memdb: 0/0 debug mgr: 0/0 debug mgrc: 0/0 debug mon: 0/0 debug monc: 0/0 debug ms: 0/0 debug objclass: 0/0 debug objectcacher: 0/0 debug objecter: 0/0 debug optracker: 0/0 debug osd: 0/0 debug paxos: 0/0 debug perfcounter: 0/0 debug rados: 0/0 debug rbd: 0/0 debug rbd mirror: 0/0 debug rbd replay: 0/0 debug refs: 0/0 debug rgw: 0/0 debug rgw lifecycle: 0/0 debug rgw notification: 0/0 debug rgw sync: 0/0 debug rocksdb: 0/0 debug striper: 0/0 debug throttle: 0/0 debug timer: 0/0 debug tp: 0/0 enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 0/0 debug ms: 0/0 debug paxos: 0/0 osd pool default crimson: true osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug filestore: 0/0 debug journal: 0/0 debug ms: 0/0 debug osd: 0/0 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd objectstore: seastore osd shutdown pgref assert: true seastore cachepin size pershard: 64M seastore cachepin type: 2Q seastore main device type: RANDOM_BLOCK_SSD seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - \(PG_ - \(OSD_ - \(OBJECT_ - overall HEALTH sha1: b58fab16a61897dbc214a1865300c7cef586ea65 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} install: ceph: flavor: debug sha1: b58fab16a61897dbc214a1865300c7cef586ea65 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: ebc89147fc1a1731b84ef7e7003e19f704ba15c0 owner: scheduled_matan@soko04.front.sepia.ceph.com priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 2314 sha1: b58fab16a61897dbc214a1865300c7cef586ea65 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_ebc89147fc1a1731b84ef7e7003e19f704ba15c0/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: ebc89147fc1a1731b84ef7e7003e19f704ba15c0 targets: trial070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG71L8jELsCIgBbuYM8ahUocfwRmB9aIOcoi+CkC0VUUpotnOfJZy1NyGwTckTNcXm6bDaNLwvsDCnEWqVRivPs= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: osd: debug monc: 20 wait-for-scrub: false - ssh_keys: null - cbt: benchmarks: radosbench: concurrent_ops: 4 concurrent_procs: 2 op_size: - 4194304 pool_monitoring_list: - collectl pool_profile: replicated run_monitoring_list: - collectl time: 60 write_only: true cluster: iterations: 1 osds_per_node: 3 pool_profiles: replicated: pg_size: 256 pgp_size: 256 replication: replicated user: ubuntu monitoring_profiles: perf: args: stat -p {pid} -o {perf_dir}/perf_stat.{pid} nodes: - osds perf_cmd: perf pid_glob: crimson-osd.*.pid teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_08:51:22 tube: trial user: matan verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T09:44:03.110 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_ebc89147fc1a1731b84ef7e7003e19f704ba15c0/qa; will attempt to use it 2026-02-17T09:44:03.111 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_ebc89147fc1a1731b84ef7e7003e19f704ba15c0/qa/tasks 2026-02-17T09:44:03.111 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T09:44:03.112 INFO:teuthology.task.internal:Checking packages... 2026-02-17T09:44:03.112 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash 'b58fab16a61897dbc214a1865300c7cef586ea65' 2026-02-17T09:44:03.113 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T09:44:03.113 INFO:teuthology.packaging:ref: None 2026-02-17T09:44:03.113 INFO:teuthology.packaging:tag: None 2026-02-17T09:44:03.113 INFO:teuthology.packaging:branch: wip-sjust-seastore-2026-02-16-1771285632 2026-02-17T09:44:03.113 INFO:teuthology.packaging:sha1: b58fab16a61897dbc214a1865300c7cef586ea65 2026-02-17T09:44:03.113 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=wip-sjust-seastore-2026-02-16-1771285632 2026-02-17T09:44:03.229 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5345.gb58fab16 2026-02-17T09:44:03.230 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T09:44:03.243 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T09:44:03.243 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T09:44:03.253 INFO:teuthology.task.internal:Saving configuration 2026-02-17T09:44:03.267 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T09:44:03.279 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T09:44:03.354 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial070.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/matan-2026-02-17_08:51:22-crimson-rados-wip-sjust-seastore-2026-02-16-1771285632-distro-debug-trial/52078', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 09:40:37.817605', 'locked_by': 'scheduled_matan@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG71L8jELsCIgBbuYM8ahUocfwRmB9aIOcoi+CkC0VUUpotnOfJZy1NyGwTckTNcXm6bDaNLwvsDCnEWqVRivPs='} 2026-02-17T09:44:03.354 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T09:44:03.366 INFO:teuthology.task.internal:roles: ubuntu@trial070.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-17T09:44:03.366 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T09:44:03.449 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb49e993ec0>, signals=[15]) 2026-02-17T09:44:03.449 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T09:44:03.461 INFO:teuthology.task.internal:Opening connections... 2026-02-17T09:44:03.461 DEBUG:teuthology.task.internal:connecting to ubuntu@trial070.front.sepia.ceph.com 2026-02-17T09:44:03.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T09:44:03.521 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T09:44:03.533 DEBUG:teuthology.orchestra.run.trial070:> uname -m 2026-02-17T09:44:03.593 INFO:teuthology.orchestra.run.trial070.stdout:x86_64 2026-02-17T09:44:03.594 DEBUG:teuthology.orchestra.run.trial070:> cat /etc/os-release 2026-02-17T09:44:03.650 INFO:teuthology.orchestra.run.trial070.stdout:NAME="CentOS Stream" 2026-02-17T09:44:03.650 INFO:teuthology.orchestra.run.trial070.stdout:VERSION="9" 2026-02-17T09:44:03.650 INFO:teuthology.orchestra.run.trial070.stdout:ID="centos" 2026-02-17T09:44:03.650 INFO:teuthology.orchestra.run.trial070.stdout:ID_LIKE="rhel fedora" 2026-02-17T09:44:03.650 INFO:teuthology.orchestra.run.trial070.stdout:VERSION_ID="9" 2026-02-17T09:44:03.650 INFO:teuthology.orchestra.run.trial070.stdout:PLATFORM_ID="platform:el9" 2026-02-17T09:44:03.650 INFO:teuthology.orchestra.run.trial070.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T09:44:03.650 INFO:teuthology.orchestra.run.trial070.stdout:ANSI_COLOR="0;31" 2026-02-17T09:44:03.650 INFO:teuthology.orchestra.run.trial070.stdout:LOGO="fedora-logo-icon" 2026-02-17T09:44:03.650 INFO:teuthology.orchestra.run.trial070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T09:44:03.650 INFO:teuthology.orchestra.run.trial070.stdout:HOME_URL="https://centos.org/" 2026-02-17T09:44:03.651 INFO:teuthology.orchestra.run.trial070.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T09:44:03.651 INFO:teuthology.orchestra.run.trial070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T09:44:03.651 INFO:teuthology.orchestra.run.trial070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T09:44:03.651 INFO:teuthology.lock.ops:Updating trial070.front.sepia.ceph.com on lock server 2026-02-17T09:44:03.736 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T09:44:03.749 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T09:44:03.760 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T09:44:03.760 DEBUG:teuthology.orchestra.run.trial070:> test '!' -e /home/ubuntu/cephtest 2026-02-17T09:44:03.776 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T09:44:03.787 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T09:44:03.787 DEBUG:teuthology.orchestra.run.trial070:> test -z $(ls -A /var/lib/ceph) 2026-02-17T09:44:03.833 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T09:44:03.938 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T09:44:03.960 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T09:44:03.960 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T09:44:03.960 DEBUG:teuthology.orchestra.run.trial070:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T09:44:03.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T09:44:03.976 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-17T09:44:04.037 INFO:teuthology.orchestra.run.trial070.stdout:5.14.0-645.el9.x86_64 2026-02-17T09:44:04.037 INFO:teuthology.task.kernel:Running kernel on trial070: 5.14.0-645.el9.x86_64 2026-02-17T09:44:04.037 DEBUG:teuthology.orchestra.run.trial070:> sudo yum install -y kernel 2026-02-17T09:44:04.887 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.9 MB 00:00 2026-02-17T09:44:08.044 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T09:44:12.178 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 7.8 MB 00:01 2026-02-17T09:44:13.015 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - Extras packages 183 kB/s | 20 kB 00:00 2026-02-17T09:44:13.288 INFO:teuthology.orchestra.run.trial070.stdout:Extra Packages for Enterprise Linux 97 MB/s | 20 MB 00:00 2026-02-17T09:44:16.485 INFO:teuthology.orchestra.run.trial070.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-17T09:44:17.495 INFO:teuthology.orchestra.run.trial070.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T09:44:17.515 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:44:17.516 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:44:17.516 INFO:teuthology.orchestra.run.trial070.stdout: Package Architecture Version Repository Size 2026-02-17T09:44:17.516 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:44:17.516 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-17T09:44:17.516 INFO:teuthology.orchestra.run.trial070.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T09:44:17.516 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-17T09:44:17.516 INFO:teuthology.orchestra.run.trial070.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T09:44:17.516 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T09:44:17.516 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T09:44:17.516 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:44:17.516 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-17T09:44:17.516 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:44:17.516 INFO:teuthology.orchestra.run.trial070.stdout:Install 4 Packages 2026-02-17T09:44:17.516 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:44:17.516 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 88 M 2026-02-17T09:44:17.516 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 135 M 2026-02-17T09:44:17.517 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-17T09:44:18.170 INFO:teuthology.orchestra.run.trial070.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 1.4 MB/s | 803 kB 00:00 2026-02-17T09:44:20.050 INFO:teuthology.orchestra.run.trial070.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 7.0 MB/s | 17 MB 00:02 2026-02-17T09:44:21.999 INFO:teuthology.orchestra.run.trial070.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 8.1 MB/s | 31 MB 00:03 2026-02-17T09:44:23.325 INFO:teuthology.orchestra.run.trial070.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 6.9 MB/s | 40 MB 00:05 2026-02-17T09:44:23.325 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-17T09:44:23.325 INFO:teuthology.orchestra.run.trial070.stdout:Total 15 MB/s | 88 MB 00:05 2026-02-17T09:44:23.519 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-17T09:44:23.722 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-17T09:44:23.722 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-17T09:44:24.068 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-17T09:44:24.068 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-17T09:44:25.162 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-17T09:44:25.448 INFO:teuthology.orchestra.run.trial070.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T09:44:25.467 INFO:teuthology.orchestra.run.trial070.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T09:44:27.233 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T09:44:27.262 INFO:teuthology.orchestra.run.trial070.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T09:44:30.347 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T09:44:30.353 INFO:teuthology.orchestra.run.trial070.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T09:44:33.387 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T09:45:03.787 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T09:45:03.807 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T09:45:03.871 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T09:45:03.871 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T09:45:03.872 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T09:45:03.872 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T09:45:03.923 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T09:45:03.924 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:45:03.924 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-17T09:45:03.924 INFO:teuthology.orchestra.run.trial070.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T09:45:03.924 INFO:teuthology.orchestra.run.trial070.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T09:45:03.924 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T09:45:03.924 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T09:45:03.924 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:45:03.924 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:45:03.981 DEBUG:teuthology.orchestra.run.trial070:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T09:45:04.007 INFO:teuthology.orchestra.run.trial070.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T09:45:04.008 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T09:45:04.008 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T09:45:04.008 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T09:45:04.009 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T09:45:04.009 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T09:45:04.009 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial070.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T09:45:04.009 DEBUG:teuthology.orchestra.run.trial070:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T09:45:04.071 INFO:teuthology.orchestra.run.trial070.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T09:45:04.072 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T09:45:04.072 DEBUG:teuthology.orchestra.run.trial070:> sudo rpm -qi grub2-tools 2026-02-17T09:45:04.140 INFO:teuthology.orchestra.run.trial070.stdout:Name : grub2-tools 2026-02-17T09:45:04.141 INFO:teuthology.orchestra.run.trial070.stdout:Epoch : 1 2026-02-17T09:45:04.141 INFO:teuthology.orchestra.run.trial070.stdout:Version : 2.06 2026-02-17T09:45:04.141 INFO:teuthology.orchestra.run.trial070.stdout:Release : 118.el9 2026-02-17T09:45:04.141 INFO:teuthology.orchestra.run.trial070.stdout:Architecture: x86_64 2026-02-17T09:45:04.141 INFO:teuthology.orchestra.run.trial070.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T09:45:04.141 INFO:teuthology.orchestra.run.trial070.stdout:Group : Unspecified 2026-02-17T09:45:04.141 INFO:teuthology.orchestra.run.trial070.stdout:Size : 8393909 2026-02-17T09:45:04.141 INFO:teuthology.orchestra.run.trial070.stdout:License : GPLv3+ 2026-02-17T09:45:04.141 INFO:teuthology.orchestra.run.trial070.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T09:45:04.141 INFO:teuthology.orchestra.run.trial070.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T09:45:04.142 INFO:teuthology.orchestra.run.trial070.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T09:45:04.142 INFO:teuthology.orchestra.run.trial070.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T09:45:04.142 INFO:teuthology.orchestra.run.trial070.stdout:Packager : builder@centos.org 2026-02-17T09:45:04.142 INFO:teuthology.orchestra.run.trial070.stdout:Vendor : CentOS 2026-02-17T09:45:04.142 INFO:teuthology.orchestra.run.trial070.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T09:45:04.142 INFO:teuthology.orchestra.run.trial070.stdout:Summary : Support tools for GRUB. 2026-02-17T09:45:04.142 INFO:teuthology.orchestra.run.trial070.stdout:Description : 2026-02-17T09:45:04.142 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:45:04.142 INFO:teuthology.orchestra.run.trial070.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T09:45:04.142 INFO:teuthology.orchestra.run.trial070.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T09:45:04.142 INFO:teuthology.orchestra.run.trial070.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T09:45:04.142 INFO:teuthology.orchestra.run.trial070.stdout:hardware devices. 2026-02-17T09:45:04.143 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:45:04.143 INFO:teuthology.orchestra.run.trial070.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T09:45:04.144 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T09:45:04.144 INFO:teuthology.task.kernel:Updating grub on trial070 to boot 5.14.0-681.el9.x86_64 2026-02-17T09:45:04.144 DEBUG:teuthology.orchestra.run.trial070:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T09:45:04.206 INFO:teuthology.orchestra.run.trial070.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T09:45:04.208 DEBUG:teuthology.orchestra.run.trial070:> sudo command -v grubby && echo yes || echo no 2026-02-17T09:45:04.271 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/grubby 2026-02-17T09:45:04.272 INFO:teuthology.orchestra.run.trial070.stdout:yes 2026-02-17T09:45:04.273 DEBUG:teuthology.orchestra.run.trial070:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T09:45:04.337 INFO:teuthology.orchestra.run.trial070.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T09:45:04.338 DEBUG:teuthology.orchestra.run.trial070:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T09:45:04.411 DEBUG:teuthology.orchestra.run.trial070:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T09:45:04.619 INFO:teuthology.orchestra.run.trial070.stderr:Generating grub configuration file ... 2026-02-17T09:45:04.681 INFO:teuthology.orchestra.run.trial070.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T09:45:04.688 INFO:teuthology.orchestra.run.trial070.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T09:45:04.939 INFO:teuthology.orchestra.run.trial070.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T09:45:04.946 INFO:teuthology.orchestra.run.trial070.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T09:45:04.978 INFO:teuthology.orchestra.run.trial070.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T09:45:04.984 INFO:teuthology.orchestra.run.trial070.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T09:45:05.007 INFO:teuthology.orchestra.run.trial070.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T09:45:05.013 INFO:teuthology.orchestra.run.trial070.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T09:45:05.095 INFO:teuthology.orchestra.run.trial070.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T09:45:05.103 INFO:teuthology.orchestra.run.trial070.stderr:done 2026-02-17T09:45:05.105 DEBUG:teuthology.orchestra.run.trial070:> test -d /sys/firmware/efi 2026-02-17T09:45:05.121 DEBUG:teuthology.orchestra.run.trial070:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T09:45:05.186 INFO:teuthology.orchestra.run.trial070.stdout:/boot/efi/EFI/BOOT 2026-02-17T09:45:05.186 INFO:teuthology.orchestra.run.trial070.stdout:/boot/efi/EFI/centos 2026-02-17T09:45:05.188 DEBUG:teuthology.orchestra.run.trial070:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T09:45:05.253 INFO:teuthology.orchestra.run.trial070.stdout:no 2026-02-17T09:45:05.254 DEBUG:teuthology.orchestra.run.trial070:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T09:45:05.318 INFO:teuthology.orchestra.run.trial070.stdout:yes 2026-02-17T09:45:05.319 DEBUG:teuthology.orchestra.run.trial070:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T09:45:05.385 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial070 2026-02-17T09:45:05.385 DEBUG:teuthology.orchestra.run.trial070:> sudo bash -c ' 2026-02-17T09:45:05.385 DEBUG:teuthology.orchestra.run.trial070:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T09:45:05.386 DEBUG:teuthology.orchestra.run.trial070:> ' 2026-02-17T09:45:35.428 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T09:45:35.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-17T09:45:35.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T09:45:49.696 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.70 2026-02-17T09:45:58.704 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-17T09:45:58.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T09:46:34.843 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-17T09:46:35.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-17T09:46:35.017 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T09:46:35.017 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-17T09:46:35.075 INFO:teuthology.orchestra.run.trial070.stdout:5.14.0-681.el9.x86_64 2026-02-17T09:46:35.075 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T09:46:35.076 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T09:46:35.076 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T09:46:36.077 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T09:46:36.077 DEBUG:teuthology.orchestra.run.trial070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T09:46:36.109 INFO:teuthology.orchestra.run.trial070.stdout:ttyS1 2026-02-17T09:46:36.133 DEBUG:teuthology.parallel:result is None 2026-02-17T09:46:36.133 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T09:46:36.147 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T09:46:36.148 DEBUG:teuthology.orchestra.run.trial070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T09:46:36.190 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T09:46:36.202 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T09:46:36.216 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T09:46:36.216 DEBUG:teuthology.orchestra.run.trial070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T09:46:36.254 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T09:46:36.265 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T09:46:36.265 DEBUG:teuthology.orchestra.run.trial070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T09:46:36.312 INFO:teuthology.orchestra.run.trial070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T09:46:36.321 INFO:teuthology.orchestra.run.trial070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T09:46:36.323 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T09:46:36.335 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T09:46:36.335 DEBUG:teuthology.orchestra.run.trial070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T09:46:36.387 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T09:46:36.404 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T09:46:36.404 DEBUG:teuthology.orchestra.run.trial070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T09:46:36.444 DEBUG:teuthology.orchestra.run.trial070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T09:46:36.608 DEBUG:teuthology.orchestra.run.trial070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T09:46:36.633 DEBUG:teuthology.orchestra.run.trial070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T09:46:36.789 DEBUG:teuthology.orchestra.run.trial070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T09:46:36.814 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:46:36.814 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T09:46:36.878 DEBUG:teuthology.orchestra.run.trial070:> sudo service rsyslog restart 2026-02-17T09:46:36.945 INFO:teuthology.orchestra.run.trial070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T09:46:37.264 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T09:46:37.276 INFO:teuthology.task.internal:Starting timer... 2026-02-17T09:46:37.277 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T09:46:37.293 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T09:46:37.306 DEBUG:teuthology.orchestra.run.trial070:> sudo service auditd rotate 2026-02-17T09:46:37.334 INFO:teuthology.orchestra.run.trial070.stdout:Rotating logs: 2026-02-17T09:46:37.336 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T09:46:37.336 DEBUG:teuthology.orchestra.run.trial070:> /usr/sbin/getenforce 2026-02-17T09:46:37.391 INFO:teuthology.orchestra.run.trial070.stdout:Permissive 2026-02-17T09:46:37.391 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial070.front.sepia.ceph.com': 'permissive'} 2026-02-17T09:46:37.391 DEBUG:teuthology.orchestra.run.trial070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-17T09:46:37.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T09:46:37.457 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T09:46:37.457 DEBUG:teuthology.orchestra.run.trial070:> sudo /usr/sbin/setenforce permissive 2026-02-17T09:46:37.520 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T09:46:37.534 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-17T09:46:37.536 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-17T09:46:37.644 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T09:46:37.655 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T09:46:37.656 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial070.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T09:49:21.534 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial070.front.sepia.ceph.com')] 2026-02-17T09:49:21.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-17T09:49:21.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T09:49:21.644 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-17T09:49:21.722 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-17T09:49:21.722 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T09:49:21.737 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T09:49:21.737 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T09:49:21.737 DEBUG:teuthology.orchestra.run.trial070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T09:49:21.788 INFO:teuthology.orchestra.run.trial070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T09:49:21.799 INFO:teuthology.orchestra.run.trial070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T09:49:21.818 INFO:teuthology.orchestra.run.trial070.stderr:sudo: ntpd: command not found 2026-02-17T09:49:21.828 INFO:teuthology.orchestra.run.trial070.stdout:506 Cannot talk to daemon 2026-02-17T09:49:21.839 INFO:teuthology.orchestra.run.trial070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T09:49:21.850 INFO:teuthology.orchestra.run.trial070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T09:49:21.900 INFO:teuthology.orchestra.run.trial070.stderr:bash: line 1: ntpq: command not found 2026-02-17T09:49:21.901 INFO:teuthology.orchestra.run.trial070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T09:49:21.901 INFO:teuthology.orchestra.run.trial070.stdout:=============================================================================== 2026-02-17T09:49:21.902 INFO:teuthology.run_tasks:Running task install... 2026-02-17T09:49:21.916 DEBUG:teuthology.task.install:project ceph 2026-02-17T09:49:21.916 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': 'b58fab16a61897dbc214a1865300c7cef586ea65'}} 2026-02-17T09:49:21.916 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': 'b58fab16a61897dbc214a1865300c7cef586ea65'} 2026-02-17T09:49:21.916 INFO:teuthology.task.install:Using flavor: debug 2026-02-17T09:49:21.926 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T09:49:21.927 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-17T09:49:21.927 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b58fab16a61897dbc214a1865300c7cef586ea65', 'tag': None, 'wait_for_package': False} 2026-02-17T09:49:21.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=b58fab16a61897dbc214a1865300c7cef586ea65 2026-02-17T09:49:22.087 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-sjust-seastore-2026-02-16-1771285632/b58fab16a61897dbc214a1865300c7cef586ea65/centos/9/flavors/debug/ 2026-02-17T09:49:22.087 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5345.gb58fab16 2026-02-17T09:49:22.463 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-sjust-seastore-2026-02-16-1771285632/b58fab16a61897dbc214a1865300c7cef586ea65/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-sjust-seastore-2026-02-16-1771285632/b58fab16a61897dbc214a1865300c7cef586ea65/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-sjust-seastore-2026-02-16-1771285632/b58fab16a61897dbc214a1865300c7cef586ea65/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T09:49:22.463 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:49:22.463 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T09:49:22.489 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-17T09:49:22.489 DEBUG:teuthology.orchestra.run.trial070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b58fab16a61897dbc214a1865300c7cef586ea65/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T09:49:22.554 DEBUG:teuthology.orchestra.run.trial070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T09:49:22.627 DEBUG:teuthology.orchestra.run.trial070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T09:49:22.690 INFO:teuthology.orchestra.run.trial070.stdout:check_obsoletes = 1 2026-02-17T09:49:22.692 DEBUG:teuthology.orchestra.run.trial070:> sudo yum clean all 2026-02-17T09:49:22.842 INFO:teuthology.orchestra.run.trial070.stdout:41 files removed 2026-02-17T09:49:22.855 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-radosgw 2026-02-17T09:49:23.765 INFO:teuthology.orchestra.run.trial070.stdout:ceph packages for x86_64 123 kB/s | 94 kB 00:00 2026-02-17T09:49:24.367 INFO:teuthology.orchestra.run.trial070.stdout:ceph noarch packages 42 kB/s | 24 kB 00:00 2026-02-17T09:49:24.933 INFO:teuthology.orchestra.run.trial070.stdout:ceph source packages 3.8 kB/s | 2.1 kB 00:00 2026-02-17T09:49:26.007 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - BaseOS 8.4 MB/s | 8.9 MB 00:01 2026-02-17T09:49:29.169 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T09:49:32.652 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - CRB 7.0 MB/s | 7.8 MB 00:01 2026-02-17T09:49:33.834 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 20 kB 00:00 2026-02-17T09:49:34.780 INFO:teuthology.orchestra.run.trial070.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2026-02-17T09:49:38.003 INFO:teuthology.orchestra.run.trial070.stdout:lab-extras 1.3 MB/s | 50 kB 00:00 2026-02-17T09:49:39.221 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:49:39.223 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:49:39.223 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repository Size 2026-02-17T09:49:39.223 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:49:39.223 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-17T09:49:39.223 INFO:teuthology.orchestra.run.trial070.stdout: ceph-radosgw x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 11 M 2026-02-17T09:49:39.223 INFO:teuthology.orchestra.run.trial070.stdout:Upgrading: 2026-02-17T09:49:39.223 INFO:teuthology.orchestra.run.trial070.stdout: librados2 x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 3.3 M 2026-02-17T09:49:39.223 INFO:teuthology.orchestra.run.trial070.stdout: librbd1 x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 2.7 M 2026-02-17T09:49:39.223 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-17T09:49:39.223 INFO:teuthology.orchestra.run.trial070.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T09:49:39.224 INFO:teuthology.orchestra.run.trial070.stdout: ceph-base x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 5.1 M 2026-02-17T09:49:39.224 INFO:teuthology.orchestra.run.trial070.stdout: ceph-common x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 21 M 2026-02-17T09:49:39.224 INFO:teuthology.orchestra.run.trial070.stdout: ceph-selinux x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 25 k 2026-02-17T09:49:39.224 INFO:teuthology.orchestra.run.trial070.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T09:49:39.224 INFO:teuthology.orchestra.run.trial070.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T09:49:39.224 INFO:teuthology.orchestra.run.trial070.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T09:49:39.224 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs2 x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 859 k 2026-02-17T09:49:39.224 INFO:teuthology.orchestra.run.trial070.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T09:49:39.224 INFO:teuthology.orchestra.run.trial070.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T09:49:39.224 INFO:teuthology.orchestra.run.trial070.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T09:49:39.224 INFO:teuthology.orchestra.run.trial070.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T09:49:39.224 INFO:teuthology.orchestra.run.trial070.stdout: libradosstriper1 x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 263 k 2026-02-17T09:49:39.225 INFO:teuthology.orchestra.run.trial070.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T09:49:39.225 INFO:teuthology.orchestra.run.trial070.stdout: librgw2 x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 5.6 M 2026-02-17T09:49:39.225 INFO:teuthology.orchestra.run.trial070.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T09:49:39.225 INFO:teuthology.orchestra.run.trial070.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T09:49:39.225 INFO:teuthology.orchestra.run.trial070.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T09:49:39.225 INFO:teuthology.orchestra.run.trial070.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T09:49:39.225 INFO:teuthology.orchestra.run.trial070.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T09:49:39.225 INFO:teuthology.orchestra.run.trial070.stdout: python3-ceph-argparse x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 45 k 2026-02-17T09:49:39.225 INFO:teuthology.orchestra.run.trial070.stdout: python3-ceph-common x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 185 k 2026-02-17T09:49:39.225 INFO:teuthology.orchestra.run.trial070.stdout: python3-cephfs x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 204 k 2026-02-17T09:49:39.225 INFO:teuthology.orchestra.run.trial070.stdout: python3-rados x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 325 k 2026-02-17T09:49:39.225 INFO:teuthology.orchestra.run.trial070.stdout: python3-rbd x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 306 k 2026-02-17T09:49:39.225 INFO:teuthology.orchestra.run.trial070.stdout: python3-rgw x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 100 k 2026-02-17T09:49:39.226 INFO:teuthology.orchestra.run.trial070.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T09:49:39.226 INFO:teuthology.orchestra.run.trial070.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T09:49:39.226 INFO:teuthology.orchestra.run.trial070.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T09:49:39.226 INFO:teuthology.orchestra.run.trial070.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T09:49:39.226 INFO:teuthology.orchestra.run.trial070.stdout:Installing weak dependencies: 2026-02-17T09:49:39.226 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs-daemon x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 37 k 2026-02-17T09:49:39.226 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 26 k 2026-02-17T09:49:39.226 INFO:teuthology.orchestra.run.trial070.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T09:49:39.226 INFO:teuthology.orchestra.run.trial070.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T09:49:39.226 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:49:39.226 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-17T09:49:39.226 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:49:39.227 INFO:teuthology.orchestra.run.trial070.stdout:Install 35 Packages 2026-02-17T09:49:39.227 INFO:teuthology.orchestra.run.trial070.stdout:Upgrade 2 Packages 2026-02-17T09:49:39.227 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:49:39.227 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 61 M 2026-02-17T09:49:39.227 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-17T09:49:41.182 INFO:teuthology.orchestra.run.trial070.stdout:(1/37): ceph-base-20.3.0-5345.gb58fab16.el9.x86 3.5 MB/s | 5.1 MB 00:01 2026-02-17T09:49:41.242 INFO:teuthology.orchestra.run.trial070.stdout:(2/37): ceph-selinux-20.3.0-5345.gb58fab16.el9. 420 kB/s | 25 kB 00:00 2026-02-17T09:49:41.303 INFO:teuthology.orchestra.run.trial070.stdout:(3/37): libcephfs-daemon-20.3.0-5345.gb58fab16. 612 kB/s | 37 kB 00:00 2026-02-17T09:49:41.363 INFO:teuthology.orchestra.run.trial070.stdout:(4/37): libcephfs-proxy2-20.3.0-5345.gb58fab16. 421 kB/s | 26 kB 00:00 2026-02-17T09:49:41.562 INFO:teuthology.orchestra.run.trial070.stdout:(5/37): libcephfs2-20.3.0-5345.gb58fab16.el9.x8 4.2 MB/s | 859 kB 00:00 2026-02-17T09:49:41.630 INFO:teuthology.orchestra.run.trial070.stdout:(6/37): libradosstriper1-20.3.0-5345.gb58fab16. 3.8 MB/s | 263 kB 00:00 2026-02-17T09:49:42.757 INFO:teuthology.orchestra.run.trial070.stdout:(7/37): librgw2-20.3.0-5345.gb58fab16.el9.x86_6 5.0 MB/s | 5.6 MB 00:01 2026-02-17T09:49:42.820 INFO:teuthology.orchestra.run.trial070.stdout:(8/37): python3-ceph-argparse-20.3.0-5345.gb58f 710 kB/s | 45 kB 00:00 2026-02-17T09:49:42.891 INFO:teuthology.orchestra.run.trial070.stdout:(9/37): python3-ceph-common-20.3.0-5345.gb58fab 2.6 MB/s | 185 kB 00:00 2026-02-17T09:49:42.954 INFO:teuthology.orchestra.run.trial070.stdout:(10/37): python3-cephfs-20.3.0-5345.gb58fab16.e 3.1 MB/s | 204 kB 00:00 2026-02-17T09:49:43.078 INFO:teuthology.orchestra.run.trial070.stdout:(11/37): python3-rados-20.3.0-5345.gb58fab16.el 2.6 MB/s | 325 kB 00:00 2026-02-17T09:49:43.144 INFO:teuthology.orchestra.run.trial070.stdout:(12/37): python3-rbd-20.3.0-5345.gb58fab16.el9. 4.6 MB/s | 306 kB 00:00 2026-02-17T09:49:43.206 INFO:teuthology.orchestra.run.trial070.stdout:(13/37): python3-rgw-20.3.0-5345.gb58fab16.el9. 1.6 MB/s | 100 kB 00:00 2026-02-17T09:49:43.255 INFO:teuthology.orchestra.run.trial070.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 670 kB/s | 33 kB 00:00 2026-02-17T09:49:43.294 INFO:teuthology.orchestra.run.trial070.stdout:(15/37): nvme-cli-2.13-1.el9.x86_64.rpm 29 MB/s | 1.1 MB 00:00 2026-02-17T09:49:43.314 INFO:teuthology.orchestra.run.trial070.stdout:(16/37): ceph-radosgw-20.3.0-5345.gb58fab16.el9 3.1 MB/s | 11 MB 00:03 2026-02-17T09:49:43.316 INFO:teuthology.orchestra.run.trial070.stdout:(17/37): pciutils-3.7.0-7.el9.x86_64.rpm 4.1 MB/s | 93 kB 00:00 2026-02-17T09:49:43.335 INFO:teuthology.orchestra.run.trial070.stdout:(18/37): boost-program-options-1.75.0-13.el9.x8 4.7 MB/s | 104 kB 00:00 2026-02-17T09:49:43.336 INFO:teuthology.orchestra.run.trial070.stdout:(19/37): libnbd-1.20.3-4.el9.x86_64.rpm 7.9 MB/s | 164 kB 00:00 2026-02-17T09:49:43.341 INFO:teuthology.orchestra.run.trial070.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 9.8 MB/s | 45 kB 00:00 2026-02-17T09:49:43.344 INFO:teuthology.orchestra.run.trial070.stdout:(21/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 18 MB/s | 160 kB 00:00 2026-02-17T09:49:43.353 INFO:teuthology.orchestra.run.trial070.stdout:(22/37): librdkafka-1.6.1-102.el9.x86_64.rpm 52 MB/s | 662 kB 00:00 2026-02-17T09:49:43.357 INFO:teuthology.orchestra.run.trial070.stdout:(23/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 23 MB/s | 292 kB 00:00 2026-02-17T09:49:43.360 INFO:teuthology.orchestra.run.trial070.stdout:(24/37): qatlib-25.08.0-2.el9.x86_64.rpm 38 MB/s | 240 kB 00:00 2026-02-17T09:49:43.361 INFO:teuthology.orchestra.run.trial070.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 8.4 MB/s | 37 kB 00:00 2026-02-17T09:49:43.364 INFO:teuthology.orchestra.run.trial070.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 14 MB/s | 66 kB 00:00 2026-02-17T09:49:43.653 INFO:teuthology.orchestra.run.trial070.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.0 MB/s | 308 kB 00:00 2026-02-17T09:49:43.692 INFO:teuthology.orchestra.run.trial070.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 635 kB/s | 25 kB 00:00 2026-02-17T09:49:43.732 INFO:teuthology.orchestra.run.trial070.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2026-02-17T09:49:43.775 INFO:teuthology.orchestra.run.trial070.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2026-02-17T09:49:43.802 INFO:teuthology.orchestra.run.trial070.stdout:(31/37): libarrow-9.0.0-15.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2026-02-17T09:49:43.841 INFO:teuthology.orchestra.run.trial070.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 4.8 MB/s | 191 kB 00:00 2026-02-17T09:49:43.883 INFO:teuthology.orchestra.run.trial070.stdout:(33/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 7.6 MB/s | 838 kB 00:00 2026-02-17T09:49:43.889 INFO:teuthology.orchestra.run.trial070.stdout:(34/37): thrift-0.15.0-4.el9.x86_64.rpm 33 MB/s | 1.6 MB 00:00 2026-02-17T09:49:44.562 INFO:teuthology.orchestra.run.trial070.stdout:(35/37): librados2-20.3.0-5345.gb58fab16.el9.x8 4.8 MB/s | 3.3 MB 00:00 2026-02-17T09:49:44.571 INFO:teuthology.orchestra.run.trial070.stdout:(36/37): librbd1-20.3.0-5345.gb58fab16.el9.x86_ 3.9 MB/s | 2.7 MB 00:00 2026-02-17T09:49:45.885 INFO:teuthology.orchestra.run.trial070.stdout:(37/37): ceph-common-20.3.0-5345.gb58fab16.el9. 3.4 MB/s | 21 MB 00:06 2026-02-17T09:49:45.888 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-17T09:49:45.888 INFO:teuthology.orchestra.run.trial070.stdout:Total 9.2 MB/s | 61 MB 00:06 2026-02-17T09:49:45.991 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-17T09:49:46.012 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-17T09:49:46.012 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-17T09:49:46.247 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-17T09:49:46.247 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-17T09:49:46.537 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-17T09:49:46.676 INFO:teuthology.orchestra.run.trial070.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-17T09:49:46.680 INFO:teuthology.orchestra.run.trial070.stdout: Upgrading : librados2-2:20.3.0-5345.gb58fab16.el9.x86_64 2/39 2026-02-17T09:49:46.730 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librados2-2:20.3.0-5345.gb58fab16.el9.x86_64 2/39 2026-02-17T09:49:46.731 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libcephfs2-2:20.3.0-5345.gb58fab16.el9.x86_64 3/39 2026-02-17T09:49:46.744 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libcephfs2-2:20.3.0-5345.gb58fab16.el9.x86_64 3/39 2026-02-17T09:49:46.746 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libcephfs-daemon-2:20.3.0-5345.gb58fab16.el9.x86_6 4/39 2026-02-17T09:49:46.746 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libcephfs-proxy2-2:20.3.0-5345.gb58fab16.el9.x86_6 5/39 2026-02-17T09:49:46.773 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5345.gb58fab16.el9.x86_6 5/39 2026-02-17T09:49:46.776 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-rados-2:20.3.0-5345.gb58fab16.el9.x86_64 6/39 2026-02-17T09:49:46.783 INFO:teuthology.orchestra.run.trial070.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-17T09:49:46.786 INFO:teuthology.orchestra.run.trial070.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-17T09:49:46.791 INFO:teuthology.orchestra.run.trial070.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-17T09:49:46.795 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-17T09:49:46.806 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-ceph-argparse-2:20.3.0-5345.gb58fab16.el9. 11/39 2026-02-17T09:49:46.818 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cephfs-2:20.3.0-5345.gb58fab16.el9.x86_64 12/39 2026-02-17T09:49:46.819 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libradosstriper1-2:20.3.0-5345.gb58fab16.el9.x86_6 13/39 2026-02-17T09:49:46.840 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5345.gb58fab16.el9.x86_6 13/39 2026-02-17T09:49:46.844 INFO:teuthology.orchestra.run.trial070.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-17T09:49:46.873 INFO:teuthology.orchestra.run.trial070.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-17T09:49:46.877 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-17T09:49:46.884 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-17T09:49:46.886 INFO:teuthology.orchestra.run.trial070.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-17T09:49:46.890 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-17T09:49:47.005 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-17T09:49:47.006 INFO:teuthology.orchestra.run.trial070.stdout: Upgrading : librbd1-2:20.3.0-5345.gb58fab16.el9.x86_64 21/39 2026-02-17T09:49:47.032 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librbd1-2:20.3.0-5345.gb58fab16.el9.x86_64 21/39 2026-02-17T09:49:47.034 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-rbd-2:20.3.0-5345.gb58fab16.el9.x86_64 22/39 2026-02-17T09:49:47.040 INFO:teuthology.orchestra.run.trial070.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-17T09:49:47.288 INFO:teuthology.orchestra.run.trial070.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-17T09:49:47.289 INFO:teuthology.orchestra.run.trial070.stdout: Installing : librgw2-2:20.3.0-5345.gb58fab16.el9.x86_64 25/39 2026-02-17T09:49:47.307 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librgw2-2:20.3.0-5345.gb58fab16.el9.x86_64 25/39 2026-02-17T09:49:47.310 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-rgw-2:20.3.0-5345.gb58fab16.el9.x86_64 26/39 2026-02-17T09:49:47.315 INFO:teuthology.orchestra.run.trial070.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-17T09:49:47.317 INFO:teuthology.orchestra.run.trial070.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-17T09:49:47.318 INFO:teuthology.orchestra.run.trial070.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-17T09:49:47.337 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-17T09:49:47.450 INFO:teuthology.orchestra.run.trial070.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-17T09:49:47.452 INFO:teuthology.orchestra.run.trial070.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-17T09:49:47.726 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-17T09:49:47.727 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T09:49:47.727 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:49:47.772 INFO:teuthology.orchestra.run.trial070.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-17T09:49:47.773 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-ceph-common-2:20.3.0-5345.gb58fab16.el9.x8 33/39 2026-02-17T09:49:48.715 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-common-2:20.3.0-5345.gb58fab16.el9.x86_64 34/39 2026-02-17T09:49:48.718 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-common-2:20.3.0-5345.gb58fab16.el9.x86_64 34/39 2026-02-17T09:49:48.978 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-common-2:20.3.0-5345.gb58fab16.el9.x86_64 34/39 2026-02-17T09:49:48.981 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-base-2:20.3.0-5345.gb58fab16.el9.x86_64 35/39 2026-02-17T09:49:49.019 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-base-2:20.3.0-5345.gb58fab16.el9.x86_64 35/39 2026-02-17T09:49:49.020 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T09:49:49.020 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T09:49:49.020 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:49:49.023 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-selinux-2:20.3.0-5345.gb58fab16.el9.x86_64 36/39 2026-02-17T09:49:53.583 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5345.gb58fab16.el9.x86_64 36/39 2026-02-17T09:49:53.583 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /sys 2026-02-17T09:49:53.583 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /proc 2026-02-17T09:49:53.583 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /mnt 2026-02-17T09:49:53.583 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /var/tmp 2026-02-17T09:49:53.584 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /home 2026-02-17T09:49:53.584 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /root 2026-02-17T09:49:53.584 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /tmp 2026-02-17T09:49:53.584 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:49:54.076 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-radosgw-2:20.3.0-5345.gb58fab16.el9.x86_64 37/39 2026-02-17T09:49:54.099 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5345.gb58fab16.el9.x86_64 37/39 2026-02-17T09:49:54.099 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T09:49:54.100 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T09:49:54.100 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T09:49:54.100 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T09:49:54.100 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:49:54.101 INFO:teuthology.orchestra.run.trial070.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-17T09:49:54.114 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-17T09:49:54.114 INFO:teuthology.orchestra.run.trial070.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T09:49:54.169 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T09:49:54.169 INFO:teuthology.orchestra.run.trial070.stdout:Creating group 'qat' with GID 992. 2026-02-17T09:49:54.169 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:49:54.445 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-base-2:20.3.0-5345.gb58fab16.el9.x86_64 1/39 2026-02-17T09:49:54.445 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-common-2:20.3.0-5345.gb58fab16.el9.x86_64 2/39 2026-02-17T09:49:54.445 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-radosgw-2:20.3.0-5345.gb58fab16.el9.x86_64 3/39 2026-02-17T09:49:54.445 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-selinux-2:20.3.0-5345.gb58fab16.el9.x86_64 4/39 2026-02-17T09:49:54.445 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libcephfs-daemon-2:20.3.0-5345.gb58fab16.el9.x86_6 5/39 2026-02-17T09:49:54.445 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5345.gb58fab16.el9.x86_6 6/39 2026-02-17T09:49:54.445 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libcephfs2-2:20.3.0-5345.gb58fab16.el9.x86_64 7/39 2026-02-17T09:49:54.445 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libradosstriper1-2:20.3.0-5345.gb58fab16.el9.x86_6 8/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librgw2-2:20.3.0-5345.gb58fab16.el9.x86_64 9/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5345.gb58fab16.el9. 10/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-ceph-common-2:20.3.0-5345.gb58fab16.el9.x8 11/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cephfs-2:20.3.0-5345.gb58fab16.el9.x86_64 12/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-rados-2:20.3.0-5345.gb58fab16.el9.x86_64 13/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-rbd-2:20.3.0-5345.gb58fab16.el9.x86_64 14/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-rgw-2:20.3.0-5345.gb58fab16.el9.x86_64 15/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-17T09:49:54.446 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-17T09:49:54.447 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-17T09:49:54.447 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-17T09:49:54.447 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-17T09:49:54.447 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-17T09:49:54.447 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librados2-2:20.3.0-5345.gb58fab16.el9.x86_64 36/39 2026-02-17T09:49:54.447 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-17T09:49:54.447 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librbd1-2:20.3.0-5345.gb58fab16.el9.x86_64 38/39 2026-02-17T09:49:54.509 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T09:49:54.509 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:49:54.509 INFO:teuthology.orchestra.run.trial070.stdout:Upgraded: 2026-02-17T09:49:54.509 INFO:teuthology.orchestra.run.trial070.stdout: librados2-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:49:54.509 INFO:teuthology.orchestra.run.trial070.stdout: librbd1-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:49:54.509 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-17T09:49:54.509 INFO:teuthology.orchestra.run.trial070.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T09:49:54.509 INFO:teuthology.orchestra.run.trial070.stdout: ceph-base-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: ceph-common-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: ceph-radosgw-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: ceph-selinux-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs-daemon-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs-proxy2-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs2-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: libradosstriper1-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: librgw2-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T09:49:54.510 INFO:teuthology.orchestra.run.trial070.stdout: python3-ceph-argparse-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:49:54.511 INFO:teuthology.orchestra.run.trial070.stdout: python3-ceph-common-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:49:54.511 INFO:teuthology.orchestra.run.trial070.stdout: python3-cephfs-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:49:54.511 INFO:teuthology.orchestra.run.trial070.stdout: python3-rados-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:49:54.511 INFO:teuthology.orchestra.run.trial070.stdout: python3-rbd-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:49:54.511 INFO:teuthology.orchestra.run.trial070.stdout: python3-rgw-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:49:54.511 INFO:teuthology.orchestra.run.trial070.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T09:49:54.511 INFO:teuthology.orchestra.run.trial070.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T09:49:54.511 INFO:teuthology.orchestra.run.trial070.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T09:49:54.511 INFO:teuthology.orchestra.run.trial070.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T09:49:54.511 INFO:teuthology.orchestra.run.trial070.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T09:49:54.511 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:49:54.511 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:49:54.550 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-test 2026-02-17T09:49:54.862 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:16 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:49:54.945 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:49:54.946 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:49:54.946 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repository Size 2026-02-17T09:49:54.946 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:49:54.946 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-17T09:49:54.946 INFO:teuthology.orchestra.run.trial070.stdout: ceph-test x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 125 M 2026-02-17T09:49:54.946 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-17T09:49:54.946 INFO:teuthology.orchestra.run.trial070.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-17T09:49:54.946 INFO:teuthology.orchestra.run.trial070.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-17T09:49:54.946 INFO:teuthology.orchestra.run.trial070.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-17T09:49:54.947 INFO:teuthology.orchestra.run.trial070.stdout: libcephsqlite x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 153 k 2026-02-17T09:49:54.947 INFO:teuthology.orchestra.run.trial070.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-17T09:49:54.947 INFO:teuthology.orchestra.run.trial070.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T09:49:54.947 INFO:teuthology.orchestra.run.trial070.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-17T09:49:54.947 INFO:teuthology.orchestra.run.trial070.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T09:49:54.947 INFO:teuthology.orchestra.run.trial070.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T09:49:54.947 INFO:teuthology.orchestra.run.trial070.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T09:49:54.947 INFO:teuthology.orchestra.run.trial070.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-17T09:49:54.947 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:49:54.947 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-17T09:49:54.947 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:49:54.948 INFO:teuthology.orchestra.run.trial070.stdout:Install 12 Packages 2026-02-17T09:49:54.948 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:49:54.948 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 129 M 2026-02-17T09:49:54.948 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 963 M 2026-02-17T09:49:54.948 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-17T09:49:55.348 INFO:teuthology.orchestra.run.trial070.stdout:(1/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 12 MB/s | 2.1 MB 00:00 2026-02-17T09:49:55.370 INFO:teuthology.orchestra.run.trial070.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 1.0 MB/s | 23 kB 00:00 2026-02-17T09:49:55.393 INFO:teuthology.orchestra.run.trial070.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 4.1 MB/s | 94 kB 00:00 2026-02-17T09:49:55.421 INFO:teuthology.orchestra.run.trial070.stdout:(4/12): libasan8-15.2.1-7.el9.x86_64.rpm 18 MB/s | 525 kB 00:00 2026-02-17T09:49:55.427 INFO:teuthology.orchestra.run.trial070.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 29 MB/s | 176 kB 00:00 2026-02-17T09:49:55.433 INFO:teuthology.orchestra.run.trial070.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 38 MB/s | 233 kB 00:00 2026-02-17T09:49:55.465 INFO:teuthology.orchestra.run.trial070.stdout:(7/12): protobuf-3.14.0-17.el9.x86_64.rpm 32 MB/s | 1.0 MB 00:00 2026-02-17T09:49:55.474 INFO:teuthology.orchestra.run.trial070.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 32 MB/s | 303 kB 00:00 2026-02-17T09:49:55.479 INFO:teuthology.orchestra.run.trial070.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 14 MB/s | 64 kB 00:00 2026-02-17T09:49:55.596 INFO:teuthology.orchestra.run.trial070.stdout:(10/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.0 MB/s | 122 kB 00:00 2026-02-17T09:49:55.604 INFO:teuthology.orchestra.run.trial070.stdout:(11/12): libcephsqlite-20.3.0-5345.gb58fab16.el 353 kB/s | 153 kB 00:00 2026-02-17T09:50:09.753 INFO:teuthology.orchestra.run.trial070.stdout:(12/12): ceph-test-20.3.0-5345.gb58fab16.el9.x8 8.5 MB/s | 125 MB 00:14 2026-02-17T09:50:09.754 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-17T09:50:09.755 INFO:teuthology.orchestra.run.trial070.stdout:Total 8.7 MB/s | 129 MB 00:14 2026-02-17T09:50:09.835 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-17T09:50:09.847 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-17T09:50:09.847 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-17T09:50:10.271 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-17T09:50:10.272 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-17T09:50:10.725 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-17T09:50:10.733 INFO:teuthology.orchestra.run.trial070.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-17T09:50:10.742 INFO:teuthology.orchestra.run.trial070.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-17T09:50:10.747 INFO:teuthology.orchestra.run.trial070.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-17T09:50:10.751 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-17T09:50:10.753 INFO:teuthology.orchestra.run.trial070.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-17T09:50:10.757 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-17T09:50:10.758 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-17T09:50:10.777 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-17T09:50:10.779 INFO:teuthology.orchestra.run.trial070.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-17T09:50:10.791 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-17T09:50:10.799 INFO:teuthology.orchestra.run.trial070.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-17T09:50:10.800 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libcephsqlite-2:20.3.0-5345.gb58fab16.el9.x86_64 11/12 2026-02-17T09:50:17.594 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5345.gb58fab16.el9.x86_64 11/12 2026-02-17T09:50:17.612 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-test-2:20.3.0-5345.gb58fab16.el9.x86_64 12/12 2026-02-17T09:50:18.383 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-test-2:20.3.0-5345.gb58fab16.el9.x86_64 12/12 2026-02-17T09:50:18.383 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-test-2:20.3.0-5345.gb58fab16.el9.x86_64 1/12 2026-02-17T09:50:18.384 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libcephsqlite-2:20.3.0-5345.gb58fab16.el9.x86_64 2/12 2026-02-17T09:50:18.384 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-17T09:50:18.384 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-17T09:50:18.384 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-17T09:50:18.384 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-17T09:50:18.384 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-17T09:50:18.384 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-17T09:50:18.384 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-17T09:50:18.384 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-17T09:50:18.384 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-17T09:50:18.437 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-17T09:50:18.437 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:18.438 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-17T09:50:18.438 INFO:teuthology.orchestra.run.trial070.stdout: ceph-test-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:50:18.438 INFO:teuthology.orchestra.run.trial070.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-17T09:50:18.438 INFO:teuthology.orchestra.run.trial070.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-17T09:50:18.438 INFO:teuthology.orchestra.run.trial070.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-17T09:50:18.438 INFO:teuthology.orchestra.run.trial070.stdout: libcephsqlite-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:50:18.438 INFO:teuthology.orchestra.run.trial070.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-17T09:50:18.438 INFO:teuthology.orchestra.run.trial070.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T09:50:18.438 INFO:teuthology.orchestra.run.trial070.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-17T09:50:18.438 INFO:teuthology.orchestra.run.trial070.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T09:50:18.438 INFO:teuthology.orchestra.run.trial070.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T09:50:18.438 INFO:teuthology.orchestra.run.trial070.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T09:50:18.439 INFO:teuthology.orchestra.run.trial070.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-17T09:50:18.439 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:18.439 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:50:18.481 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph 2026-02-17T09:50:18.791 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:50:18.876 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:50:18.878 INFO:teuthology.orchestra.run.trial070.stdout:======================================================================================= 2026-02-17T09:50:18.878 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repository Size 2026-02-17T09:50:18.878 INFO:teuthology.orchestra.run.trial070.stdout:======================================================================================= 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: ceph x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 6.5 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5345.gb58fab16.el9 ceph-noarch 57 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mds x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 2.0 M 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 937 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5345.gb58fab16.el9 ceph-noarch 297 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mon x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 4.9 M 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 163 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd-classic x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 15 M 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd-crimson x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 85 M 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5345.gb58fab16.el9 ceph-noarch 17 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: cephadm noarch 2:20.3.0-5345.gb58fab16.el9 ceph-noarch 1.0 M 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T09:50:18.879 INFO:teuthology.orchestra.run.trial070.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T09:50:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout:Installing weak dependencies: 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5345.gb58fab16.el9 ceph-noarch 184 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5345.gb58fab16.el9 ceph-noarch 51 M 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5345.gb58fab16.el9 ceph-noarch 7.4 M 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5345.gb58fab16.el9 ceph-noarch 22 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-rook noarch 2:20.3.0-5345.gb58fab16.el9 ceph-noarch 50 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: ceph-volume noarch 2:20.3.0-5345.gb58fab16.el9 ceph-noarch 301 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout:======================================================================================= 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout:Install 96 Packages 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 223 M 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 1.5 G 2026-02-17T09:50:18.881 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-17T09:50:19.723 INFO:teuthology.orchestra.run.trial070.stdout:(1/96): ceph-20.3.0-5345.gb58fab16.el9.x86_64.r 22 kB/s | 6.5 kB 00:00 2026-02-17T09:50:20.179 INFO:teuthology.orchestra.run.trial070.stdout:(2/96): ceph-mgr-20.3.0-5345.gb58fab16.el9.x86_ 1.2 MB/s | 937 kB 00:00 2026-02-17T09:50:20.236 INFO:teuthology.orchestra.run.trial070.stdout:(3/96): ceph-osd-20.3.0-5345.gb58fab16.el9.x86_ 2.8 MB/s | 163 kB 00:00 2026-02-17T09:50:20.327 INFO:teuthology.orchestra.run.trial070.stdout:(4/96): ceph-mds-20.3.0-5345.gb58fab16.el9.x86_ 2.3 MB/s | 2.0 MB 00:00 2026-02-17T09:50:22.028 INFO:teuthology.orchestra.run.trial070.stdout:(5/96): ceph-mon-20.3.0-5345.gb58fab16.el9.x86_ 2.1 MB/s | 4.9 MB 00:02 2026-02-17T09:50:22.096 INFO:teuthology.orchestra.run.trial070.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5345.gb5 842 kB/s | 57 kB 00:00 2026-02-17T09:50:22.233 INFO:teuthology.orchestra.run.trial070.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5345.gb58fab16. 1.3 MB/s | 184 kB 00:00 2026-02-17T09:50:23.440 INFO:teuthology.orchestra.run.trial070.stdout:(8/96): ceph-osd-classic-20.3.0-5345.gb58fab16. 4.6 MB/s | 15 MB 00:03 2026-02-17T09:50:24.812 INFO:teuthology.orchestra.run.trial070.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-53 5.4 MB/s | 7.4 MB 00:01 2026-02-17T09:50:24.871 INFO:teuthology.orchestra.run.trial070.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5345.gb58fab 378 kB/s | 22 kB 00:00 2026-02-17T09:50:24.935 INFO:teuthology.orchestra.run.trial070.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5345.gb58 4.5 MB/s | 297 kB 00:00 2026-02-17T09:50:24.995 INFO:teuthology.orchestra.run.trial070.stdout:(12/96): ceph-mgr-rook-20.3.0-5345.gb58fab16.el 838 kB/s | 50 kB 00:00 2026-02-17T09:50:25.055 INFO:teuthology.orchestra.run.trial070.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5345.gb5 292 kB/s | 17 kB 00:00 2026-02-17T09:50:25.120 INFO:teuthology.orchestra.run.trial070.stdout:(14/96): ceph-volume-20.3.0-5345.gb58fab16.el9. 4.5 MB/s | 301 kB 00:00 2026-02-17T09:50:25.317 INFO:teuthology.orchestra.run.trial070.stdout:(15/96): cephadm-20.3.0-5345.gb58fab16.el9.noar 5.2 MB/s | 1.0 MB 00:00 2026-02-17T09:50:25.485 INFO:teuthology.orchestra.run.trial070.stdout:(16/96): cryptsetup-2.8.1-2.el9.x86_64.rpm 2.0 MB/s | 350 kB 00:00 2026-02-17T09:50:25.511 INFO:teuthology.orchestra.run.trial070.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.5 MB/s | 40 kB 00:00 2026-02-17T09:50:25.538 INFO:teuthology.orchestra.run.trial070.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 2.6 MB/s | 72 kB 00:00 2026-02-17T09:50:25.602 INFO:teuthology.orchestra.run.trial070.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 12 MB/s | 794 kB 00:00 2026-02-17T09:50:25.630 INFO:teuthology.orchestra.run.trial070.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 6.4 MB/s | 184 kB 00:00 2026-02-17T09:50:25.659 INFO:teuthology.orchestra.run.trial070.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 8.5 MB/s | 253 kB 00:00 2026-02-17T09:50:25.709 INFO:teuthology.orchestra.run.trial070.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 25 MB/s | 1.2 MB 00:00 2026-02-17T09:50:25.736 INFO:teuthology.orchestra.run.trial070.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 3.9 MB/s | 106 kB 00:00 2026-02-17T09:50:25.763 INFO:teuthology.orchestra.run.trial070.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 4.8 MB/s | 135 kB 00:00 2026-02-17T09:50:25.791 INFO:teuthology.orchestra.run.trial070.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 5.3 MB/s | 150 kB 00:00 2026-02-17T09:50:25.820 INFO:teuthology.orchestra.run.trial070.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 4.3 MB/s | 126 kB 00:00 2026-02-17T09:50:25.848 INFO:teuthology.orchestra.run.trial070.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 7.7 MB/s | 218 kB 00:00 2026-02-17T09:50:25.877 INFO:teuthology.orchestra.run.trial070.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 6.1 MB/s | 182 kB 00:00 2026-02-17T09:50:25.910 INFO:teuthology.orchestra.run.trial070.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 7.9 MB/s | 266 kB 00:00 2026-02-17T09:50:26.376 INFO:teuthology.orchestra.run.trial070.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 63 kB/s | 30 kB 00:00 2026-02-17T09:50:30.001 INFO:teuthology.orchestra.run.trial070.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 844 kB/s | 3.0 MB 00:03 2026-02-17T09:50:30.104 INFO:teuthology.orchestra.run.trial070.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 144 kB/s | 15 kB 00:00 2026-02-17T09:50:30.450 INFO:teuthology.orchestra.run.trial070.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 711 kB/s | 246 kB 00:00 2026-02-17T09:50:30.717 INFO:teuthology.orchestra.run.trial070.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 708 kB/s | 188 kB 00:00 2026-02-17T09:50:30.818 INFO:teuthology.orchestra.run.trial070.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 413 kB/s | 42 kB 00:00 2026-02-17T09:50:31.914 INFO:teuthology.orchestra.run.trial070.stdout:(36/96): ceph-osd-crimson-20.3.0-5345.gb58fab16 7.4 MB/s | 85 MB 00:11 2026-02-17T09:50:32.655 INFO:teuthology.orchestra.run.trial070.stdout:(37/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 2.9 MB/s | 5.3 MB 00:01 2026-02-17T09:50:32.759 INFO:teuthology.orchestra.run.trial070.stdout:(38/96): python3-devel-3.9.25-2.el9.x86_64.rpm 2.3 MB/s | 244 kB 00:00 2026-02-17T09:50:32.863 INFO:teuthology.orchestra.run.trial070.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 2.3 MB/s | 249 kB 00:00 2026-02-17T09:50:32.966 INFO:teuthology.orchestra.run.trial070.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 462 kB/s | 48 kB 00:00 2026-02-17T09:50:33.070 INFO:teuthology.orchestra.run.trial070.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 1.7 MB/s | 177 kB 00:00 2026-02-17T09:50:33.217 INFO:teuthology.orchestra.run.trial070.stdout:(42/96): ceph-mgr-dashboard-20.3.0-5345.gb58fab 4.6 MB/s | 51 MB 00:10 2026-02-17T09:50:33.462 INFO:teuthology.orchestra.run.trial070.stdout:(43/96): python3-babel-2.9.1-2.el9.noarch.rpm 3.9 MB/s | 6.0 MB 00:01 2026-02-17T09:50:33.464 INFO:teuthology.orchestra.run.trial070.stdout:(44/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 3.1 MB/s | 1.2 MB 00:00 2026-02-17T09:50:33.588 INFO:teuthology.orchestra.run.trial070.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 3.5 MB/s | 442 kB 00:00 2026-02-17T09:50:33.653 INFO:teuthology.orchestra.run.trial070.stdout:(46/96): python3-markupsafe-1.1.1-12.el9.x86_64 80 kB/s | 35 kB 00:00 2026-02-17T09:50:33.692 INFO:teuthology.orchestra.run.trial070.stdout:(47/96): python3-packaging-20.9-5.el9.noarch.rp 745 kB/s | 77 kB 00:00 2026-02-17T09:50:33.796 INFO:teuthology.orchestra.run.trial070.stdout:(48/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2026-02-17T09:50:33.900 INFO:teuthology.orchestra.run.trial070.stdout:(49/96): python3-pyasn1-modules-0.4.8-6.el9.noa 2.6 MB/s | 279 kB 00:00 2026-02-17T09:50:34.001 INFO:teuthology.orchestra.run.trial070.stdout:(50/96): python3-protobuf-3.14.0-17.el9.noarch. 769 kB/s | 267 kB 00:00 2026-02-17T09:50:34.003 INFO:teuthology.orchestra.run.trial070.stdout:(51/96): python3-requests-oauthlib-1.3.0-12.el9 521 kB/s | 54 kB 00:00 2026-02-17T09:50:34.106 INFO:teuthology.orchestra.run.trial070.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 406 kB/s | 42 kB 00:00 2026-02-17T09:50:34.372 INFO:teuthology.orchestra.run.trial070.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 710 kB/s | 189 kB 00:00 2026-02-17T09:50:34.556 INFO:teuthology.orchestra.run.trial070.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 492 kB/s | 90 kB 00:00 2026-02-17T09:50:34.632 INFO:teuthology.orchestra.run.trial070.stdout:(55/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 5.2 MB/s | 6.1 MB 00:01 2026-02-17T09:50:34.659 INFO:teuthology.orchestra.run.trial070.stdout:(56/96): lua-devel-5.4.4-4.el9.x86_64.rpm 216 kB/s | 22 kB 00:00 2026-02-17T09:50:34.729 INFO:teuthology.orchestra.run.trial070.stdout:(57/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 7.7 MB/s | 551 kB 00:00 2026-02-17T09:50:34.739 INFO:teuthology.orchestra.run.trial070.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 2.0 MB/s | 19 kB 00:00 2026-02-17T09:50:34.750 INFO:teuthology.orchestra.run.trial070.stdout:(59/96): luarocks-3.9.2-5.el9.noarch.rpm 14 MB/s | 151 kB 00:00 2026-02-17T09:50:34.765 INFO:teuthology.orchestra.run.trial070.stdout:(60/96): python3-asyncssh-2.13.2-5.el9.noarch.r 36 MB/s | 548 kB 00:00 2026-02-17T09:50:34.775 INFO:teuthology.orchestra.run.trial070.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 2.9 MB/s | 29 kB 00:00 2026-02-17T09:50:34.785 INFO:teuthology.orchestra.run.trial070.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 5.8 MB/s | 60 kB 00:00 2026-02-17T09:50:34.795 INFO:teuthology.orchestra.run.trial070.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 4.2 MB/s | 43 kB 00:00 2026-02-17T09:50:34.806 INFO:teuthology.orchestra.run.trial070.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 3.2 MB/s | 32 kB 00:00 2026-02-17T09:50:34.815 INFO:teuthology.orchestra.run.trial070.stdout:(65/96): python3-certifi-2023.05.07-4.el9.noarc 1.4 MB/s | 14 kB 00:00 2026-02-17T09:50:34.817 INFO:teuthology.orchestra.run.trial070.stdout:(66/96): protobuf-compiler-3.14.0-17.el9.x86_64 4.5 MB/s | 862 kB 00:00 2026-02-17T09:50:34.827 INFO:teuthology.orchestra.run.trial070.stdout:(67/96): python3-cheroot-10.0.1-4.el9.noarch.rp 14 MB/s | 173 kB 00:00 2026-02-17T09:50:34.842 INFO:teuthology.orchestra.run.trial070.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 17 MB/s | 254 kB 00:00 2026-02-17T09:50:34.870 INFO:teuthology.orchestra.run.trial070.stdout:(69/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 72 MB/s | 2.0 MB 00:00 2026-02-17T09:50:34.877 INFO:teuthology.orchestra.run.trial070.stdout:(70/96): python3-cherrypy-18.6.1-2.el9.noarch.r 5.9 MB/s | 358 kB 00:00 2026-02-17T09:50:34.883 INFO:teuthology.orchestra.run.trial070.stdout:(71/96): python3-grpcio-tools-1.46.7-10.el9.x86 12 MB/s | 144 kB 00:00 2026-02-17T09:50:34.889 INFO:teuthology.orchestra.run.trial070.stdout:(72/96): python3-influxdb-5.3.1-1.el9.noarch.rp 12 MB/s | 139 kB 00:00 2026-02-17T09:50:34.893 INFO:teuthology.orchestra.run.trial070.stdout:(73/96): python3-isodate-0.6.1-3.el9.noarch.rpm 5.2 MB/s | 56 kB 00:00 2026-02-17T09:50:34.898 INFO:teuthology.orchestra.run.trial070.stdout:(74/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 1.1 MB/s | 11 kB 00:00 2026-02-17T09:50:34.903 INFO:teuthology.orchestra.run.trial070.stdout:(75/96): python3-jaraco-classes-3.2.1-5.el9.noa 1.8 MB/s | 18 kB 00:00 2026-02-17T09:50:34.908 INFO:teuthology.orchestra.run.trial070.stdout:(76/96): python3-jaraco-collections-3.0.0-8.el9 2.3 MB/s | 23 kB 00:00 2026-02-17T09:50:34.913 INFO:teuthology.orchestra.run.trial070.stdout:(77/96): python3-jaraco-context-6.0.1-3.el9.noa 2.0 MB/s | 20 kB 00:00 2026-02-17T09:50:34.918 INFO:teuthology.orchestra.run.trial070.stdout:(78/96): python3-jaraco-functools-3.5.0-2.el9.n 2.0 MB/s | 19 kB 00:00 2026-02-17T09:50:34.923 INFO:teuthology.orchestra.run.trial070.stdout:(79/96): python3-jaraco-text-4.0.0-2.el9.noarch 2.6 MB/s | 26 kB 00:00 2026-02-17T09:50:34.933 INFO:teuthology.orchestra.run.trial070.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 7.7 MB/s | 79 kB 00:00 2026-02-17T09:50:34.944 INFO:teuthology.orchestra.run.trial070.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 7.5 MB/s | 86 kB 00:00 2026-02-17T09:50:34.948 INFO:teuthology.orchestra.run.trial070.stdout:(82/96): python3-kubernetes-26.1.0-3.el9.noarch 34 MB/s | 1.0 MB 00:00 2026-02-17T09:50:34.955 INFO:teuthology.orchestra.run.trial070.stdout:(83/96): python3-natsort-7.1.1-5.el9.noarch.rpm 5.4 MB/s | 58 kB 00:00 2026-02-17T09:50:34.958 INFO:teuthology.orchestra.run.trial070.stdout:(84/96): python3-portend-3.1.0-2.el9.noarch.rpm 1.6 MB/s | 16 kB 00:00 2026-02-17T09:50:34.966 INFO:teuthology.orchestra.run.trial070.stdout:(85/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 8.1 MB/s | 90 kB 00:00 2026-02-17T09:50:34.969 INFO:teuthology.orchestra.run.trial070.stdout:(86/96): python3-repoze-lru-0.7-16.el9.noarch.r 2.9 MB/s | 31 kB 00:00 2026-02-17T09:50:34.977 INFO:teuthology.orchestra.run.trial070.stdout:(87/96): python3-routes-2.5.1-5.el9.noarch.rpm 17 MB/s | 188 kB 00:00 2026-02-17T09:50:34.979 INFO:teuthology.orchestra.run.trial070.stdout:(88/96): python3-rsa-4.9-2.el9.noarch.rpm 5.6 MB/s | 59 kB 00:00 2026-02-17T09:50:34.988 INFO:teuthology.orchestra.run.trial070.stdout:(89/96): python3-saml-1.16.0-1.el9.noarch.rpm 11 MB/s | 125 kB 00:00 2026-02-17T09:50:34.989 INFO:teuthology.orchestra.run.trial070.stdout:(90/96): python3-tempora-5.0.0-2.el9.noarch.rpm 3.5 MB/s | 36 kB 00:00 2026-02-17T09:50:34.998 INFO:teuthology.orchestra.run.trial070.stdout:(91/96): python3-typing-extensions-4.15.0-1.el9 8.3 MB/s | 86 kB 00:00 2026-02-17T09:50:35.000 INFO:teuthology.orchestra.run.trial070.stdout:(92/96): python3-websocket-client-1.2.3-2.el9.n 8.1 MB/s | 90 kB 00:00 2026-02-17T09:50:35.009 INFO:teuthology.orchestra.run.trial070.stdout:(93/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 4.6 MB/s | 48 kB 00:00 2026-02-17T09:50:35.010 INFO:teuthology.orchestra.run.trial070.stdout:(94/96): python3-xmltodict-0.12.0-15.el9.noarch 2.2 MB/s | 22 kB 00:00 2026-02-17T09:50:35.019 INFO:teuthology.orchestra.run.trial070.stdout:(95/96): python3-zc-lockfile-2.0-10.el9.noarch. 1.9 MB/s | 20 kB 00:00 2026-02-17T09:50:35.538 INFO:teuthology.orchestra.run.trial070.stdout:(96/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 13 MB/s | 19 MB 00:01 2026-02-17T09:50:35.541 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-17T09:50:35.542 INFO:teuthology.orchestra.run.trial070.stdout:Total 13 MB/s | 223 MB 00:16 2026-02-17T09:50:35.963 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-17T09:50:36.002 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-17T09:50:36.002 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-17T09:50:36.794 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-17T09:50:36.795 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-17T09:50:37.609 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-17T09:50:37.611 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-17T09:50:37.615 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-17T09:50:37.638 INFO:teuthology.orchestra.run.trial070.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-17T09:50:37.672 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-17T09:50:37.678 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-17T09:50:37.681 INFO:teuthology.orchestra.run.trial070.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-17T09:50:37.685 INFO:teuthology.orchestra.run.trial070.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-17T09:50:37.708 INFO:teuthology.orchestra.run.trial070.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-17T09:50:37.721 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-17T09:50:37.724 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-17T09:50:37.730 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-17T09:50:37.731 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-17T09:50:37.743 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-17T09:50:37.749 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-17T09:50:37.773 INFO:teuthology.orchestra.run.trial070.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-17T09:50:37.776 INFO:teuthology.orchestra.run.trial070.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-17T09:50:37.826 INFO:teuthology.orchestra.run.trial070.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-17T09:50:37.838 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-17T09:50:37.841 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-17T09:50:37.845 INFO:teuthology.orchestra.run.trial070.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-17T09:50:37.850 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-17T09:50:37.855 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-17T09:50:37.858 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-17T09:50:37.873 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-17T09:50:37.877 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-17T09:50:37.882 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-17T09:50:37.893 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-17T09:50:37.903 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-17T09:50:37.909 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-17T09:50:37.929 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-17T09:50:37.940 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-17T09:50:37.955 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-17T09:50:37.960 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-17T09:50:37.968 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-17T09:50:38.008 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-17T09:50:38.336 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-17T09:50:38.346 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-17T09:50:38.350 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-17T09:50:38.356 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-17T09:50:38.358 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-17T09:50:38.385 INFO:teuthology.orchestra.run.trial070.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-17T09:50:38.429 INFO:teuthology.orchestra.run.trial070.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-17T09:50:38.437 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-17T09:50:38.443 INFO:teuthology.orchestra.run.trial070.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-17T09:50:38.446 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-17T09:50:38.452 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-17T09:50:38.455 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-17T09:50:38.462 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-17T09:50:38.466 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-17T09:50:38.494 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-17T09:50:38.504 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-17T09:50:38.509 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-17T09:50:38.517 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-17T09:50:38.551 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-17T09:50:38.778 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 55/96 2026-02-17T09:50:38.801 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-17T09:50:38.805 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-17T09:50:38.863 INFO:teuthology.orchestra.run.trial070.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-17T09:50:38.865 INFO:teuthology.orchestra.run.trial070.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-17T09:50:38.886 INFO:teuthology.orchestra.run.trial070.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-17T09:50:39.214 INFO:teuthology.orchestra.run.trial070.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-17T09:50:39.287 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-17T09:50:39.957 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-17T09:50:39.974 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-17T09:50:39.984 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-17T09:50:39.991 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-17T09:50:40.004 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-17T09:50:40.020 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-17T09:50:40.095 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-17T09:50:40.104 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-17T09:50:40.127 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-17T09:50:40.157 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-17T09:50:40.207 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-17T09:50:40.213 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-17T09:50:40.217 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-17T09:50:40.218 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-17T09:50:40.237 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T09:50:40.237 INFO:teuthology.orchestra.run.trial070.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T09:50:40.237 INFO:teuthology.orchestra.run.trial070.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T09:50:40.237 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:40.246 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T09:50:40.273 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T09:50:40.273 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T09:50:40.273 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:40.308 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-17T09:50:40.895 INFO:teuthology.orchestra.run.trial070.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 79/96 2026-02-17T09:50:46.152 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-osd-classic-2:20.3.0-5345.gb58fab16.el9.x86_6 80/96 2026-02-17T09:50:46.216 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-osd-crimson-2:20.3.0-5345.gb58fab16.el9.x86_6 81/96 2026-02-17T09:50:46.218 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-volume-2:20.3.0-5345.gb58fab16.el9.noarch 82/96 2026-02-17T09:50:46.232 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-volume-2:20.3.0-5345.gb58fab16.el9.noarch 82/96 2026-02-17T09:50:46.232 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T09:50:46.232 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T09:50:46.232 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:46.242 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-osd-2:20.3.0-5345.gb58fab16.el9.x86_64 83/96 2026-02-17T09:50:46.265 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-osd-2:20.3.0-5345.gb58fab16.el9.x86_64 83/96 2026-02-17T09:50:46.266 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T09:50:46.266 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T09:50:46.266 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T09:50:46.266 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T09:50:46.266 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:46.321 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: cephadm-2:20.3.0-5345.gb58fab16.el9.noarch 84/96 2026-02-17T09:50:46.323 INFO:teuthology.orchestra.run.trial070.stdout: Installing : cephadm-2:20.3.0-5345.gb58fab16.el9.noarch 84/96 2026-02-17T09:50:46.332 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5345.gb58fab16.el9 85/96 2026-02-17T09:50:46.356 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5345.gb58fab16.el 86/96 2026-02-17T09:50:46.357 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5345.gb58fab16.el9.noarc 87/96 2026-02-17T09:50:49.246 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5345.gb58fab16.el9.noarc 87/96 2026-02-17T09:50:49.253 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5345.gb58fab16.el9.noa 88/96 2026-02-17T09:50:49.712 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5345.gb58fab16.el9.noa 88/96 2026-02-17T09:50:49.713 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5345.gb58fa 89/96 2026-02-17T09:50:49.726 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5345.gb58fa 89/96 2026-02-17T09:50:49.726 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5345.gb58fab16.el9.noa 90/96 2026-02-17T09:50:49.790 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5345.gb58fab16.el9.noa 90/96 2026-02-17T09:50:49.830 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5345.gb58fab16.el9. 91/96 2026-02-17T09:50:49.831 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-2:20.3.0-5345.gb58fab16.el9.x86_64 92/96 2026-02-17T09:50:49.855 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5345.gb58fab16.el9.x86_64 92/96 2026-02-17T09:50:49.855 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T09:50:49.855 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T09:50:49.855 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T09:50:49.855 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T09:50:49.855 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:49.868 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-rook-2:20.3.0-5345.gb58fab16.el9.noarch 93/96 2026-02-17T09:50:50.082 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5345.gb58fab16.el9.noarch 93/96 2026-02-17T09:50:50.083 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mon-2:20.3.0-5345.gb58fab16.el9.x86_64 94/96 2026-02-17T09:50:50.104 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mon-2:20.3.0-5345.gb58fab16.el9.x86_64 94/96 2026-02-17T09:50:50.104 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T09:50:50.104 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T09:50:50.104 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T09:50:50.104 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T09:50:50.104 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:50.186 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mds-2:20.3.0-5345.gb58fab16.el9.x86_64 95/96 2026-02-17T09:50:50.207 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mds-2:20.3.0-5345.gb58fab16.el9.x86_64 95/96 2026-02-17T09:50:50.207 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T09:50:50.207 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T09:50:50.207 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T09:50:50.207 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T09:50:50.207 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:50.208 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-2:20.3.0-5345.gb58fab16.el9.x86_64 96/96 2026-02-17T09:50:50.215 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5345.gb58fab16.el9.x86_6 96/96 2026-02-17T09:50:50.239 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5345.gb58fab16.el9.x86_6 96/96 2026-02-17T09:50:51.653 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-2:20.3.0-5345.gb58fab16.el9.x86_64 96/96 2026-02-17T09:50:51.653 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-2:20.3.0-5345.gb58fab16.el9.x86_64 1/96 2026-02-17T09:50:51.653 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mds-2:20.3.0-5345.gb58fab16.el9.x86_64 2/96 2026-02-17T09:50:51.653 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-2:20.3.0-5345.gb58fab16.el9.x86_64 3/96 2026-02-17T09:50:51.653 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mon-2:20.3.0-5345.gb58fab16.el9.x86_64 4/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-osd-2:20.3.0-5345.gb58fab16.el9.x86_64 5/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-osd-classic-2:20.3.0-5345.gb58fab16.el9.x86_6 6/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5345.gb58fab16.el9.x86_6 7/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5345.gb58fab16.el 8/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5345.gb58fab16.el9.noarc 9/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5345.gb58fab16.el9.noa 10/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5345.gb58fa 11/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5345.gb58fab16.el9.noa 12/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5345.gb58fab16.el9. 13/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5345.gb58fab16.el9.noarch 14/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5345.gb58fab16.el9 15/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-volume-2:20.3.0-5345.gb58fab16.el9.noarch 16/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : cephadm-2:20.3.0-5345.gb58fab16.el9.noarch 17/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 18/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-17T09:50:51.654 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 40/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-17T09:50:51.655 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-17T09:50:51.656 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-17T09:50:51.657 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-17T09:50:51.721 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-17T09:50:51.722 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:51.722 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-17T09:50:51.722 INFO:teuthology.orchestra.run.trial070.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T09:50:51.722 INFO:teuthology.orchestra.run.trial070.stdout: ceph-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:50:51.722 INFO:teuthology.orchestra.run.trial070.stdout: ceph-grafana-dashboards-2:20.3.0-5345.gb58fab16.el9.noarch 2026-02-17T09:50:51.722 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mds-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:50:51.722 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:50:51.722 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-cephadm-2:20.3.0-5345.gb58fab16.el9.noarch 2026-02-17T09:50:51.722 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-dashboard-2:20.3.0-5345.gb58fab16.el9.noarch 2026-02-17T09:50:51.722 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5345.gb58fab16.el9.noarch 2026-02-17T09:50:51.723 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-k8sevents-2:20.3.0-5345.gb58fab16.el9.noarch 2026-02-17T09:50:51.723 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-modules-core-2:20.3.0-5345.gb58fab16.el9.noarch 2026-02-17T09:50:51.723 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-rook-2:20.3.0-5345.gb58fab16.el9.noarch 2026-02-17T09:50:51.723 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mon-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:50:51.723 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:50:51.723 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd-classic-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:50:51.723 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd-crimson-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:50:51.723 INFO:teuthology.orchestra.run.trial070.stdout: ceph-prometheus-alerts-2:20.3.0-5345.gb58fab16.el9.noarch 2026-02-17T09:50:51.723 INFO:teuthology.orchestra.run.trial070.stdout: ceph-volume-2:20.3.0-5345.gb58fab16.el9.noarch 2026-02-17T09:50:51.723 INFO:teuthology.orchestra.run.trial070.stdout: cephadm-2:20.3.0-5345.gb58fab16.el9.noarch 2026-02-17T09:50:51.723 INFO:teuthology.orchestra.run.trial070.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T09:50:51.723 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T09:50:51.724 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T09:50:51.724 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T09:50:51.724 INFO:teuthology.orchestra.run.trial070.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T09:50:51.724 INFO:teuthology.orchestra.run.trial070.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T09:50:51.724 INFO:teuthology.orchestra.run.trial070.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T09:50:51.724 INFO:teuthology.orchestra.run.trial070.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T09:50:51.724 INFO:teuthology.orchestra.run.trial070.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T09:50:51.724 INFO:teuthology.orchestra.run.trial070.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T09:50:51.724 INFO:teuthology.orchestra.run.trial070.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T09:50:51.724 INFO:teuthology.orchestra.run.trial070.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T09:50:51.724 INFO:teuthology.orchestra.run.trial070.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T09:50:51.724 INFO:teuthology.orchestra.run.trial070.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T09:50:51.725 INFO:teuthology.orchestra.run.trial070.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T09:50:51.725 INFO:teuthology.orchestra.run.trial070.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T09:50:51.725 INFO:teuthology.orchestra.run.trial070.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T09:50:51.725 INFO:teuthology.orchestra.run.trial070.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T09:50:51.725 INFO:teuthology.orchestra.run.trial070.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T09:50:51.725 INFO:teuthology.orchestra.run.trial070.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T09:50:51.725 INFO:teuthology.orchestra.run.trial070.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T09:50:51.725 INFO:teuthology.orchestra.run.trial070.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T09:50:51.725 INFO:teuthology.orchestra.run.trial070.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T09:50:51.725 INFO:teuthology.orchestra.run.trial070.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T09:50:51.725 INFO:teuthology.orchestra.run.trial070.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T09:50:51.725 INFO:teuthology.orchestra.run.trial070.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T09:50:51.725 INFO:teuthology.orchestra.run.trial070.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T09:50:51.726 INFO:teuthology.orchestra.run.trial070.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T09:50:51.726 INFO:teuthology.orchestra.run.trial070.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T09:50:51.726 INFO:teuthology.orchestra.run.trial070.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T09:50:51.726 INFO:teuthology.orchestra.run.trial070.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T09:50:51.726 INFO:teuthology.orchestra.run.trial070.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T09:50:51.726 INFO:teuthology.orchestra.run.trial070.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T09:50:51.726 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T09:50:51.726 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T09:50:51.726 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T09:50:51.726 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T09:50:51.726 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T09:50:51.726 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T09:50:51.727 INFO:teuthology.orchestra.run.trial070.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T09:50:51.727 INFO:teuthology.orchestra.run.trial070.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-17T09:50:51.727 INFO:teuthology.orchestra.run.trial070.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T09:50:51.727 INFO:teuthology.orchestra.run.trial070.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T09:50:51.727 INFO:teuthology.orchestra.run.trial070.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T09:50:51.727 INFO:teuthology.orchestra.run.trial070.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T09:50:51.727 INFO:teuthology.orchestra.run.trial070.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T09:50:51.727 INFO:teuthology.orchestra.run.trial070.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T09:50:51.727 INFO:teuthology.orchestra.run.trial070.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T09:50:51.727 INFO:teuthology.orchestra.run.trial070.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T09:50:51.727 INFO:teuthology.orchestra.run.trial070.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T09:50:51.727 INFO:teuthology.orchestra.run.trial070.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T09:50:51.728 INFO:teuthology.orchestra.run.trial070.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T09:50:51.728 INFO:teuthology.orchestra.run.trial070.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T09:50:51.728 INFO:teuthology.orchestra.run.trial070.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T09:50:51.728 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T09:50:51.728 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T09:50:51.728 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T09:50:51.728 INFO:teuthology.orchestra.run.trial070.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T09:50:51.728 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T09:50:51.728 INFO:teuthology.orchestra.run.trial070.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T09:50:51.728 INFO:teuthology.orchestra.run.trial070.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T09:50:51.728 INFO:teuthology.orchestra.run.trial070.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T09:50:51.728 INFO:teuthology.orchestra.run.trial070.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T09:50:51.729 INFO:teuthology.orchestra.run.trial070.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T09:50:51.729 INFO:teuthology.orchestra.run.trial070.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T09:50:51.729 INFO:teuthology.orchestra.run.trial070.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T09:50:51.729 INFO:teuthology.orchestra.run.trial070.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T09:50:51.729 INFO:teuthology.orchestra.run.trial070.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T09:50:51.729 INFO:teuthology.orchestra.run.trial070.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T09:50:51.729 INFO:teuthology.orchestra.run.trial070.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T09:50:51.729 INFO:teuthology.orchestra.run.trial070.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T09:50:51.729 INFO:teuthology.orchestra.run.trial070.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T09:50:51.729 INFO:teuthology.orchestra.run.trial070.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T09:50:51.729 INFO:teuthology.orchestra.run.trial070.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T09:50:51.729 INFO:teuthology.orchestra.run.trial070.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T09:50:51.730 INFO:teuthology.orchestra.run.trial070.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T09:50:51.730 INFO:teuthology.orchestra.run.trial070.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T09:50:51.730 INFO:teuthology.orchestra.run.trial070.stdout: zip-3.0-35.el9.x86_64 2026-02-17T09:50:51.730 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:51.730 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:50:51.790 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-base 2026-02-17T09:50:52.099 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:14 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:50:52.163 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-base-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:50:52.181 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:50:52.181 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:50:52.182 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:50:52.203 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install cephadm 2026-02-17T09:50:52.513 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:14 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:50:52.579 INFO:teuthology.orchestra.run.trial070.stdout:Package cephadm-2:20.3.0-5345.gb58fab16.el9.noarch is already installed. 2026-02-17T09:50:52.596 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:50:52.597 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:50:52.597 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:50:52.618 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T09:50:52.930 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:14 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:50:53.012 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:50:53.012 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:50:53.012 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-17T09:50:53.013 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:50:53.013 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-17T09:50:53.013 INFO:teuthology.orchestra.run.trial070.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 149 k 2026-02-17T09:50:53.013 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:53.013 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-17T09:50:53.013 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:50:53.013 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-17T09:50:53.013 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:53.013 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 149 k 2026-02-17T09:50:53.013 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 455 k 2026-02-17T09:50:53.014 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-17T09:50:53.399 INFO:teuthology.orchestra.run.trial070.stdout:ceph-immutable-object-cache-20.3.0-5345.gb58fab 387 kB/s | 149 kB 00:00 2026-02-17T09:50:53.399 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-17T09:50:53.399 INFO:teuthology.orchestra.run.trial070.stdout:Total 386 kB/s | 149 kB 00:00 2026-02-17T09:50:53.400 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-17T09:50:53.404 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-17T09:50:53.404 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-17T09:50:53.435 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-17T09:50:53.435 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-17T09:50:53.490 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-17T09:50:53.492 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5345.gb58fab16. 1/1 2026-02-17T09:50:53.513 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5345.gb58fab16. 1/1 2026-02-17T09:50:53.513 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T09:50:53.513 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T09:50:53.513 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:53.802 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5345.gb58fab16. 1/1 2026-02-17T09:50:53.802 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:53.802 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-17T09:50:53.803 INFO:teuthology.orchestra.run.trial070.stdout: ceph-immutable-object-cache-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:50:53.803 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:53.803 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:50:53.829 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mgr 2026-02-17T09:50:54.142 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:16 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:50:54.207 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-mgr-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:50:54.225 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:50:54.225 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:50:54.226 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:50:54.248 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T09:50:54.563 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:16 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:50:54.626 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-mgr-dashboard-2:20.3.0-5345.gb58fab16.el9.noarch is already installed. 2026-02-17T09:50:54.644 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:50:54.645 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:50:54.645 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:50:54.667 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T09:50:54.975 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:16 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:50:55.040 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5345.gb58fab16.el9.noarch is already installed. 2026-02-17T09:50:55.058 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:50:55.058 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:50:55.058 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:50:55.080 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mgr-rook 2026-02-17T09:50:55.388 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:17 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:50:55.453 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-mgr-rook-2:20.3.0-5345.gb58fab16.el9.noarch is already installed. 2026-02-17T09:50:55.470 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:50:55.471 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:50:55.471 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:50:55.492 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T09:50:55.802 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:17 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:50:55.867 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-mgr-cephadm-2:20.3.0-5345.gb58fab16.el9.noarch is already installed. 2026-02-17T09:50:55.884 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:50:55.885 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:50:55.885 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:50:55.906 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-osd 2026-02-17T09:50:56.218 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:18 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:50:56.283 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-osd-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:50:56.301 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:50:56.301 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:50:56.302 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:50:56.323 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-osd-classic 2026-02-17T09:50:56.632 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:18 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:50:56.696 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-osd-classic-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:50:56.714 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:50:56.715 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:50:56.715 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:50:56.736 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-fuse 2026-02-17T09:50:57.043 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:19 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:50:57.125 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:50:57.125 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:50:57.125 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-17T09:50:57.125 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:50:57.126 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-17T09:50:57.126 INFO:teuthology.orchestra.run.trial070.stdout: ceph-fuse x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 914 k 2026-02-17T09:50:57.126 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:57.126 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-17T09:50:57.126 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:50:57.126 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-17T09:50:57.126 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:57.126 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 914 k 2026-02-17T09:50:57.126 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 2.9 M 2026-02-17T09:50:57.126 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-17T09:50:57.641 INFO:teuthology.orchestra.run.trial070.stdout:ceph-fuse-20.3.0-5345.gb58fab16.el9.x86_64.rpm 1.7 MB/s | 914 kB 00:00 2026-02-17T09:50:57.641 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-17T09:50:57.641 INFO:teuthology.orchestra.run.trial070.stdout:Total 1.7 MB/s | 914 kB 00:00 2026-02-17T09:50:57.642 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-17T09:50:57.647 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-17T09:50:57.647 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-17T09:50:57.680 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-17T09:50:57.681 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-17T09:50:57.771 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-17T09:50:57.788 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-fuse-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:50:58.002 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:50:58.060 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-fuse-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:50:58.060 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:58.061 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-17T09:50:58.061 INFO:teuthology.orchestra.run.trial070.stdout: ceph-fuse-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:50:58.061 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:58.061 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:50:58.089 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-volume 2026-02-17T09:50:58.401 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:20 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:50:58.465 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-volume-2:20.3.0-5345.gb58fab16.el9.noarch is already installed. 2026-02-17T09:50:58.483 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:50:58.484 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:50:58.484 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:50:58.505 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install librados-devel 2026-02-17T09:50:58.827 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:20 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:50:58.910 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:50:58.910 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:50:58.910 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-17T09:50:58.910 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:50:58.910 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-17T09:50:58.911 INFO:teuthology.orchestra.run.trial070.stdout: librados-devel x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 124 k 2026-02-17T09:50:58.911 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:58.911 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-17T09:50:58.911 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:50:58.911 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-17T09:50:58.911 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:58.911 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 124 k 2026-02-17T09:50:58.911 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 434 k 2026-02-17T09:50:58.911 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-17T09:50:59.315 INFO:teuthology.orchestra.run.trial070.stdout:librados-devel-20.3.0-5345.gb58fab16.el9.x86_64 306 kB/s | 124 kB 00:00 2026-02-17T09:50:59.315 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-17T09:50:59.315 INFO:teuthology.orchestra.run.trial070.stdout:Total 305 kB/s | 124 kB 00:00 2026-02-17T09:50:59.316 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-17T09:50:59.318 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-17T09:50:59.318 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-17T09:50:59.350 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-17T09:50:59.350 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-17T09:50:59.405 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-17T09:50:59.421 INFO:teuthology.orchestra.run.trial070.stdout: Installing : librados-devel-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:50:59.503 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librados-devel-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:50:59.561 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librados-devel-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:50:59.561 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:59.561 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-17T09:50:59.561 INFO:teuthology.orchestra.run.trial070.stdout: librados-devel-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:50:59.561 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:50:59.561 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:50:59.589 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install libcephfs2 2026-02-17T09:50:59.903 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:21 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:50:59.968 INFO:teuthology.orchestra.run.trial070.stdout:Package libcephfs2-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:50:59.986 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:50:59.986 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:50:59.987 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:51:00.008 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install libcephfs-devel 2026-02-17T09:51:00.315 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:22 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:51:00.397 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:51:00.398 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:51:00.398 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-17T09:51:00.398 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:51:00.398 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-17T09:51:00.398 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs-devel x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 37 k 2026-02-17T09:51:00.398 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:00.398 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-17T09:51:00.398 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:51:00.398 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-17T09:51:00.398 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:00.399 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 37 k 2026-02-17T09:51:00.399 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 171 k 2026-02-17T09:51:00.399 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-17T09:51:00.674 INFO:teuthology.orchestra.run.trial070.stdout:libcephfs-devel-20.3.0-5345.gb58fab16.el9.x86_6 135 kB/s | 37 kB 00:00 2026-02-17T09:51:00.675 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-17T09:51:00.675 INFO:teuthology.orchestra.run.trial070.stdout:Total 135 kB/s | 37 kB 00:00 2026-02-17T09:51:00.675 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-17T09:51:00.677 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-17T09:51:00.677 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-17T09:51:00.680 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-17T09:51:00.680 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-17T09:51:00.702 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-17T09:51:00.719 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libcephfs-devel-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:51:00.776 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:51:00.833 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libcephfs-devel-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:51:00.833 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:00.833 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-17T09:51:00.833 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs-devel-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:51:00.833 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:00.833 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:51:00.861 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install librados2 2026-02-17T09:51:01.170 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:23 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:51:01.235 INFO:teuthology.orchestra.run.trial070.stdout:Package librados2-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:51:01.253 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:51:01.253 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:51:01.253 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:51:01.275 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install librbd1 2026-02-17T09:51:01.583 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:23 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:51:01.648 INFO:teuthology.orchestra.run.trial070.stdout:Package librbd1-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:51:01.666 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:51:01.667 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:51:01.667 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:51:01.688 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install python3-rados 2026-02-17T09:51:01.993 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:23 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:51:02.058 INFO:teuthology.orchestra.run.trial070.stdout:Package python3-rados-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:51:02.075 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:51:02.076 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:51:02.076 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:51:02.097 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install python3-rgw 2026-02-17T09:51:02.406 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:24 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:51:02.471 INFO:teuthology.orchestra.run.trial070.stdout:Package python3-rgw-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:51:02.488 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:51:02.489 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:51:02.489 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:51:02.510 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install python3-cephfs 2026-02-17T09:51:02.818 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:24 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:51:02.883 INFO:teuthology.orchestra.run.trial070.stdout:Package python3-cephfs-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:51:02.900 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:51:02.901 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:51:02.901 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:51:02.923 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install python3-rbd 2026-02-17T09:51:03.235 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:25 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:51:03.299 INFO:teuthology.orchestra.run.trial070.stdout:Package python3-rbd-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:51:03.316 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:51:03.317 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:51:03.317 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:51:03.339 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install rbd-fuse 2026-02-17T09:51:03.647 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:25 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:51:03.730 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:51:03.731 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:51:03.732 INFO:teuthology.orchestra.run.trial070.stdout: Package Architecture Version Repository Size 2026-02-17T09:51:03.732 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:51:03.732 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-17T09:51:03.732 INFO:teuthology.orchestra.run.trial070.stdout: rbd-fuse x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 87 k 2026-02-17T09:51:03.732 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:03.732 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-17T09:51:03.732 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:51:03.732 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-17T09:51:03.732 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:03.732 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 87 k 2026-02-17T09:51:03.733 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 236 k 2026-02-17T09:51:03.733 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-17T09:51:04.047 INFO:teuthology.orchestra.run.trial070.stdout:rbd-fuse-20.3.0-5345.gb58fab16.el9.x86_64.rpm 274 kB/s | 87 kB 00:00 2026-02-17T09:51:04.048 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-17T09:51:04.048 INFO:teuthology.orchestra.run.trial070.stdout:Total 273 kB/s | 87 kB 00:00 2026-02-17T09:51:04.049 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-17T09:51:04.054 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-17T09:51:04.054 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-17T09:51:04.085 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-17T09:51:04.085 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-17T09:51:04.136 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-17T09:51:04.153 INFO:teuthology.orchestra.run.trial070.stdout: Installing : rbd-fuse-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:51:04.233 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:51:04.292 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : rbd-fuse-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:51:04.292 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:04.292 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-17T09:51:04.292 INFO:teuthology.orchestra.run.trial070.stdout: rbd-fuse-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:51:04.292 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:04.292 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:51:04.321 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install rbd-mirror 2026-02-17T09:51:04.631 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:26 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:51:04.714 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:51:04.714 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:51:04.714 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-17T09:51:04.714 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:51:04.714 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-17T09:51:04.714 INFO:teuthology.orchestra.run.trial070.stdout: rbd-mirror x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 2.6 M 2026-02-17T09:51:04.714 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:04.715 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-17T09:51:04.715 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:51:04.715 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-17T09:51:04.715 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:04.715 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 2.6 M 2026-02-17T09:51:04.715 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 11 M 2026-02-17T09:51:04.715 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-17T09:51:05.346 INFO:teuthology.orchestra.run.trial070.stdout:rbd-mirror-20.3.0-5345.gb58fab16.el9.x86_64.rpm 4.1 MB/s | 2.6 MB 00:00 2026-02-17T09:51:05.346 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-17T09:51:05.346 INFO:teuthology.orchestra.run.trial070.stdout:Total 4.1 MB/s | 2.6 MB 00:00 2026-02-17T09:51:05.346 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-17T09:51:05.351 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-17T09:51:05.351 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-17T09:51:05.390 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-17T09:51:05.390 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-17T09:51:05.552 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-17T09:51:05.554 INFO:teuthology.orchestra.run.trial070.stdout: Installing : rbd-mirror-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:51:05.577 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:51:05.577 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T09:51:05.577 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T09:51:05.578 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T09:51:05.578 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T09:51:05.578 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:05.862 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : rbd-mirror-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:51:05.862 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:05.863 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-17T09:51:05.863 INFO:teuthology.orchestra.run.trial070.stdout: rbd-mirror-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:51:05.863 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:05.863 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:51:05.889 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install rbd-nbd 2026-02-17T09:51:06.196 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:28 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:51:06.280 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:51:06.280 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:51:06.280 INFO:teuthology.orchestra.run.trial070.stdout: Package Architecture Version Repository Size 2026-02-17T09:51:06.280 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:51:06.281 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-17T09:51:06.281 INFO:teuthology.orchestra.run.trial070.stdout: rbd-nbd x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 167 k 2026-02-17T09:51:06.281 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:06.281 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-17T09:51:06.281 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:51:06.281 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-17T09:51:06.281 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:06.281 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 167 k 2026-02-17T09:51:06.281 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 496 k 2026-02-17T09:51:06.281 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-17T09:51:06.631 INFO:teuthology.orchestra.run.trial070.stdout:rbd-nbd-20.3.0-5345.gb58fab16.el9.x86_64.rpm 475 kB/s | 167 kB 00:00 2026-02-17T09:51:06.632 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-17T09:51:06.633 INFO:teuthology.orchestra.run.trial070.stdout:Total 472 kB/s | 167 kB 00:00 2026-02-17T09:51:06.633 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-17T09:51:06.638 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-17T09:51:06.638 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-17T09:51:06.671 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-17T09:51:06.671 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-17T09:51:06.727 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-17T09:51:06.744 INFO:teuthology.orchestra.run.trial070.stdout: Installing : rbd-nbd-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:51:06.825 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:51:06.883 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : rbd-nbd-2:20.3.0-5345.gb58fab16.el9.x86_64 1/1 2026-02-17T09:51:06.883 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:06.883 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-17T09:51:06.883 INFO:teuthology.orchestra.run.trial070.stdout: rbd-nbd-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:51:06.883 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:06.883 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:51:06.910 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-osd-crimson 2026-02-17T09:51:07.223 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:29 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:51:07.288 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-osd-crimson-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:51:07.305 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:51:07.306 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:51:07.306 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:51:07.327 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-17T09:51:07.635 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:29 ago on Tue 17 Feb 2026 09:49:38 AM UTC. 2026-02-17T09:51:07.718 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:51:07.719 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:51:07.719 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-17T09:51:07.720 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:51:07.720 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-17T09:51:07.720 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 425 M 2026-02-17T09:51:07.720 INFO:teuthology.orchestra.run.trial070.stdout:Installing weak dependencies: 2026-02-17T09:51:07.720 INFO:teuthology.orchestra.run.trial070.stdout: ceph-debugsource x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 12 M 2026-02-17T09:51:07.720 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:07.720 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-17T09:51:07.720 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:51:07.720 INFO:teuthology.orchestra.run.trial070.stdout:Install 2 Packages 2026-02-17T09:51:07.720 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:07.721 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 437 M 2026-02-17T09:51:07.721 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 2.6 G 2026-02-17T09:51:07.721 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-17T09:51:09.069 INFO:teuthology.orchestra.run.trial070.stdout:(1/2): ceph-debugsource-20.3.0-5345.gb58fab16.e 8.9 MB/s | 12 MB 00:01 2026-02-17T09:51:27.692 INFO:teuthology.orchestra.run.trial070.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5345.g 21 MB/s | 425 MB 00:19 2026-02-17T09:51:27.693 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-17T09:51:27.693 INFO:teuthology.orchestra.run.trial070.stdout:Total 22 MB/s | 437 MB 00:19 2026-02-17T09:51:27.694 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-17T09:51:27.698 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-17T09:51:27.699 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-17T09:51:29.052 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-17T09:51:29.052 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-17T09:51:32.626 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-17T09:51:54.397 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-debugsource-2:20.3.0-5345.gb58fab16.el9.x86_64 1/2 2026-02-17T09:51:54.414 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5345.gb58fab16.e 2/2 2026-02-17T09:51:56.405 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5345.gb58fab16.e 2/2 2026-02-17T09:51:56.405 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-debugsource-2:20.3.0-5345.gb58fab16.el9.x86_64 1/2 2026-02-17T09:51:56.463 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5345.gb58fab16.e 2/2 2026-02-17T09:51:56.463 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:56.463 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-17T09:51:56.463 INFO:teuthology.orchestra.run.trial070.stdout: ceph-debugsource-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:51:56.463 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:51:56.463 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:51:56.463 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:51:56.537 DEBUG:teuthology.parallel:result is None 2026-02-17T09:51:56.537 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=b58fab16a61897dbc214a1865300c7cef586ea65 2026-02-17T09:51:56.706 DEBUG:teuthology.orchestra.run.trial070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T09:51:56.728 INFO:teuthology.orchestra.run.trial070.stdout:20.3.0-5345.gb58fab16.el9 2026-02-17T09:51:56.729 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5345.gb58fab16.el9 2026-02-17T09:51:56.729 INFO:teuthology.task.install:The correct ceph version 20.3.0-5345.gb58fab16 is installed. 2026-02-17T09:51:56.732 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T09:51:56.732 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:51:56.732 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T09:51:56.794 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T09:51:56.794 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:51:56.795 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T09:51:56.858 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T09:51:56.922 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T09:51:56.923 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:51:56.923 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T09:51:56.985 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T09:51:57.052 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T09:51:57.053 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:51:57.053 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T09:51:57.117 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T09:51:57.181 INFO:teuthology.run_tasks:Running task pexec... 2026-02-17T09:51:57.202 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-17T09:51:57.202 DEBUG:teuthology.orchestra.run.trial070:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-17T09:51:57.224 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial070.front.sepia.ceph.com 2026-02-17T09:51:57.225 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-17T09:51:57.276 DEBUG:teuthology.parallel:result is None 2026-02-17T09:51:57.276 INFO:teuthology.run_tasks:Running task install... 2026-02-17T09:51:57.290 DEBUG:teuthology.task.install:project ceph 2026-02-17T09:51:57.291 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': 'b58fab16a61897dbc214a1865300c7cef586ea65'}} 2026-02-17T09:51:57.291 DEBUG:teuthology.task.install:config {'flavor': 'debug', 'sha1': 'b58fab16a61897dbc214a1865300c7cef586ea65'} 2026-02-17T09:51:57.291 INFO:teuthology.task.install:Using flavor: debug 2026-02-17T09:51:57.299 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T09:51:57.300 INFO:teuthology.task.install:extra packages: [] 2026-02-17T09:51:57.300 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b58fab16a61897dbc214a1865300c7cef586ea65', 'tag': None, 'wait_for_package': False} 2026-02-17T09:51:57.300 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=b58fab16a61897dbc214a1865300c7cef586ea65 2026-02-17T09:51:57.475 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-sjust-seastore-2026-02-16-1771285632/b58fab16a61897dbc214a1865300c7cef586ea65/centos/9/flavors/debug/ 2026-02-17T09:51:57.475 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5345.gb58fab16 2026-02-17T09:51:57.622 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-sjust-seastore-2026-02-16-1771285632/b58fab16a61897dbc214a1865300c7cef586ea65/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-sjust-seastore-2026-02-16-1771285632/b58fab16a61897dbc214a1865300c7cef586ea65/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-sjust-seastore-2026-02-16-1771285632/b58fab16a61897dbc214a1865300c7cef586ea65/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T09:51:57.622 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:51:57.622 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T09:51:57.647 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T09:51:57.647 DEBUG:teuthology.orchestra.run.trial070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b58fab16a61897dbc214a1865300c7cef586ea65/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T09:51:57.713 DEBUG:teuthology.orchestra.run.trial070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T09:51:57.778 DEBUG:teuthology.orchestra.run.trial070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T09:51:57.833 INFO:teuthology.orchestra.run.trial070.stdout:check_obsoletes = 1 2026-02-17T09:51:57.843 DEBUG:teuthology.orchestra.run.trial070:> sudo yum clean all 2026-02-17T09:51:58.003 INFO:teuthology.orchestra.run.trial070.stdout:56 files removed 2026-02-17T09:51:58.018 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-radosgw 2026-02-17T09:51:58.627 INFO:teuthology.orchestra.run.trial070.stdout:ceph packages for x86_64 205 kB/s | 94 kB 00:00 2026-02-17T09:51:58.834 INFO:teuthology.orchestra.run.trial070.stdout:ceph noarch packages 135 kB/s | 24 kB 00:00 2026-02-17T09:51:58.961 INFO:teuthology.orchestra.run.trial070.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-17T09:52:00.337 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.9 MB 00:01 2026-02-17T09:52:03.640 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 27 MB 00:02 2026-02-17T09:52:06.892 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 7.8 MB 00:00 2026-02-17T09:52:07.790 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - Extras packages 118 kB/s | 20 kB 00:00 2026-02-17T09:52:09.119 INFO:teuthology.orchestra.run.trial070.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2026-02-17T09:52:12.324 INFO:teuthology.orchestra.run.trial070.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-17T09:52:13.508 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-radosgw-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:13.526 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:13.527 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:13.527 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:13.551 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-test 2026-02-17T09:52:13.868 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:01 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:13.934 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-test-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:13.952 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:13.952 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:13.953 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:13.974 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph 2026-02-17T09:52:14.287 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:02 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:14.351 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:14.369 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:14.370 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:14.371 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:14.392 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-base 2026-02-17T09:52:14.709 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:02 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:14.774 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-base-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:14.792 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:14.792 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:14.792 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:14.814 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install cephadm 2026-02-17T09:52:15.128 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:03 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:15.193 INFO:teuthology.orchestra.run.trial070.stdout:Package cephadm-2:20.3.0-5345.gb58fab16.el9.noarch is already installed. 2026-02-17T09:52:15.210 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:15.211 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:15.211 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:15.233 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T09:52:15.550 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:03 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:15.614 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-immutable-object-cache-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:15.631 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:15.632 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:15.632 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:15.654 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mgr 2026-02-17T09:52:15.969 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:03 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:16.034 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-mgr-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:16.052 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:16.052 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:16.052 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:16.074 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T09:52:16.389 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:04 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:16.454 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-mgr-dashboard-2:20.3.0-5345.gb58fab16.el9.noarch is already installed. 2026-02-17T09:52:16.472 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:16.472 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:16.472 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:16.494 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T09:52:16.803 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:04 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:16.867 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5345.gb58fab16.el9.noarch is already installed. 2026-02-17T09:52:16.885 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:16.885 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:16.885 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:16.906 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mgr-rook 2026-02-17T09:52:17.220 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:05 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:17.284 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-mgr-rook-2:20.3.0-5345.gb58fab16.el9.noarch is already installed. 2026-02-17T09:52:17.301 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:17.302 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:17.302 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:17.324 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T09:52:17.634 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:05 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:17.699 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-mgr-cephadm-2:20.3.0-5345.gb58fab16.el9.noarch is already installed. 2026-02-17T09:52:17.717 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:17.718 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:17.718 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:17.739 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-osd 2026-02-17T09:52:18.054 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:06 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:18.118 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-osd-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:18.136 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:18.137 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:18.137 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:18.159 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-osd-classic 2026-02-17T09:52:18.476 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:06 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:18.540 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-osd-classic-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:18.558 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:18.559 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:18.559 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:18.581 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-fuse 2026-02-17T09:52:18.894 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:06 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:18.959 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-fuse-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:18.977 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:18.978 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:18.978 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:19.001 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-volume 2026-02-17T09:52:19.317 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:07 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:19.384 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-volume-2:20.3.0-5345.gb58fab16.el9.noarch is already installed. 2026-02-17T09:52:19.402 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:19.403 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:19.403 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:19.425 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install librados-devel 2026-02-17T09:52:19.735 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:07 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:19.799 INFO:teuthology.orchestra.run.trial070.stdout:Package librados-devel-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:19.817 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:19.818 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:19.818 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:19.839 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install libcephfs2 2026-02-17T09:52:20.151 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:08 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:20.216 INFO:teuthology.orchestra.run.trial070.stdout:Package libcephfs2-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:20.234 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:20.235 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:20.235 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:20.256 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install libcephfs-devel 2026-02-17T09:52:20.567 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:08 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:20.634 INFO:teuthology.orchestra.run.trial070.stdout:Package libcephfs-devel-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:20.652 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:20.652 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:20.653 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:20.674 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install librados2 2026-02-17T09:52:20.985 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:08 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:21.049 INFO:teuthology.orchestra.run.trial070.stdout:Package librados2-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:21.067 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:21.067 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:21.068 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:21.091 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install librbd1 2026-02-17T09:52:21.406 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:09 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:21.469 INFO:teuthology.orchestra.run.trial070.stdout:Package librbd1-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:21.487 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:21.488 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:21.488 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:21.509 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install python3-rados 2026-02-17T09:52:21.821 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:09 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:21.887 INFO:teuthology.orchestra.run.trial070.stdout:Package python3-rados-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:21.905 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:21.906 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:21.906 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:21.927 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install python3-rgw 2026-02-17T09:52:22.237 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:10 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:22.302 INFO:teuthology.orchestra.run.trial070.stdout:Package python3-rgw-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:22.320 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:22.321 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:22.321 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:22.342 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install python3-cephfs 2026-02-17T09:52:22.653 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:10 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:22.719 INFO:teuthology.orchestra.run.trial070.stdout:Package python3-cephfs-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:22.737 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:22.737 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:22.737 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:22.760 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install python3-rbd 2026-02-17T09:52:23.076 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:11 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:23.139 INFO:teuthology.orchestra.run.trial070.stdout:Package python3-rbd-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:23.157 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:23.158 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:23.159 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:23.180 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install rbd-fuse 2026-02-17T09:52:23.494 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:11 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:23.558 INFO:teuthology.orchestra.run.trial070.stdout:Package rbd-fuse-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:23.576 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:23.576 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:23.577 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:23.598 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install rbd-mirror 2026-02-17T09:52:23.915 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:11 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:23.982 INFO:teuthology.orchestra.run.trial070.stdout:Package rbd-mirror-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:23.999 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:23.999 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:24.000 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:24.022 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install rbd-nbd 2026-02-17T09:52:24.336 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:12 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:52:24.400 INFO:teuthology.orchestra.run.trial070.stdout:Package rbd-nbd-2:20.3.0-5345.gb58fab16.el9.x86_64 is already installed. 2026-02-17T09:52:24.418 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:52:24.419 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-17T09:52:24.419 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:52:24.443 DEBUG:teuthology.parallel:result is None 2026-02-17T09:52:24.443 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=b58fab16a61897dbc214a1865300c7cef586ea65 2026-02-17T09:52:24.620 DEBUG:teuthology.orchestra.run.trial070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T09:52:24.641 INFO:teuthology.orchestra.run.trial070.stdout:20.3.0-5345.gb58fab16.el9 2026-02-17T09:52:24.641 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5345.gb58fab16.el9 2026-02-17T09:52:24.641 INFO:teuthology.task.install:The correct ceph version 20.3.0-5345.gb58fab16 is installed. 2026-02-17T09:52:24.644 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-17T09:52:24.644 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T09:52:24.748 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T09:52:24.748 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod 777 /var/log/ceph 2026-02-17T09:52:24.773 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T09:52:24.773 DEBUG:teuthology.orchestra.run.trial070:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T09:52:24.838 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T09:52:24.838 DEBUG:teuthology.orchestra.run.trial070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T09:52:24.914 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T09:52:24.915 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T09:52:24.915 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/matan-2026-02-17_08:51:22-crimson-rados-wip-sjust-seastore-2026-02-16-1771285632-distro-debug-trial/52078', 'branch': 'wip-sjust-seastore-2026-02-16-1771285632', 'description': 'crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} perf_ignorelist settings/optimized workloads/radosbench_4M_write}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '52078', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'matan-2026-02-17_08:51:22-crimson-rados-wip-sjust-seastore-2026-02-16-1771285632-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-sjust-seastore-2026-02-16-1771285632'}, 'ceph': {'conf': {'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'sha1': 'b58fab16a61897dbc214a1865300c7cef586ea65'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': 'b58fab16a61897dbc214a1865300c7cef586ea65'}}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': 'ebc89147fc1a1731b84ef7e7003e19f704ba15c0'}}, 'owner': 'scheduled_matan@soko04.front.sepia.ceph.com', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 2314, 'sha1': 'b58fab16a61897dbc214a1865300c7cef586ea65', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_ebc89147fc1a1731b84ef7e7003e19f704ba15c0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': 'ebc89147fc1a1731b84ef7e7003e19f704ba15c0', 'targets': {'trial070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG71L8jELsCIgBbuYM8ahUocfwRmB9aIOcoi+CkC0VUUpotnOfJZy1NyGwTckTNcXm6bDaNLwvsDCnEWqVRivPs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': 'b58fab16a61897dbc214a1865300c7cef586ea65'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}}, 'wait-for-scrub': False, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'sha1': 'b58fab16a61897dbc214a1865300c7cef586ea65', 'cluster': 'ceph'}}, {'ssh_keys': None}, {'cbt': {'benchmarks': {'radosbench': {'concurrent_ops': 4, 'concurrent_procs': 2, 'op_size': [4194304], 'pool_monitoring_list': ['collectl'], 'pool_profile': 'replicated', 'run_monitoring_list': ['collectl'], 'time': 60, 'write_only': True}}, 'cluster': {'iterations': 1, 'osds_per_node': 3, 'pool_profiles': {'replicated': {'pg_size': 256, 'pgp_size': 256, 'replication': 'replicated'}}, 'user': 'ubuntu'}, 'monitoring_profiles': {'perf': {'args': 'stat -p {pid} -o {perf_dir}/perf_stat.{pid}', 'nodes': ['osds'], 'perf_cmd': 'perf', 'pid_glob': 'crimson-osd.*.pid'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_08:51:22', 'tube': 'trial', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T09:52:24.916 DEBUG:teuthology.orchestra.run.trial070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T09:52:24.960 DEBUG:teuthology.orchestra.run.trial070:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T09:52:25.025 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:52:25.025 DEBUG:teuthology.orchestra.run.trial070:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T09:52:25.081 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T09:52:25.082 DEBUG:teuthology.orchestra.run.trial070:> stat /dev/vg_nvme/lv_1 2026-02-17T09:52:25.139 INFO:teuthology.orchestra.run.trial070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T09:52:25.139 INFO:teuthology.orchestra.run.trial070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T09:52:25.139 INFO:teuthology.orchestra.run.trial070.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-17T09:52:25.140 INFO:teuthology.orchestra.run.trial070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T09:52:25.140 INFO:teuthology.orchestra.run.trial070.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T09:52:25.140 INFO:teuthology.orchestra.run.trial070.stdout:Access: 2026-02-17 09:51:05.717411693 +0000 2026-02-17T09:52:25.140 INFO:teuthology.orchestra.run.trial070.stdout:Modify: 2026-02-17 09:49:47.752782863 +0000 2026-02-17T09:52:25.140 INFO:teuthology.orchestra.run.trial070.stdout:Change: 2026-02-17 09:49:47.752782863 +0000 2026-02-17T09:52:25.140 INFO:teuthology.orchestra.run.trial070.stdout: Birth: 2026-02-17 09:49:47.752782863 +0000 2026-02-17T09:52:25.140 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T09:52:25.202 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records in 2026-02-17T09:52:25.202 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records out 2026-02-17T09:52:25.202 INFO:teuthology.orchestra.run.trial070.stderr:512 bytes copied, 0.000234222 s, 2.2 MB/s 2026-02-17T09:52:25.203 DEBUG:teuthology.orchestra.run.trial070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T09:52:25.261 DEBUG:teuthology.orchestra.run.trial070:> stat /dev/vg_nvme/lv_2 2026-02-17T09:52:25.318 INFO:teuthology.orchestra.run.trial070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T09:52:25.318 INFO:teuthology.orchestra.run.trial070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T09:52:25.318 INFO:teuthology.orchestra.run.trial070.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-17T09:52:25.318 INFO:teuthology.orchestra.run.trial070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T09:52:25.319 INFO:teuthology.orchestra.run.trial070.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T09:52:25.319 INFO:teuthology.orchestra.run.trial070.stdout:Access: 2026-02-17 09:51:05.717411693 +0000 2026-02-17T09:52:25.319 INFO:teuthology.orchestra.run.trial070.stdout:Modify: 2026-02-17 09:49:47.752782863 +0000 2026-02-17T09:52:25.319 INFO:teuthology.orchestra.run.trial070.stdout:Change: 2026-02-17 09:49:47.752782863 +0000 2026-02-17T09:52:25.319 INFO:teuthology.orchestra.run.trial070.stdout: Birth: 2026-02-17 09:49:47.752782863 +0000 2026-02-17T09:52:25.319 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T09:52:25.381 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records in 2026-02-17T09:52:25.382 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records out 2026-02-17T09:52:25.382 INFO:teuthology.orchestra.run.trial070.stderr:512 bytes copied, 0.000237077 s, 2.2 MB/s 2026-02-17T09:52:25.383 DEBUG:teuthology.orchestra.run.trial070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T09:52:25.441 DEBUG:teuthology.orchestra.run.trial070:> stat /dev/vg_nvme/lv_3 2026-02-17T09:52:25.497 INFO:teuthology.orchestra.run.trial070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T09:52:25.497 INFO:teuthology.orchestra.run.trial070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T09:52:25.497 INFO:teuthology.orchestra.run.trial070.stdout:Device: 6h/6d Inode: 1306 Links: 1 2026-02-17T09:52:25.497 INFO:teuthology.orchestra.run.trial070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T09:52:25.497 INFO:teuthology.orchestra.run.trial070.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T09:52:25.497 INFO:teuthology.orchestra.run.trial070.stdout:Access: 2026-02-17 09:51:05.717411693 +0000 2026-02-17T09:52:25.497 INFO:teuthology.orchestra.run.trial070.stdout:Modify: 2026-02-17 09:49:47.752782863 +0000 2026-02-17T09:52:25.498 INFO:teuthology.orchestra.run.trial070.stdout:Change: 2026-02-17 09:49:47.752782863 +0000 2026-02-17T09:52:25.498 INFO:teuthology.orchestra.run.trial070.stdout: Birth: 2026-02-17 09:49:47.752782863 +0000 2026-02-17T09:52:25.498 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T09:52:25.560 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records in 2026-02-17T09:52:25.560 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records out 2026-02-17T09:52:25.560 INFO:teuthology.orchestra.run.trial070.stderr:512 bytes copied, 0.000151516 s, 3.4 MB/s 2026-02-17T09:52:25.562 DEBUG:teuthology.orchestra.run.trial070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T09:52:25.618 DEBUG:teuthology.orchestra.run.trial070:> stat /dev/vg_nvme/lv_4 2026-02-17T09:52:25.674 INFO:teuthology.orchestra.run.trial070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T09:52:25.675 INFO:teuthology.orchestra.run.trial070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T09:52:25.675 INFO:teuthology.orchestra.run.trial070.stdout:Device: 6h/6d Inode: 1293 Links: 1 2026-02-17T09:52:25.675 INFO:teuthology.orchestra.run.trial070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T09:52:25.675 INFO:teuthology.orchestra.run.trial070.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T09:52:25.675 INFO:teuthology.orchestra.run.trial070.stdout:Access: 2026-02-17 09:51:05.718411680 +0000 2026-02-17T09:52:25.675 INFO:teuthology.orchestra.run.trial070.stdout:Modify: 2026-02-17 09:49:47.751782892 +0000 2026-02-17T09:52:25.675 INFO:teuthology.orchestra.run.trial070.stdout:Change: 2026-02-17 09:49:47.751782892 +0000 2026-02-17T09:52:25.675 INFO:teuthology.orchestra.run.trial070.stdout: Birth: 2026-02-17 09:49:47.751782892 +0000 2026-02-17T09:52:25.676 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T09:52:25.737 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records in 2026-02-17T09:52:25.737 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records out 2026-02-17T09:52:25.738 INFO:teuthology.orchestra.run.trial070.stderr:512 bytes copied, 0.000141577 s, 3.6 MB/s 2026-02-17T09:52:25.739 DEBUG:teuthology.orchestra.run.trial070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T09:52:25.796 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T09:52:25.796 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T09:52:25.796 INFO:tasks.ceph:Generating config... 2026-02-17T09:52:25.799 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-17T09:52:25.799 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-17T09:52:25.799 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-17T09:52:25.799 INFO:tasks.ceph:[osd] debug filestore = 0/0 2026-02-17T09:52:25.799 INFO:tasks.ceph:[osd] debug journal = 0/0 2026-02-17T09:52:25.799 INFO:tasks.ceph:[osd] debug ms = 0/0 2026-02-17T09:52:25.799 INFO:tasks.ceph:[osd] debug osd = 0/0 2026-02-17T09:52:25.799 INFO:tasks.ceph:[osd] debug seastore = 20 2026-02-17T09:52:25.799 INFO:tasks.ceph:[osd] debug seastore backref = 20 2026-02-17T09:52:25.800 INFO:tasks.ceph:[osd] debug seastore cache = 20 2026-02-17T09:52:25.800 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2026-02-17T09:52:25.800 INFO:tasks.ceph:[osd] debug seastore device = 20 2026-02-17T09:52:25.800 INFO:tasks.ceph:[osd] debug seastore epm = 20 2026-02-17T09:52:25.800 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2026-02-17T09:52:25.800 INFO:tasks.ceph:[osd] debug seastore journal = 20 2026-02-17T09:52:25.800 INFO:tasks.ceph:[osd] debug seastore lba = 20 2026-02-17T09:52:25.800 INFO:tasks.ceph:[osd] debug seastore odata = 20 2026-02-17T09:52:25.800 INFO:tasks.ceph:[osd] debug seastore omap = 20 2026-02-17T09:52:25.800 INFO:tasks.ceph:[osd] debug seastore onode = 20 2026-02-17T09:52:25.800 INFO:tasks.ceph:[osd] debug seastore t = 20 2026-02-17T09:52:25.800 INFO:tasks.ceph:[osd] debug seastore tm = 20 2026-02-17T09:52:25.801 INFO:tasks.ceph:[osd] osd objectstore = seastore 2026-02-17T09:52:25.801 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-17T09:52:25.801 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-17T09:52:25.801 INFO:tasks.ceph:[osd] seastore cachepin type = 2Q 2026-02-17T09:52:25.801 INFO:tasks.ceph:[osd] seastore main device type = RANDOM_BLOCK_SSD 2026-02-17T09:52:25.801 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-17T09:52:25.801 INFO:tasks.ceph:[global] auth client required = none 2026-02-17T09:52:25.801 INFO:tasks.ceph:[global] auth cluster required = none 2026-02-17T09:52:25.801 INFO:tasks.ceph:[global] auth service required = none 2026-02-17T09:52:25.801 INFO:tasks.ceph:[global] auth supported = none 2026-02-17T09:52:25.801 INFO:tasks.ceph:[global] debug asok = 0/0 2026-02-17T09:52:25.801 INFO:tasks.ceph:[global] debug auth = 0/0 2026-02-17T09:52:25.802 INFO:tasks.ceph:[global] debug bdev = 0/0 2026-02-17T09:52:25.802 INFO:tasks.ceph:[global] debug bluefs = 0/0 2026-02-17T09:52:25.802 INFO:tasks.ceph:[global] debug bluestore = 0/0 2026-02-17T09:52:25.802 INFO:tasks.ceph:[global] debug buffer = 0/0 2026-02-17T09:52:25.802 INFO:tasks.ceph:[global] debug civetweb = 0/0 2026-02-17T09:52:25.802 INFO:tasks.ceph:[global] debug client = 0/0 2026-02-17T09:52:25.802 INFO:tasks.ceph:[global] debug compressor = 0/0 2026-02-17T09:52:25.802 INFO:tasks.ceph:[global] debug context = 0/0 2026-02-17T09:52:25.802 INFO:tasks.ceph:[global] debug crush = 0/0 2026-02-17T09:52:25.802 INFO:tasks.ceph:[global] debug crypto = 0/0 2026-02-17T09:52:25.802 INFO:tasks.ceph:[global] debug dpdk = 0/0 2026-02-17T09:52:25.802 INFO:tasks.ceph:[global] debug eventtrace = 0/0 2026-02-17T09:52:25.802 INFO:tasks.ceph:[global] debug filer = 0/0 2026-02-17T09:52:25.803 INFO:tasks.ceph:[global] debug filestore = 0/0 2026-02-17T09:52:25.803 INFO:tasks.ceph:[global] debug finisher = 0/0 2026-02-17T09:52:25.803 INFO:tasks.ceph:[global] debug fuse = 0/0 2026-02-17T09:52:25.803 INFO:tasks.ceph:[global] debug heartbeatmap = 0/0 2026-02-17T09:52:25.803 INFO:tasks.ceph:[global] debug javaclient = 0/0 2026-02-17T09:52:25.803 INFO:tasks.ceph:[global] debug journal = 0/0 2026-02-17T09:52:25.803 INFO:tasks.ceph:[global] debug journaler = 0/0 2026-02-17T09:52:25.803 INFO:tasks.ceph:[global] debug kstore = 0/0 2026-02-17T09:52:25.803 INFO:tasks.ceph:[global] debug leveldb = 0/0 2026-02-17T09:52:25.803 INFO:tasks.ceph:[global] debug lockdep = 0/0 2026-02-17T09:52:25.803 INFO:tasks.ceph:[global] debug mds = 0/0 2026-02-17T09:52:25.803 INFO:tasks.ceph:[global] debug mds balancer = 0/0 2026-02-17T09:52:25.803 INFO:tasks.ceph:[global] debug mds locker = 0/0 2026-02-17T09:52:25.804 INFO:tasks.ceph:[global] debug mds log = 0/0 2026-02-17T09:52:25.804 INFO:tasks.ceph:[global] debug mds log expire = 0/0 2026-02-17T09:52:25.804 INFO:tasks.ceph:[global] debug mds migrator = 0/0 2026-02-17T09:52:25.804 INFO:tasks.ceph:[global] debug memdb = 0/0 2026-02-17T09:52:25.804 INFO:tasks.ceph:[global] debug mgr = 0/0 2026-02-17T09:52:25.804 INFO:tasks.ceph:[global] debug mgrc = 0/0 2026-02-17T09:52:25.804 INFO:tasks.ceph:[global] debug mon = 0/0 2026-02-17T09:52:25.804 INFO:tasks.ceph:[global] debug monc = 0/0 2026-02-17T09:52:25.804 INFO:tasks.ceph:[global] debug ms = 0/0 2026-02-17T09:52:25.804 INFO:tasks.ceph:[global] debug objclass = 0/0 2026-02-17T09:52:25.804 INFO:tasks.ceph:[global] debug objectcacher = 0/0 2026-02-17T09:52:25.804 INFO:tasks.ceph:[global] debug objecter = 0/0 2026-02-17T09:52:25.804 INFO:tasks.ceph:[global] debug optracker = 0/0 2026-02-17T09:52:25.805 INFO:tasks.ceph:[global] debug osd = 0/0 2026-02-17T09:52:25.805 INFO:tasks.ceph:[global] debug paxos = 0/0 2026-02-17T09:52:25.805 INFO:tasks.ceph:[global] debug perfcounter = 0/0 2026-02-17T09:52:25.805 INFO:tasks.ceph:[global] debug rados = 0/0 2026-02-17T09:52:25.805 INFO:tasks.ceph:[global] debug rbd = 0/0 2026-02-17T09:52:25.805 INFO:tasks.ceph:[global] debug rbd mirror = 0/0 2026-02-17T09:52:25.805 INFO:tasks.ceph:[global] debug rbd replay = 0/0 2026-02-17T09:52:25.805 INFO:tasks.ceph:[global] debug refs = 0/0 2026-02-17T09:52:25.805 INFO:tasks.ceph:[global] debug rgw = 0/0 2026-02-17T09:52:25.805 INFO:tasks.ceph:[global] debug rgw lifecycle = 0/0 2026-02-17T09:52:25.805 INFO:tasks.ceph:[global] debug rgw notification = 0/0 2026-02-17T09:52:25.805 INFO:tasks.ceph:[global] debug rgw sync = 0/0 2026-02-17T09:52:25.805 INFO:tasks.ceph:[global] debug rocksdb = 0/0 2026-02-17T09:52:25.805 INFO:tasks.ceph:[global] debug striper = 0/0 2026-02-17T09:52:25.806 INFO:tasks.ceph:[global] debug throttle = 0/0 2026-02-17T09:52:25.806 INFO:tasks.ceph:[global] debug timer = 0/0 2026-02-17T09:52:25.806 INFO:tasks.ceph:[global] debug tp = 0/0 2026-02-17T09:52:25.806 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-17T09:52:25.806 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-17T09:52:25.806 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-17T09:52:25.806 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-17T09:52:25.806 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-17T09:52:25.806 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-17T09:52:25.806 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-17T09:52:25.806 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T09:52:25.806 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T09:52:25.807 INFO:tasks.ceph:[mon] debug mon = 0/0 2026-02-17T09:52:25.807 INFO:tasks.ceph:[mon] debug ms = 0/0 2026-02-17T09:52:25.807 INFO:tasks.ceph:[mon] debug paxos = 0/0 2026-02-17T09:52:25.807 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-17T09:52:25.807 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T09:52:25.807 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T09:52:25.877 INFO:teuthology.orchestra.run.trial070.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T09:52:25.880 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T09:52:25.966 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T09:52:25.991 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.70')] 2026-02-17T09:52:25.992 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'none', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.70', 'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': '0/0', 'debug mon': '0/0', 'debug paxos': '0/0', 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-17T09:52:25.994 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:52:25.994 DEBUG:teuthology.orchestra.run.trial070:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T09:52:26.048 DEBUG:teuthology.orchestra.run.trial070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.70 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T09:52:26.131 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:26.128+0000 7fc941a3bf40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:26.132 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:26.128+0000 7fc941a3bf40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:26.132 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:26.129+0000 7fc941a3bf40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:26.133 INFO:teuthology.orchestra.run.trial070.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T09:52:26.133 INFO:teuthology.orchestra.run.trial070.stdout:monmaptool: generated fsid b5dc0509-181f-4414-8630-53ac7a057760 2026-02-17T09:52:26.133 INFO:teuthology.orchestra.run.trial070.stdout:setting min_mon_release = tentacle 2026-02-17T09:52:26.133 INFO:teuthology.orchestra.run.trial070.stdout:epoch 0 2026-02-17T09:52:26.133 INFO:teuthology.orchestra.run.trial070.stdout:fsid b5dc0509-181f-4414-8630-53ac7a057760 2026-02-17T09:52:26.134 INFO:teuthology.orchestra.run.trial070.stdout:last_changed 2026-02-17T09:52:26.130759+0000 2026-02-17T09:52:26.134 INFO:teuthology.orchestra.run.trial070.stdout:created 2026-02-17T09:52:26.130759+0000 2026-02-17T09:52:26.134 INFO:teuthology.orchestra.run.trial070.stdout:min_mon_release 20 (tentacle) 2026-02-17T09:52:26.134 INFO:teuthology.orchestra.run.trial070.stdout:election_strategy: 1 2026-02-17T09:52:26.134 INFO:teuthology.orchestra.run.trial070.stdout:0: [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] mon.a 2026-02-17T09:52:26.134 INFO:teuthology.orchestra.run.trial070.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-17T09:52:26.135 DEBUG:teuthology.orchestra.run.trial070:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T09:52:26.203 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b5dc0509-181f-4414-8630-53ac7a057760... 2026-02-17T09:52:26.206 DEBUG:teuthology.orchestra.run.trial070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T09:52:26.288 INFO:teuthology.orchestra.run.trial070.stdout:[global] 2026-02-17T09:52:26.288 INFO:teuthology.orchestra.run.trial070.stdout: chdir = "" 2026-02-17T09:52:26.289 INFO:teuthology.orchestra.run.trial070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T09:52:26.289 INFO:teuthology.orchestra.run.trial070.stdout: auth supported = none 2026-02-17T09:52:26.289 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.289 INFO:teuthology.orchestra.run.trial070.stdout: filestore xattr use omap = true 2026-02-17T09:52:26.289 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.289 INFO:teuthology.orchestra.run.trial070.stdout: mon clock drift allowed = 1.000 2026-02-17T09:52:26.289 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.289 INFO:teuthology.orchestra.run.trial070.stdout: osd crush chooseleaf type = 0 2026-02-17T09:52:26.289 INFO:teuthology.orchestra.run.trial070.stdout: auth debug = true 2026-02-17T09:52:26.290 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.290 INFO:teuthology.orchestra.run.trial070.stdout: ms die on old message = true 2026-02-17T09:52:26.290 INFO:teuthology.orchestra.run.trial070.stdout: ms die on bug = true 2026-02-17T09:52:26.290 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.290 INFO:teuthology.orchestra.run.trial070.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T09:52:26.290 INFO:teuthology.orchestra.run.trial070.stdout: mon pg warn max object skew = 0 2026-02-17T09:52:26.290 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.290 INFO:teuthology.orchestra.run.trial070.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T09:52:26.290 INFO:teuthology.orchestra.run.trial070.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T09:52:26.290 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.290 INFO:teuthology.orchestra.run.trial070.stdout: osd pool default size = 2 2026-02-17T09:52:26.290 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.291 INFO:teuthology.orchestra.run.trial070.stdout: mon osd allow primary affinity = true 2026-02-17T09:52:26.291 INFO:teuthology.orchestra.run.trial070.stdout: mon osd allow pg remap = true 2026-02-17T09:52:26.291 INFO:teuthology.orchestra.run.trial070.stdout: mon warn on legacy crush tunables = false 2026-02-17T09:52:26.291 INFO:teuthology.orchestra.run.trial070.stdout: mon warn on crush straw calc version zero = false 2026-02-17T09:52:26.291 INFO:teuthology.orchestra.run.trial070.stdout: mon warn on no sortbitwise = false 2026-02-17T09:52:26.291 INFO:teuthology.orchestra.run.trial070.stdout: mon warn on osd down out interval zero = false 2026-02-17T09:52:26.291 INFO:teuthology.orchestra.run.trial070.stdout: mon warn on too few osds = false 2026-02-17T09:52:26.291 INFO:teuthology.orchestra.run.trial070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T09:52:26.291 INFO:teuthology.orchestra.run.trial070.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T09:52:26.291 INFO:teuthology.orchestra.run.trial070.stdout: mon_allow_pool_size_one = true 2026-02-17T09:52:26.291 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.291 INFO:teuthology.orchestra.run.trial070.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T09:52:26.292 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.292 INFO:teuthology.orchestra.run.trial070.stdout: osd default data pool replay window = 5 2026-02-17T09:52:26.292 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.292 INFO:teuthology.orchestra.run.trial070.stdout: mon allow pool delete = true 2026-02-17T09:52:26.292 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.292 INFO:teuthology.orchestra.run.trial070.stdout: mon cluster log file level = debug 2026-02-17T09:52:26.292 INFO:teuthology.orchestra.run.trial070.stdout: debug asserts on shutdown = true 2026-02-17T09:52:26.292 INFO:teuthology.orchestra.run.trial070.stdout: mon health detail to clog = false 2026-02-17T09:52:26.292 INFO:teuthology.orchestra.run.trial070.stdout: mon host = 10.20.193.70 2026-02-17T09:52:26.292 INFO:teuthology.orchestra.run.trial070.stdout: auth client required = none 2026-02-17T09:52:26.292 INFO:teuthology.orchestra.run.trial070.stdout: auth cluster required = none 2026-02-17T09:52:26.292 INFO:teuthology.orchestra.run.trial070.stdout: auth service required = none 2026-02-17T09:52:26.293 INFO:teuthology.orchestra.run.trial070.stdout: debug asok = 0/0 2026-02-17T09:52:26.293 INFO:teuthology.orchestra.run.trial070.stdout: debug auth = 0/0 2026-02-17T09:52:26.293 INFO:teuthology.orchestra.run.trial070.stdout: debug bdev = 0/0 2026-02-17T09:52:26.293 INFO:teuthology.orchestra.run.trial070.stdout: debug bluefs = 0/0 2026-02-17T09:52:26.293 INFO:teuthology.orchestra.run.trial070.stdout: debug bluestore = 0/0 2026-02-17T09:52:26.293 INFO:teuthology.orchestra.run.trial070.stdout: debug buffer = 0/0 2026-02-17T09:52:26.293 INFO:teuthology.orchestra.run.trial070.stdout: debug civetweb = 0/0 2026-02-17T09:52:26.293 INFO:teuthology.orchestra.run.trial070.stdout: debug client = 0/0 2026-02-17T09:52:26.293 INFO:teuthology.orchestra.run.trial070.stdout: debug compressor = 0/0 2026-02-17T09:52:26.293 INFO:teuthology.orchestra.run.trial070.stdout: debug context = 0/0 2026-02-17T09:52:26.293 INFO:teuthology.orchestra.run.trial070.stdout: debug crush = 0/0 2026-02-17T09:52:26.293 INFO:teuthology.orchestra.run.trial070.stdout: debug crypto = 0/0 2026-02-17T09:52:26.293 INFO:teuthology.orchestra.run.trial070.stdout: debug dpdk = 0/0 2026-02-17T09:52:26.294 INFO:teuthology.orchestra.run.trial070.stdout: debug eventtrace = 0/0 2026-02-17T09:52:26.294 INFO:teuthology.orchestra.run.trial070.stdout: debug filer = 0/0 2026-02-17T09:52:26.294 INFO:teuthology.orchestra.run.trial070.stdout: debug filestore = 0/0 2026-02-17T09:52:26.294 INFO:teuthology.orchestra.run.trial070.stdout: debug finisher = 0/0 2026-02-17T09:52:26.294 INFO:teuthology.orchestra.run.trial070.stdout: debug fuse = 0/0 2026-02-17T09:52:26.294 INFO:teuthology.orchestra.run.trial070.stdout: debug heartbeatmap = 0/0 2026-02-17T09:52:26.294 INFO:teuthology.orchestra.run.trial070.stdout: debug javaclient = 0/0 2026-02-17T09:52:26.294 INFO:teuthology.orchestra.run.trial070.stdout: debug journal = 0/0 2026-02-17T09:52:26.294 INFO:teuthology.orchestra.run.trial070.stdout: debug journaler = 0/0 2026-02-17T09:52:26.294 INFO:teuthology.orchestra.run.trial070.stdout: debug kstore = 0/0 2026-02-17T09:52:26.294 INFO:teuthology.orchestra.run.trial070.stdout: debug leveldb = 0/0 2026-02-17T09:52:26.294 INFO:teuthology.orchestra.run.trial070.stdout: debug lockdep = 0/0 2026-02-17T09:52:26.294 INFO:teuthology.orchestra.run.trial070.stdout: debug mds = 0/0 2026-02-17T09:52:26.294 INFO:teuthology.orchestra.run.trial070.stdout: debug mds balancer = 0/0 2026-02-17T09:52:26.295 INFO:teuthology.orchestra.run.trial070.stdout: debug mds locker = 0/0 2026-02-17T09:52:26.295 INFO:teuthology.orchestra.run.trial070.stdout: debug mds log = 0/0 2026-02-17T09:52:26.295 INFO:teuthology.orchestra.run.trial070.stdout: debug mds log expire = 0/0 2026-02-17T09:52:26.295 INFO:teuthology.orchestra.run.trial070.stdout: debug mds migrator = 0/0 2026-02-17T09:52:26.295 INFO:teuthology.orchestra.run.trial070.stdout: debug memdb = 0/0 2026-02-17T09:52:26.295 INFO:teuthology.orchestra.run.trial070.stdout: debug mgr = 0/0 2026-02-17T09:52:26.295 INFO:teuthology.orchestra.run.trial070.stdout: debug mgrc = 0/0 2026-02-17T09:52:26.295 INFO:teuthology.orchestra.run.trial070.stdout: debug mon = 0/0 2026-02-17T09:52:26.295 INFO:teuthology.orchestra.run.trial070.stdout: debug monc = 0/0 2026-02-17T09:52:26.295 INFO:teuthology.orchestra.run.trial070.stdout: debug ms = 0/0 2026-02-17T09:52:26.295 INFO:teuthology.orchestra.run.trial070.stdout: debug objclass = 0/0 2026-02-17T09:52:26.295 INFO:teuthology.orchestra.run.trial070.stdout: debug objectcacher = 0/0 2026-02-17T09:52:26.295 INFO:teuthology.orchestra.run.trial070.stdout: debug objecter = 0/0 2026-02-17T09:52:26.296 INFO:teuthology.orchestra.run.trial070.stdout: debug optracker = 0/0 2026-02-17T09:52:26.296 INFO:teuthology.orchestra.run.trial070.stdout: debug osd = 0/0 2026-02-17T09:52:26.296 INFO:teuthology.orchestra.run.trial070.stdout: debug paxos = 0/0 2026-02-17T09:52:26.296 INFO:teuthology.orchestra.run.trial070.stdout: debug perfcounter = 0/0 2026-02-17T09:52:26.296 INFO:teuthology.orchestra.run.trial070.stdout: debug rados = 0/0 2026-02-17T09:52:26.296 INFO:teuthology.orchestra.run.trial070.stdout: debug rbd = 0/0 2026-02-17T09:52:26.296 INFO:teuthology.orchestra.run.trial070.stdout: debug rbd mirror = 0/0 2026-02-17T09:52:26.296 INFO:teuthology.orchestra.run.trial070.stdout: debug rbd replay = 0/0 2026-02-17T09:52:26.296 INFO:teuthology.orchestra.run.trial070.stdout: debug refs = 0/0 2026-02-17T09:52:26.296 INFO:teuthology.orchestra.run.trial070.stdout: debug rgw = 0/0 2026-02-17T09:52:26.296 INFO:teuthology.orchestra.run.trial070.stdout: debug rgw lifecycle = 0/0 2026-02-17T09:52:26.296 INFO:teuthology.orchestra.run.trial070.stdout: debug rgw notification = 0/0 2026-02-17T09:52:26.296 INFO:teuthology.orchestra.run.trial070.stdout: debug rgw sync = 0/0 2026-02-17T09:52:26.297 INFO:teuthology.orchestra.run.trial070.stdout: debug rocksdb = 0/0 2026-02-17T09:52:26.297 INFO:teuthology.orchestra.run.trial070.stdout: debug striper = 0/0 2026-02-17T09:52:26.297 INFO:teuthology.orchestra.run.trial070.stdout: debug throttle = 0/0 2026-02-17T09:52:26.297 INFO:teuthology.orchestra.run.trial070.stdout: debug timer = 0/0 2026-02-17T09:52:26.297 INFO:teuthology.orchestra.run.trial070.stdout: debug tp = 0/0 2026-02-17T09:52:26.297 INFO:teuthology.orchestra.run.trial070.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-17T09:52:26.297 INFO:teuthology.orchestra.run.trial070.stdout: ms client mode = crc 2026-02-17T09:52:26.297 INFO:teuthology.orchestra.run.trial070.stdout: ms cluster mode = crc 2026-02-17T09:52:26.297 INFO:teuthology.orchestra.run.trial070.stdout: ms mon client mode = crc 2026-02-17T09:52:26.298 INFO:teuthology.orchestra.run.trial070.stdout: ms mon cluster mode = crc 2026-02-17T09:52:26.298 INFO:teuthology.orchestra.run.trial070.stdout: ms mon service mode = crc 2026-02-17T09:52:26.298 INFO:teuthology.orchestra.run.trial070.stdout: ms service mode = crc 2026-02-17T09:52:26.298 INFO:teuthology.orchestra.run.trial070.stdout: fsid = b5dc0509-181f-4414-8630-53ac7a057760 2026-02-17T09:52:26.298 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.298 INFO:teuthology.orchestra.run.trial070.stdout:[osd] 2026-02-17T09:52:26.298 INFO:teuthology.orchestra.run.trial070.stdout: osd journal size = 100 2026-02-17T09:52:26.298 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.298 INFO:teuthology.orchestra.run.trial070.stdout: osd scrub load threshold = 5.0 2026-02-17T09:52:26.298 INFO:teuthology.orchestra.run.trial070.stdout: osd scrub max interval = 600 2026-02-17T09:52:26.298 INFO:teuthology.orchestra.run.trial070.stdout: osd mclock profile = high_recovery_ops 2026-02-17T09:52:26.298 INFO:teuthology.orchestra.run.trial070.stdout: osd mclock skip benchmark = true 2026-02-17T09:52:26.299 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.299 INFO:teuthology.orchestra.run.trial070.stdout: osd recover clone overlap = true 2026-02-17T09:52:26.299 INFO:teuthology.orchestra.run.trial070.stdout: osd recovery max chunk = 1048576 2026-02-17T09:52:26.299 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.299 INFO:teuthology.orchestra.run.trial070.stdout: osd debug shutdown = true 2026-02-17T09:52:26.299 INFO:teuthology.orchestra.run.trial070.stdout: osd debug op order = true 2026-02-17T09:52:26.299 INFO:teuthology.orchestra.run.trial070.stdout: osd debug verify stray on activate = true 2026-02-17T09:52:26.299 INFO:teuthology.orchestra.run.trial070.stdout: osd debug trim objects = true 2026-02-17T09:52:26.299 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.299 INFO:teuthology.orchestra.run.trial070.stdout: osd open classes on start = true 2026-02-17T09:52:26.299 INFO:teuthology.orchestra.run.trial070.stdout: osd debug pg log writeout = true 2026-02-17T09:52:26.299 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.300 INFO:teuthology.orchestra.run.trial070.stdout: osd deep scrub update digest min age = 30 2026-02-17T09:52:26.300 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.300 INFO:teuthology.orchestra.run.trial070.stdout: osd map max advance = 10 2026-02-17T09:52:26.300 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.300 INFO:teuthology.orchestra.run.trial070.stdout: journal zero on create = true 2026-02-17T09:52:26.300 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.300 INFO:teuthology.orchestra.run.trial070.stdout: filestore ondisk finisher threads = 3 2026-02-17T09:52:26.300 INFO:teuthology.orchestra.run.trial070.stdout: filestore apply finisher threads = 3 2026-02-17T09:52:26.300 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.300 INFO:teuthology.orchestra.run.trial070.stdout: bdev debug aio = true 2026-02-17T09:52:26.300 INFO:teuthology.orchestra.run.trial070.stdout: osd debug misdirected ops = true 2026-02-17T09:52:26.300 INFO:teuthology.orchestra.run.trial070.stdout: debug monc = 20 2026-02-17T09:52:26.300 INFO:teuthology.orchestra.run.trial070.stdout: crimson cpu num = 4 2026-02-17T09:52:26.301 INFO:teuthology.orchestra.run.trial070.stdout: crimson osd obc lru size = 10 2026-02-17T09:52:26.301 INFO:teuthology.orchestra.run.trial070.stdout: debug filestore = 0/0 2026-02-17T09:52:26.301 INFO:teuthology.orchestra.run.trial070.stdout: debug journal = 0/0 2026-02-17T09:52:26.301 INFO:teuthology.orchestra.run.trial070.stdout: debug ms = 0/0 2026-02-17T09:52:26.301 INFO:teuthology.orchestra.run.trial070.stdout: debug osd = 0/0 2026-02-17T09:52:26.301 INFO:teuthology.orchestra.run.trial070.stdout: debug seastore = 20 2026-02-17T09:52:26.301 INFO:teuthology.orchestra.run.trial070.stdout: debug seastore backref = 20 2026-02-17T09:52:26.301 INFO:teuthology.orchestra.run.trial070.stdout: debug seastore cache = 20 2026-02-17T09:52:26.301 INFO:teuthology.orchestra.run.trial070.stdout: debug seastore cleaner = 20 2026-02-17T09:52:26.301 INFO:teuthology.orchestra.run.trial070.stdout: debug seastore device = 20 2026-02-17T09:52:26.301 INFO:teuthology.orchestra.run.trial070.stdout: debug seastore epm = 20 2026-02-17T09:52:26.301 INFO:teuthology.orchestra.run.trial070.stdout: debug seastore fixedkv tree = 20 2026-02-17T09:52:26.301 INFO:teuthology.orchestra.run.trial070.stdout: debug seastore journal = 20 2026-02-17T09:52:26.302 INFO:teuthology.orchestra.run.trial070.stdout: debug seastore lba = 20 2026-02-17T09:52:26.302 INFO:teuthology.orchestra.run.trial070.stdout: debug seastore odata = 20 2026-02-17T09:52:26.302 INFO:teuthology.orchestra.run.trial070.stdout: debug seastore omap = 20 2026-02-17T09:52:26.302 INFO:teuthology.orchestra.run.trial070.stdout: debug seastore onode = 20 2026-02-17T09:52:26.302 INFO:teuthology.orchestra.run.trial070.stdout: debug seastore t = 20 2026-02-17T09:52:26.302 INFO:teuthology.orchestra.run.trial070.stdout: debug seastore tm = 20 2026-02-17T09:52:26.302 INFO:teuthology.orchestra.run.trial070.stdout: osd objectstore = seastore 2026-02-17T09:52:26.302 INFO:teuthology.orchestra.run.trial070.stdout: osd shutdown pgref assert = True 2026-02-17T09:52:26.302 INFO:teuthology.orchestra.run.trial070.stdout: seastore cachepin size pershard = 64M 2026-02-17T09:52:26.302 INFO:teuthology.orchestra.run.trial070.stdout: seastore cachepin type = 2Q 2026-02-17T09:52:26.302 INFO:teuthology.orchestra.run.trial070.stdout: seastore main device type = RANDOM_BLOCK_SSD 2026-02-17T09:52:26.302 INFO:teuthology.orchestra.run.trial070.stdout: seastore max concurrent transactions = 8 2026-02-17T09:52:26.302 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.303 INFO:teuthology.orchestra.run.trial070.stdout:[mgr] 2026-02-17T09:52:26.303 INFO:teuthology.orchestra.run.trial070.stdout: debug ms = 1 2026-02-17T09:52:26.303 INFO:teuthology.orchestra.run.trial070.stdout: debug mgr = 20 2026-02-17T09:52:26.303 INFO:teuthology.orchestra.run.trial070.stdout: debug mon = 20 2026-02-17T09:52:26.303 INFO:teuthology.orchestra.run.trial070.stdout: debug auth = 20 2026-02-17T09:52:26.303 INFO:teuthology.orchestra.run.trial070.stdout: mon reweight min pgs per osd = 4 2026-02-17T09:52:26.303 INFO:teuthology.orchestra.run.trial070.stdout: mon reweight min bytes per osd = 10 2026-02-17T09:52:26.303 INFO:teuthology.orchestra.run.trial070.stdout: mgr/telemetry/nag = false 2026-02-17T09:52:26.303 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.303 INFO:teuthology.orchestra.run.trial070.stdout:[mon] 2026-02-17T09:52:26.303 INFO:teuthology.orchestra.run.trial070.stdout: debug ms = 0/0 2026-02-17T09:52:26.303 INFO:teuthology.orchestra.run.trial070.stdout: debug mon = 0/0 2026-02-17T09:52:26.304 INFO:teuthology.orchestra.run.trial070.stdout: debug paxos = 0/0 2026-02-17T09:52:26.304 INFO:teuthology.orchestra.run.trial070.stdout: debug auth = 20 2026-02-17T09:52:26.304 INFO:teuthology.orchestra.run.trial070.stdout: mon data avail warn = 5 2026-02-17T09:52:26.304 INFO:teuthology.orchestra.run.trial070.stdout: mon mgr mkfs grace = 240 2026-02-17T09:52:26.304 INFO:teuthology.orchestra.run.trial070.stdout: mon reweight min pgs per osd = 4 2026-02-17T09:52:26.304 INFO:teuthology.orchestra.run.trial070.stdout: mon osd reporter subtree level = osd 2026-02-17T09:52:26.304 INFO:teuthology.orchestra.run.trial070.stdout: mon osd prime pg temp = true 2026-02-17T09:52:26.304 INFO:teuthology.orchestra.run.trial070.stdout: mon reweight min bytes per osd = 10 2026-02-17T09:52:26.304 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.304 INFO:teuthology.orchestra.run.trial070.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T09:52:26.304 INFO:teuthology.orchestra.run.trial070.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T09:52:26.304 INFO:teuthology.orchestra.run.trial070.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T09:52:26.304 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.305 INFO:teuthology.orchestra.run.trial070.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T09:52:26.305 INFO:teuthology.orchestra.run.trial070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T09:52:26.305 INFO:teuthology.orchestra.run.trial070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T09:52:26.305 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.305 INFO:teuthology.orchestra.run.trial070.stdout: # 1m isn't quite enough 2026-02-17T09:52:26.305 INFO:teuthology.orchestra.run.trial070.stdout: mon_down_mkfs_grace = 2m 2026-02-17T09:52:26.305 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.305 INFO:teuthology.orchestra.run.trial070.stdout: mon_warn_on_filestore_osds = false 2026-02-17T09:52:26.305 INFO:teuthology.orchestra.run.trial070.stdout: osd pool default crimson = True 2026-02-17T09:52:26.305 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:26.305 INFO:teuthology.orchestra.run.trial070.stdout:[client] 2026-02-17T09:52:26.306 INFO:teuthology.orchestra.run.trial070.stdout: rgw cache enabled = true 2026-02-17T09:52:26.306 INFO:teuthology.orchestra.run.trial070.stdout: rgw enable ops log = true 2026-02-17T09:52:26.306 INFO:teuthology.orchestra.run.trial070.stdout: rgw enable usage log = true 2026-02-17T09:52:26.306 INFO:teuthology.orchestra.run.trial070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T09:52:26.306 INFO:teuthology.orchestra.run.trial070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T09:52:26.306 INFO:teuthology.orchestra.run.trial070.stdout:[mon.a] 2026-02-17T09:52:26.307 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T09:52:26.308 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T09:52:26.398 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T09:52:26.398 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:52:26.399 DEBUG:teuthology.orchestra.run.trial070:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T09:52:26.417 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:52:26.417 DEBUG:teuthology.orchestra.run.trial070:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T09:52:26.473 INFO:tasks.ceph:Sending monmap to node ubuntu@trial070.front.sepia.ceph.com 2026-02-17T09:52:26.473 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:52:26.473 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T09:52:26.473 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T09:52:26.546 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:52:26.546 DEBUG:teuthology.orchestra.run.trial070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T09:52:26.603 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T09:52:26.603 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T09:52:26.604 DEBUG:teuthology.orchestra.run.trial070:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T09:52:26.693 INFO:teuthology.orchestra.run.trial070.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T09:52:26.696 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T09:52:26.696 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T09:52:26.697 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T09:52:26.738 INFO:teuthology.orchestra.run.trial070.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T09:52:26.750 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T09:52:26.750 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T09:52:26.751 DEBUG:teuthology.orchestra.run.trial070:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T09:52:26.815 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T09:52:26.815 INFO:tasks.ceph:role: osd.0 2026-02-17T09:52:26.815 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial070.front.sepia.ceph.com 2026-02-17T09:52:26.816 DEBUG:teuthology.orchestra.run.trial070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T09:52:26.881 INFO:teuthology.orchestra.run.trial070.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T09:52:26.881 INFO:teuthology.orchestra.run.trial070.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T09:52:26.881 INFO:teuthology.orchestra.run.trial070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T09:52:26.881 INFO:teuthology.orchestra.run.trial070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T09:52:26.881 INFO:teuthology.orchestra.run.trial070.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T09:52:26.882 INFO:teuthology.orchestra.run.trial070.stdout: = sunit=0 swidth=0 blks 2026-02-17T09:52:26.882 INFO:teuthology.orchestra.run.trial070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T09:52:26.882 INFO:teuthology.orchestra.run.trial070.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T09:52:26.882 INFO:teuthology.orchestra.run.trial070.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T09:52:26.882 INFO:teuthology.orchestra.run.trial070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T09:52:27.488 INFO:teuthology.orchestra.run.trial070.stdout:Discarding blocks...Done. 2026-02-17T09:52:27.491 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial070.front.sepia.ceph.com -o noatime 2026-02-17T09:52:27.491 DEBUG:teuthology.orchestra.run.trial070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T09:52:27.559 DEBUG:teuthology.orchestra.run.trial070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T09:52:27.627 DEBUG:teuthology.orchestra.run.trial070:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T09:52:27.692 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T09:52:27.692 INFO:tasks.ceph:role: osd.1 2026-02-17T09:52:27.692 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial070.front.sepia.ceph.com 2026-02-17T09:52:27.692 DEBUG:teuthology.orchestra.run.trial070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T09:52:27.757 INFO:teuthology.orchestra.run.trial070.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T09:52:27.757 INFO:teuthology.orchestra.run.trial070.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T09:52:27.757 INFO:teuthology.orchestra.run.trial070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T09:52:27.757 INFO:teuthology.orchestra.run.trial070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T09:52:27.758 INFO:teuthology.orchestra.run.trial070.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T09:52:27.758 INFO:teuthology.orchestra.run.trial070.stdout: = sunit=0 swidth=0 blks 2026-02-17T09:52:27.758 INFO:teuthology.orchestra.run.trial070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T09:52:27.758 INFO:teuthology.orchestra.run.trial070.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T09:52:27.758 INFO:teuthology.orchestra.run.trial070.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T09:52:27.758 INFO:teuthology.orchestra.run.trial070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T09:52:28.335 INFO:teuthology.orchestra.run.trial070.stdout:Discarding blocks...Done. 2026-02-17T09:52:28.337 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial070.front.sepia.ceph.com -o noatime 2026-02-17T09:52:28.337 DEBUG:teuthology.orchestra.run.trial070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-17T09:52:28.409 DEBUG:teuthology.orchestra.run.trial070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T09:52:28.476 DEBUG:teuthology.orchestra.run.trial070:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T09:52:28.540 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T09:52:28.541 INFO:tasks.ceph:role: osd.2 2026-02-17T09:52:28.541 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial070.front.sepia.ceph.com 2026-02-17T09:52:28.541 DEBUG:teuthology.orchestra.run.trial070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T09:52:28.605 INFO:teuthology.orchestra.run.trial070.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T09:52:28.605 INFO:teuthology.orchestra.run.trial070.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T09:52:28.605 INFO:teuthology.orchestra.run.trial070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T09:52:28.605 INFO:teuthology.orchestra.run.trial070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T09:52:28.605 INFO:teuthology.orchestra.run.trial070.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T09:52:28.605 INFO:teuthology.orchestra.run.trial070.stdout: = sunit=0 swidth=0 blks 2026-02-17T09:52:28.605 INFO:teuthology.orchestra.run.trial070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T09:52:28.605 INFO:teuthology.orchestra.run.trial070.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T09:52:28.606 INFO:teuthology.orchestra.run.trial070.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T09:52:28.606 INFO:teuthology.orchestra.run.trial070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T09:52:29.202 INFO:teuthology.orchestra.run.trial070.stdout:Discarding blocks...Done. 2026-02-17T09:52:29.204 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial070.front.sepia.ceph.com -o noatime 2026-02-17T09:52:29.205 DEBUG:teuthology.orchestra.run.trial070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-17T09:52:29.277 DEBUG:teuthology.orchestra.run.trial070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T09:52:29.344 DEBUG:teuthology.orchestra.run.trial070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T09:52:29.495 INFO:teuthology.orchestra.run.trial070.stderr:INFO  osd - OSD::main: parsing early config 2026-02-17T09:52:29.549 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:29,548 seastar - Reactor backend: linux-aio 2026-02-17T09:52:29.559 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:29,558 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-17T09:52:29.560 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:29,558 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-17T09:52:29.561 INFO:teuthology.orchestra.run.trial070.stderr:==39258==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-17T09:52:29.620 INFO:teuthology.orchestra.run.trial070.stderr:DEBUG 2026-02-17 09:52:29,619 [shard 0:main] seastar - reactor::drain 2026-02-17T09:52:31.664 INFO:teuthology.orchestra.run.trial070.stderr:----------------------------------------------------- 2026-02-17T09:52:31.664 INFO:teuthology.orchestra.run.trial070.stderr:Suppressions used: 2026-02-17T09:52:31.664 INFO:teuthology.orchestra.run.trial070.stderr: count bytes template 2026-02-17T09:52:31.664 INFO:teuthology.orchestra.run.trial070.stderr: 1 8 MallocExtension::Register 2026-02-17T09:52:31.664 INFO:teuthology.orchestra.run.trial070.stderr:----------------------------------------------------- 2026-02-17T09:52:31.664 INFO:teuthology.orchestra.run.trial070.stderr: 2026-02-17T09:52:31.682 INFO:teuthology.orchestra.run.trial070.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-17T09:52:31.683 INFO:teuthology.orchestra.run.trial070.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-17T09:52:31.724 INFO:teuthology.orchestra.run.trial070.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-17T09:52:31.724 INFO:teuthology.orchestra.run.trial070.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-17T09:52:31.731 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:31,730 seastar - Reactor backend: linux-aio 2026-02-17T09:52:31.742 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:31,741 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-17T09:52:31.742 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:31,741 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-17T09:52:31.746 INFO:teuthology.orchestra.run.trial070.stderr:==39256==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-17T09:52:31.746 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:31,745 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-17T09:52:31.885 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f 0x3132c07 0x993d322 0x993d5ea 0x993e099 0x993e597 0x993ebc7 0x993ed31 0x9a4bfe1 0x9a5ede8 0x99c4c35 0x99c3c35 0x7b60f77 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f6fdb6 0x6f73bb7 0x6f79761 0x73e3839 0x7412d74 0x7256dc1 0x7256eb9 0x732d51e 0x732d5d7 0x732d78e 0x7412df5 0x7256f36 0x7256fbb 0x72819ab 0x73ec44d 0x73ec4d2 0x73ec5b0 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:31.885 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xfd191 /lib64/libasan.so.8+0xef979 0x7455c86 0x712bf15 0x712c4d4 0x786fa88 0x7b60eae 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f6fdb6 0x6f73bb7 0x6f79761 0x73e3839 0x7412d74 0x7256dc1 0x7256eb9 0x732d51e 0x732d5d7 0x732d78e 0x7412df5 0x7256f36 0x7256fbb 0x72819ab 0x73ec44d 0x73ec4d2 0x73ec5b0 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:31.885 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f /lib64/ld-linux-x86-64.so.2+0x16ed3 /lib64/libasan.so.8+0xc65b1 /lib64/libasan.so.8+0x157c7 0x1022b6b 0x10dd80a 0x993cdc4 0x993d0c1 0x993d334 0x993d5ea 0x993e099 0x993e597 0x993ebc7 0x993ed31 0x9a4bfe1 0x9a5ede8 0x99c4c35 0x99c3c35 0x7b60f77 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f6fdb6 0x6f73bb7 0x6f79761 0x73e3839 0x7412d74 0x7256dc1 0x7256eb9 0x732d51e 0x732d5d7 0x732d78e 0x7412df5 0x7256f36 0x7256fbb 0x72819ab 0x73ec44d 0x73ec4d2 0x73ec5b0 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:32.029 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xe91b /lib64/libasan.so.8+0xec776 0xc80a85 0x9a627ed 0x786fa4b 0x7b608a9 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f0b812 0x6f0db7a 0x73e34d8 0x740d434 0x7255508 0x7255600 0x732cdbe 0x732ce77 0x732d02e 0x740d4b5 0x725567d 0x7255702 0x727ca0b 0x73eae9c 0x73eaf21 0x73eafff 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:32.030 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f 0xd91a95 0x74a6cd6 0x727883b 0x712c1de 0x7b60bfb 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f0b812 0x6f0db7a 0x73e34d8 0x740d434 0x7255508 0x7255600 0x732cdbe 0x732ce77 0x732d02e 0x740d4b5 0x725567d 0x7255702 0x727ca0b 0x73eae9c 0x73eaf21 0x73eafff 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:32.030 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xb0494 /lib64/libasan.so.8+0xb1437 0xb3a067 0x1022af4 0x10dd80a 0x993cdc4 0x993d0c1 0x993d334 0x993d5ea 0x993dbac 0x9942cd1 0x99433b1 0x9a5c1c4 0x9a6086f 0x99c4c35 0x99c3c35 0x7b60f77 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f0b812 0x6f0db7a 0x73e34d8 0x740d434 0x7255508 0x7255600 0x732cdbe 0x732ce77 0x732d02e 0x740d4b5 0x725567d 0x7255702 0x727ca0b 0x73eae9c 0x73eaf21 0x73eafff 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:34.159 INFO:teuthology.orchestra.run.trial070.stderr:----------------------------------------------------- 2026-02-17T09:52:34.159 INFO:teuthology.orchestra.run.trial070.stderr:Suppressions used: 2026-02-17T09:52:34.159 INFO:teuthology.orchestra.run.trial070.stderr: count bytes template 2026-02-17T09:52:34.159 INFO:teuthology.orchestra.run.trial070.stderr: 1 8 MallocExtension::Register 2026-02-17T09:52:34.159 INFO:teuthology.orchestra.run.trial070.stderr:----------------------------------------------------- 2026-02-17T09:52:34.159 INFO:teuthology.orchestra.run.trial070.stderr: 2026-02-17T09:52:34.188 DEBUG:teuthology.orchestra.run.trial070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T09:52:34.213 DEBUG:teuthology.orchestra.run.trial070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T09:52:34.363 INFO:teuthology.orchestra.run.trial070.stderr:INFO  osd - OSD::main: parsing early config 2026-02-17T09:52:34.416 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:34,415 seastar - Reactor backend: linux-aio 2026-02-17T09:52:34.435 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:34,434 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-17T09:52:34.435 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:34,434 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-17T09:52:34.437 INFO:teuthology.orchestra.run.trial070.stderr:==39325==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-17T09:52:34.497 INFO:teuthology.orchestra.run.trial070.stderr:DEBUG 2026-02-17 09:52:34,496 [shard 0:main] seastar - reactor::drain 2026-02-17T09:52:36.526 INFO:teuthology.orchestra.run.trial070.stderr:----------------------------------------------------- 2026-02-17T09:52:36.527 INFO:teuthology.orchestra.run.trial070.stderr:Suppressions used: 2026-02-17T09:52:36.527 INFO:teuthology.orchestra.run.trial070.stderr: count bytes template 2026-02-17T09:52:36.527 INFO:teuthology.orchestra.run.trial070.stderr: 1 8 MallocExtension::Register 2026-02-17T09:52:36.527 INFO:teuthology.orchestra.run.trial070.stderr:----------------------------------------------------- 2026-02-17T09:52:36.527 INFO:teuthology.orchestra.run.trial070.stderr: 2026-02-17T09:52:36.546 INFO:teuthology.orchestra.run.trial070.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-17T09:52:36.547 INFO:teuthology.orchestra.run.trial070.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-17T09:52:36.589 INFO:teuthology.orchestra.run.trial070.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-17T09:52:36.589 INFO:teuthology.orchestra.run.trial070.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-17T09:52:36.596 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:36,595 seastar - Reactor backend: linux-aio 2026-02-17T09:52:36.608 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:36,607 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-17T09:52:36.608 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:36,607 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-17T09:52:36.611 INFO:teuthology.orchestra.run.trial070.stderr:==39323==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-17T09:52:36.611 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:36,611 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-17T09:52:36.752 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f 0x993caf8 0x993d0c1 0x993d334 0x993d5ea 0x993e099 0x993e597 0x993ebc7 0x993ed31 0x9a4bfe1 0x9a5ede8 0x99c4c35 0x99c3c35 0x7b60f77 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f6fdb6 0x6f73bb7 0x6f79761 0x73e3839 0x7412d74 0x7256dc1 0x7256eb9 0x732d51e 0x732d5d7 0x732d78e 0x7412df5 0x7256f36 0x7256fbb 0x72819ab 0x73ec44d 0x73ec4d2 0x73ec5b0 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:36.752 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f 0x993cea8 0x993d334 0x993d5ea 0x993e099 0x993e597 0x993ebc7 0x993ed31 0x9a4bfe1 0x9a5ede8 0x99c4c35 0x99c3c35 0x7b60f77 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f6fdb6 0x6f73bb7 0x6f79761 0x73e3839 0x7412d74 0x7256dc1 0x7256eb9 0x732d51e 0x732d5d7 0x732d78e 0x7412df5 0x7256f36 0x7256fbb 0x72819ab 0x73ec44d 0x73ec4d2 0x73ec5b0 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:36.752 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f 0xb3d065 0xbd8dbf 0x7c68d55 0x7c68ef4 0x7b516ef 0x7b60b53 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f6fdb6 0x6f73bb7 0x6f79761 0x73e3839 0x7412d74 0x7256dc1 0x7256eb9 0x732d51e 0x732d5d7 0x732d78e 0x7412df5 0x7256f36 0x7256fbb 0x72819ab 0x73ec44d 0x73ec4d2 0x73ec5b0 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:36.897 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc58e /lib64/libasan.so.8+0x8eea /lib64/libasan.so.8+0xedc45 0xd91811 0x9a61fb3 0x786fa4b 0x7b60eae 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f0b812 0x6f0db7a 0x73e34d8 0x740d434 0x7255508 0x7255600 0x732cdbe 0x732ce77 0x732d02e 0x740d4b5 0x725567d 0x7255702 0x727ca0b 0x73eae9c 0x73eaf21 0x73eafff 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:36.897 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc230 /lib64/libasan.so.8+0xc553 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x980b6db 0x98c1632 0x98c1748 0x98c1824 0x98c1aa0 0x98c2047 0x98c244b 0x98c2708 0x98c31c6 0x9a42740 0x9a42839 0x7b60eeb 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f0b812 0x6f0db7a 0x73e34d8 0x740d434 0x7255508 0x7255600 0x732cdbe 0x732ce77 0x732d02e 0x740d4b5 0x725567d 0x7255702 0x727ca0b 0x73eae9c 0x73eaf21 0x73eafff 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:36.897 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6592 /lib64/libasan.so.8+0x15197 0x10dd764 0x10dd7ff 0x993cdc4 0x993d0c1 0x993d334 0x993f05b 0x993f5a8 0x993f7a7 0x9a51a09 0x9a52164 0x9a5c3f6 0x9a6086f 0x99c4c35 0x99c3c35 0x7b60f77 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f0b812 0x6f0db7a 0x73e34d8 0x740d434 0x7255508 0x7255600 0x732cdbe 0x732ce77 0x732d02e 0x740d4b5 0x725567d 0x7255702 0x727ca0b 0x73eae9c 0x73eaf21 0x73eafff 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:39.048 INFO:teuthology.orchestra.run.trial070.stderr:----------------------------------------------------- 2026-02-17T09:52:39.049 INFO:teuthology.orchestra.run.trial070.stderr:Suppressions used: 2026-02-17T09:52:39.049 INFO:teuthology.orchestra.run.trial070.stderr: count bytes template 2026-02-17T09:52:39.049 INFO:teuthology.orchestra.run.trial070.stderr: 1 8 MallocExtension::Register 2026-02-17T09:52:39.049 INFO:teuthology.orchestra.run.trial070.stderr:----------------------------------------------------- 2026-02-17T09:52:39.049 INFO:teuthology.orchestra.run.trial070.stderr: 2026-02-17T09:52:39.080 DEBUG:teuthology.orchestra.run.trial070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T09:52:39.105 DEBUG:teuthology.orchestra.run.trial070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T09:52:39.258 INFO:teuthology.orchestra.run.trial070.stderr:INFO  osd - OSD::main: parsing early config 2026-02-17T09:52:39.317 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:39,316 seastar - Reactor backend: linux-aio 2026-02-17T09:52:39.335 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:39,334 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-17T09:52:39.335 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:39,334 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-17T09:52:39.337 INFO:teuthology.orchestra.run.trial070.stderr:==39389==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-17T09:52:39.396 INFO:teuthology.orchestra.run.trial070.stderr:DEBUG 2026-02-17 09:52:39,395 [shard 0:main] seastar - reactor::drain 2026-02-17T09:52:41.446 INFO:teuthology.orchestra.run.trial070.stderr:----------------------------------------------------- 2026-02-17T09:52:41.447 INFO:teuthology.orchestra.run.trial070.stderr:Suppressions used: 2026-02-17T09:52:41.447 INFO:teuthology.orchestra.run.trial070.stderr: count bytes template 2026-02-17T09:52:41.447 INFO:teuthology.orchestra.run.trial070.stderr: 1 8 MallocExtension::Register 2026-02-17T09:52:41.447 INFO:teuthology.orchestra.run.trial070.stderr:----------------------------------------------------- 2026-02-17T09:52:41.447 INFO:teuthology.orchestra.run.trial070.stderr: 2026-02-17T09:52:41.466 INFO:teuthology.orchestra.run.trial070.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-17T09:52:41.466 INFO:teuthology.orchestra.run.trial070.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-17T09:52:41.511 INFO:teuthology.orchestra.run.trial070.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-17T09:52:41.512 INFO:teuthology.orchestra.run.trial070.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-17T09:52:41.518 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:41,518 seastar - Reactor backend: linux-aio 2026-02-17T09:52:41.529 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:41,528 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-17T09:52:41.529 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:41,528 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-17T09:52:41.532 INFO:teuthology.orchestra.run.trial070.stderr:==39387==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-17T09:52:41.533 INFO:teuthology.orchestra.run.trial070.stderr:INFO 2026-02-17 09:52:41,532 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-17T09:52:41.670 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x12975d /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x725439b 0x72785b9 0x712c1de 0x7b60600 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f6fdb6 0x6f73bb7 0x6f79761 0x73e3839 0x7412d74 0x7256dc1 0x7256eb9 0x732d51e 0x732d5d7 0x732d78e 0x7412df5 0x7256f36 0x7256fbb 0x72819ab 0x73ec44d 0x73ec4d2 0x73ec5b0 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:41.670 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f 0x980b20c 0x9a40ff8 0x9a4136a 0x9a41416 0x9a5b6c5 0x9a6086f 0x99c4c35 0x99c3c35 0x7b60f77 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f6fdb6 0x6f73bb7 0x6f79761 0x73e3839 0x7412d74 0x7256dc1 0x7256eb9 0x732d51e 0x732d5d7 0x732d78e 0x7412df5 0x7256f36 0x7256fbb 0x72819ab 0x73ec44d 0x73ec4d2 0x73ec5b0 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:41.670 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f 0xd91544 0xd918ff 0x9a6272a 0x786fa4b 0x7b608a9 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f6fdb6 0x6f73bb7 0x6f79761 0x73e3839 0x7412d74 0x7256dc1 0x7256eb9 0x732d51e 0x732d5d7 0x732d78e 0x7412df5 0x7256f36 0x7256fbb 0x72819ab 0x73ec44d 0x73ec4d2 0x73ec5b0 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:41.815 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x157f2 0x1022b6b 0x10dd80a 0x9940ed6 0x9941815 0x9a5ae71 0x9a5bd91 0x9a6086f 0x99c4c35 0x99c3c35 0x7b60f77 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f0b812 0x6f0db7a 0x73e34d8 0x740d434 0x7255508 0x7255600 0x732cdbe 0x732ce77 0x732d02e 0x740d4b5 0x725567d 0x7255702 0x727ca0b 0x73eae9c 0x73eaf21 0x73eafff 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:41.816 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f 0x1022b15 0x10dd80a 0x993cbf7 0x993d0c1 0x993d334 0x993d5ea 0x993dbac 0x9942cd1 0x99433b1 0x9a5c1c4 0x9a6086f 0x99c4c35 0x99c3c35 0x7b60f77 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f0b812 0x6f0db7a 0x73e34d8 0x740d434 0x7255508 0x7255600 0x732cdbe 0x732ce77 0x732d02e 0x740d4b5 0x725567d 0x7255702 0x727ca0b 0x73eae9c 0x73eaf21 0x73eafff 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:41.816 INFO:teuthology.orchestra.run.trial070.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8e6a6 0x9ac12ed 0x9afc253 0x9aff80c 0x9affa7a 0x9affbc2 0x9b00081 /lib64/libc.so.6+0x3fc2f 0xa5725f 0x993cf82 0x993d334 0x993f05b 0x9a51ef5 0x9a52164 0x9a5c3f6 0x9a6086f 0x99c4c35 0x99c3c35 0x7b60f77 0x7b6aae6 0x7a0f4cf 0x7a2845f 0x70e97ab 0x6f0b812 0x6f0db7a 0x73e34d8 0x740d434 0x7255508 0x7255600 0x732cdbe 0x732ce77 0x732d02e 0x740d4b5 0x725567d 0x7255702 0x727ca0b 0x73eae9c 0x73eaf21 0x73eafff 0x740d634 0x7388718 0x75533a1 0x73f4234 0x73f42af 0x74a88b2 0x759bcbc 0x9bc371d 0x9ac988c 0x9b822d9 0x9bd2877 0x9d17362 0x9d179de 0x265f883 0xa352190 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-17T09:52:43.964 INFO:teuthology.orchestra.run.trial070.stderr:----------------------------------------------------- 2026-02-17T09:52:43.965 INFO:teuthology.orchestra.run.trial070.stderr:Suppressions used: 2026-02-17T09:52:43.965 INFO:teuthology.orchestra.run.trial070.stderr: count bytes template 2026-02-17T09:52:43.965 INFO:teuthology.orchestra.run.trial070.stderr: 1 8 MallocExtension::Register 2026-02-17T09:52:43.965 INFO:teuthology.orchestra.run.trial070.stderr:----------------------------------------------------- 2026-02-17T09:52:43.965 INFO:teuthology.orchestra.run.trial070.stderr: 2026-02-17T09:52:43.995 DEBUG:teuthology.orchestra.run.trial070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T09:52:44.021 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T09:52:44.022 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:52:44.022 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T09:52:44.086 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:52:44.086 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T09:52:44.150 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:52:44.151 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T09:52:44.216 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:52:44.216 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T09:52:44.280 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:52:44.280 DEBUG:teuthology.orchestra.run.trial070:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-17T09:52:44.338 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T09:52:44.338 DEBUG:teuthology.orchestra.run.trial070:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T09:52:44.400 INFO:teuthology.orchestra.run.trial070.stdout:[mgr.x] 2026-02-17T09:52:44.400 INFO:teuthology.orchestra.run.trial070.stdout: key = AQBaOpRp2RZLKRAAIuUc5cU35uzqDfJsxEPirg== 2026-02-17T09:52:44.400 INFO:teuthology.orchestra.run.trial070.stdout:[osd.0] 2026-02-17T09:52:44.401 INFO:teuthology.orchestra.run.trial070.stdout: key = AQBfOpRpNsZJMBAAXQFqtJICmSx8ajp+Gjdoxg== 2026-02-17T09:52:44.401 INFO:teuthology.orchestra.run.trial070.stdout:[osd.1] 2026-02-17T09:52:44.401 INFO:teuthology.orchestra.run.trial070.stdout: key = AQBkOpRpmfBJKBAA03Xn7Tq0WYvIcxIKAV70kg== 2026-02-17T09:52:44.401 INFO:teuthology.orchestra.run.trial070.stdout:[osd.2] 2026-02-17T09:52:44.401 INFO:teuthology.orchestra.run.trial070.stdout: key = AQBpOpRp4iuHIxAA203+dQi+7KA3m7i36aOpiw== 2026-02-17T09:52:44.401 INFO:teuthology.orchestra.run.trial070.stdout:[client.0] 2026-02-17T09:52:44.401 INFO:teuthology.orchestra.run.trial070.stdout: key = AQBaOpRp1sXzKxAA7Zbz79UzWehP78l763rAUQ== 2026-02-17T09:52:44.402 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T09:52:44.492 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T09:52:44.541 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T09:52:44.590 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T09:52:44.638 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T09:52:44.687 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T09:52:44.688 DEBUG:teuthology.orchestra.run.trial070:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T09:52:44.712 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T09:52:44.798 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:44.795+0000 7f8e70841c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:44.798 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:44.795+0000 7f8e70841c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:44.805 DEBUG:teuthology.orchestra.run.trial070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T09:52:44.830 DEBUG:teuthology.orchestra.run.trial070:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T09:52:44.886 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T09:52:44.887 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T09:52:44.887 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T09:52:44.928 INFO:tasks.ceph.mon.a:Started 2026-02-17T09:52:44.929 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T09:52:44.929 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T09:52:44.929 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T09:52:44.931 INFO:tasks.ceph.mgr.x:Started 2026-02-17T09:52:44.932 DEBUG:tasks.ceph:set 0 configs 2026-02-17T09:52:44.932 DEBUG:teuthology.orchestra.run.trial070:> sudo ceph --cluster ceph config dump 2026-02-17T09:52:44.993 INFO:tasks.ceph.mon.a.trial070.stderr:2026-02-17T09:52:44.990+0000 7fe85aca0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:44.993 INFO:tasks.ceph.mon.a.trial070.stderr:2026-02-17T09:52:44.990+0000 7fe85aca0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:44.993 INFO:tasks.ceph.mon.a.trial070.stderr:2026-02-17T09:52:44.990+0000 7fe85aca0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:44.995 INFO:tasks.ceph.mgr.x.trial070.stderr:2026-02-17T09:52:44.992+0000 7fcb5a837fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:45.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:45.003+0000 7fda8f011640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:45.009 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:45.007+0000 7fda8f011640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:45.040 INFO:teuthology.orchestra.run.trial070.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-17T09:52:45.048 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T09:52:45.049 DEBUG:teuthology.orchestra.run.trial070:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T09:52:45.124 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:45.118+0000 7f876821a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:45.125 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:45.123+0000 7f876821a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:45.158 INFO:teuthology.orchestra.run.trial070.stderr:adjusted tunables profile to default 2026-02-17T09:52:45.165 INFO:tasks.ceph:check_enable_crimson: True 2026-02-17T09:52:45.165 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-17T09:52:45.165 DEBUG:teuthology.orchestra.run.trial070:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-17T09:52:45.197 INFO:tasks.ceph.mgr.x.trial070.stderr:2026-02-17T09:52:45.195+0000 7fcb5a837fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:45.197 INFO:tasks.ceph.mgr.x.trial070.stderr:2026-02-17T09:52:45.195+0000 7fcb5a837fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:45.240 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:45.235+0000 7f718310b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:45.242 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:45.240+0000 7f718310b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:45.279 INFO:tasks.ceph.mon.a.trial070.stderr:2026-02-17T09:52:45.276+0000 7fe8523f1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-17T09:52:45.279 INFO:tasks.ceph.mon.a.trial070.stderr:Please be aware that this feature is experimental, untested, 2026-02-17T09:52:45.279 INFO:tasks.ceph.mon.a.trial070.stderr:unsupported, and may result in data corruption, data loss, 2026-02-17T09:52:45.279 INFO:tasks.ceph.mon.a.trial070.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-17T09:52:45.279 INFO:tasks.ceph.mon.a.trial070.stderr:feature with important data. 2026-02-17T09:52:45.279 INFO:tasks.ceph.mon.a.trial070.stderr: 2026-02-17T09:52:46.041 INFO:tasks.ceph.mgr.x.trial070.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T09:52:46.041 INFO:tasks.ceph.mgr.x.trial070.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T09:52:46.042 INFO:tasks.ceph.mgr.x.trial070.stderr: from numpy import show_config as show_numpy_config 2026-02-17T09:52:46.169 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T09:52:46.169 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:52:46.169 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T09:52:46.235 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:52:46.235 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T09:52:46.299 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:52:46.299 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T09:52:46.365 DEBUG:teuthology.orchestra.run.trial070:> sudo ceph --cluster ceph osd new 501ee38b-6463-48fa-a25d-81f7cfd91af9 0 2026-02-17T09:52:46.479 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:46.474+0000 7f65f330b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:46.480 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:46.478+0000 7f65f330b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:46.518 INFO:teuthology.orchestra.run.trial070.stdout:0 2026-02-17T09:52:46.527 DEBUG:teuthology.orchestra.run.trial070:> sudo ceph --cluster ceph osd new 7c499fd1-c9f9-4a9c-8e42-6e4a1e1beca1 1 2026-02-17T09:52:46.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:46.597+0000 7fab691e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:46.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:46.601+0000 7fab691e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:46.640 INFO:teuthology.orchestra.run.trial070.stdout:1 2026-02-17T09:52:46.648 DEBUG:teuthology.orchestra.run.trial070:> sudo ceph --cluster ceph osd new 697bfb8e-b38d-468a-90c9-7040a3fbf66b 2 2026-02-17T09:52:46.723 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:46.718+0000 7f6821c51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:46.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:46.722+0000 7f6821c51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:46.761 INFO:teuthology.orchestra.run.trial070.stdout:2 2026-02-17T09:52:46.770 DEBUG:teuthology.orchestra.run.trial070:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-17T09:52:46.800 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T09:52:46.800 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-17T09:52:46.842 INFO:tasks.ceph.osd.0:Started 2026-02-17T09:52:46.843 DEBUG:teuthology.orchestra.run.trial070:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-17T09:52:46.871 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T09:52:46.872 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-17T09:52:46.914 INFO:tasks.ceph.osd.1:Started 2026-02-17T09:52:46.915 DEBUG:teuthology.orchestra.run.trial070:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-17T09:52:46.943 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T09:52:46.943 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-17T09:52:46.986 INFO:tasks.ceph.osd.2:Started 2026-02-17T09:52:46.987 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T09:52:47.063 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:47.059+0000 7fda6e05a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:47.065 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:52:47.063+0000 7fda6e05a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:47.097 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:52:47.098 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":6,"fsid":"b5dc0509-181f-4414-8630-53ac7a057760","created":"2026-02-17T09:52:45.001942+0000","modified":"2026-02-17T09:52:46.759711+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T09:52:46.759711+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"501ee38b-6463-48fa-a25d-81f7cfd91af9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7c499fd1-c9f9-4a9c-8e42-6e4a1e1beca1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"697bfb8e-b38d-468a-90c9-7040a3fbf66b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T09:52:47.106 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T09:52:47.107 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T09:52:47.409 DEBUG:teuthology.orchestra.run.trial070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T09:52:47.477 INFO:teuthology.misc.health.trial070.stderr:2026-02-17T09:52:47.473+0000 7f124eb0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:47.478 INFO:teuthology.misc.health.trial070.stderr:2026-02-17T09:52:47.476+0000 7f124eb0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:47.510 INFO:teuthology.misc.health.trial070.stdout: 2026-02-17T09:52:47.510 INFO:teuthology.misc.health.trial070.stdout:{"epoch":6,"fsid":"b5dc0509-181f-4414-8630-53ac7a057760","created":"2026-02-17T09:52:45.001942+0000","modified":"2026-02-17T09:52:46.759711+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T09:52:46.759711+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"501ee38b-6463-48fa-a25d-81f7cfd91af9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7c499fd1-c9f9-4a9c-8e42-6e4a1e1beca1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"697bfb8e-b38d-468a-90c9-7040a3fbf66b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T09:52:47.516 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-17T09:52:48.448 INFO:tasks.ceph.mgr.x.trial070.stderr:2026-02-17T09:52:48.446+0000 7fca75cb1640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-17T09:52:53.819 DEBUG:teuthology.orchestra.run.trial070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T09:52:53.890 INFO:teuthology.misc.health.trial070.stderr:2026-02-17T09:52:53.886+0000 7f01b8e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:53.891 INFO:teuthology.misc.health.trial070.stderr:2026-02-17T09:52:53.889+0000 7f01b8e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:52:54.000 INFO:teuthology.misc.health.trial070.stdout: 2026-02-17T09:52:54.000 INFO:teuthology.misc.health.trial070.stdout:{"epoch":7,"fsid":"b5dc0509-181f-4414-8630-53ac7a057760","created":"2026-02-17T09:52:45.001942+0000","modified":"2026-02-17T09:52:53.317344+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T09:52:46.759711+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"501ee38b-6463-48fa-a25d-81f7cfd91af9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7c499fd1-c9f9-4a9c-8e42-6e4a1e1beca1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"697bfb8e-b38d-468a-90c9-7040a3fbf66b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T09:52:54.008 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-17T09:53:00.311 DEBUG:teuthology.orchestra.run.trial070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T09:53:00.382 INFO:teuthology.misc.health.trial070.stderr:2026-02-17T09:53:00.378+0000 7f43aa8c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:00.383 INFO:teuthology.misc.health.trial070.stderr:2026-02-17T09:53:00.381+0000 7f43aa8c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:00.493 INFO:teuthology.misc.health.trial070.stdout: 2026-02-17T09:53:00.494 INFO:teuthology.misc.health.trial070.stdout:{"epoch":12,"fsid":"b5dc0509-181f-4414-8630-53ac7a057760","created":"2026-02-17T09:52:45.001942+0000","modified":"2026-02-17T09:52:58.328522+0000","last_up_change":"2026-02-17T09:52:56.319543+0000","last_in_change":"2026-02-17T09:52:46.759711+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T09:52:55.460295+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"501ee38b-6463-48fa-a25d-81f7cfd91af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6810","nonce":574284361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6809","nonce":574284361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6807","nonce":574284361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6811","nonce":574284361}]},"public_addr":"10.20.193.70:6810/574284361","cluster_addr":"10.20.193.70:6809/574284361","heartbeat_back_addr":"10.20.193.70:6807/574284361","heartbeat_front_addr":"10.20.193.70:6811/574284361","state":["exists","up"]},{"osd":1,"uuid":"7c499fd1-c9f9-4a9c-8e42-6e4a1e1beca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6804","nonce":119717252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6805","nonce":119717252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6812","nonce":119717252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6813","nonce":119717252}]},"public_addr":"10.20.193.70:6804/119717252","cluster_addr":"10.20.193.70:6805/119717252","heartbeat_back_addr":"10.20.193.70:6812/119717252","heartbeat_front_addr":"10.20.193.70:6813/119717252","state":["exists","up"]},{"osd":2,"uuid":"697bfb8e-b38d-468a-90c9-7040a3fbf66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6802","nonce":3219025130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6803","nonce":3219025130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6808","nonce":3219025130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6806","nonce":3219025130}]},"public_addr":"10.20.193.70:6802/3219025130","cluster_addr":"10.20.193.70:6803/3219025130","heartbeat_back_addr":"10.20.193.70:6808/3219025130","heartbeat_front_addr":"10.20.193.70:6806/3219025130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T09:53:00.502 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-17T09:53:00.502 INFO:tasks.ceph:Creating RBD pool 2026-02-17T09:53:00.502 DEBUG:teuthology.orchestra.run.trial070:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T09:53:00.576 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:00.570+0000 7f2fa46cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:00.577 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:00.575+0000 7f2fa46cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:01.338 INFO:teuthology.orchestra.run.trial070.stderr:pool 'rbd' created 2026-02-17T09:53:01.351 DEBUG:teuthology.orchestra.run.trial070:> rbd --cluster ceph pool init rbd 2026-02-17T09:53:01.394 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:01.392+0000 7fda9f4bd240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:01.394 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:01.392+0000 7fda9f4bd240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:01.396 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:01.394+0000 7fda9f4bd240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:04.373 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T09:53:04.374 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-17T09:53:04.375 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T09:53:04.451 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:04.446+0000 7f0bfd30b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:04.452 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:04.450+0000 7f0bfd30b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:04.564 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:53:04.573 INFO:teuthology.orchestra.run.trial070.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-17T09:53:04.573 INFO:tasks.ceph_manager:config epoch is 1 2026-02-17T09:53:04.574 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T09:53:04.574 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T09:53:04.574 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T09:53:04.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:04.646+0000 7f696b8cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:04.652 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:04.650+0000 7f696b8cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:04.792 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:53:04.801 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6800","nonce":143059466},{"type":"v1","addr":"10.20.193.70:6801","nonce":143059466}]},"active_addr":"10.20.193.70:6801/143059466","active_change":"2026-02-17T09:52:47.439295+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.70:0","nonce":2094505905}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.70:0","nonce":2527792644}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.70:0","nonce":2625550101}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.70:0","nonce":794664269}]}]} 2026-02-17T09:53:04.805 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T09:53:04.805 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T09:53:04.806 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T09:53:04.883 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:04.879+0000 7f402dbdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:04.884 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:04.882+0000 7f402dbdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:04.996 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:53:04.996 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":16,"fsid":"b5dc0509-181f-4414-8630-53ac7a057760","created":"2026-02-17T09:52:45.001942+0000","modified":"2026-02-17T09:53:04.345768+0000","last_up_change":"2026-02-17T09:52:56.319543+0000","last_in_change":"2026-02-17T09:52:46.759711+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T09:52:55.460295+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T09:53:00.688241+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"501ee38b-6463-48fa-a25d-81f7cfd91af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6810","nonce":574284361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6809","nonce":574284361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6807","nonce":574284361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6811","nonce":574284361}]},"public_addr":"10.20.193.70:6810/574284361","cluster_addr":"10.20.193.70:6809/574284361","heartbeat_back_addr":"10.20.193.70:6807/574284361","heartbeat_front_addr":"10.20.193.70:6811/574284361","state":["exists","up"]},{"osd":1,"uuid":"7c499fd1-c9f9-4a9c-8e42-6e4a1e1beca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6804","nonce":119717252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6805","nonce":119717252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6812","nonce":119717252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6813","nonce":119717252}]},"public_addr":"10.20.193.70:6804/119717252","cluster_addr":"10.20.193.70:6805/119717252","heartbeat_back_addr":"10.20.193.70:6812/119717252","heartbeat_front_addr":"10.20.193.70:6813/119717252","state":["exists","up"]},{"osd":2,"uuid":"697bfb8e-b38d-468a-90c9-7040a3fbf66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6802","nonce":3219025130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6803","nonce":3219025130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6808","nonce":3219025130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6806","nonce":3219025130}]},"public_addr":"10.20.193.70:6802/3219025130","cluster_addr":"10.20.193.70:6803/3219025130","heartbeat_back_addr":"10.20.193.70:6808/3219025130","heartbeat_front_addr":"10.20.193.70:6806/3219025130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T09:53:05.007 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T09:53:05.007 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T09:53:05.084 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:05.080+0000 7f1196f5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:05.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:05.083+0000 7f1196f5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:05.195 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:53:05.195 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":16,"fsid":"b5dc0509-181f-4414-8630-53ac7a057760","created":"2026-02-17T09:52:45.001942+0000","modified":"2026-02-17T09:53:04.345768+0000","last_up_change":"2026-02-17T09:52:56.319543+0000","last_in_change":"2026-02-17T09:52:46.759711+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T09:52:55.460295+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T09:53:00.688241+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"501ee38b-6463-48fa-a25d-81f7cfd91af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6810","nonce":574284361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6809","nonce":574284361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6807","nonce":574284361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6811","nonce":574284361}]},"public_addr":"10.20.193.70:6810/574284361","cluster_addr":"10.20.193.70:6809/574284361","heartbeat_back_addr":"10.20.193.70:6807/574284361","heartbeat_front_addr":"10.20.193.70:6811/574284361","state":["exists","up"]},{"osd":1,"uuid":"7c499fd1-c9f9-4a9c-8e42-6e4a1e1beca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6804","nonce":119717252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6805","nonce":119717252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6812","nonce":119717252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6813","nonce":119717252}]},"public_addr":"10.20.193.70:6804/119717252","cluster_addr":"10.20.193.70:6805/119717252","heartbeat_back_addr":"10.20.193.70:6812/119717252","heartbeat_front_addr":"10.20.193.70:6813/119717252","state":["exists","up"]},{"osd":2,"uuid":"697bfb8e-b38d-468a-90c9-7040a3fbf66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6802","nonce":3219025130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6803","nonce":3219025130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6808","nonce":3219025130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6806","nonce":3219025130}]},"public_addr":"10.20.193.70:6802/3219025130","cluster_addr":"10.20.193.70:6803/3219025130","heartbeat_back_addr":"10.20.193.70:6808/3219025130","heartbeat_front_addr":"10.20.193.70:6806/3219025130","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T09:53:05.205 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T09:53:05.206 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T09:53:05.207 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T09:53:05.287 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:05.282+0000 7f4ba408b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:05.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:05.282+0000 7f256801a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:05.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:05.282+0000 7f31f050b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:05.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:05.286+0000 7f256801a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:05.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:05.286+0000 7f4ba408b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:05.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:05.286+0000 7f31f050b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:05.303 INFO:teuthology.orchestra.run.trial070.stdout:38654705673 2026-02-17T09:53:05.304 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T09:53:05.305 INFO:teuthology.orchestra.run.trial070.stdout:42949672968 2026-02-17T09:53:05.305 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T09:53:05.306 INFO:teuthology.orchestra.run.trial070.stdout:38654705673 2026-02-17T09:53:05.307 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T09:53:05.426 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:05.421+0000 7f03cb28b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:05.426 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:05.421+0000 7f43ce3d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:05.427 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:05.421+0000 7f5c3cb0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:05.427 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:05.425+0000 7f43ce3d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:05.427 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:05.425+0000 7f03cb28b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:05.428 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:05.425+0000 7f5c3cb0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:05.541 INFO:teuthology.orchestra.run.trial070.stdout:38654705673 2026-02-17T09:53:05.543 INFO:teuthology.orchestra.run.trial070.stdout:42949672965 2026-02-17T09:53:05.545 INFO:teuthology.orchestra.run.trial070.stdout:38654705673 2026-02-17T09:53:05.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705673 got 38654705673 for osd.0 2026-02-17T09:53:05.553 DEBUG:teuthology.parallel:result is None 2026-02-17T09:53:05.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672965 for osd.1 2026-02-17T09:53:05.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705673 got 38654705673 for osd.2 2026-02-17T09:53:05.556 DEBUG:teuthology.parallel:result is None 2026-02-17T09:53:06.556 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T09:53:06.635 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:06.631+0000 7efc2d0c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:06.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:06.634+0000 7efc2d0c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:06.746 INFO:teuthology.orchestra.run.trial070.stdout:42949672968 2026-02-17T09:53:06.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.1 2026-02-17T09:53:06.756 DEBUG:teuthology.parallel:result is None 2026-02-17T09:53:06.756 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T09:53:06.756 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T09:53:06.832 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:06.828+0000 7f42f65d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:06.833 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:06.831+0000 7f42f65d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:06.942 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:53:06.942 INFO:teuthology.orchestra.run.trial070.stderr:dumped all 2026-02-17T09:53:06.952 INFO:teuthology.orchestra.run.trial070.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2026-02-17T09:53:05.446617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":157286352,"kb_used":62916980,"kb_used_data":62916980,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":94369372,"statfs":{"total":161061224448,"available":96634236928,"internally_reserved":0,"allocated":64426987520,"data_stored":64426987520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.104051"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.358646+0000","last_change":"2026-02-17T09:53:04.361249+0000","last_active":"2026-02-17T09:53:04.358646+0000","last_peered":"2026-02-17T09:53:04.358646+0000","last_clean":"2026-02-17T09:53:04.358646+0000","last_became_active":"2026-02-17T09:53:02.373919+0000","last_became_peered":"2026-02-17T09:53:02.373919+0000","last_unstale":"2026-02-17T09:53:04.358646+0000","last_undegraded":"2026-02-17T09:53:04.358646+0000","last_fullsized":"2026-02-17T09:53:04.358646+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_clean_scrub_stamp":"2026-02-17T09:53:01.334187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.359660+0000","last_change":"2026-02-17T09:53:04.361637+0000","last_active":"2026-02-17T09:53:04.359660+0000","last_peered":"2026-02-17T09:53:04.359660+0000","last_clean":"2026-02-17T09:53:04.359660+0000","last_became_active":"2026-02-17T09:53:02.383692+0000","last_became_peered":"2026-02-17T09:53:02.383692+0000","last_unstale":"2026-02-17T09:53:04.359660+0000","last_undegraded":"2026-02-17T09:53:04.359660+0000","last_fullsized":"2026-02-17T09:53:04.359660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_clean_scrub_stamp":"2026-02-17T09:53:01.334187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.359486+0000","last_change":"2026-02-17T09:53:04.363441+0000","last_active":"2026-02-17T09:53:04.359486+0000","last_peered":"2026-02-17T09:53:04.359486+0000","last_clean":"2026-02-17T09:53:04.359486+0000","last_became_active":"2026-02-17T09:53:02.382275+0000","last_became_peered":"2026-02-17T09:53:02.382275+0000","last_unstale":"2026-02-17T09:53:04.359486+0000","last_undegraded":"2026-02-17T09:53:04.359486+0000","last_fullsized":"2026-02-17T09:53:04.359486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_clean_scrub_stamp":"2026-02-17T09:53:01.334187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.359645+0000","last_change":"2026-02-17T09:53:04.361391+0000","last_active":"2026-02-17T09:53:04.359645+0000","last_peered":"2026-02-17T09:53:04.359645+0000","last_clean":"2026-02-17T09:53:04.359645+0000","last_became_active":"2026-02-17T09:53:02.377492+0000","last_became_peered":"2026-02-17T09:53:02.377492+0000","last_unstale":"2026-02-17T09:53:04.359645+0000","last_undegraded":"2026-02-17T09:53:04.359645+0000","last_fullsized":"2026-02-17T09:53:04.359645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_clean_scrub_stamp":"2026-02-17T09:53:01.334187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.361353+0000","last_change":"2026-02-17T09:53:04.361353+0000","last_active":"2026-02-17T09:53:04.361353+0000","last_peered":"2026-02-17T09:53:04.361353+0000","last_clean":"2026-02-17T09:53:04.361353+0000","last_became_active":"2026-02-17T09:53:02.377765+0000","last_became_peered":"2026-02-17T09:53:02.377765+0000","last_unstale":"2026-02-17T09:53:04.361353+0000","last_undegraded":"2026-02-17T09:53:04.361353+0000","last_fullsized":"2026-02-17T09:53:04.361353+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_clean_scrub_stamp":"2026-02-17T09:53:01.334187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.360091+0000","last_change":"2026-02-17T09:53:04.362330+0000","last_active":"2026-02-17T09:53:04.360091+0000","last_peered":"2026-02-17T09:53:04.360091+0000","last_clean":"2026-02-17T09:53:04.360091+0000","last_became_active":"2026-02-17T09:53:02.381628+0000","last_became_peered":"2026-02-17T09:53:02.381628+0000","last_unstale":"2026-02-17T09:53:04.360091+0000","last_undegraded":"2026-02-17T09:53:04.360091+0000","last_fullsized":"2026-02-17T09:53:04.360091+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_clean_scrub_stamp":"2026-02-17T09:53:01.334187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.358074+0000","last_change":"2026-02-17T09:53:04.360666+0000","last_active":"2026-02-17T09:53:04.358074+0000","last_peered":"2026-02-17T09:53:04.358074+0000","last_clean":"2026-02-17T09:53:04.358074+0000","last_became_active":"2026-02-17T09:53:02.387352+0000","last_became_peered":"2026-02-17T09:53:02.387352+0000","last_unstale":"2026-02-17T09:53:04.358074+0000","last_undegraded":"2026-02-17T09:53:04.358074+0000","last_fullsized":"2026-02-17T09:53:04.358074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_clean_scrub_stamp":"2026-02-17T09:53:01.334187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.360147+0000","last_change":"2026-02-17T09:53:04.363304+0000","last_active":"2026-02-17T09:53:04.360147+0000","last_peered":"2026-02-17T09:53:04.360147+0000","last_clean":"2026-02-17T09:53:04.360147+0000","last_became_active":"2026-02-17T09:53:02.377416+0000","last_became_peered":"2026-02-17T09:53:02.377416+0000","last_unstale":"2026-02-17T09:53:04.360147+0000","last_undegraded":"2026-02-17T09:53:04.360147+0000","last_fullsized":"2026-02-17T09:53:04.360147+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_clean_scrub_stamp":"2026-02-17T09:53:01.334187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":90,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.358375+0000","last_change":"2026-02-17T09:52:57.355592+0000","last_active":"2026-02-17T09:53:04.358375+0000","last_peered":"2026-02-17T09:53:04.358375+0000","last_clean":"2026-02-17T09:53:04.358375+0000","last_became_active":"2026-02-17T09:52:57.348575+0000","last_became_peered":"2026-02-17T09:52:57.348575+0000","last_unstale":"2026-02-17T09:53:04.358375+0000","last_undegraded":"2026-02-17T09:53:04.358375+0000","last_fullsized":"2026-02-17T09:53:04.358375+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:52:56.319543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:52:56.319543+0000","last_clean_scrub_stamp":"2026-02-17T09:52:56.319543+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96634212352,"internally_reserved":0,"allocated":64427012096,"data_stored":64427012096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211111936,"internally_reserved":0,"allocated":21475962880,"data_stored":21475962880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971804,"kb_used_data":20971804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456980,"statfs":{"total":53687074816,"available":32211947520,"internally_reserved":0,"allocated":21475127296,"data_stored":21475127296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972564,"kb_used_data":20972564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456220,"statfs":{"total":53687074816,"available":32211169280,"internally_reserved":0,"allocated":21475905536,"data_stored":21475905536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972612,"kb_used_data":20972612,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456172,"statfs":{"total":53687074816,"available":32211120128,"internally_reserved":0,"allocated":21475954688,"data_stored":21475954688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211111936,"internally_reserved":0,"allocated":21475962880,"data_stored":21475962880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53687074816,"available":32211161088,"internally_reserved":0,"allocated":21475913728,"data_stored":21475913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53687074816,"available":32211111936,"internally_reserved":0,"allocated":21475962880,"data_stored":21475962880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53687074816,"available":32211939328,"internally_reserved":0,"allocated":21475135488,"data_stored":21475135488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T09:53:06.953 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T09:53:07.028 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:07.024+0000 7f0194606640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:07.029 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:07.027+0000 7f0194606640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:07.138 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:53:07.139 INFO:teuthology.orchestra.run.trial070.stderr:dumped all 2026-02-17T09:53:07.148 INFO:teuthology.orchestra.run.trial070.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2026-02-17T09:53:05.446617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":157286352,"kb_used":62916980,"kb_used_data":62916980,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":94369372,"statfs":{"total":161061224448,"available":96634236928,"internally_reserved":0,"allocated":64426987520,"data_stored":64426987520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.104051"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.358646+0000","last_change":"2026-02-17T09:53:04.361249+0000","last_active":"2026-02-17T09:53:04.358646+0000","last_peered":"2026-02-17T09:53:04.358646+0000","last_clean":"2026-02-17T09:53:04.358646+0000","last_became_active":"2026-02-17T09:53:02.373919+0000","last_became_peered":"2026-02-17T09:53:02.373919+0000","last_unstale":"2026-02-17T09:53:04.358646+0000","last_undegraded":"2026-02-17T09:53:04.358646+0000","last_fullsized":"2026-02-17T09:53:04.358646+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_clean_scrub_stamp":"2026-02-17T09:53:01.334187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.359660+0000","last_change":"2026-02-17T09:53:04.361637+0000","last_active":"2026-02-17T09:53:04.359660+0000","last_peered":"2026-02-17T09:53:04.359660+0000","last_clean":"2026-02-17T09:53:04.359660+0000","last_became_active":"2026-02-17T09:53:02.383692+0000","last_became_peered":"2026-02-17T09:53:02.383692+0000","last_unstale":"2026-02-17T09:53:04.359660+0000","last_undegraded":"2026-02-17T09:53:04.359660+0000","last_fullsized":"2026-02-17T09:53:04.359660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_clean_scrub_stamp":"2026-02-17T09:53:01.334187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.359486+0000","last_change":"2026-02-17T09:53:04.363441+0000","last_active":"2026-02-17T09:53:04.359486+0000","last_peered":"2026-02-17T09:53:04.359486+0000","last_clean":"2026-02-17T09:53:04.359486+0000","last_became_active":"2026-02-17T09:53:02.382275+0000","last_became_peered":"2026-02-17T09:53:02.382275+0000","last_unstale":"2026-02-17T09:53:04.359486+0000","last_undegraded":"2026-02-17T09:53:04.359486+0000","last_fullsized":"2026-02-17T09:53:04.359486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_clean_scrub_stamp":"2026-02-17T09:53:01.334187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.359645+0000","last_change":"2026-02-17T09:53:04.361391+0000","last_active":"2026-02-17T09:53:04.359645+0000","last_peered":"2026-02-17T09:53:04.359645+0000","last_clean":"2026-02-17T09:53:04.359645+0000","last_became_active":"2026-02-17T09:53:02.377492+0000","last_became_peered":"2026-02-17T09:53:02.377492+0000","last_unstale":"2026-02-17T09:53:04.359645+0000","last_undegraded":"2026-02-17T09:53:04.359645+0000","last_fullsized":"2026-02-17T09:53:04.359645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_clean_scrub_stamp":"2026-02-17T09:53:01.334187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.361353+0000","last_change":"2026-02-17T09:53:04.361353+0000","last_active":"2026-02-17T09:53:04.361353+0000","last_peered":"2026-02-17T09:53:04.361353+0000","last_clean":"2026-02-17T09:53:04.361353+0000","last_became_active":"2026-02-17T09:53:02.377765+0000","last_became_peered":"2026-02-17T09:53:02.377765+0000","last_unstale":"2026-02-17T09:53:04.361353+0000","last_undegraded":"2026-02-17T09:53:04.361353+0000","last_fullsized":"2026-02-17T09:53:04.361353+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_clean_scrub_stamp":"2026-02-17T09:53:01.334187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.360091+0000","last_change":"2026-02-17T09:53:04.362330+0000","last_active":"2026-02-17T09:53:04.360091+0000","last_peered":"2026-02-17T09:53:04.360091+0000","last_clean":"2026-02-17T09:53:04.360091+0000","last_became_active":"2026-02-17T09:53:02.381628+0000","last_became_peered":"2026-02-17T09:53:02.381628+0000","last_unstale":"2026-02-17T09:53:04.360091+0000","last_undegraded":"2026-02-17T09:53:04.360091+0000","last_fullsized":"2026-02-17T09:53:04.360091+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_clean_scrub_stamp":"2026-02-17T09:53:01.334187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.358074+0000","last_change":"2026-02-17T09:53:04.360666+0000","last_active":"2026-02-17T09:53:04.358074+0000","last_peered":"2026-02-17T09:53:04.358074+0000","last_clean":"2026-02-17T09:53:04.358074+0000","last_became_active":"2026-02-17T09:53:02.387352+0000","last_became_peered":"2026-02-17T09:53:02.387352+0000","last_unstale":"2026-02-17T09:53:04.358074+0000","last_undegraded":"2026-02-17T09:53:04.358074+0000","last_fullsized":"2026-02-17T09:53:04.358074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_clean_scrub_stamp":"2026-02-17T09:53:01.334187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.360147+0000","last_change":"2026-02-17T09:53:04.363304+0000","last_active":"2026-02-17T09:53:04.360147+0000","last_peered":"2026-02-17T09:53:04.360147+0000","last_clean":"2026-02-17T09:53:04.360147+0000","last_became_active":"2026-02-17T09:53:02.377416+0000","last_became_peered":"2026-02-17T09:53:02.377416+0000","last_unstale":"2026-02-17T09:53:04.360147+0000","last_undegraded":"2026-02-17T09:53:04.360147+0000","last_fullsized":"2026-02-17T09:53:04.360147+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:53:01.334187+0000","last_clean_scrub_stamp":"2026-02-17T09:53:01.334187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":90,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T09:53:04.358375+0000","last_change":"2026-02-17T09:52:57.355592+0000","last_active":"2026-02-17T09:53:04.358375+0000","last_peered":"2026-02-17T09:53:04.358375+0000","last_clean":"2026-02-17T09:53:04.358375+0000","last_became_active":"2026-02-17T09:52:57.348575+0000","last_became_peered":"2026-02-17T09:52:57.348575+0000","last_unstale":"2026-02-17T09:53:04.358375+0000","last_undegraded":"2026-02-17T09:53:04.358375+0000","last_fullsized":"2026-02-17T09:53:04.358375+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T09:52:56.319543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T09:52:56.319543+0000","last_clean_scrub_stamp":"2026-02-17T09:52:56.319543+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96634212352,"internally_reserved":0,"allocated":64427012096,"data_stored":64427012096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211111936,"internally_reserved":0,"allocated":21475962880,"data_stored":21475962880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971804,"kb_used_data":20971804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456980,"statfs":{"total":53687074816,"available":32211947520,"internally_reserved":0,"allocated":21475127296,"data_stored":21475127296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972564,"kb_used_data":20972564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456220,"statfs":{"total":53687074816,"available":32211169280,"internally_reserved":0,"allocated":21475905536,"data_stored":21475905536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972612,"kb_used_data":20972612,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456172,"statfs":{"total":53687074816,"available":32211120128,"internally_reserved":0,"allocated":21475954688,"data_stored":21475954688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211111936,"internally_reserved":0,"allocated":21475962880,"data_stored":21475962880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53687074816,"available":32211161088,"internally_reserved":0,"allocated":21475913728,"data_stored":21475913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53687074816,"available":32211111936,"internally_reserved":0,"allocated":21475962880,"data_stored":21475962880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53687074816,"available":32211939328,"internally_reserved":0,"allocated":21475135488,"data_stored":21475135488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T09:53:07.149 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T09:53:07.150 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T09:53:07.150 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T09:53:07.150 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T09:53:07.227 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:07.223+0000 7fcadf0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:07.227 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:53:07.226+0000 7fcadf0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:53:07.366 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:53:07.366 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T09:53:07.377 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T09:53:07.377 INFO:teuthology.run_tasks:Running task ssh_keys... 2026-02-17T09:53:07.460 DEBUG:teuthology.orchestra.run.trial070:> echo 'StrictHostKeyChecking no 2026-02-17T09:53:07.460 DEBUG:teuthology.orchestra.run.trial070:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2026-02-17T09:53:07.476 INFO:teuthology.task.ssh_keys:generated public key AAAAB3NzaC1yc2EAAAADAQABAAABAQDNBUuPW95dE+rJsn3Gkb7Yy54QsIXcJeoFtzZyEISiAVWKzBjzNVTepAWJJwU40IYGDAUuavFLV8SIjE3ewIlEKNxgh42ESjxJYmMnGjWFhJ684ZFKdpwyzQDdprCb11IBUOXYLJqAuMI7eQO+aEcMW4Ppcw5959Sw1B+jSw7Itt7d1FT4+Jc5X9dmYNe5pR84WA6pnUrgmQ305A0gNBpjhzuhFGiirJETHHROHA1/58O8tOL17gGPo/BdgQFa8IC2634Z5eoN7XVSdt9W/kVWfBxF+X55GXk6e2RltGpKqYc/uo/Ir3O6Qvigo3GYP1jIDE4PKXyTz0pyiW6VwQwL 2026-02-17T09:53:07.476 INFO:teuthology.task.ssh_keys:pushing keys to trial070.front.sepia.ceph.com for ubuntu 2026-02-17T09:53:07.476 DEBUG:teuthology.orchestra.run.trial070:> rm -f -- /home/ubuntu/.ssh/id_rsa 2026-02-17T09:53:07.532 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:53:07.532 DEBUG:teuthology.orchestra.run.trial070:> dd of=/home/ubuntu/.ssh/id_rsa 2026-02-17T09:53:07.532 DEBUG:teuthology.orchestra.run.trial070:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2026-02-17T09:53:07.589 DEBUG:teuthology.orchestra.run.trial070:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2026-02-17T09:53:07.646 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:53:07.646 DEBUG:teuthology.orchestra.run.trial070:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2026-02-17T09:53:07.702 DEBUG:teuthology.orchestra.run.trial070:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2026-02-17_09:53:07:702156 2026-02-17T09:53:07.759 INFO:teuthology.orchestra.run.trial070.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2026-02-17_09:53:07:702156' 2026-02-17T09:53:07.759 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:53:07.760 DEBUG:teuthology.orchestra.run.trial070:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2026-02-17T09:53:07.815 INFO:teuthology.run_tasks:Running task cbt... 2026-02-17T09:53:07.840 INFO:tasks.cbt:cbt configuration is {'cluster': {'user': 'ubuntu', 'head': 'ubuntu@trial070.front.sepia.ceph.com', 'osds': ['ubuntu@trial070.front.sepia.ceph.com'], 'mons': ['ubuntu@trial070.front.sepia.ceph.com'], 'clients': ['ubuntu@trial070.front.sepia.ceph.com'], 'rgws': {'ubuntu@trial070.front.sepia.ceph.com': None}, 'osds_per_node': 3, 'rebuild_every_test': False, 'use_existing': True, 'is_teuthology': True, 'iterations': 1, 'tmp_dir': '/tmp/cbt', 'pool_profiles': {'replicated': {'pg_size': 256, 'pgp_size': 256, 'replication': 'replicated'}}, 'pid_dir': '/var/run/ceph'}, 'benchmarks': {'radosbench': {'concurrent_ops': 4, 'concurrent_procs': 2, 'op_size': [4194304], 'pool_monitoring_list': ['collectl'], 'pool_profile': 'replicated', 'run_monitoring_list': ['collectl'], 'time': 60, 'write_only': True}}, 'client_endpoints': None, 'monitoring_profiles': {'perf': {'args': 'stat -p {pid} -o {perf_dir}/perf_stat.{pid}', 'nodes': ['osds'], 'perf_cmd': 'perf', 'pid_glob': 'crimson-osd.*.pid'}}} 2026-02-17T09:53:07.840 DEBUG:teuthology.orchestra.run.trial070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/cbt 2026-02-17T09:53:07.875 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:53:07.875 DEBUG:teuthology.orchestra.run.trial070:> dd of=/home/ubuntu/cephtest/archive/cbt/cbt_config.yaml 2026-02-17T09:53:07.928 DEBUG:teuthology.orchestra.run.trial070:> git clone --depth 1 -b master https://github.com/ceph/cbt.git /home/ubuntu/cephtest/cbt 2026-02-17T09:53:07.991 INFO:teuthology.orchestra.run.trial070.stderr:Cloning into '/home/ubuntu/cephtest/cbt'... 2026-02-17T09:53:08.270 INFO:tasks.cbt:Installing collectl 2026-02-17T09:53:08.271 DEBUG:teuthology.orchestra.run.trial070:> sudo mkdir collectl && cd collectl && sudo wget https://sourceforge.net/projects/collectl/files/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz/download -O collectl.tar.gz && sudo tar -xvf collectl.tar.gz && cd collectl-4.3.1 && sudo ./INSTALL 2026-02-17T09:53:08.346 INFO:teuthology.orchestra.run.trial070.stderr:--2026-02-17 09:53:08-- https://sourceforge.net/projects/collectl/files/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz/download 2026-02-17T09:53:08.407 INFO:teuthology.orchestra.run.trial070.stderr:Resolving sourceforge.net (sourceforge.net)... 104.18.12.149, 104.18.13.149, 2606:4700::6812:c95, ... 2026-02-17T09:53:08.410 INFO:teuthology.orchestra.run.trial070.stderr:Connecting to sourceforge.net (sourceforge.net)|104.18.12.149|:443... connected. 2026-02-17T09:53:08.607 INFO:teuthology.orchestra.run.trial070.stderr:HTTP request sent, awaiting response... 302 Found 2026-02-17T09:53:08.607 INFO:teuthology.orchestra.run.trial070.stderr:Location: https://downloads.sourceforge.net/project/collectl/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz?ts=gAAAAABplDqERSSBYYnRCA32T956Xt83I3MJ6gbJetKuYBjHKg3vl6YK-69tzYsWb-x2Vihmz0N-wEaObVhjmUjSCEne-Rd3dQ%3D%3D&use_mirror=gigenet&r= [following] 2026-02-17T09:53:08.608 INFO:teuthology.orchestra.run.trial070.stderr:--2026-02-17 09:53:08-- https://downloads.sourceforge.net/project/collectl/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz?ts=gAAAAABplDqERSSBYYnRCA32T956Xt83I3MJ6gbJetKuYBjHKg3vl6YK-69tzYsWb-x2Vihmz0N-wEaObVhjmUjSCEne-Rd3dQ%3D%3D&use_mirror=gigenet&r= 2026-02-17T09:53:08.646 INFO:teuthology.orchestra.run.trial070.stderr:Resolving downloads.sourceforge.net (downloads.sourceforge.net)... 104.18.12.149, 104.18.13.149, 2606:4700::6812:c95, ... 2026-02-17T09:53:08.649 INFO:teuthology.orchestra.run.trial070.stderr:Connecting to downloads.sourceforge.net (downloads.sourceforge.net)|104.18.12.149|:443... connected. 2026-02-17T09:53:08.820 INFO:teuthology.orchestra.run.trial070.stderr:HTTP request sent, awaiting response... 302 Found 2026-02-17T09:53:08.820 INFO:teuthology.orchestra.run.trial070.stderr:Location: https://gigenet.dl.sourceforge.net/project/collectl/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz?viasf=1 [following] 2026-02-17T09:53:08.821 INFO:teuthology.orchestra.run.trial070.stderr:--2026-02-17 09:53:08-- https://gigenet.dl.sourceforge.net/project/collectl/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz?viasf=1 2026-02-17T09:53:08.831 INFO:teuthology.orchestra.run.trial070.stderr:Resolving gigenet.dl.sourceforge.net (gigenet.dl.sourceforge.net)... 69.65.16.141 2026-02-17T09:53:08.851 INFO:teuthology.orchestra.run.trial070.stderr:Connecting to gigenet.dl.sourceforge.net (gigenet.dl.sourceforge.net)|69.65.16.141|:443... connected. 2026-02-17T09:53:08.995 INFO:teuthology.orchestra.run.trial070.stderr:HTTP request sent, awaiting response... 200 OK 2026-02-17T09:53:08.995 INFO:teuthology.orchestra.run.trial070.stderr:Length: 620693 (606K) [application/x-gzip] 2026-02-17T09:53:08.995 INFO:teuthology.orchestra.run.trial070.stderr:Saving to: ‘collectl.tar.gz’ 2026-02-17T09:53:08.995 INFO:teuthology.orchestra.run.trial070.stderr: 2026-02-17T09:53:09.015 INFO:teuthology.orchestra.run.trial070.stderr: 0K .......... .......... .......... .......... .......... 8% 2.45M 0s 2026-02-17T09:53:09.035 INFO:teuthology.orchestra.run.trial070.stderr: 50K .......... .......... .......... .......... .......... 16% 2.56M 0s 2026-02-17T09:53:09.035 INFO:teuthology.orchestra.run.trial070.stderr: 100K .......... .......... .......... .......... .......... 24% 67.1M 0s 2026-02-17T09:53:09.035 INFO:teuthology.orchestra.run.trial070.stderr: 150K .......... .......... .......... .......... .......... 32% 87.2M 0s 2026-02-17T09:53:09.053 INFO:teuthology.orchestra.run.trial070.stderr: 200K .......... .......... .......... .......... .......... 41% 2.59M 0s 2026-02-17T09:53:09.054 INFO:teuthology.orchestra.run.trial070.stderr: 250K .......... .......... .......... .......... .......... 49% 52.1M 0s 2026-02-17T09:53:09.055 INFO:teuthology.orchestra.run.trial070.stderr: 300K .......... .......... .......... .......... .......... 57% 55.7M 0s 2026-02-17T09:53:09.055 INFO:teuthology.orchestra.run.trial070.stderr: 350K .......... .......... .......... .......... .......... 65% 88.4M 0s 2026-02-17T09:53:09.072 INFO:teuthology.orchestra.run.trial070.stderr: 400K .......... .......... .......... .......... .......... 74% 2.92M 0s 2026-02-17T09:53:09.074 INFO:teuthology.orchestra.run.trial070.stderr: 450K .......... .......... .......... .......... .......... 82% 97.7M 0s 2026-02-17T09:53:09.074 INFO:teuthology.orchestra.run.trial070.stderr: 500K .......... .......... .......... .......... .......... 90% 114M 0s 2026-02-17T09:53:09.074 INFO:teuthology.orchestra.run.trial070.stderr: 550K .......... .......... .......... .......... .......... 98% 94.9M 0s 2026-02-17T09:53:09.074 INFO:teuthology.orchestra.run.trial070.stderr: 600K ...... 100% 11.4T=0.08s 2026-02-17T09:53:09.074 INFO:teuthology.orchestra.run.trial070.stderr: 2026-02-17T09:53:09.074 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17 09:53:09 (7.43 MB/s) - ‘collectl.tar.gz’ saved [620693/620693] 2026-02-17T09:53:09.074 INFO:teuthology.orchestra.run.trial070.stderr: 2026-02-17T09:53:09.096 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/ 2026-02-17T09:53:09.096 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/collectl.conf 2026-02-17T09:53:09.096 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/ 2026-02-17T09:53:09.096 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/SlowProc.html 2026-02-17T09:53:09.097 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/BuddyInfo.html 2026-02-17T09:53:09.097 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/WhySummary.html 2026-02-17T09:53:09.097 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Socket.html 2026-02-17T09:53:09.097 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/colmux.html 2026-02-17T09:53:09.097 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Tutorial.html 2026-02-17T09:53:09.097 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Gexpr.html 2026-02-17T09:53:09.097 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Import.html 2026-02-17T09:53:09.097 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/style.css 2026-02-17T09:53:09.097 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Ganglia3.jpg 2026-02-17T09:53:09.097 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Ganglia2.jpg 2026-02-17T09:53:09.097 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/FileNaming.html 2026-02-17T09:53:09.097 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/TheMath.html 2026-02-17T09:53:09.098 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Environmental.html 2026-02-17T09:53:09.098 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Process.html 2026-02-17T09:53:09.098 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/OutputFiles.html 2026-02-17T09:53:09.098 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/HiResTime.html 2026-02-17T09:53:09.098 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/OutputFormats.html 2026-02-17T09:53:09.098 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/slub.jpg 2026-02-17T09:53:09.098 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Lustre.html 2026-02-17T09:53:09.098 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Documentation.html 2026-02-17T09:53:09.098 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Inodes.html 2026-02-17T09:53:09.098 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Graphite.html 2026-02-17T09:53:09.098 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/InputFiles.html 2026-02-17T09:53:09.098 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Export.html 2026-02-17T09:53:09.099 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Interrupts.html 2026-02-17T09:53:09.099 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Startup.html 2026-02-17T09:53:09.099 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Performance.html 2026-02-17T09:53:09.099 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Messages.html 2026-02-17T09:53:09.099 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Logging.html 2026-02-17T09:53:09.099 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Data-detail.html 2026-02-17T09:53:09.099 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/CPUs.html 2026-02-17T09:53:09.099 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Matrix.html 2026-02-17T09:53:09.099 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Data-brief.html 2026-02-17T09:53:09.099 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/SlabInfo.html 2026-02-17T09:53:09.099 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Misc.html 2026-02-17T09:53:09.099 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Examples.html 2026-02-17T09:53:09.099 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/OpenStack.html 2026-02-17T09:53:09.100 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Plotfiles.html 2026-02-17T09:53:09.100 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/ColmuxCPU.jpg 2026-02-17T09:53:09.100 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Tutorial-Lustre.html 2026-02-17T09:53:09.100 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Data-verbose.html 2026-02-17T09:53:09.100 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Data.html 2026-02-17T09:53:09.100 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Exceptions.html 2026-02-17T09:53:09.100 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/RunningAsAService.html 2026-02-17T09:53:09.100 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/FAQ-collectl.html 2026-02-17T09:53:09.100 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Ganglia.jpg 2026-02-17T09:53:09.100 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/OperationalModes.html 2026-02-17T09:53:09.100 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Playback.html 2026-02-17T09:53:09.100 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Hello.html 2026-02-17T09:53:09.100 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Sockets.html 2026-02-17T09:53:09.101 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Network.html 2026-02-17T09:53:09.101 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Infiniband.html 2026-02-17T09:53:09.101 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Memory.html 2026-02-17T09:53:09.101 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/ColmuxLustre.jpg 2026-02-17T09:53:09.101 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/Disks.html 2026-02-17T09:53:09.101 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/docs/NfsInfo.html 2026-02-17T09:53:09.101 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/service/ 2026-02-17T09:53:09.101 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/service/collectl.service 2026-02-17T09:53:09.101 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/initd/ 2026-02-17T09:53:09.101 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/initd/collectl-suse 2026-02-17T09:53:09.101 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/initd/collectl-debian 2026-02-17T09:53:09.101 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/initd/collectl-generic 2026-02-17T09:53:09.101 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/initd/collectl 2026-02-17T09:53:09.101 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/misc.ph 2026-02-17T09:53:09.102 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/gexpr.ph 2026-02-17T09:53:09.102 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/statsd.ph 2026-02-17T09:53:09.102 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/envrules.std 2026-02-17T09:53:09.102 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/hello.ph 2026-02-17T09:53:09.102 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/vmsum.ph 2026-02-17T09:53:09.102 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/proctree.ph 2026-02-17T09:53:09.102 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/README-WINDOWS 2026-02-17T09:53:09.102 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/formatit.ph 2026-02-17T09:53:09.102 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/colmux 2026-02-17T09:53:09.102 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/INSTALL 2026-02-17T09:53:09.102 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/graphite.ph 2026-02-17T09:53:09.102 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/RELEASE-collectl 2026-02-17T09:53:09.102 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/vmstat.ph 2026-02-17T09:53:09.103 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/README 2026-02-17T09:53:09.103 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/man1/ 2026-02-17T09:53:09.103 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/man1/collectl.1 2026-02-17T09:53:09.103 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/man1/colmux.1 2026-02-17T09:53:09.103 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/lexpr.ph 2026-02-17T09:53:09.103 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/client.pl 2026-02-17T09:53:09.103 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/collectl 2026-02-17T09:53:09.103 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/COPYING 2026-02-17T09:53:09.103 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/vnet.ph 2026-02-17T09:53:09.103 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/GPL 2026-02-17T09:53:09.103 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/UNINSTALL 2026-02-17T09:53:09.103 INFO:teuthology.orchestra.run.trial070.stdout:collectl-4.3.1/ARTISTIC 2026-02-17T09:53:09.137 INFO:teuthology.orchestra.run.trial070.stderr:./INSTALL: line 90: chkconfig: command not found 2026-02-17T09:53:09.139 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install librbd-devel pdsh pdsh-rcmd-ssh perf 2026-02-17T09:53:09.494 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Feb 2026 09:52:12 AM UTC. 2026-02-17T09:53:09.580 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-17T09:53:09.580 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:53:09.580 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repository Size 2026-02-17T09:53:09.580 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:53:09.580 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-17T09:53:09.580 INFO:teuthology.orchestra.run.trial070.stdout: librbd-devel x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 24 k 2026-02-17T09:53:09.580 INFO:teuthology.orchestra.run.trial070.stdout: pdsh x86_64 2.34-7.el9 epel 118 k 2026-02-17T09:53:09.580 INFO:teuthology.orchestra.run.trial070.stdout: pdsh-rcmd-ssh x86_64 2.34-7.el9 epel 13 k 2026-02-17T09:53:09.580 INFO:teuthology.orchestra.run.trial070.stdout: perf x86_64 5.14.0-681.el9 appstream 3.2 M 2026-02-17T09:53:09.580 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-17T09:53:09.580 INFO:teuthology.orchestra.run.trial070.stdout: libradospp-devel x86_64 2:20.3.0-5345.gb58fab16.el9 ceph 31 k 2026-02-17T09:53:09.580 INFO:teuthology.orchestra.run.trial070.stdout: libtraceevent x86_64 1.8.4-2.el9 baseos 290 k 2026-02-17T09:53:09.580 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:53:09.580 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-17T09:53:09.580 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-17T09:53:09.580 INFO:teuthology.orchestra.run.trial070.stdout:Install 6 Packages 2026-02-17T09:53:09.580 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:53:09.581 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 3.7 M 2026-02-17T09:53:09.581 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 14 M 2026-02-17T09:53:09.581 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-17T09:53:09.905 INFO:teuthology.orchestra.run.trial070.stdout:(1/6): libradospp-devel-20.3.0-5345.gb58fab16.e 483 kB/s | 31 kB 00:00 2026-02-17T09:53:09.907 INFO:teuthology.orchestra.run.trial070.stdout:(2/6): libtraceevent-1.8.4-2.el9.x86_64.rpm 4.3 MB/s | 290 kB 00:00 2026-02-17T09:53:09.908 INFO:teuthology.orchestra.run.trial070.stdout:(3/6): librbd-devel-20.3.0-5345.gb58fab16.el9.x 353 kB/s | 24 kB 00:00 2026-02-17T09:53:10.081 INFO:teuthology.orchestra.run.trial070.stdout:(4/6): pdsh-rcmd-ssh-2.34-7.el9.x86_64.rpm 76 kB/s | 13 kB 00:00 2026-02-17T09:53:10.163 INFO:teuthology.orchestra.run.trial070.stdout:(5/6): pdsh-2.34-7.el9.x86_64.rpm 463 kB/s | 118 kB 00:00 2026-02-17T09:53:10.692 INFO:teuthology.orchestra.run.trial070.stdout:(6/6): perf-5.14.0-681.el9.x86_64.rpm 4.1 MB/s | 3.2 MB 00:00 2026-02-17T09:53:10.694 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-17T09:53:10.694 INFO:teuthology.orchestra.run.trial070.stdout:Total 3.3 MB/s | 3.7 MB 00:01 2026-02-17T09:53:10.718 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-17T09:53:10.729 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-17T09:53:10.729 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-17T09:53:10.786 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-17T09:53:10.786 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-17T09:53:10.859 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-17T09:53:10.865 INFO:teuthology.orchestra.run.trial070.stdout: Installing : pdsh-rcmd-ssh-2.34-7.el9.x86_64 1/6 2026-02-17T09:53:10.904 INFO:teuthology.orchestra.run.trial070.stdout: Installing : pdsh-2.34-7.el9.x86_64 2/6 2026-02-17T09:53:10.909 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libtraceevent-1.8.4-2.el9.x86_64 3/6 2026-02-17T09:53:10.911 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libradospp-devel-2:20.3.0-5345.gb58fab16.el9.x86_64 4/6 2026-02-17T09:53:11.072 INFO:teuthology.orchestra.run.trial070.stdout: Installing : librbd-devel-2:20.3.0-5345.gb58fab16.el9.x86_64 5/6 2026-02-17T09:53:11.093 INFO:teuthology.orchestra.run.trial070.stdout: Installing : perf-5.14.0-681.el9.x86_64 6/6 2026-02-17T09:53:11.212 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: perf-5.14.0-681.el9.x86_64 6/6 2026-02-17T09:53:11.212 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libradospp-devel-2:20.3.0-5345.gb58fab16.el9.x86_64 1/6 2026-02-17T09:53:11.212 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librbd-devel-2:20.3.0-5345.gb58fab16.el9.x86_64 2/6 2026-02-17T09:53:11.212 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libtraceevent-1.8.4-2.el9.x86_64 3/6 2026-02-17T09:53:11.212 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : perf-5.14.0-681.el9.x86_64 4/6 2026-02-17T09:53:11.212 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : pdsh-2.34-7.el9.x86_64 5/6 2026-02-17T09:53:11.271 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : pdsh-rcmd-ssh-2.34-7.el9.x86_64 6/6 2026-02-17T09:53:11.271 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:53:11.271 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-17T09:53:11.271 INFO:teuthology.orchestra.run.trial070.stdout: libradospp-devel-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:53:11.271 INFO:teuthology.orchestra.run.trial070.stdout: librbd-devel-2:20.3.0-5345.gb58fab16.el9.x86_64 2026-02-17T09:53:11.271 INFO:teuthology.orchestra.run.trial070.stdout: libtraceevent-1.8.4-2.el9.x86_64 2026-02-17T09:53:11.271 INFO:teuthology.orchestra.run.trial070.stdout: pdsh-2.34-7.el9.x86_64 2026-02-17T09:53:11.271 INFO:teuthology.orchestra.run.trial070.stdout: pdsh-rcmd-ssh-2.34-7.el9.x86_64 2026-02-17T09:53:11.271 INFO:teuthology.orchestra.run.trial070.stdout: perf-5.14.0-681.el9.x86_64 2026-02-17T09:53:11.272 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-17T09:53:11.272 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-17T09:53:11.301 DEBUG:teuthology.orchestra.run.trial070:> python3 -m pip install -r /home/ubuntu/cephtest/cbt/requirements.txt 2026-02-17T09:53:11.443 INFO:teuthology.orchestra.run.trial070.stdout:Defaulting to user installation because normal site-packages is not writeable 2026-02-17T09:53:11.455 INFO:teuthology.orchestra.run.trial070.stdout:Requirement already satisfied: pyyaml in /usr/lib64/python3.9/site-packages (from -r /home/ubuntu/cephtest/cbt/requirements.txt (line 1)) (5.4.1) 2026-02-17T09:53:11.455 INFO:teuthology.orchestra.run.trial070.stdout:Requirement already satisfied: lxml in /usr/lib64/python3.9/site-packages (from -r /home/ubuntu/cephtest/cbt/requirements.txt (line 2)) (4.6.5) 2026-02-17T09:53:11.777 INFO:teuthology.orchestra.run.trial070.stdout:Collecting matplotlib 2026-02-17T09:53:11.807 INFO:teuthology.orchestra.run.trial070.stdout: Downloading matplotlib-3.9.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.3 MB) 2026-02-17T09:53:11.898 INFO:teuthology.orchestra.run.trial070.stdout:Collecting importlib-resources>=3.2.0 2026-02-17T09:53:11.902 INFO:teuthology.orchestra.run.trial070.stdout: Downloading importlib_resources-6.5.2-py3-none-any.whl (37 kB) 2026-02-17T09:53:11.913 INFO:teuthology.orchestra.run.trial070.stdout:Collecting cycler>=0.10 2026-02-17T09:53:11.917 INFO:teuthology.orchestra.run.trial070.stdout: Downloading cycler-0.12.1-py3-none-any.whl (8.3 kB) 2026-02-17T09:53:11.918 INFO:teuthology.orchestra.run.trial070.stdout:Requirement already satisfied: python-dateutil>=2.7 in /usr/lib/python3.9/site-packages (from matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (2.9.0.post0) 2026-02-17T09:53:12.057 INFO:teuthology.orchestra.run.trial070.stdout:Collecting contourpy>=1.0.1 2026-02-17T09:53:12.061 INFO:teuthology.orchestra.run.trial070.stdout: Downloading contourpy-1.3.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (321 kB) 2026-02-17T09:53:12.064 INFO:teuthology.orchestra.run.trial070.stdout:Requirement already satisfied: numpy>=1.23 in /usr/lib64/python3.9/site-packages (from matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (1.23.5) 2026-02-17T09:53:12.399 INFO:teuthology.orchestra.run.trial070.stdout:Collecting fonttools>=4.22.0 2026-02-17T09:53:12.405 INFO:teuthology.orchestra.run.trial070.stdout: Downloading fonttools-4.60.2-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (4.8 MB) 2026-02-17T09:53:12.792 INFO:teuthology.orchestra.run.trial070.stdout:Collecting pillow>=8 2026-02-17T09:53:12.799 INFO:teuthology.orchestra.run.trial070.stdout: Downloading pillow-11.3.0-cp39-cp39-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (6.6 MB) 2026-02-17T09:53:12.979 INFO:teuthology.orchestra.run.trial070.stdout:Collecting kiwisolver>=1.3.1 2026-02-17T09:53:12.985 INFO:teuthology.orchestra.run.trial070.stdout: Downloading kiwisolver-1.4.7-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.6 MB) 2026-02-17T09:53:12.993 INFO:teuthology.orchestra.run.trial070.stdout:Requirement already satisfied: pyparsing>=2.3.1 in /usr/lib/python3.9/site-packages (from matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (2.4.7) 2026-02-17T09:53:12.993 INFO:teuthology.orchestra.run.trial070.stdout:Requirement already satisfied: packaging>=20.0 in /usr/lib/python3.9/site-packages (from matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (20.9) 2026-02-17T09:53:13.042 INFO:teuthology.orchestra.run.trial070.stdout:Collecting zipp>=3.1.0 2026-02-17T09:53:13.046 INFO:teuthology.orchestra.run.trial070.stdout: Downloading zipp-3.23.0-py3-none-any.whl (10 kB) 2026-02-17T09:53:13.057 INFO:teuthology.orchestra.run.trial070.stdout:Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil>=2.7->matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (1.15.0) 2026-02-17T09:53:13.173 INFO:teuthology.orchestra.run.trial070.stdout:Installing collected packages: zipp, pillow, kiwisolver, importlib-resources, fonttools, cycler, contourpy, matplotlib 2026-02-17T09:53:14.240 INFO:teuthology.orchestra.run.trial070.stdout:Successfully installed contourpy-1.3.0 cycler-0.12.1 fonttools-4.60.2 importlib-resources-6.5.2 kiwisolver-1.4.7 matplotlib-3.9.4 pillow-11.3.0 zipp-3.23.0 2026-02-17T09:53:14.346 INFO:tasks.cbt:benchmark: radosbench 2026-02-17T09:53:14.346 DEBUG:teuthology.orchestra.run.trial070:> sudo /sbin/sysctl -q -w kernel.perf_event_paranoid=0 2026-02-17T09:53:14.373 DEBUG:teuthology.orchestra.run.trial070:> /home/ubuntu/cephtest/cbt/cbt.py -a /home/ubuntu/cephtest/archive/cbt /home/ubuntu/cephtest/archive/cbt/cbt_config.yaml 2026-02-17T09:53:14.486 INFO:teuthology.orchestra.run.trial070.stderr:09:53:14 - DEBUG - cbt - Settings.cluster: 2026-02-17T09:53:14.486 INFO:teuthology.orchestra.run.trial070.stderr: {'archive_dir': '/home/ubuntu/cephtest/archive/cbt', 2026-02-17T09:53:14.486 INFO:teuthology.orchestra.run.trial070.stderr: 'clients': ['ubuntu@trial070.front.sepia.ceph.com'], 2026-02-17T09:53:14.486 INFO:teuthology.orchestra.run.trial070.stderr: 'conf_file': '/etc/ceph/ceph.conf', 2026-02-17T09:53:14.487 INFO:teuthology.orchestra.run.trial070.stderr: 'head': 'ubuntu@trial070.front.sepia.ceph.com', 2026-02-17T09:53:14.487 INFO:teuthology.orchestra.run.trial070.stderr: 'is_teuthology': True, 2026-02-17T09:53:14.487 INFO:teuthology.orchestra.run.trial070.stderr: 'iterations': 1, 2026-02-17T09:53:14.487 INFO:teuthology.orchestra.run.trial070.stderr: 'mons': ['ubuntu@trial070.front.sepia.ceph.com'], 2026-02-17T09:53:14.487 INFO:teuthology.orchestra.run.trial070.stderr: 'osds': ['ubuntu@trial070.front.sepia.ceph.com'], 2026-02-17T09:53:14.487 INFO:teuthology.orchestra.run.trial070.stderr: 'osds_per_node': 3, 2026-02-17T09:53:14.487 INFO:teuthology.orchestra.run.trial070.stderr: 'pid_dir': '/var/run/ceph', 2026-02-17T09:53:14.487 INFO:teuthology.orchestra.run.trial070.stderr: 'pool_profiles': {'replicated': {'pg_size': 256, 2026-02-17T09:53:14.487 INFO:teuthology.orchestra.run.trial070.stderr: 'pgp_size': 256, 2026-02-17T09:53:14.487 INFO:teuthology.orchestra.run.trial070.stderr: 'replication': 'replicated'}}, 2026-02-17T09:53:14.487 INFO:teuthology.orchestra.run.trial070.stderr: 'rebuild_every_test': False, 2026-02-17T09:53:14.488 INFO:teuthology.orchestra.run.trial070.stderr: 'rgws': {'ubuntu@trial070.front.sepia.ceph.com': None}, 2026-02-17T09:53:14.488 INFO:teuthology.orchestra.run.trial070.stderr: 'tmp_dir': '/tmp/cbt', 2026-02-17T09:53:14.488 INFO:teuthology.orchestra.run.trial070.stderr: 'use_existing': True, 2026-02-17T09:53:14.488 INFO:teuthology.orchestra.run.trial070.stderr: 'user': 'ubuntu'} 2026-02-17T09:53:14.488 INFO:teuthology.orchestra.run.trial070.stderr:09:53:14 - INFO - cbt - Results dir: /home/ubuntu/cephtest/archive/cbt/results/00000000/id-9a441ab3 2026-02-17T09:53:14.488 INFO:teuthology.orchestra.run.trial070.stderr:09:53:14 - INFO - cbt - Pausing for 60s for idle monitoring. 2026-02-17T09:53:14.489 INFO:teuthology.orchestra.run.trial070.stderr:09:53:14 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/idle_monitoring/collectl 2026-02-17T09:53:14.654 INFO:teuthology.orchestra.run.trial070.stderr:09:53:14 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com collectl -s+mYZ -i 1:10 -F0 -f /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/idle_monitoring/collectl --rawdskfilt \"+cciss/c\d+d\d+ |hd[ab] | sd[a-z]+ |dm-\d+ |xvd[a-z] |fio[a-z]+ | vd[a-z]+ |emcpower[a-z]+ |psv\d+ |nvme[0-9]n[0-9]+p[0-9]+ \" 2026-02-17T09:53:14.655 INFO:teuthology.orchestra.run.trial070.stderr:09:53:14 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/idle_monitoring/perf 2026-02-17T09:53:14.818 INFO:teuthology.orchestra.run.trial070.stderr:09:53:14 - DEBUG - cbt - PerfMonitoring: remote_node 2026-02-17T09:53:14.818 INFO:teuthology.orchestra.run.trial070.stderr:09:53:14 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com for pid in `cat /var/run/ceph/crimson-osd.*.pid`; do perf stat -p ${pid} -o /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/idle_monitoring/perf/perf_stat.${pid} & done 2026-02-17T09:54:14.848 INFO:teuthology.orchestra.run.trial070.stderr:09:54:14 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com pkill -SIGINT -f collectl 2026-02-17T09:54:15.035 INFO:teuthology.orchestra.run.trial070.stderr:09:54:15 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sudo pkill -SIGINT -f perf\ 2026-02-17T09:54:15.222 INFO:teuthology.orchestra.run.trial070.stderr:09:54:15 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/idle_monitoring/perf/perf.data 2026-02-17T09:54:15.224 INFO:teuthology.orchestra.run.trial070.stderr:09:54:15 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/idle_monitoring/perf/perf_stat.* 2026-02-17T09:54:15.226 INFO:teuthology.orchestra.run.trial070.stderr:09:54:15 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sudo chown -R ubuntu.ubuntu /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/* 2026-02-17T09:54:15.403 INFO:teuthology.orchestra.run.trial070.stderr:09:54:15 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=rpdcp -f 10 -R ssh -w ubuntu@trial070.front.sepia.ceph.com -r /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/* /home/ubuntu/cephtest/archive/cbt/results/00000000/id-9a441ab3 2026-02-17T09:54:15.571 INFO:teuthology.orchestra.run.trial070.stderr:09:54:15 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sudo killall -9 rados 2026-02-17T09:54:15.750 INFO:teuthology.orchestra.run.trial070.stderr:09:54:15 - INFO - cbt - Results dir: /home/ubuntu/cephtest/archive/cbt/results/00000000/id-9a441ab3 2026-02-17T09:54:15.750 INFO:teuthology.orchestra.run.trial070.stderr:09:54:15 - INFO - cbt - Skipping existing test in /home/ubuntu/cephtest/archive/cbt/results/00000000/id-9a441ab3. 2026-02-17T09:54:15.750 INFO:teuthology.orchestra.run.trial070.stderr:09:54:15 - INFO - cbt - Running benchmark /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004 2026-02-17T09:54:15.750 INFO:teuthology.orchestra.run.trial070.stderr:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-9a441ab3 2026-02-17T09:54:15.750 INFO:teuthology.orchestra.run.trial070.stderr:{'concurrent_ops': 4, 'concurrent_procs': 2, 'pool_profile': 'replicated', 'time': 60, 'write_only': True, 'op_size': 4194304, 'pool_monitoring_list': 'collectl', 'run_monitoring_list': 'collectl', 'benchmark': 'radosbench', 'iteration': 0} == iteration 0 == 2026-02-17T09:54:15.750 INFO:teuthology.orchestra.run.trial070.stderr:09:54:15 - INFO - cbt - Setting OSD Read Ahead to: 0 2026-02-17T09:54:15.750 INFO:teuthology.orchestra.run.trial070.stderr:09:54:15 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com find /dev/disk/by-partlabel/osd-device-*data -exec readlink {} \; | cut -d"/" -f 3 | sed "s/[0-9]$//" | xargs -I{} sudo sh -c "echo 0 > /sys/block/'{}'/queue/read_ahead_kb" 2026-02-17T09:54:15.751 INFO:teuthology.orchestra.run.trial070.stderr:09:54:15 - DEBUG - cbt - Cleaning existing temporary run directory: /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004 2026-02-17T09:54:15.751 INFO:teuthology.orchestra.run.trial070.stderr:09:54:15 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sudo rm -rf /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004 2026-02-17T09:54:15.922 INFO:teuthology.orchestra.run.trial070.stderr:09:54:15 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/pool_monitoring/collectl 2026-02-17T09:54:16.079 INFO:teuthology.orchestra.run.trial070.stderr:09:54:16 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com collectl -s+mYZ -i 1:10 -F0 -f /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/pool_monitoring/collectl --rawdskfilt \"+cciss/c\d+d\d+ |hd[ab] | sd[a-z]+ |dm-\d+ |xvd[a-z] |fio[a-z]+ | vd[a-z]+ |emcpower[a-z]+ |psv\d+ |nvme[0-9]n[0-9]+p[0-9]+ \" 2026-02-17T09:54:16.081 INFO:teuthology.orchestra.run.trial070.stderr:09:54:16 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/pool_monitoring/perf 2026-02-17T09:54:16.249 INFO:teuthology.orchestra.run.trial070.stderr:09:54:16 - DEBUG - cbt - PerfMonitoring: remote_node 2026-02-17T09:54:16.249 INFO:teuthology.orchestra.run.trial070.stderr:09:54:16 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com for pid in `cat /var/run/ceph/crimson-osd.*.pid`; do perf stat -p ${pid} -o /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/pool_monitoring/perf/perf_stat.${pid} & done 2026-02-17T09:54:16.250 INFO:teuthology.orchestra.run.trial070.stderr:09:54:16 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool delete rados-bench-cbt rados-bench-cbt --yes-i-really-really-mean-it 2026-02-17T09:54:16.597 INFO:teuthology.orchestra.run.trial070.stderr:09:54:16 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool create rados-bench-cbt 256 256 2026-02-17T09:54:17.550 INFO:teuthology.orchestra.run.trial070.stderr:09:54:17 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool application enable rados-bench-cbt radosbench 2026-02-17T09:54:18.553 INFO:teuthology.orchestra.run.trial070.stderr:09:54:18 - INFO - cbt - Checking Health after pool creation. 2026-02-17T09:54:23.555 INFO:teuthology.orchestra.run.trial070.stderr:09:54:23 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com /usr/bin/ceph -c /etc/ceph/ceph.conf health 2026-02-17T09:54:23.914 INFO:teuthology.orchestra.run.trial070.stderr:09:54:23 - INFO - cbt - Final Pool Health Check. 2026-02-17T09:54:28.920 INFO:teuthology.orchestra.run.trial070.stderr:09:54:28 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com /usr/bin/ceph -c /etc/ceph/ceph.conf health 2026-02-17T09:54:29.275 INFO:teuthology.orchestra.run.trial070.stderr:09:54:29 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com pkill -SIGINT -f collectl 2026-02-17T09:54:29.448 INFO:teuthology.orchestra.run.trial070.stderr:09:54:29 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sudo pkill -SIGINT -f perf\ 2026-02-17T09:54:29.635 INFO:teuthology.orchestra.run.trial070.stderr:09:54:29 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/pool_monitoring/perf/perf.data 2026-02-17T09:54:29.636 INFO:teuthology.orchestra.run.trial070.stderr:09:54:29 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/pool_monitoring/perf/perf_stat.* 2026-02-17T09:54:29.638 INFO:teuthology.orchestra.run.trial070.stderr:09:54:29 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sync 2026-02-17T09:54:29.832 INFO:teuthology.orchestra.run.trial070.stderr:09:54:29 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com echo 3 | sudo tee /proc/sys/vm/drop_caches 2026-02-17T09:54:30.831 INFO:teuthology.orchestra.run.trial070.stderr:09:54:30 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com /usr/bin/rados -c /etc/ceph/ceph.conf -v 2026-02-17T09:54:31.041 INFO:teuthology.orchestra.run.trial070.stderr:09:54:31 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/write 2026-02-17T09:54:31.202 INFO:teuthology.orchestra.run.trial070.stderr:09:54:31 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf daemon osd.0 config show > /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/write/ceph_settings.out 2026-02-17T09:54:31.480 INFO:teuthology.orchestra.run.trial070.stderr:09:54:31 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/write/collectl 2026-02-17T09:54:31.641 INFO:teuthology.orchestra.run.trial070.stderr:09:54:31 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com collectl -s+mYZ -i 1:10 -F0 -f /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/write/collectl --rawdskfilt \"+cciss/c\d+d\d+ |hd[ab] | sd[a-z]+ |dm-\d+ |xvd[a-z] |fio[a-z]+ | vd[a-z]+ |emcpower[a-z]+ |psv\d+ |nvme[0-9]n[0-9]+p[0-9]+ \" 2026-02-17T09:54:31.643 INFO:teuthology.orchestra.run.trial070.stderr:09:54:31 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/write/perf 2026-02-17T09:54:31.806 INFO:teuthology.orchestra.run.trial070.stderr:09:54:31 - DEBUG - cbt - PerfMonitoring: remote_node 2026-02-17T09:54:31.806 INFO:teuthology.orchestra.run.trial070.stderr:09:54:31 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com for pid in `cat /var/run/ceph/crimson-osd.*.pid`; do perf stat -p ${pid} -o /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/write/perf/perf_stat.${pid} & done 2026-02-17T09:54:31.808 INFO:teuthology.orchestra.run.trial070.stderr:09:54:31 - INFO - cbt - Running radosbench write test. 2026-02-17T09:54:31.808 INFO:teuthology.orchestra.run.trial070.stderr:09:54:31 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com /usr/bin/rados -c /etc/ceph/ceph.conf -p rados-bench-cbt bench -b 4194304 60 write --concurrent-ios 4 --run-name `hostname -f`-0 --no-cleanup 2> /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/write/objecter.0.log > /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/write/output.0 2026-02-17T09:54:31.809 INFO:teuthology.orchestra.run.trial070.stderr:09:54:31 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com /usr/bin/rados -c /etc/ceph/ceph.conf -p rados-bench-cbt bench -b 4194304 60 write --concurrent-ios 4 --run-name `hostname -f`-1 --no-cleanup 2> /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/write/objecter.1.log > /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/write/output.1 2026-02-17T09:55:33.035 INFO:teuthology.orchestra.run.trial070.stderr:09:55:33 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com pkill -SIGINT -f collectl 2026-02-17T09:55:33.227 INFO:teuthology.orchestra.run.trial070.stderr:09:55:33 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sudo pkill -SIGINT -f perf\ 2026-02-17T09:55:33.408 INFO:teuthology.orchestra.run.trial070.stderr:09:55:33 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/write/perf/perf.data 2026-02-17T09:55:33.410 INFO:teuthology.orchestra.run.trial070.stderr:09:55:33 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/write/perf/perf_stat.* 2026-02-17T09:55:33.412 INFO:teuthology.orchestra.run.trial070.stderr:09:55:33 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com find /var/run/ceph/ceph-osd*.asok -maxdepth 1 -exec sudo /usr/bin/ceph --admin-daemon {} dump_historic_ops \; > /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/write/historic_ops.out 2026-02-17T09:55:33.775 INFO:teuthology.orchestra.run.trial070.stderr:09:55:33 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial070.front.sepia.ceph.com sudo chown -R ubuntu.ubuntu /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/write/* 2026-02-17T09:55:33.946 INFO:teuthology.orchestra.run.trial070.stderr:09:55:33 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=rpdcp -f 10 -R ssh -w ubuntu@trial070.front.sepia.ceph.com -r /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000004/write/* /home/ubuntu/cephtest/archive/cbt/results/00000000/id-9a441ab3/write 2026-02-17T09:55:34.109 INFO:teuthology.orchestra.run.trial070.stderr:09:55:34 - INFO - cbt - Convert results to json format. 2026-02-17T09:55:34.121 DEBUG:teuthology.run_tasks:Unwinding manager cbt 2026-02-17T09:55:34.140 DEBUG:teuthology.orchestra.run.trial070:> rm --one-file-system -rf -- /home/ubuntu/cephtest/cbt 2026-02-17T09:55:34.168 INFO:tasks.cbt_performance:Collecting CBT performance data config 2026-02-17T09:55:34.169 INFO:tasks.cbt_performance:reading cbt preferences 2026-02-17T09:55:34.169 DEBUG:teuthology.orchestra.run.trial070:> find /home/ubuntu/cephtest -name 'json_output.*' 2026-02-17T09:55:34.227 INFO:teuthology.orchestra.run.trial070.stdout:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-9a441ab3/write/json_output.1.trial070.front.sepia.ceph.com 2026-02-17T09:55:34.227 INFO:teuthology.orchestra.run.trial070.stdout:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-9a441ab3/write/json_output.0.trial070.front.sepia.ceph.com 2026-02-17T09:55:34.228 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:55:34.228 DEBUG:teuthology.orchestra.run.trial070:> dd if=/home/ubuntu/cephtest/archive/cbt/results/00000000/id-9a441ab3/write/json_output.1.trial070.front.sepia.ceph.com of=/dev/stdout 2026-02-17T09:55:34.283 INFO:tasks.cbt_performance:reading total cpu cycles 2026-02-17T09:55:34.283 DEBUG:teuthology.orchestra.run.trial070:> find /home/ubuntu/cephtest/archive/cbt/results/00000000/id-9a441ab3/write -name 'perf_stat.*' 2026-02-17T09:55:34.340 INFO:tasks.cbt_performance:cpu_cycles_paths: [''] 2026-02-17T09:55:34.340 INFO:tasks.cbt_performance:total cpu cycles: 0 2026-02-17T09:55:34.340 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-17T09:55:34.340 DEBUG:teuthology.orchestra.run.trial070:> dd if=/home/ubuntu/cephtest/archive/cbt/results/00000000/id-9a441ab3/write/json_output.0.trial070.front.sepia.ceph.com of=/dev/stdout 2026-02-17T09:55:34.396 INFO:tasks.cbt_performance:reading total cpu cycles 2026-02-17T09:55:34.396 DEBUG:teuthology.orchestra.run.trial070:> find /home/ubuntu/cephtest/archive/cbt/results/00000000/id-9a441ab3/write -name 'perf_stat.*' 2026-02-17T09:55:34.452 INFO:tasks.cbt_performance:cpu_cycles_paths: [''] 2026-02-17T09:55:34.452 INFO:tasks.cbt_performance:total cpu cycles: 0 2026-02-17T09:55:34.457 WARNING:tasks.cbt_performance:Could not send performance data to http://mira118.front.sepia.ceph.com:4000/cbt_performance: HTTPConnectionPool(host='mira118.front.sepia.ceph.com', port=4000): Max retries exceeded with url: /cbt_performance (Caused by NewConnectionError(': Failed to establish a new connection: [Errno -2] Name or service not known')) 2026-02-17T09:55:34.457 WARNING:tasks.cbt_performance:Continuing without performance data collection 2026-02-17T09:55:34.458 DEBUG:teuthology.run_tasks:Unwinding manager ssh_keys 2026-02-17T09:55:34.475 INFO:teuthology.task.ssh_keys:Cleaning up SSH keys 2026-02-17T09:55:34.475 INFO:teuthology.task.ssh_keys:cleaning up keys added for testing 2026-02-17T09:55:34.475 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on trial070.front.sepia.ceph.com 2026-02-17T09:55:34.475 DEBUG:teuthology.orchestra.run.trial070:> rm -- /home/ubuntu/.ssh/id_rsa 2026-02-17T09:55:34.508 DEBUG:teuthology.orchestra.run.trial070:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2026-02-17T09:55:34.565 DEBUG:teuthology.orchestra.run.trial070:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2026-02-17T09:55:34.622 INFO:teuthology.orchestra.run.trial070.stdout:"600" 2026-02-17T09:55:34.622 DEBUG:teuthology.orchestra.run.trial070:> mv -- /home/ubuntu/.ssh/authorized_keys_2026-02-17_09:53:07:702156 /home/ubuntu/.ssh/authorized_keys 2026-02-17T09:55:34.679 DEBUG:teuthology.orchestra.run.trial070:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2026-02-17T09:55:34.738 DEBUG:teuthology.orchestra.run.trial070:> rm /home/ubuntu/.ssh/config 2026-02-17T09:55:34.795 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T09:55:34.809 DEBUG:teuthology.orchestra.run.trial070:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T09:55:34.909 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:55:34.904+0000 7fc88a2b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:55:34.910 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-17T09:55:34.909+0000 7fc88a2b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-17T09:55:35.035 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T09:55:35.036 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T09:55:35.036 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T09:55:35.036 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T09:55:35.108 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T09:55:35.108 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T09:55:35.108 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T09:55:35.184 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T09:55:35.184 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T09:55:35.185 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T09:55:35.271 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T09:55:35.271 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T09:55:35.272 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T09:55:35.272 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T09:55:35.309 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T09:55:35.309 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T09:55:35.310 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T09:55:35.310 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T09:55:35.359 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T09:55:35.359 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T09:55:35.359 DEBUG:teuthology.orchestra.run.trial070:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v '\(PG_' | grep -E -v '\(OSD_' | grep -E -v '\(OBJECT_' | grep -E -v 'overall HEALTH' | head -n 1 2026-02-17T09:55:35.425 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial070.front.sepia.ceph.com 2026-02-17T09:55:35.426 DEBUG:teuthology.orchestra.run.trial070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T09:55:35.555 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial070.front.sepia.ceph.com 2026-02-17T09:55:35.555 DEBUG:teuthology.orchestra.run.trial070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T09:55:35.584 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial070.front.sepia.ceph.com 2026-02-17T09:55:35.584 DEBUG:teuthology.orchestra.run.trial070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T09:55:35.652 INFO:tasks.ceph:Archiving mon data... 2026-02-17T09:55:35.654 DEBUG:teuthology.misc:Transferring archived files from trial070:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/matan-2026-02-17_08:51:22-crimson-rados-wip-sjust-seastore-2026-02-16-1771285632-distro-debug-trial/52078/data/mon.a.tgz 2026-02-17T09:55:35.654 DEBUG:teuthology.orchestra.run.trial070:> mktemp 2026-02-17T09:55:35.709 INFO:teuthology.orchestra.run.trial070.stdout:/tmp/tmp.m3AiPVjLke 2026-02-17T09:55:35.710 DEBUG:teuthology.orchestra.run.trial070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.m3AiPVjLke 2026-02-17T09:55:35.800 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod 0666 /tmp/tmp.m3AiPVjLke 2026-02-17T09:55:35.882 DEBUG:teuthology.orchestra.remote:trial070:/tmp/tmp.m3AiPVjLke is 196KB 2026-02-17T09:55:35.935 DEBUG:teuthology.orchestra.run.trial070:> rm -fr /tmp/tmp.m3AiPVjLke 2026-02-17T09:55:35.951 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T09:55:35.952 DEBUG:teuthology.orchestra.run.trial070:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T09:55:36.072 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T09:55:36.072 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T09:55:36.075 DEBUG:teuthology.misc:Transferring archived files from trial070:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/matan-2026-02-17_08:51:22-crimson-rados-wip-sjust-seastore-2026-02-16-1771285632-distro-debug-trial/52078/remote/trial070/crash 2026-02-17T09:55:36.076 DEBUG:teuthology.orchestra.run.trial070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T09:55:36.135 INFO:tasks.ceph:Compressing logs... 2026-02-17T09:55:36.135 DEBUG:teuthology.orchestra.run.trial070:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T09:55:36.158 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T09:55:36.159 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41447.log 2026-02-17T09:55:36.159 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T09:55:36.159 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.41447.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T09:55:36.159 INFO:teuthology.orchestra.run.trial070.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41447.log.gz 2026-02-17T09:55:36.159 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44239.log 2026-02-17T09:55:36.159 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40748.log 2026-02-17T09:55:36.160 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40957.log 2026-02-17T09:55:36.160 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40818.log 2026-02-17T09:55:36.160 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.44239.log: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz/var/log/ceph/ceph-client.admin.40748.log: 2026-02-17T09:55:36.160 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.40957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40908.log 2026-02-17T09:55:36.160 INFO:teuthology.orchestra.run.trial070.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44239.log.gz 2026-02-17T09:55:36.160 INFO:teuthology.orchestra.run.trial070.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40748.log.gz 2026-02-17T09:55:36.161 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.40818.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.40957.log.gz 2026-02-17T09:55:36.161 INFO:teuthology.orchestra.run.trial070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40504.log 2026-02-17T09:55:36.161 INFO:teuthology.orchestra.run.trial070.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40818.log.gz 2026-02-17T09:55:36.161 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.40908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41305.log 2026-02-17T09:55:36.161 INFO:teuthology.orchestra.run.trial070.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40908.log.gz 2026-02-17T09:55:36.161 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.40504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41545.log 2026-02-17T09:55:36.161 INFO:teuthology.orchestra.run.trial070.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40504.log.gz 2026-02-17T09:55:36.161 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.41305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41055.log 2026-02-17T09:55:36.161 INFO:teuthology.orchestra.run.trial070.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41305.log.gz 2026-02-17T09:55:36.161 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.41545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41157.log 2026-02-17T09:55:36.162 INFO:teuthology.orchestra.run.trial070.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41545.log.gz 2026-02-17T09:55:36.162 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.41055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44183.log 2026-02-17T09:55:36.162 INFO:teuthology.orchestra.run.trial070.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41055.log.gz 2026-02-17T09:55:36.162 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.41157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41303.log 2026-02-17T09:55:36.162 INFO:teuthology.orchestra.run.trial070.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41157.log.gz 2026-02-17T09:55:36.162 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.44183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44942.log 2026-02-17T09:55:36.162 INFO:teuthology.orchestra.run.trial070.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44183.log.gz 2026-02-17T09:55:36.162 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.41303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44297.log 2026-02-17T09:55:36.163 INFO:teuthology.orchestra.run.trial070.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41303.log.gz 2026-02-17T09:55:36.163 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.44942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40285.log 66.7% 2026-02-17T09:55:36.163 INFO:teuthology.orchestra.run.trial070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44942.log.gz 2026-02-17T09:55:36.163 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.44297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44333.log 2026-02-17T09:55:36.163 INFO:teuthology.orchestra.run.trial070.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44297.log.gz 2026-02-17T09:55:36.163 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.40285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45544.log 2026-02-17T09:55:36.163 INFO:teuthology.orchestra.run.trial070.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40285.log.gz 2026-02-17T09:55:36.164 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41156.log 2026-02-17T09:55:36.164 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.45544.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45544.log.gz 2026-02-17T09:55:36.164 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40534.log 2026-02-17T09:55:36.164 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.41156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40007.log 2026-02-17T09:55:36.164 INFO:teuthology.orchestra.run.trial070.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41156.log.gz 2026-02-17T09:55:36.164 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.40534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41496.log 2026-02-17T09:55:36.165 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.44333.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40534.log.gz 2026-02-17T09:55:36.165 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.40007.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44333.log.gz 2026-02-17T09:55:36.165 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T09:55:36.165 INFO:teuthology.orchestra.run.trial070.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40007.log.gz 2026-02-17T09:55:36.165 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.41496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44941.log 2026-02-17T09:55:36.165 INFO:teuthology.orchestra.run.trial070.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41496.log.gz 2026-02-17T09:55:36.165 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40681.log 2026-02-17T09:55:36.165 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.44941.log: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.44941.log.gz 2026-02-17T09:55:36.165 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T09:55:36.165 INFO:teuthology.orchestra.run.trial070.stderr: 87.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T09:55:36.166 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.40681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41158.log 2026-02-17T09:55:36.166 INFO:teuthology.orchestra.run.trial070.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40681.log.gz 2026-02-17T09:55:36.166 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40191.log 2026-02-17T09:55:36.166 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.41158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41006.log 2026-02-17T09:55:36.166 INFO:teuthology.orchestra.run.trial070.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41158.log.gz 2026-02-17T09:55:36.167 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.40191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41398.log 2026-02-17T09:55:36.167 INFO:teuthology.orchestra.run.trial070.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40191.log.gz 2026-02-17T09:55:36.167 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.41006.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.38623.log 2026-02-17T09:55:36.167 INFO:teuthology.orchestra.run.trial070.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41006.log.gz 2026-02-17T09:55:36.167 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.41398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39912.log 2026-02-17T09:55:36.167 INFO:teuthology.orchestra.run.trial070.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41398.log.gz 2026-02-17T09:55:36.167 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph.tmp-client.admin.38623.log: gzip 66.7% -5 --verbose -- replaced with /var/log/ceph/ceph.tmp-client.admin.38623.log.gz 2026-02-17T09:55:36.167 INFO:teuthology.orchestra.run.trial070.stderr: -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T09:55:36.168 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.39912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40843.log 2026-02-17T09:55:36.168 INFO:teuthology.orchestra.run.trial070.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39912.log.gz 2026-02-17T09:55:36.168 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40238.log 2026-02-17T09:55:36.168 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.40843.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T09:55:36.168 INFO:teuthology.orchestra.run.trial070.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.40843.log.gz 2026-02-17T09:55:36.168 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.40238.log: /var/log/ceph/ceph-client.admin.41304.log 2026-02-17T09:55:36.169 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40238.log.gz 2026-02-17T09:55:36.169 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44387.log 2026-02-17T09:55:36.169 INFO:teuthology.orchestra.run.trial070.stderr: 84.6% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T09:55:36.169 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.41304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40054.log 2026-02-17T09:55:36.169 INFO:teuthology.orchestra.run.trial070.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41304.log.gz 2026-02-17T09:55:36.170 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-client.admin.44387.log: /var/log/ceph/ceph-client.admin.40054.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44387.log.gz 2026-02-17T09:55:36.170 INFO:teuthology.orchestra.run.trial070.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40054.log.gz 2026-02-17T09:55:36.177 INFO:teuthology.orchestra.run.trial070.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T09:55:37.835 INFO:teuthology.orchestra.run.trial070.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T09:55:37.906 INFO:teuthology.orchestra.run.trial070.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T09:55:37.979 INFO:teuthology.orchestra.run.trial070.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T09:55:37.980 INFO:teuthology.orchestra.run.trial070.stderr: 2026-02-17T09:55:37.980 INFO:teuthology.orchestra.run.trial070.stderr:real 0m1.830s 2026-02-17T09:55:37.980 INFO:teuthology.orchestra.run.trial070.stderr:user 0m4.956s 2026-02-17T09:55:37.980 INFO:teuthology.orchestra.run.trial070.stderr:sys 0m0.319s 2026-02-17T09:55:37.981 INFO:tasks.ceph:Archiving logs... 2026-02-17T09:55:37.981 DEBUG:teuthology.misc:Transferring archived files from trial070:/var/log/ceph to /home/teuthworker/mnt/teuthology/matan-2026-02-17_08:51:22-crimson-rados-wip-sjust-seastore-2026-02-16-1771285632-distro-debug-trial/52078/remote/trial070/log 2026-02-17T09:55:37.983 DEBUG:teuthology.orchestra.run.trial070:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T09:55:38.560 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T09:55:38.633 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T09:55:38.645 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T09:55:38.645 DEBUG:teuthology.orchestra.run.trial070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T09:55:38.671 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T09:55:38.685 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T09:55:38.685 DEBUG:teuthology.orchestra.run.trial070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T09:55:38.725 INFO:teuthology.orchestra.run.trial070.stderr:bash: line 1: ntpq: command not found 2026-02-17T09:55:39.286 INFO:teuthology.orchestra.run.trial070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T09:55:39.286 INFO:teuthology.orchestra.run.trial070.stdout:=============================================================================== 2026-02-17T09:55:39.287 INFO:teuthology.orchestra.run.trial070.stdout:^- ntp.maxhost.io 2 6 377 111 +1196us[+1411us] +/- 56ms 2026-02-17T09:55:39.287 INFO:teuthology.orchestra.run.trial070.stdout:^+ rn-03.koehn.com 2 6 377 47 +259us[ +460us] +/- 38ms 2026-02-17T09:55:39.287 INFO:teuthology.orchestra.run.trial070.stdout:^+ ntp2.zeus.frumentum.media 2 6 377 45 -1715us[-1715us] +/- 24ms 2026-02-17T09:55:39.287 INFO:teuthology.orchestra.run.trial070.stdout:^* 38.45.64.130 2 6 377 47 +1392us[+1592us] +/- 14ms 2026-02-17T09:55:39.289 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T09:55:39.309 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T09:55:39.310 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T09:55:39.326 DEBUG:teuthology.orchestra.run.trial070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T09:55:39.388 DEBUG:teuthology.orchestra.run.trial070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-17T09:55:39.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T09:55:39.416 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T09:55:39.433 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T09:55:39.450 INFO:teuthology.task.internal:Duration was 542.173817 seconds 2026-02-17T09:55:39.451 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T09:55:39.468 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T09:55:39.468 DEBUG:teuthology.orchestra.run.trial070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T09:55:39.509 INFO:teuthology.orchestra.run.trial070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T09:55:39.771 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T09:55:39.771 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial070.front.sepia.ceph.com 2026-02-17T09:55:39.771 DEBUG:teuthology.orchestra.run.trial070:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T09:55:39.830 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T09:55:39.830 DEBUG:teuthology.orchestra.run.trial070:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T09:55:39.933 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T09:55:39.933 DEBUG:teuthology.orchestra.run.trial070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T09:55:39.956 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T09:55:39.956 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T09:55:39.956 INFO:teuthology.orchestra.run.trial070.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T09:55:39.956 INFO:teuthology.orchestra.run.trial070.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T09:55:39.957 INFO:teuthology.orchestra.run.trial070.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T09:55:39.967 INFO:teuthology.orchestra.run.trial070.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T09:55:39.968 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T09:55:39.980 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T09:55:39.980 DEBUG:teuthology.orchestra.run.trial070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T09:55:40.032 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T09:55:40.049 DEBUG:teuthology.orchestra.run.trial070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T09:55:40.097 INFO:teuthology.orchestra.run.trial070.stdout:kernel.core_pattern = core 2026-02-17T09:55:40.110 DEBUG:teuthology.orchestra.run.trial070:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T09:55:40.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T09:55:40.167 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T09:55:40.185 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T09:55:40.186 DEBUG:teuthology.misc:Transferring archived files from trial070:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/matan-2026-02-17_08:51:22-crimson-rados-wip-sjust-seastore-2026-02-16-1771285632-distro-debug-trial/52078/remote/trial070 2026-02-17T09:55:40.186 DEBUG:teuthology.orchestra.run.trial070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T09:55:40.266 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T09:55:40.267 DEBUG:teuthology.orchestra.run.trial070:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T09:55:40.297 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T09:55:40.318 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T09:55:40.318 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T09:55:40.336 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T09:55:40.336 DEBUG:teuthology.orchestra.run.trial070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T09:55:40.355 INFO:teuthology.orchestra.run.trial070.stdout: 791885 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 09:55 /home/ubuntu/cephtest 2026-02-17T09:55:40.356 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T09:55:40.374 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T09:55:40.415 INFO:teuthology.run:Summary data: description: crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} perf_ignorelist settings/optimized workloads/radosbench_4M_write} duration: 542.1738169193268 flavor: debug owner: scheduled_matan@soko04.front.sepia.ceph.com success: true 2026-02-17T09:55:40.415 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T09:55:40.549 INFO:teuthology.run:pass