2026-02-20T11:27:01.517 INFO:root:teuthology version: 1.2.4.dev11+ge6d9099ce 2026-02-20T11:27:01.533 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T11:27:01.614 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60536 branch: wip-perezjos-crimson-only-19-02-2026-PR64439 description: crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} perf_ignorelist settings/optimized workloads/fio_4M_rand_write} email: null first_in_suite: false flavor: debug job_id: '60536' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-perezjos-crimson-only-19-02-2026-PR64439 ceph: conf: global: auth client required: none auth cluster required: none auth service required: none auth supported: none debug asok: 0/0 debug auth: 0/0 debug bdev: 0/0 debug bluefs: 0/0 debug bluestore: 0/0 debug buffer: 0/0 debug civetweb: 0/0 debug client: 0/0 debug compressor: 0/0 debug context: 0/0 debug crush: 0/0 debug crypto: 0/0 debug dpdk: 0/0 debug eventtrace: 0/0 debug filer: 0/0 debug filestore: 0/0 debug finisher: 0/0 debug fuse: 0/0 debug heartbeatmap: 0/0 debug javaclient: 0/0 debug journal: 0/0 debug journaler: 0/0 debug kstore: 0/0 debug leveldb: 0/0 debug lockdep: 0/0 debug mds: 0/0 debug mds balancer: 0/0 debug mds locker: 0/0 debug mds log: 0/0 debug mds log expire: 0/0 debug mds migrator: 0/0 debug memdb: 0/0 debug mgr: 0/0 debug mgrc: 0/0 debug mon: 0/0 debug monc: 0/0 debug ms: 0/0 debug objclass: 0/0 debug objectcacher: 0/0 debug objecter: 0/0 debug optracker: 0/0 debug osd: 0/0 debug paxos: 0/0 debug perfcounter: 0/0 debug rados: 0/0 debug rbd: 0/0 debug rbd mirror: 0/0 debug rbd replay: 0/0 debug refs: 0/0 debug rgw: 0/0 debug rgw lifecycle: 0/0 debug rgw notification: 0/0 debug rgw sync: 0/0 debug rocksdb: 0/0 debug striper: 0/0 debug throttle: 0/0 debug timer: 0/0 debug tp: 0/0 enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 0/0 debug ms: 0/0 debug paxos: 0/0 osd pool default crimson: true osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug filestore: 0/0 debug journal: 0/0 debug ms: 0/0 debug osd: 0/0 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd objectstore: seastore osd shutdown pgref assert: true seastore cachepin size pershard: 64M seastore cachepin type: 2Q seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - \(PG_ - \(OSD_ - \(OBJECT_ - overall HEALTH sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} install: ceph: flavor: debug sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 445d5c9ba18a4040e70e25303230c36c77773acb owner: scheduled_jjperez@soko04.front.sepia.ceph.com priority: 101 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 1736 sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 445d5c9ba18a4040e70e25303230c36c77773acb targets: trial095.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFw5Mlsjsj+Xyb1Yd/fKfTYc5dBm5VD0Z5d6p2ZyDeTEFJjqEbIJdjM0WparkX9sCR3zuRLpbGBuo6LZ5nmE9KY= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: osd: debug monc: 20 wait-for-scrub: false - ssh_keys: null - cbt: benchmarks: librbdfio: iodepth: - 32 log_avg_msec: 100 mode: - randwrite norandommap: true op_size: - 4194304 osd_ra: - 4096 pool_profile: rbd procs_per_volume: - 1 time: 60 vol_size: 4096 volumes_per_client: - 2 cluster: iterations: 1 osds_per_node: 3 pool_profiles: rbd: pg_size: 128 pgp_size: 128 replication: 3 user: ubuntu monitoring_profiles: perf: args: stat -p {pid} -o {perf_dir}/perf_stat.{pid} nodes: - osds perf_cmd: perf pid_glob: crimson-osd.*.pid teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: reimage-ssh-down teuthology_sha1: e6d9099ce03dc21193fda653159ec82465c3a94a timestamp: 2026-02-20_10:21:31 tube: trial user: jjperez verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-20T11:27:01.614 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa; will attempt to use it 2026-02-20T11:27:01.615 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks 2026-02-20T11:27:01.615 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-20T11:27:01.616 INFO:teuthology.task.internal:Checking packages... 2026-02-20T11:27:01.616 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4' 2026-02-20T11:27:01.616 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T11:27:01.617 INFO:teuthology.packaging:ref: None 2026-02-20T11:27:01.617 INFO:teuthology.packaging:tag: None 2026-02-20T11:27:01.617 INFO:teuthology.packaging:branch: wip-perezjos-crimson-only-19-02-2026-PR64439 2026-02-20T11:27:01.617 INFO:teuthology.packaging:sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:27:01.617 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=wip-perezjos-crimson-only-19-02-2026-PR64439 2026-02-20T11:27:01.732 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5357.g0c3148ca 2026-02-20T11:27:01.733 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-20T11:27:01.745 INFO:teuthology.task.internal:no buildpackages task found 2026-02-20T11:27:01.745 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-20T11:27:01.757 INFO:teuthology.task.internal:Saving configuration 2026-02-20T11:27:01.772 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-20T11:27:01.785 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-20T11:27:01.860 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial095.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60536', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 11:23:36.420115', 'locked_by': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFw5Mlsjsj+Xyb1Yd/fKfTYc5dBm5VD0Z5d6p2ZyDeTEFJjqEbIJdjM0WparkX9sCR3zuRLpbGBuo6LZ5nmE9KY='} 2026-02-20T11:27:01.860 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-20T11:27:01.877 INFO:teuthology.task.internal:roles: ubuntu@trial095.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-20T11:27:01.877 INFO:teuthology.run_tasks:Running task console_log... 2026-02-20T11:27:01.959 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7d363aa2bba0>, signals=[15]) 2026-02-20T11:27:01.959 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-20T11:27:01.972 INFO:teuthology.task.internal:Opening connections... 2026-02-20T11:27:01.972 DEBUG:teuthology.task.internal:connecting to ubuntu@trial095.front.sepia.ceph.com 2026-02-20T11:27:01.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial095.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:27:02.035 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-20T11:27:02.046 DEBUG:teuthology.orchestra.run.trial095:> uname -m 2026-02-20T11:27:02.108 INFO:teuthology.orchestra.run.trial095.stdout:x86_64 2026-02-20T11:27:02.108 DEBUG:teuthology.orchestra.run.trial095:> cat /etc/os-release 2026-02-20T11:27:02.164 INFO:teuthology.orchestra.run.trial095.stdout:NAME="CentOS Stream" 2026-02-20T11:27:02.165 INFO:teuthology.orchestra.run.trial095.stdout:VERSION="9" 2026-02-20T11:27:02.165 INFO:teuthology.orchestra.run.trial095.stdout:ID="centos" 2026-02-20T11:27:02.165 INFO:teuthology.orchestra.run.trial095.stdout:ID_LIKE="rhel fedora" 2026-02-20T11:27:02.165 INFO:teuthology.orchestra.run.trial095.stdout:VERSION_ID="9" 2026-02-20T11:27:02.165 INFO:teuthology.orchestra.run.trial095.stdout:PLATFORM_ID="platform:el9" 2026-02-20T11:27:02.165 INFO:teuthology.orchestra.run.trial095.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T11:27:02.165 INFO:teuthology.orchestra.run.trial095.stdout:ANSI_COLOR="0;31" 2026-02-20T11:27:02.165 INFO:teuthology.orchestra.run.trial095.stdout:LOGO="fedora-logo-icon" 2026-02-20T11:27:02.165 INFO:teuthology.orchestra.run.trial095.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T11:27:02.166 INFO:teuthology.orchestra.run.trial095.stdout:HOME_URL="https://centos.org/" 2026-02-20T11:27:02.166 INFO:teuthology.orchestra.run.trial095.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T11:27:02.166 INFO:teuthology.orchestra.run.trial095.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T11:27:02.166 INFO:teuthology.orchestra.run.trial095.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T11:27:02.167 INFO:teuthology.lock.ops:Updating trial095.front.sepia.ceph.com on lock server 2026-02-20T11:27:02.254 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-20T11:27:02.267 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-20T11:27:02.279 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-20T11:27:02.279 DEBUG:teuthology.orchestra.run.trial095:> test '!' -e /home/ubuntu/cephtest 2026-02-20T11:27:02.295 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-20T11:27:02.306 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-20T11:27:02.306 DEBUG:teuthology.orchestra.run.trial095:> test -z $(ls -A /var/lib/ceph) 2026-02-20T11:27:02.352 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-20T11:27:02.455 INFO:teuthology.run_tasks:Running task kernel... 2026-02-20T11:27:02.476 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-20T11:27:02.476 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-20T11:27:02.476 DEBUG:teuthology.orchestra.run.trial095:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T11:27:02.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:27:02.491 DEBUG:teuthology.orchestra.run.trial095:> uname -r 2026-02-20T11:27:02.547 INFO:teuthology.orchestra.run.trial095.stdout:5.14.0-681.el9.x86_64 2026-02-20T11:27:02.547 INFO:teuthology.task.kernel:Running kernel on trial095: 5.14.0-681.el9.x86_64 2026-02-20T11:27:02.547 DEBUG:teuthology.orchestra.run.trial095:> sudo yum install -y kernel 2026-02-20T11:27:03.960 INFO:teuthology.orchestra.run.trial095.stdout:CentOS Stream 9 - BaseOS 8.7 MB/s | 8.9 MB 00:01 2026-02-20T11:27:12.283 INFO:teuthology.orchestra.run.trial095.stdout:CentOS Stream 9 - AppStream 3.4 MB/s | 27 MB 00:07 2026-02-20T11:27:19.292 INFO:teuthology.orchestra.run.trial095.stdout:CentOS Stream 9 - CRB 1.7 MB/s | 7.8 MB 00:04 2026-02-20T11:27:20.990 INFO:teuthology.orchestra.run.trial095.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:00 2026-02-20T11:27:21.358 INFO:teuthology.orchestra.run.trial095.stdout:Extra Packages for Enterprise Linux 66 MB/s | 20 MB 00:00 2026-02-20T11:27:24.574 INFO:teuthology.orchestra.run.trial095.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-20T11:27:25.582 INFO:teuthology.orchestra.run.trial095.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T11:27:25.582 INFO:teuthology.orchestra.run.trial095.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T11:27:25.601 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:27:25.601 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:27:25.602 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:27:25.625 DEBUG:teuthology.orchestra.run.trial095:> echo no | sudo yum reinstall kernel || true 2026-02-20T11:27:25.921 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 11:27:24 AM UTC. 2026-02-20T11:27:26.001 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:27:26.002 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:27:26.002 INFO:teuthology.orchestra.run.trial095.stdout: Package Architecture Version Repository Size 2026-02-20T11:27:26.002 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:27:26.002 INFO:teuthology.orchestra.run.trial095.stdout:Reinstalling: 2026-02-20T11:27:26.002 INFO:teuthology.orchestra.run.trial095.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:27:26.002 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:27:26.002 INFO:teuthology.orchestra.run.trial095.stdout:Transaction Summary 2026-02-20T11:27:26.002 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:27:26.002 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:27:26.002 INFO:teuthology.orchestra.run.trial095.stdout:Total download size: 803 k 2026-02-20T11:27:26.002 INFO:teuthology.orchestra.run.trial095.stdout:Installed size: 0 2026-02-20T11:27:26.002 INFO:teuthology.orchestra.run.trial095.stderr:Operation aborted. 2026-02-20T11:27:26.022 INFO:teuthology.orchestra.run.trial095.stdout:Is this ok [y/N]: 2026-02-20T11:27:26.022 DEBUG:teuthology.orchestra.run.trial095:> sudo yum reinstall -y kernel || true 2026-02-20T11:27:26.320 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:27:24 AM UTC. 2026-02-20T11:27:26.400 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:27:26.401 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:27:26.401 INFO:teuthology.orchestra.run.trial095.stdout: Package Architecture Version Repository Size 2026-02-20T11:27:26.401 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:27:26.401 INFO:teuthology.orchestra.run.trial095.stdout:Reinstalling: 2026-02-20T11:27:26.401 INFO:teuthology.orchestra.run.trial095.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:27:26.401 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:27:26.401 INFO:teuthology.orchestra.run.trial095.stdout:Transaction Summary 2026-02-20T11:27:26.401 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:27:26.401 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:27:26.402 INFO:teuthology.orchestra.run.trial095.stdout:Total download size: 803 k 2026-02-20T11:27:26.402 INFO:teuthology.orchestra.run.trial095.stdout:Installed size: 0 2026-02-20T11:27:26.402 INFO:teuthology.orchestra.run.trial095.stdout:Downloading Packages: 2026-02-20T11:27:27.199 INFO:teuthology.orchestra.run.trial095.stdout:kernel-5.14.0-681.el9.x86_64.rpm 1.1 MB/s | 803 kB 00:00 2026-02-20T11:27:27.199 INFO:teuthology.orchestra.run.trial095.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:27:27.199 INFO:teuthology.orchestra.run.trial095.stdout:Total 1.0 MB/s | 803 kB 00:00 2026-02-20T11:27:27.208 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction check 2026-02-20T11:27:27.241 INFO:teuthology.orchestra.run.trial095.stdout:Transaction check succeeded. 2026-02-20T11:27:27.242 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction test 2026-02-20T11:27:27.246 INFO:teuthology.orchestra.run.trial095.stdout:Transaction test succeeded. 2026-02-20T11:27:27.246 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction 2026-02-20T11:27:27.269 INFO:teuthology.orchestra.run.trial095.stdout: Preparing : 1/1 2026-02-20T11:27:27.273 INFO:teuthology.orchestra.run.trial095.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:27:27.273 INFO:teuthology.orchestra.run.trial095.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:27:27.385 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:27:27.385 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:27:27.436 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:27:27.436 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:27:27.436 INFO:teuthology.orchestra.run.trial095.stdout:Reinstalled: 2026-02-20T11:27:27.436 INFO:teuthology.orchestra.run.trial095.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T11:27:27.436 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:27:27.436 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:27:27.463 DEBUG:teuthology.orchestra.run.trial095:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T11:27:27.488 INFO:teuthology.orchestra.run.trial095.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T11:27:27.488 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T11:27:27.489 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T11:27:27.489 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-20T11:27:27.489 DEBUG:teuthology.orchestra.run.trial095:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T11:27:27.552 INFO:teuthology.orchestra.run.trial095.stdout:ttyS1 2026-02-20T11:27:27.575 DEBUG:teuthology.parallel:result is None 2026-02-20T11:27:27.575 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-20T11:27:27.586 INFO:teuthology.task.internal:Creating test directory... 2026-02-20T11:27:27.587 DEBUG:teuthology.orchestra.run.trial095:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T11:27:27.631 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-20T11:27:27.643 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-20T11:27:27.658 INFO:teuthology.task.internal:Creating archive directory... 2026-02-20T11:27:27.658 DEBUG:teuthology.orchestra.run.trial095:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T11:27:27.692 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-20T11:27:27.704 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-20T11:27:27.704 DEBUG:teuthology.orchestra.run.trial095:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T11:27:27.752 INFO:teuthology.orchestra.run.trial095.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:27:27.762 INFO:teuthology.orchestra.run.trial095.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:27:27.763 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-20T11:27:27.775 INFO:teuthology.task.internal:Configuring sudo... 2026-02-20T11:27:27.776 DEBUG:teuthology.orchestra.run.trial095:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T11:27:27.828 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-20T11:27:27.845 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-20T11:27:27.845 DEBUG:teuthology.orchestra.run.trial095:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T11:27:27.885 DEBUG:teuthology.orchestra.run.trial095:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:27:28.045 DEBUG:teuthology.orchestra.run.trial095:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:27:28.069 DEBUG:teuthology.orchestra.run.trial095:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:27:28.223 DEBUG:teuthology.orchestra.run.trial095:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:27:28.245 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:27:28.246 DEBUG:teuthology.orchestra.run.trial095:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T11:27:28.309 DEBUG:teuthology.orchestra.run.trial095:> sudo service rsyslog restart 2026-02-20T11:27:28.377 INFO:teuthology.orchestra.run.trial095.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T11:27:28.901 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-20T11:27:28.913 INFO:teuthology.task.internal:Starting timer... 2026-02-20T11:27:28.914 INFO:teuthology.run_tasks:Running task pcp... 2026-02-20T11:27:28.934 INFO:teuthology.run_tasks:Running task selinux... 2026-02-20T11:27:28.953 DEBUG:teuthology.orchestra.run.trial095:> sudo service auditd rotate 2026-02-20T11:27:28.982 INFO:teuthology.orchestra.run.trial095.stdout:Rotating logs: 2026-02-20T11:27:28.984 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-20T11:27:28.984 DEBUG:teuthology.orchestra.run.trial095:> /usr/sbin/getenforce 2026-02-20T11:27:29.040 INFO:teuthology.orchestra.run.trial095.stdout:Permissive 2026-02-20T11:27:29.041 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial095.front.sepia.ceph.com': 'permissive'} 2026-02-20T11:27:29.041 DEBUG:teuthology.orchestra.run.trial095:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T11:27:29.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:27:29.106 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-20T11:27:29.106 DEBUG:teuthology.orchestra.run.trial095:> sudo /usr/sbin/setenforce permissive 2026-02-20T11:27:29.170 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-20T11:27:29.183 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-20T11:27:29.192 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-20T11:27:29.192 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial095.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-20T11:30:12.244 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial095.front.sepia.ceph.com')] 2026-02-20T11:30:12.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial095.front.sepia.ceph.com' 2026-02-20T11:30:12.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial095.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:30:12.356 DEBUG:teuthology.orchestra.run.trial095:> true 2026-02-20T11:30:12.431 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial095.front.sepia.ceph.com' 2026-02-20T11:30:12.431 INFO:teuthology.run_tasks:Running task clock... 2026-02-20T11:30:12.444 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-20T11:30:12.444 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T11:30:12.445 DEBUG:teuthology.orchestra.run.trial095:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T11:30:12.500 INFO:teuthology.orchestra.run.trial095.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T11:30:12.513 INFO:teuthology.orchestra.run.trial095.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T11:30:12.533 INFO:teuthology.orchestra.run.trial095.stderr:sudo: ntpd: command not found 2026-02-20T11:30:12.543 INFO:teuthology.orchestra.run.trial095.stdout:506 Cannot talk to daemon 2026-02-20T11:30:12.554 INFO:teuthology.orchestra.run.trial095.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T11:30:12.566 INFO:teuthology.orchestra.run.trial095.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T11:30:12.620 INFO:teuthology.orchestra.run.trial095.stderr:bash: line 1: ntpq: command not found 2026-02-20T11:30:12.939 INFO:teuthology.orchestra.run.trial095.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T11:30:12.939 INFO:teuthology.orchestra.run.trial095.stdout:=============================================================================== 2026-02-20T11:30:12.939 INFO:teuthology.orchestra.run.trial095.stdout:^? 104-167-215-195.ipv4.ber> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:30:12.940 INFO:teuthology.orchestra.run.trial095.stdout:^? ntp11.kernfusion.at 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:30:12.940 INFO:teuthology.orchestra.run.trial095.stdout:^? 173.249.203.227 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:30:12.940 INFO:teuthology.orchestra.run.trial095.stdout:^? 209.205.228.50 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:30:12.941 INFO:teuthology.run_tasks:Running task install... 2026-02-20T11:30:12.954 DEBUG:teuthology.task.install:project ceph 2026-02-20T11:30:12.955 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}} 2026-02-20T11:30:12.955 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'} 2026-02-20T11:30:12.955 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T11:30:12.965 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T11:30:12.965 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-20T11:30:12.966 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:30:12.966 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:30:13.132 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:30:13.132 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:30:13.496 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:30:13.496 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:30:13.497 DEBUG:teuthology.orchestra.run.trial095:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:30:13.523 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-20T11:30:13.524 DEBUG:teuthology.orchestra.run.trial095:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:30:13.589 DEBUG:teuthology.orchestra.run.trial095:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:30:13.663 DEBUG:teuthology.orchestra.run.trial095:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:30:13.727 INFO:teuthology.orchestra.run.trial095.stdout:check_obsoletes = 1 2026-02-20T11:30:13.729 DEBUG:teuthology.orchestra.run.trial095:> sudo yum clean all 2026-02-20T11:30:13.888 INFO:teuthology.orchestra.run.trial095.stdout:41 files removed 2026-02-20T11:30:13.903 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-radosgw 2026-02-20T11:30:14.718 INFO:teuthology.orchestra.run.trial095.stdout:ceph packages for x86_64 139 kB/s | 94 kB 00:00 2026-02-20T11:30:15.359 INFO:teuthology.orchestra.run.trial095.stdout:ceph noarch packages 40 kB/s | 24 kB 00:00 2026-02-20T11:30:15.908 INFO:teuthology.orchestra.run.trial095.stdout:ceph source packages 3.9 kB/s | 2.1 kB 00:00 2026-02-20T11:30:17.895 INFO:teuthology.orchestra.run.trial095.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.9 MB 00:01 2026-02-20T11:30:20.933 INFO:teuthology.orchestra.run.trial095.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-20T11:30:24.475 INFO:teuthology.orchestra.run.trial095.stdout:CentOS Stream 9 - CRB 7.0 MB/s | 7.8 MB 00:01 2026-02-20T11:30:26.171 INFO:teuthology.orchestra.run.trial095.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 20 kB 00:00 2026-02-20T11:30:26.642 INFO:teuthology.orchestra.run.trial095.stdout:Extra Packages for Enterprise Linux 50 MB/s | 20 MB 00:00 2026-02-20T11:30:29.793 INFO:teuthology.orchestra.run.trial095.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-20T11:30:30.982 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:30:30.983 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:30:30.983 INFO:teuthology.orchestra.run.trial095.stdout: Package Arch Version Repository Size 2026-02-20T11:30:30.983 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:30:30.983 INFO:teuthology.orchestra.run.trial095.stdout:Installing: 2026-02-20T11:30:30.983 INFO:teuthology.orchestra.run.trial095.stdout: ceph-radosgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 11 M 2026-02-20T11:30:30.983 INFO:teuthology.orchestra.run.trial095.stdout:Upgrading: 2026-02-20T11:30:30.983 INFO:teuthology.orchestra.run.trial095.stdout: librados2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 3.3 M 2026-02-20T11:30:30.983 INFO:teuthology.orchestra.run.trial095.stdout: librbd1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.7 M 2026-02-20T11:30:30.984 INFO:teuthology.orchestra.run.trial095.stdout:Installing dependencies: 2026-02-20T11:30:30.984 INFO:teuthology.orchestra.run.trial095.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T11:30:30.984 INFO:teuthology.orchestra.run.trial095.stdout: ceph-base x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.1 M 2026-02-20T11:30:30.984 INFO:teuthology.orchestra.run.trial095.stdout: ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 21 M 2026-02-20T11:30:30.984 INFO:teuthology.orchestra.run.trial095.stdout: ceph-selinux x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 25 k 2026-02-20T11:30:30.984 INFO:teuthology.orchestra.run.trial095.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T11:30:30.984 INFO:teuthology.orchestra.run.trial095.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T11:30:30.984 INFO:teuthology.orchestra.run.trial095.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T11:30:30.984 INFO:teuthology.orchestra.run.trial095.stdout: libcephfs2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 860 k 2026-02-20T11:30:30.984 INFO:teuthology.orchestra.run.trial095.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T11:30:30.984 INFO:teuthology.orchestra.run.trial095.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T11:30:30.984 INFO:teuthology.orchestra.run.trial095.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T11:30:30.985 INFO:teuthology.orchestra.run.trial095.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T11:30:30.985 INFO:teuthology.orchestra.run.trial095.stdout: libradosstriper1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 263 k 2026-02-20T11:30:30.985 INFO:teuthology.orchestra.run.trial095.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T11:30:30.985 INFO:teuthology.orchestra.run.trial095.stdout: librgw2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.6 M 2026-02-20T11:30:30.985 INFO:teuthology.orchestra.run.trial095.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T11:30:30.985 INFO:teuthology.orchestra.run.trial095.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T11:30:30.985 INFO:teuthology.orchestra.run.trial095.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T11:30:30.985 INFO:teuthology.orchestra.run.trial095.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T11:30:30.985 INFO:teuthology.orchestra.run.trial095.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T11:30:30.985 INFO:teuthology.orchestra.run.trial095.stdout: python3-ceph-argparse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 45 k 2026-02-20T11:30:30.985 INFO:teuthology.orchestra.run.trial095.stdout: python3-ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 185 k 2026-02-20T11:30:30.986 INFO:teuthology.orchestra.run.trial095.stdout: python3-cephfs x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 204 k 2026-02-20T11:30:30.986 INFO:teuthology.orchestra.run.trial095.stdout: python3-rados x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 324 k 2026-02-20T11:30:30.986 INFO:teuthology.orchestra.run.trial095.stdout: python3-rbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 305 k 2026-02-20T11:30:30.986 INFO:teuthology.orchestra.run.trial095.stdout: python3-rgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 100 k 2026-02-20T11:30:30.986 INFO:teuthology.orchestra.run.trial095.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T11:30:30.986 INFO:teuthology.orchestra.run.trial095.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T11:30:30.986 INFO:teuthology.orchestra.run.trial095.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T11:30:30.986 INFO:teuthology.orchestra.run.trial095.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T11:30:30.986 INFO:teuthology.orchestra.run.trial095.stdout:Installing weak dependencies: 2026-02-20T11:30:30.986 INFO:teuthology.orchestra.run.trial095.stdout: libcephfs-daemon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:30:30.986 INFO:teuthology.orchestra.run.trial095.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 26 k 2026-02-20T11:30:30.986 INFO:teuthology.orchestra.run.trial095.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T11:30:30.986 INFO:teuthology.orchestra.run.trial095.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T11:30:30.987 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:30:30.987 INFO:teuthology.orchestra.run.trial095.stdout:Transaction Summary 2026-02-20T11:30:30.987 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:30:30.987 INFO:teuthology.orchestra.run.trial095.stdout:Install 35 Packages 2026-02-20T11:30:30.987 INFO:teuthology.orchestra.run.trial095.stdout:Upgrade 2 Packages 2026-02-20T11:30:30.987 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:30:30.988 INFO:teuthology.orchestra.run.trial095.stdout:Total download size: 61 M 2026-02-20T11:30:30.988 INFO:teuthology.orchestra.run.trial095.stdout:Downloading Packages: 2026-02-20T11:30:33.239 INFO:teuthology.orchestra.run.trial095.stdout:(1/37): ceph-base-20.3.0-5357.g0c3148ca.el9.x86 2.9 MB/s | 5.1 MB 00:01 2026-02-20T11:30:33.303 INFO:teuthology.orchestra.run.trial095.stdout:(2/37): ceph-selinux-20.3.0-5357.g0c3148ca.el9. 394 kB/s | 25 kB 00:00 2026-02-20T11:30:33.366 INFO:teuthology.orchestra.run.trial095.stdout:(3/37): libcephfs-daemon-20.3.0-5357.g0c3148ca. 593 kB/s | 37 kB 00:00 2026-02-20T11:30:33.429 INFO:teuthology.orchestra.run.trial095.stdout:(4/37): libcephfs-proxy2-20.3.0-5357.g0c3148ca. 407 kB/s | 26 kB 00:00 2026-02-20T11:30:33.633 INFO:teuthology.orchestra.run.trial095.stdout:(5/37): libcephfs2-20.3.0-5357.g0c3148ca.el9.x8 4.1 MB/s | 860 kB 00:00 2026-02-20T11:30:33.703 INFO:teuthology.orchestra.run.trial095.stdout:(6/37): libradosstriper1-20.3.0-5357.g0c3148ca. 3.7 MB/s | 263 kB 00:00 2026-02-20T11:30:34.916 INFO:teuthology.orchestra.run.trial095.stdout:(7/37): librgw2-20.3.0-5357.g0c3148ca.el9.x86_6 4.6 MB/s | 5.6 MB 00:01 2026-02-20T11:30:34.980 INFO:teuthology.orchestra.run.trial095.stdout:(8/37): python3-ceph-argparse-20.3.0-5357.g0c31 706 kB/s | 45 kB 00:00 2026-02-20T11:30:35.047 INFO:teuthology.orchestra.run.trial095.stdout:(9/37): python3-ceph-common-20.3.0-5357.g0c3148 2.7 MB/s | 185 kB 00:00 2026-02-20T11:30:35.115 INFO:teuthology.orchestra.run.trial095.stdout:(10/37): python3-cephfs-20.3.0-5357.g0c3148ca.e 2.9 MB/s | 204 kB 00:00 2026-02-20T11:30:35.185 INFO:teuthology.orchestra.run.trial095.stdout:(11/37): python3-rados-20.3.0-5357.g0c3148ca.el 4.5 MB/s | 324 kB 00:00 2026-02-20T11:30:35.256 INFO:teuthology.orchestra.run.trial095.stdout:(12/37): python3-rbd-20.3.0-5357.g0c3148ca.el9. 4.2 MB/s | 305 kB 00:00 2026-02-20T11:30:35.323 INFO:teuthology.orchestra.run.trial095.stdout:(13/37): python3-rgw-20.3.0-5357.g0c3148ca.el9. 1.5 MB/s | 100 kB 00:00 2026-02-20T11:30:35.426 INFO:teuthology.orchestra.run.trial095.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 321 kB/s | 33 kB 00:00 2026-02-20T11:30:35.469 INFO:teuthology.orchestra.run.trial095.stdout:(15/37): nvme-cli-2.16-1.el9.x86_64.rpm 27 MB/s | 1.2 MB 00:00 2026-02-20T11:30:35.478 INFO:teuthology.orchestra.run.trial095.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 9.9 MB/s | 93 kB 00:00 2026-02-20T11:30:35.683 INFO:teuthology.orchestra.run.trial095.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 507 kB/s | 104 kB 00:00 2026-02-20T11:30:35.740 INFO:teuthology.orchestra.run.trial095.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 2.8 MB/s | 164 kB 00:00 2026-02-20T11:30:35.775 INFO:teuthology.orchestra.run.trial095.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.4 MB/s | 160 kB 00:00 2026-02-20T11:30:35.802 INFO:teuthology.orchestra.run.trial095.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.6 MB/s | 45 kB 00:00 2026-02-20T11:30:35.870 INFO:teuthology.orchestra.run.trial095.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 9.4 MB/s | 662 kB 00:00 2026-02-20T11:30:35.901 INFO:teuthology.orchestra.run.trial095.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 9.4 MB/s | 292 kB 00:00 2026-02-20T11:30:35.930 INFO:teuthology.orchestra.run.trial095.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 8.0 MB/s | 240 kB 00:00 2026-02-20T11:30:35.956 INFO:teuthology.orchestra.run.trial095.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.4 MB/s | 37 kB 00:00 2026-02-20T11:30:35.982 INFO:teuthology.orchestra.run.trial095.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.5 MB/s | 66 kB 00:00 2026-02-20T11:30:36.233 INFO:teuthology.orchestra.run.trial095.stdout:(26/37): ceph-radosgw-20.3.0-5357.g0c3148ca.el9 2.4 MB/s | 11 MB 00:04 2026-02-20T11:30:36.390 INFO:teuthology.orchestra.run.trial095.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 753 kB/s | 308 kB 00:00 2026-02-20T11:30:36.434 INFO:teuthology.orchestra.run.trial095.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 566 kB/s | 25 kB 00:00 2026-02-20T11:30:36.480 INFO:teuthology.orchestra.run.trial095.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2026-02-20T11:30:36.527 INFO:teuthology.orchestra.run.trial095.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2026-02-20T11:30:36.628 INFO:teuthology.orchestra.run.trial095.stdout:(31/37): ceph-common-20.3.0-5357.g0c3148ca.el9. 4.1 MB/s | 21 MB 00:05 2026-02-20T11:30:36.647 INFO:teuthology.orchestra.run.trial095.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 6.8 MB/s | 838 kB 00:00 2026-02-20T11:30:36.739 INFO:teuthology.orchestra.run.trial095.stdout:(33/37): libarrow-9.0.0-15.el9.x86_64.rpm 8.7 MB/s | 4.4 MB 00:00 2026-02-20T11:30:36.749 INFO:teuthology.orchestra.run.trial095.stdout:(34/37): thrift-0.15.0-4.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2026-02-20T11:30:36.918 INFO:teuthology.orchestra.run.trial095.stdout:(35/37): re2-20211101-20.el9.x86_64.rpm 659 kB/s | 191 kB 00:00 2026-02-20T11:30:37.350 INFO:teuthology.orchestra.run.trial095.stdout:(36/37): librbd1-20.3.0-5357.g0c3148ca.el9.x86_ 4.5 MB/s | 2.7 MB 00:00 2026-02-20T11:30:37.883 INFO:teuthology.orchestra.run.trial095.stdout:(37/37): librados2-20.3.0-5357.g0c3148ca.el9.x8 2.9 MB/s | 3.3 MB 00:01 2026-02-20T11:30:37.886 INFO:teuthology.orchestra.run.trial095.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:37.886 INFO:teuthology.orchestra.run.trial095.stdout:Total 8.9 MB/s | 61 MB 00:06 2026-02-20T11:30:37.983 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction check 2026-02-20T11:30:38.001 INFO:teuthology.orchestra.run.trial095.stdout:Transaction check succeeded. 2026-02-20T11:30:38.002 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction test 2026-02-20T11:30:38.254 INFO:teuthology.orchestra.run.trial095.stdout:Transaction test succeeded. 2026-02-20T11:30:38.255 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction 2026-02-20T11:30:38.544 INFO:teuthology.orchestra.run.trial095.stdout: Preparing : 1/1 2026-02-20T11:30:38.685 INFO:teuthology.orchestra.run.trial095.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-20T11:30:38.689 INFO:teuthology.orchestra.run.trial095.stdout: Upgrading : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:30:38.738 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:30:38.739 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:30:38.752 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:30:38.754 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 4/39 2026-02-20T11:30:38.755 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:30:38.781 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:30:38.783 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 6/39 2026-02-20T11:30:38.791 INFO:teuthology.orchestra.run.trial095.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-20T11:30:38.793 INFO:teuthology.orchestra.run.trial095.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-20T11:30:38.796 INFO:teuthology.orchestra.run.trial095.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-20T11:30:38.800 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-20T11:30:38.811 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 11/39 2026-02-20T11:30:38.824 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:30:38.825 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:30:38.851 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:30:38.855 INFO:teuthology.orchestra.run.trial095.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-20T11:30:38.890 INFO:teuthology.orchestra.run.trial095.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-20T11:30:38.894 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-20T11:30:38.900 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-20T11:30:38.902 INFO:teuthology.orchestra.run.trial095.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-20T11:30:38.907 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-20T11:30:39.021 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:30:39.022 INFO:teuthology.orchestra.run.trial095.stdout: Upgrading : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:30:39.050 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:30:39.054 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 22/39 2026-02-20T11:30:39.061 INFO:teuthology.orchestra.run.trial095.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-20T11:30:39.308 INFO:teuthology.orchestra.run.trial095.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-20T11:30:39.309 INFO:teuthology.orchestra.run.trial095.stdout: Installing : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:30:39.326 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:30:39.330 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 26/39 2026-02-20T11:30:39.335 INFO:teuthology.orchestra.run.trial095.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-20T11:30:39.338 INFO:teuthology.orchestra.run.trial095.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-20T11:30:39.338 INFO:teuthology.orchestra.run.trial095.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:30:39.357 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:30:39.471 INFO:teuthology.orchestra.run.trial095.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-20T11:30:39.474 INFO:teuthology.orchestra.run.trial095.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:30:39.781 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:30:39.781 INFO:teuthology.orchestra.run.trial095.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T11:30:39.781 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:30:39.827 INFO:teuthology.orchestra.run.trial095.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-20T11:30:39.829 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 33/39 2026-02-20T11:30:40.776 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:30:40.779 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:30:41.043 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:30:41.046 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:30:41.086 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:30:41.087 INFO:teuthology.orchestra.run.trial095.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T11:30:41.087 INFO:teuthology.orchestra.run.trial095.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T11:30:41.087 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:30:41.091 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:30:45.553 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:30:45.553 INFO:teuthology.orchestra.run.trial095.stdout:skipping the directory /sys 2026-02-20T11:30:45.553 INFO:teuthology.orchestra.run.trial095.stdout:skipping the directory /proc 2026-02-20T11:30:45.553 INFO:teuthology.orchestra.run.trial095.stdout:skipping the directory /mnt 2026-02-20T11:30:45.553 INFO:teuthology.orchestra.run.trial095.stdout:skipping the directory /var/tmp 2026-02-20T11:30:45.553 INFO:teuthology.orchestra.run.trial095.stdout:skipping the directory /home 2026-02-20T11:30:45.553 INFO:teuthology.orchestra.run.trial095.stdout:skipping the directory /root 2026-02-20T11:30:45.553 INFO:teuthology.orchestra.run.trial095.stdout:skipping the directory /tmp 2026-02-20T11:30:45.553 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:30:46.044 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:30:46.066 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:30:46.067 INFO:teuthology.orchestra.run.trial095.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:46.067 INFO:teuthology.orchestra.run.trial095.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T11:30:46.067 INFO:teuthology.orchestra.run.trial095.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:30:46.067 INFO:teuthology.orchestra.run.trial095.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:30:46.067 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:30:46.068 INFO:teuthology.orchestra.run.trial095.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:30:46.080 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:30:46.080 INFO:teuthology.orchestra.run.trial095.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:30:46.131 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:30:46.131 INFO:teuthology.orchestra.run.trial095.stdout:Creating group 'qat' with GID 992. 2026-02-20T11:30:46.131 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:30:46.430 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/39 2026-02-20T11:30:46.430 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:30:46.431 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:30:46.431 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/39 2026-02-20T11:30:46.431 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:30:46.431 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/39 2026-02-20T11:30:46.431 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 7/39 2026-02-20T11:30:46.431 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 8/39 2026-02-20T11:30:46.431 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 9/39 2026-02-20T11:30:46.431 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 10/39 2026-02-20T11:30:46.431 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 11/39 2026-02-20T11:30:46.431 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:30:46.431 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 13/39 2026-02-20T11:30:46.432 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 14/39 2026-02-20T11:30:46.432 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 15/39 2026-02-20T11:30:46.432 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-20T11:30:46.432 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-20T11:30:46.432 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-20T11:30:46.432 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-20T11:30:46.432 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:30:46.432 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-20T11:30:46.432 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-20T11:30:46.432 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-20T11:30:46.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-20T11:30:46.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-20T11:30:46.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-20T11:30:46.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-20T11:30:46.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-20T11:30:46.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-20T11:30:46.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-20T11:30:46.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-20T11:30:46.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-20T11:30:46.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-20T11:30:46.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-20T11:30:46.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-20T11:30:46.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:30:46.434 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-20T11:30:46.434 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 38/39 2026-02-20T11:30:46.491 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:30:46.491 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:30:46.492 INFO:teuthology.orchestra.run.trial095.stdout:Upgraded: 2026-02-20T11:30:46.492 INFO:teuthology.orchestra.run.trial095.stdout: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.492 INFO:teuthology.orchestra.run.trial095.stdout: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.492 INFO:teuthology.orchestra.run.trial095.stdout:Installed: 2026-02-20T11:30:46.492 INFO:teuthology.orchestra.run.trial095.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T11:30:46.492 INFO:teuthology.orchestra.run.trial095.stdout: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.492 INFO:teuthology.orchestra.run.trial095.stdout: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.492 INFO:teuthology.orchestra.run.trial095.stdout: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.492 INFO:teuthology.orchestra.run.trial095.stdout: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.492 INFO:teuthology.orchestra.run.trial095.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T11:30:46.492 INFO:teuthology.orchestra.run.trial095.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T11:30:46.493 INFO:teuthology.orchestra.run.trial095.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T11:30:46.493 INFO:teuthology.orchestra.run.trial095.stdout: libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.493 INFO:teuthology.orchestra.run.trial095.stdout: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.493 INFO:teuthology.orchestra.run.trial095.stdout: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.493 INFO:teuthology.orchestra.run.trial095.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T11:30:46.493 INFO:teuthology.orchestra.run.trial095.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T11:30:46.493 INFO:teuthology.orchestra.run.trial095.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T11:30:46.493 INFO:teuthology.orchestra.run.trial095.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T11:30:46.493 INFO:teuthology.orchestra.run.trial095.stdout: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.493 INFO:teuthology.orchestra.run.trial095.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T11:30:46.493 INFO:teuthology.orchestra.run.trial095.stdout: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.493 INFO:teuthology.orchestra.run.trial095.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T11:30:46.494 INFO:teuthology.orchestra.run.trial095.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T11:30:46.494 INFO:teuthology.orchestra.run.trial095.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T11:30:46.494 INFO:teuthology.orchestra.run.trial095.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T11:30:46.494 INFO:teuthology.orchestra.run.trial095.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T11:30:46.494 INFO:teuthology.orchestra.run.trial095.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T11:30:46.494 INFO:teuthology.orchestra.run.trial095.stdout: python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.494 INFO:teuthology.orchestra.run.trial095.stdout: python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.494 INFO:teuthology.orchestra.run.trial095.stdout: python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.494 INFO:teuthology.orchestra.run.trial095.stdout: python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.494 INFO:teuthology.orchestra.run.trial095.stdout: python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.494 INFO:teuthology.orchestra.run.trial095.stdout: python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.494 INFO:teuthology.orchestra.run.trial095.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T11:30:46.494 INFO:teuthology.orchestra.run.trial095.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T11:30:46.495 INFO:teuthology.orchestra.run.trial095.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T11:30:46.495 INFO:teuthology.orchestra.run.trial095.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T11:30:46.495 INFO:teuthology.orchestra.run.trial095.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T11:30:46.495 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:30:46.495 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:30:46.533 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-test 2026-02-20T11:30:46.836 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:17 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:30:46.919 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:30:46.920 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:30:46.920 INFO:teuthology.orchestra.run.trial095.stdout: Package Arch Version Repository Size 2026-02-20T11:30:46.920 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:30:46.920 INFO:teuthology.orchestra.run.trial095.stdout:Installing: 2026-02-20T11:30:46.920 INFO:teuthology.orchestra.run.trial095.stdout: ceph-test x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 127 M 2026-02-20T11:30:46.920 INFO:teuthology.orchestra.run.trial095.stdout:Installing dependencies: 2026-02-20T11:30:46.920 INFO:teuthology.orchestra.run.trial095.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-20T11:30:46.920 INFO:teuthology.orchestra.run.trial095.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-20T11:30:46.921 INFO:teuthology.orchestra.run.trial095.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-20T11:30:46.921 INFO:teuthology.orchestra.run.trial095.stdout: libcephsqlite x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 153 k 2026-02-20T11:30:46.921 INFO:teuthology.orchestra.run.trial095.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-20T11:30:46.921 INFO:teuthology.orchestra.run.trial095.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T11:30:46.921 INFO:teuthology.orchestra.run.trial095.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-20T11:30:46.921 INFO:teuthology.orchestra.run.trial095.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T11:30:46.921 INFO:teuthology.orchestra.run.trial095.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T11:30:46.921 INFO:teuthology.orchestra.run.trial095.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T11:30:46.921 INFO:teuthology.orchestra.run.trial095.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-20T11:30:46.921 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:30:46.921 INFO:teuthology.orchestra.run.trial095.stdout:Transaction Summary 2026-02-20T11:30:46.921 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:30:46.922 INFO:teuthology.orchestra.run.trial095.stdout:Install 12 Packages 2026-02-20T11:30:46.922 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:30:46.922 INFO:teuthology.orchestra.run.trial095.stdout:Total download size: 132 M 2026-02-20T11:30:46.922 INFO:teuthology.orchestra.run.trial095.stdout:Installed size: 989 M 2026-02-20T11:30:46.922 INFO:teuthology.orchestra.run.trial095.stdout:Downloading Packages: 2026-02-20T11:30:47.946 INFO:teuthology.orchestra.run.trial095.stdout:(1/12): libcephsqlite-20.3.0-5357.g0c3148ca.el9 280 kB/s | 153 kB 00:00 2026-02-20T11:30:48.167 INFO:teuthology.orchestra.run.trial095.stdout:(2/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 2.7 MB/s | 2.1 MB 00:00 2026-02-20T11:30:48.204 INFO:teuthology.orchestra.run.trial095.stdout:(3/12): libatomic-11.5.0-14.el9.x86_64.rpm 88 kB/s | 23 kB 00:00 2026-02-20T11:30:48.249 INFO:teuthology.orchestra.run.trial095.stdout:(4/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2026-02-20T11:30:48.937 INFO:teuthology.orchestra.run.trial095.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 256 kB/s | 176 kB 00:00 2026-02-20T11:30:49.114 INFO:teuthology.orchestra.run.trial095.stdout:(6/12): libasan8-15.2.1-7.el9.x86_64.rpm 577 kB/s | 525 kB 00:00 2026-02-20T11:30:49.131 INFO:teuthology.orchestra.run.trial095.stdout:(7/12): libxslt-1.1.34-12.el9.x86_64.rpm 1.2 MB/s | 233 kB 00:00 2026-02-20T11:30:49.240 INFO:teuthology.orchestra.run.trial095.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 2.7 MB/s | 303 kB 00:00 2026-02-20T11:30:49.348 INFO:teuthology.orchestra.run.trial095.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 592 kB/s | 64 kB 00:00 2026-02-20T11:30:49.397 INFO:teuthology.orchestra.run.trial095.stdout:(10/12): protobuf-3.14.0-17.el9.x86_64.rpm 3.6 MB/s | 1.0 MB 00:00 2026-02-20T11:30:49.716 INFO:teuthology.orchestra.run.trial095.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 331 kB/s | 122 kB 00:00 2026-02-20T11:31:41.595 INFO:teuthology.orchestra.run.trial095.stdout:(12/12): ceph-test-20.3.0-5357.g0c3148ca.el9.x8 2.3 MB/s | 127 MB 00:54 2026-02-20T11:31:41.597 INFO:teuthology.orchestra.run.trial095.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:41.597 INFO:teuthology.orchestra.run.trial095.stdout:Total 2.4 MB/s | 132 MB 00:54 2026-02-20T11:31:41.669 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction check 2026-02-20T11:31:41.681 INFO:teuthology.orchestra.run.trial095.stdout:Transaction check succeeded. 2026-02-20T11:31:41.681 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction test 2026-02-20T11:31:42.112 INFO:teuthology.orchestra.run.trial095.stdout:Transaction test succeeded. 2026-02-20T11:31:42.113 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction 2026-02-20T11:31:42.569 INFO:teuthology.orchestra.run.trial095.stdout: Preparing : 1/1 2026-02-20T11:31:42.577 INFO:teuthology.orchestra.run.trial095.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-20T11:31:42.585 INFO:teuthology.orchestra.run.trial095.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-20T11:31:42.590 INFO:teuthology.orchestra.run.trial095.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-20T11:31:42.595 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-20T11:31:42.597 INFO:teuthology.orchestra.run.trial095.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-20T11:31:42.601 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-20T11:31:42.602 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:31:42.619 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:31:42.622 INFO:teuthology.orchestra.run.trial095.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-20T11:31:42.633 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-20T11:31:42.642 INFO:teuthology.orchestra.run.trial095.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-20T11:31:42.642 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:31:49.575 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:31:49.594 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:31:50.432 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:31:50.432 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/12 2026-02-20T11:31:50.432 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/12 2026-02-20T11:31:50.432 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-20T11:31:50.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-20T11:31:50.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-20T11:31:50.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-20T11:31:50.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-20T11:31:50.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-20T11:31:50.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-20T11:31:50.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-20T11:31:50.433 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-20T11:31:50.487 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-20T11:31:50.487 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:31:50.488 INFO:teuthology.orchestra.run.trial095.stdout:Installed: 2026-02-20T11:31:50.488 INFO:teuthology.orchestra.run.trial095.stdout: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:50.488 INFO:teuthology.orchestra.run.trial095.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-20T11:31:50.488 INFO:teuthology.orchestra.run.trial095.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-20T11:31:50.488 INFO:teuthology.orchestra.run.trial095.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-20T11:31:50.488 INFO:teuthology.orchestra.run.trial095.stdout: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:50.488 INFO:teuthology.orchestra.run.trial095.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-20T11:31:50.488 INFO:teuthology.orchestra.run.trial095.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T11:31:50.488 INFO:teuthology.orchestra.run.trial095.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-20T11:31:50.488 INFO:teuthology.orchestra.run.trial095.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T11:31:50.489 INFO:teuthology.orchestra.run.trial095.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T11:31:50.489 INFO:teuthology.orchestra.run.trial095.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T11:31:50.489 INFO:teuthology.orchestra.run.trial095.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-20T11:31:50.489 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:31:50.489 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:31:50.528 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph 2026-02-20T11:31:50.830 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:01:21 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:31:50.916 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:31:50.919 INFO:teuthology.orchestra.run.trial095.stdout:======================================================================================= 2026-02-20T11:31:50.919 INFO:teuthology.orchestra.run.trial095.stdout: Package Arch Version Repository Size 2026-02-20T11:31:50.919 INFO:teuthology.orchestra.run.trial095.stdout:======================================================================================= 2026-02-20T11:31:50.919 INFO:teuthology.orchestra.run.trial095.stdout:Installing: 2026-02-20T11:31:50.919 INFO:teuthology.orchestra.run.trial095.stdout: ceph x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 6.5 k 2026-02-20T11:31:50.919 INFO:teuthology.orchestra.run.trial095.stdout:Installing dependencies: 2026-02-20T11:31:50.919 INFO:teuthology.orchestra.run.trial095.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T11:31:50.920 INFO:teuthology.orchestra.run.trial095.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 57 k 2026-02-20T11:31:50.920 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mds x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.0 M 2026-02-20T11:31:50.920 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mgr x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 937 k 2026-02-20T11:31:50.920 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 297 k 2026-02-20T11:31:50.920 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 4.9 M 2026-02-20T11:31:50.920 INFO:teuthology.orchestra.run.trial095.stdout: ceph-osd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 163 k 2026-02-20T11:31:50.920 INFO:teuthology.orchestra.run.trial095.stdout: ceph-osd-classic x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 15 M 2026-02-20T11:31:50.920 INFO:teuthology.orchestra.run.trial095.stdout: ceph-osd-crimson x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 88 M 2026-02-20T11:31:50.920 INFO:teuthology.orchestra.run.trial095.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 17 k 2026-02-20T11:31:50.920 INFO:teuthology.orchestra.run.trial095.stdout: cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 1.0 M 2026-02-20T11:31:50.920 INFO:teuthology.orchestra.run.trial095.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T11:31:50.921 INFO:teuthology.orchestra.run.trial095.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T11:31:50.921 INFO:teuthology.orchestra.run.trial095.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T11:31:50.921 INFO:teuthology.orchestra.run.trial095.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T11:31:50.921 INFO:teuthology.orchestra.run.trial095.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T11:31:50.921 INFO:teuthology.orchestra.run.trial095.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T11:31:50.921 INFO:teuthology.orchestra.run.trial095.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T11:31:50.921 INFO:teuthology.orchestra.run.trial095.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T11:31:50.921 INFO:teuthology.orchestra.run.trial095.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T11:31:50.921 INFO:teuthology.orchestra.run.trial095.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T11:31:50.921 INFO:teuthology.orchestra.run.trial095.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T11:31:50.921 INFO:teuthology.orchestra.run.trial095.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T11:31:50.921 INFO:teuthology.orchestra.run.trial095.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T11:31:50.922 INFO:teuthology.orchestra.run.trial095.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T11:31:50.922 INFO:teuthology.orchestra.run.trial095.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T11:31:50.922 INFO:teuthology.orchestra.run.trial095.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T11:31:50.922 INFO:teuthology.orchestra.run.trial095.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T11:31:50.922 INFO:teuthology.orchestra.run.trial095.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T11:31:50.922 INFO:teuthology.orchestra.run.trial095.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T11:31:50.922 INFO:teuthology.orchestra.run.trial095.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T11:31:50.922 INFO:teuthology.orchestra.run.trial095.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T11:31:50.922 INFO:teuthology.orchestra.run.trial095.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T11:31:50.922 INFO:teuthology.orchestra.run.trial095.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T11:31:50.922 INFO:teuthology.orchestra.run.trial095.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T11:31:50.922 INFO:teuthology.orchestra.run.trial095.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T11:31:50.922 INFO:teuthology.orchestra.run.trial095.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T11:31:50.923 INFO:teuthology.orchestra.run.trial095.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T11:31:50.923 INFO:teuthology.orchestra.run.trial095.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T11:31:50.923 INFO:teuthology.orchestra.run.trial095.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T11:31:50.923 INFO:teuthology.orchestra.run.trial095.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T11:31:50.923 INFO:teuthology.orchestra.run.trial095.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T11:31:50.923 INFO:teuthology.orchestra.run.trial095.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T11:31:50.923 INFO:teuthology.orchestra.run.trial095.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T11:31:50.923 INFO:teuthology.orchestra.run.trial095.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T11:31:50.923 INFO:teuthology.orchestra.run.trial095.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T11:31:50.923 INFO:teuthology.orchestra.run.trial095.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T11:31:50.924 INFO:teuthology.orchestra.run.trial095.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T11:31:50.924 INFO:teuthology.orchestra.run.trial095.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T11:31:50.924 INFO:teuthology.orchestra.run.trial095.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T11:31:50.924 INFO:teuthology.orchestra.run.trial095.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T11:31:50.924 INFO:teuthology.orchestra.run.trial095.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T11:31:50.924 INFO:teuthology.orchestra.run.trial095.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T11:31:50.924 INFO:teuthology.orchestra.run.trial095.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T11:31:50.924 INFO:teuthology.orchestra.run.trial095.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T11:31:50.924 INFO:teuthology.orchestra.run.trial095.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T11:31:50.924 INFO:teuthology.orchestra.run.trial095.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T11:31:50.924 INFO:teuthology.orchestra.run.trial095.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T11:31:50.924 INFO:teuthology.orchestra.run.trial095.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T11:31:50.924 INFO:teuthology.orchestra.run.trial095.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T11:31:50.925 INFO:teuthology.orchestra.run.trial095.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T11:31:50.925 INFO:teuthology.orchestra.run.trial095.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T11:31:50.925 INFO:teuthology.orchestra.run.trial095.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T11:31:50.925 INFO:teuthology.orchestra.run.trial095.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T11:31:50.925 INFO:teuthology.orchestra.run.trial095.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T11:31:50.925 INFO:teuthology.orchestra.run.trial095.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T11:31:50.925 INFO:teuthology.orchestra.run.trial095.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T11:31:50.925 INFO:teuthology.orchestra.run.trial095.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T11:31:50.925 INFO:teuthology.orchestra.run.trial095.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T11:31:50.925 INFO:teuthology.orchestra.run.trial095.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T11:31:50.925 INFO:teuthology.orchestra.run.trial095.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T11:31:50.925 INFO:teuthology.orchestra.run.trial095.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T11:31:50.926 INFO:teuthology.orchestra.run.trial095.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T11:31:50.926 INFO:teuthology.orchestra.run.trial095.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T11:31:50.926 INFO:teuthology.orchestra.run.trial095.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T11:31:50.926 INFO:teuthology.orchestra.run.trial095.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T11:31:50.926 INFO:teuthology.orchestra.run.trial095.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T11:31:50.926 INFO:teuthology.orchestra.run.trial095.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T11:31:50.926 INFO:teuthology.orchestra.run.trial095.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T11:31:50.926 INFO:teuthology.orchestra.run.trial095.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T11:31:50.926 INFO:teuthology.orchestra.run.trial095.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T11:31:50.926 INFO:teuthology.orchestra.run.trial095.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T11:31:50.926 INFO:teuthology.orchestra.run.trial095.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T11:31:50.926 INFO:teuthology.orchestra.run.trial095.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T11:31:50.926 INFO:teuthology.orchestra.run.trial095.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T11:31:50.927 INFO:teuthology.orchestra.run.trial095.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T11:31:50.927 INFO:teuthology.orchestra.run.trial095.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T11:31:50.927 INFO:teuthology.orchestra.run.trial095.stdout:Installing weak dependencies: 2026-02-20T11:31:50.927 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 184 k 2026-02-20T11:31:50.927 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 51 M 2026-02-20T11:31:50.927 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 7.4 M 2026-02-20T11:31:50.927 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 22 k 2026-02-20T11:31:50.927 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mgr-rook noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 50 k 2026-02-20T11:31:50.927 INFO:teuthology.orchestra.run.trial095.stdout: ceph-volume noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 301 k 2026-02-20T11:31:50.927 INFO:teuthology.orchestra.run.trial095.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T11:31:50.927 INFO:teuthology.orchestra.run.trial095.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T11:31:50.927 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:31:50.928 INFO:teuthology.orchestra.run.trial095.stdout:Transaction Summary 2026-02-20T11:31:50.928 INFO:teuthology.orchestra.run.trial095.stdout:======================================================================================= 2026-02-20T11:31:50.928 INFO:teuthology.orchestra.run.trial095.stdout:Install 96 Packages 2026-02-20T11:31:50.928 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:31:50.929 INFO:teuthology.orchestra.run.trial095.stdout:Total download size: 226 M 2026-02-20T11:31:50.929 INFO:teuthology.orchestra.run.trial095.stdout:Installed size: 1.5 G 2026-02-20T11:31:50.929 INFO:teuthology.orchestra.run.trial095.stdout:Downloading Packages: 2026-02-20T11:31:51.450 INFO:teuthology.orchestra.run.trial095.stdout:(1/96): ceph-20.3.0-5357.g0c3148ca.el9.x86_64.r 24 kB/s | 6.5 kB 00:00 2026-02-20T11:31:51.997 INFO:teuthology.orchestra.run.trial095.stdout:(2/96): ceph-mgr-20.3.0-5357.g0c3148ca.el9.x86_ 1.1 MB/s | 937 kB 00:00 2026-02-20T11:31:52.066 INFO:teuthology.orchestra.run.trial095.stdout:(3/96): ceph-osd-20.3.0-5357.g0c3148ca.el9.x86_ 2.3 MB/s | 163 kB 00:00 2026-02-20T11:31:52.290 INFO:teuthology.orchestra.run.trial095.stdout:(4/96): ceph-mds-20.3.0-5357.g0c3148ca.el9.x86_ 1.8 MB/s | 2.0 MB 00:01 2026-02-20T11:31:53.883 INFO:teuthology.orchestra.run.trial095.stdout:(5/96): ceph-mon-20.3.0-5357.g0c3148ca.el9.x86_ 2.0 MB/s | 4.9 MB 00:02 2026-02-20T11:31:53.953 INFO:teuthology.orchestra.run.trial095.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5357.g0c 819 kB/s | 57 kB 00:00 2026-02-20T11:31:54.161 INFO:teuthology.orchestra.run.trial095.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5357.g0c3148ca. 887 kB/s | 184 kB 00:00 2026-02-20T11:31:56.357 INFO:teuthology.orchestra.run.trial095.stdout:(8/96): ceph-osd-classic-20.3.0-5357.g0c3148ca. 3.4 MB/s | 15 MB 00:04 2026-02-20T11:32:00.368 INFO:teuthology.orchestra.run.trial095.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-53 1.8 MB/s | 7.4 MB 00:04 2026-02-20T11:32:00.436 INFO:teuthology.orchestra.run.trial095.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5357.g0c3148 327 kB/s | 22 kB 00:00 2026-02-20T11:32:00.640 INFO:teuthology.orchestra.run.trial095.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5357.g0c3 1.4 MB/s | 297 kB 00:00 2026-02-20T11:32:00.709 INFO:teuthology.orchestra.run.trial095.stdout:(12/96): ceph-mgr-rook-20.3.0-5357.g0c3148ca.el 730 kB/s | 50 kB 00:00 2026-02-20T11:32:00.777 INFO:teuthology.orchestra.run.trial095.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5357.g0c 254 kB/s | 17 kB 00:00 2026-02-20T11:32:00.987 INFO:teuthology.orchestra.run.trial095.stdout:(14/96): ceph-volume-20.3.0-5357.g0c3148ca.el9. 1.4 MB/s | 301 kB 00:00 2026-02-20T11:32:01.516 INFO:teuthology.orchestra.run.trial095.stdout:(15/96): cephadm-20.3.0-5357.g0c3148ca.el9.noar 1.9 MB/s | 1.0 MB 00:00 2026-02-20T11:32:02.171 INFO:teuthology.orchestra.run.trial095.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 536 kB/s | 351 kB 00:00 2026-02-20T11:32:02.282 INFO:teuthology.orchestra.run.trial095.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 363 kB/s | 40 kB 00:00 2026-02-20T11:32:02.396 INFO:teuthology.orchestra.run.trial095.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 631 kB/s | 72 kB 00:00 2026-02-20T11:32:02.644 INFO:teuthology.orchestra.run.trial095.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 3.1 MB/s | 794 kB 00:00 2026-02-20T11:32:02.765 INFO:teuthology.orchestra.run.trial095.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 1.5 MB/s | 184 kB 00:00 2026-02-20T11:32:02.890 INFO:teuthology.orchestra.run.trial095.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2026-02-20T11:32:03.075 INFO:teuthology.orchestra.run.trial095.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 6.7 MB/s | 1.2 MB 00:00 2026-02-20T11:32:03.169 INFO:teuthology.orchestra.run.trial095.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2026-02-20T11:32:03.263 INFO:teuthology.orchestra.run.trial095.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 1.4 MB/s | 135 kB 00:00 2026-02-20T11:32:03.358 INFO:teuthology.orchestra.run.trial095.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 1.5 MB/s | 150 kB 00:00 2026-02-20T11:32:03.452 INFO:teuthology.orchestra.run.trial095.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 1.3 MB/s | 126 kB 00:00 2026-02-20T11:32:03.549 INFO:teuthology.orchestra.run.trial095.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 2.2 MB/s | 218 kB 00:00 2026-02-20T11:32:03.643 INFO:teuthology.orchestra.run.trial095.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 1.9 MB/s | 182 kB 00:00 2026-02-20T11:32:03.747 INFO:teuthology.orchestra.run.trial095.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 2.5 MB/s | 266 kB 00:00 2026-02-20T11:32:04.094 INFO:teuthology.orchestra.run.trial095.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 85 kB/s | 30 kB 00:00 2026-02-20T11:32:04.712 INFO:teuthology.orchestra.run.trial095.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 4.8 MB/s | 3.0 MB 00:00 2026-02-20T11:32:04.793 INFO:teuthology.orchestra.run.trial095.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 182 kB/s | 15 kB 00:00 2026-02-20T11:32:04.878 INFO:teuthology.orchestra.run.trial095.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.8 MB/s | 246 kB 00:00 2026-02-20T11:32:04.962 INFO:teuthology.orchestra.run.trial095.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2026-02-20T11:32:05.044 INFO:teuthology.orchestra.run.trial095.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 516 kB/s | 42 kB 00:00 2026-02-20T11:32:05.259 INFO:teuthology.orchestra.run.trial095.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 25 MB/s | 5.3 MB 00:00 2026-02-20T11:32:05.452 INFO:teuthology.orchestra.run.trial095.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 6.0 MB 00:00 2026-02-20T11:32:05.537 INFO:teuthology.orchestra.run.trial095.stdout:(38/96): python3-devel-3.9.25-3.el9.x86_64.rpm 2.8 MB/s | 244 kB 00:00 2026-02-20T11:32:05.621 INFO:teuthology.orchestra.run.trial095.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 2.9 MB/s | 249 kB 00:00 2026-02-20T11:32:05.704 INFO:teuthology.orchestra.run.trial095.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 577 kB/s | 48 kB 00:00 2026-02-20T11:32:05.787 INFO:teuthology.orchestra.run.trial095.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 2.1 MB/s | 177 kB 00:00 2026-02-20T11:32:05.879 INFO:teuthology.orchestra.run.trial095.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2026-02-20T11:32:05.961 INFO:teuthology.orchestra.run.trial095.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 423 kB/s | 35 kB 00:00 2026-02-20T11:32:06.155 INFO:teuthology.orchestra.run.trial095.stdout:(44/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 32 MB/s | 6.1 MB 00:00 2026-02-20T11:32:06.240 INFO:teuthology.orchestra.run.trial095.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 5.1 MB/s | 442 kB 00:00 2026-02-20T11:32:06.323 INFO:teuthology.orchestra.run.trial095.stdout:(46/96): python3-packaging-20.9-5.el9.noarch.rp 931 kB/s | 77 kB 00:00 2026-02-20T11:32:06.407 INFO:teuthology.orchestra.run.trial095.stdout:(47/96): python3-protobuf-3.14.0-17.el9.noarch. 3.1 MB/s | 267 kB 00:00 2026-02-20T11:32:06.491 INFO:teuthology.orchestra.run.trial095.stdout:(48/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 159 kB 00:00 2026-02-20T11:32:06.575 INFO:teuthology.orchestra.run.trial095.stdout:(49/96): python3-pyasn1-modules-0.4.8-6.el9.noa 3.2 MB/s | 279 kB 00:00 2026-02-20T11:32:06.658 INFO:teuthology.orchestra.run.trial095.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 649 kB/s | 54 kB 00:00 2026-02-20T11:32:07.298 INFO:teuthology.orchestra.run.trial095.stdout:(51/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 30 MB/s | 19 MB 00:00 2026-02-20T11:32:07.381 INFO:teuthology.orchestra.run.trial095.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 504 kB/s | 42 kB 00:00 2026-02-20T11:32:07.465 INFO:teuthology.orchestra.run.trial095.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.2 MB/s | 189 kB 00:00 2026-02-20T11:32:07.547 INFO:teuthology.orchestra.run.trial095.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 1.1 MB/s | 90 kB 00:00 2026-02-20T11:32:08.204 INFO:teuthology.orchestra.run.trial095.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 34 kB/s | 22 kB 00:00 2026-02-20T11:32:08.746 INFO:teuthology.orchestra.run.trial095.stdout:(56/96): protobuf-compiler-3.14.0-17.el9.x86_64 1.6 MB/s | 862 kB 00:00 2026-02-20T11:32:09.314 INFO:teuthology.orchestra.run.trial095.stdout:(57/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 970 kB/s | 551 kB 00:00 2026-02-20T11:32:09.354 INFO:teuthology.orchestra.run.trial095.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 480 kB/s | 19 kB 00:00 2026-02-20T11:32:09.396 INFO:teuthology.orchestra.run.trial095.stdout:(59/96): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2026-02-20T11:32:09.441 INFO:teuthology.orchestra.run.trial095.stdout:(60/96): python3-asyncssh-2.13.2-5.el9.noarch.r 12 MB/s | 548 kB 00:00 2026-02-20T11:32:09.482 INFO:teuthology.orchestra.run.trial095.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 720 kB/s | 29 kB 00:00 2026-02-20T11:32:09.524 INFO:teuthology.orchestra.run.trial095.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 1.4 MB/s | 60 kB 00:00 2026-02-20T11:32:09.565 INFO:teuthology.orchestra.run.trial095.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2026-02-20T11:32:09.607 INFO:teuthology.orchestra.run.trial095.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 772 kB/s | 32 kB 00:00 2026-02-20T11:32:09.648 INFO:teuthology.orchestra.run.trial095.stdout:(65/96): python3-certifi-2023.05.07-4.el9.noarc 344 kB/s | 14 kB 00:00 2026-02-20T11:32:09.691 INFO:teuthology.orchestra.run.trial095.stdout:(66/96): python3-cheroot-10.0.1-4.el9.noarch.rp 3.9 MB/s | 173 kB 00:00 2026-02-20T11:32:09.740 INFO:teuthology.orchestra.run.trial095.stdout:(67/96): python3-cherrypy-18.6.1-2.el9.noarch.r 7.3 MB/s | 358 kB 00:00 2026-02-20T11:32:09.783 INFO:teuthology.orchestra.run.trial095.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 5.7 MB/s | 254 kB 00:00 2026-02-20T11:32:09.903 INFO:teuthology.orchestra.run.trial095.stdout:(69/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 17 MB/s | 2.0 MB 00:00 2026-02-20T11:32:09.946 INFO:teuthology.orchestra.run.trial095.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 3.3 MB/s | 144 kB 00:00 2026-02-20T11:32:09.990 INFO:teuthology.orchestra.run.trial095.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 3.1 MB/s | 139 kB 00:00 2026-02-20T11:32:10.031 INFO:teuthology.orchestra.run.trial095.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 1.3 MB/s | 56 kB 00:00 2026-02-20T11:32:10.072 INFO:teuthology.orchestra.run.trial095.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 264 kB/s | 11 kB 00:00 2026-02-20T11:32:10.113 INFO:teuthology.orchestra.run.trial095.stdout:(74/96): python3-jaraco-classes-3.2.1-5.el9.noa 433 kB/s | 18 kB 00:00 2026-02-20T11:32:10.154 INFO:teuthology.orchestra.run.trial095.stdout:(75/96): python3-jaraco-collections-3.0.0-8.el9 565 kB/s | 23 kB 00:00 2026-02-20T11:32:10.195 INFO:teuthology.orchestra.run.trial095.stdout:(76/96): python3-jaraco-context-6.0.1-3.el9.noa 481 kB/s | 20 kB 00:00 2026-02-20T11:32:10.236 INFO:teuthology.orchestra.run.trial095.stdout:(77/96): python3-jaraco-functools-3.5.0-2.el9.n 476 kB/s | 19 kB 00:00 2026-02-20T11:32:10.278 INFO:teuthology.orchestra.run.trial095.stdout:(78/96): python3-jaraco-text-4.0.0-2.el9.noarch 629 kB/s | 26 kB 00:00 2026-02-20T11:32:10.323 INFO:teuthology.orchestra.run.trial095.stdout:(79/96): python3-kubernetes-26.1.0-3.el9.noarch 23 MB/s | 1.0 MB 00:00 2026-02-20T11:32:10.365 INFO:teuthology.orchestra.run.trial095.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2026-02-20T11:32:10.407 INFO:teuthology.orchestra.run.trial095.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.0 MB/s | 86 kB 00:00 2026-02-20T11:32:10.448 INFO:teuthology.orchestra.run.trial095.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 1.4 MB/s | 58 kB 00:00 2026-02-20T11:32:10.489 INFO:teuthology.orchestra.run.trial095.stdout:(83/96): python3-portend-3.1.0-2.el9.noarch.rpm 404 kB/s | 16 kB 00:00 2026-02-20T11:32:10.531 INFO:teuthology.orchestra.run.trial095.stdout:(84/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2026-02-20T11:32:10.571 INFO:teuthology.orchestra.run.trial095.stdout:(85/96): python3-repoze-lru-0.7-16.el9.noarch.r 751 kB/s | 31 kB 00:00 2026-02-20T11:32:10.614 INFO:teuthology.orchestra.run.trial095.stdout:(86/96): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2026-02-20T11:32:10.656 INFO:teuthology.orchestra.run.trial095.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2026-02-20T11:32:10.697 INFO:teuthology.orchestra.run.trial095.stdout:(88/96): python3-saml-1.16.0-1.el9.noarch.rpm 2.9 MB/s | 125 kB 00:00 2026-02-20T11:32:10.739 INFO:teuthology.orchestra.run.trial095.stdout:(89/96): python3-tempora-5.0.0-2.el9.noarch.rpm 874 kB/s | 36 kB 00:00 2026-02-20T11:32:10.780 INFO:teuthology.orchestra.run.trial095.stdout:(90/96): python3-typing-extensions-4.15.0-1.el9 2.0 MB/s | 86 kB 00:00 2026-02-20T11:32:10.821 INFO:teuthology.orchestra.run.trial095.stdout:(91/96): python3-websocket-client-1.2.3-2.el9.n 2.1 MB/s | 90 kB 00:00 2026-02-20T11:32:10.863 INFO:teuthology.orchestra.run.trial095.stdout:(92/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.1 MB/s | 48 kB 00:00 2026-02-20T11:32:10.903 INFO:teuthology.orchestra.run.trial095.stdout:(93/96): python3-xmltodict-0.12.0-15.el9.noarch 547 kB/s | 22 kB 00:00 2026-02-20T11:32:10.944 INFO:teuthology.orchestra.run.trial095.stdout:(94/96): python3-zc-lockfile-2.0-10.el9.noarch. 491 kB/s | 20 kB 00:00 2026-02-20T11:32:20.730 INFO:teuthology.orchestra.run.trial095.stdout:(95/96): ceph-osd-crimson-20.3.0-5357.g0c3148ca 3.1 MB/s | 88 MB 00:28 2026-02-20T11:32:40.267 INFO:teuthology.orchestra.run.trial095.stdout:(96/96): ceph-mgr-dashboard-20.3.0-5357.g0c3148 1.1 MB/s | 51 MB 00:46 2026-02-20T11:32:40.270 INFO:teuthology.orchestra.run.trial095.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:32:40.270 INFO:teuthology.orchestra.run.trial095.stdout:Total 4.6 MB/s | 226 MB 00:49 2026-02-20T11:32:40.643 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction check 2026-02-20T11:32:40.680 INFO:teuthology.orchestra.run.trial095.stdout:Transaction check succeeded. 2026-02-20T11:32:40.681 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction test 2026-02-20T11:32:41.480 INFO:teuthology.orchestra.run.trial095.stdout:Transaction test succeeded. 2026-02-20T11:32:41.480 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction 2026-02-20T11:32:42.315 INFO:teuthology.orchestra.run.trial095.stdout: Preparing : 1/1 2026-02-20T11:32:42.316 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-20T11:32:42.320 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-20T11:32:42.341 INFO:teuthology.orchestra.run.trial095.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-20T11:32:42.377 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-20T11:32:42.383 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-20T11:32:42.386 INFO:teuthology.orchestra.run.trial095.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-20T11:32:42.391 INFO:teuthology.orchestra.run.trial095.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-20T11:32:42.414 INFO:teuthology.orchestra.run.trial095.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-20T11:32:42.427 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-20T11:32:42.430 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-20T11:32:42.436 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-20T11:32:42.437 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-20T11:32:42.449 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-20T11:32:42.455 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-20T11:32:42.479 INFO:teuthology.orchestra.run.trial095.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-20T11:32:42.482 INFO:teuthology.orchestra.run.trial095.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-20T11:32:42.532 INFO:teuthology.orchestra.run.trial095.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-20T11:32:42.545 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-20T11:32:42.547 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-20T11:32:42.552 INFO:teuthology.orchestra.run.trial095.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-20T11:32:42.557 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-20T11:32:42.562 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-20T11:32:42.565 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-20T11:32:42.579 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-20T11:32:42.584 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-20T11:32:42.589 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-20T11:32:42.600 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-20T11:32:42.609 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-20T11:32:42.615 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-20T11:32:42.634 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-20T11:32:42.645 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-20T11:32:42.661 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-20T11:32:42.665 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-20T11:32:42.673 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-20T11:32:42.713 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-20T11:32:43.037 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-20T11:32:43.047 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-20T11:32:43.051 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-20T11:32:43.056 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-20T11:32:43.058 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-20T11:32:43.086 INFO:teuthology.orchestra.run.trial095.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-20T11:32:43.129 INFO:teuthology.orchestra.run.trial095.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-20T11:32:43.138 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-20T11:32:43.143 INFO:teuthology.orchestra.run.trial095.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-20T11:32:43.147 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-20T11:32:43.153 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-20T11:32:43.156 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-20T11:32:43.163 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-20T11:32:43.166 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-20T11:32:43.194 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-20T11:32:43.204 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-20T11:32:43.209 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-20T11:32:43.216 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-20T11:32:43.251 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-20T11:32:43.474 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-20T11:32:43.497 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-20T11:32:43.501 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-20T11:32:43.559 INFO:teuthology.orchestra.run.trial095.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-20T11:32:43.561 INFO:teuthology.orchestra.run.trial095.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-20T11:32:43.582 INFO:teuthology.orchestra.run.trial095.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-20T11:32:43.906 INFO:teuthology.orchestra.run.trial095.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-20T11:32:43.979 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-20T11:32:44.648 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-20T11:32:44.664 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-20T11:32:44.674 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-20T11:32:44.681 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-20T11:32:44.694 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-20T11:32:44.710 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-20T11:32:44.786 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-20T11:32:44.794 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-20T11:32:44.818 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-20T11:32:44.848 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-20T11:32:44.899 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-20T11:32:44.905 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-20T11:32:44.908 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-20T11:32:44.909 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-20T11:32:44.927 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:32:44.927 INFO:teuthology.orchestra.run.trial095.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T11:32:44.927 INFO:teuthology.orchestra.run.trial095.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T11:32:44.927 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:32:44.934 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:32:44.959 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:32:44.959 INFO:teuthology.orchestra.run.trial095.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T11:32:44.960 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:32:44.995 INFO:teuthology.orchestra.run.trial095.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-20T11:32:45.593 INFO:teuthology.orchestra.run.trial095.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-20T11:32:51.081 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 80/96 2026-02-20T11:32:51.145 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 81/96 2026-02-20T11:32:51.147 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:32:51.161 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:32:51.161 INFO:teuthology.orchestra.run.trial095.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:32:51.161 INFO:teuthology.orchestra.run.trial095.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T11:32:51.161 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:32:51.172 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:32:51.197 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:32:51.197 INFO:teuthology.orchestra.run.trial095.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:32:51.197 INFO:teuthology.orchestra.run.trial095.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T11:32:51.197 INFO:teuthology.orchestra.run.trial095.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:32:51.198 INFO:teuthology.orchestra.run.trial095.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:32:51.198 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:32:51.258 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:32:51.260 INFO:teuthology.orchestra.run.trial095.stdout: Installing : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:32:51.269 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 85/96 2026-02-20T11:32:51.293 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 86/96 2026-02-20T11:32:51.294 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:32:54.322 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:32:54.329 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:32:54.784 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:32:54.785 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:32:54.797 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:32:54.798 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:32:54.859 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:32:54.901 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 91/96 2026-02-20T11:32:54.902 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:32:54.923 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:32:54.923 INFO:teuthology.orchestra.run.trial095.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:32:54.923 INFO:teuthology.orchestra.run.trial095.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T11:32:54.923 INFO:teuthology.orchestra.run.trial095.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:32:54.923 INFO:teuthology.orchestra.run.trial095.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:32:54.923 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:32:54.935 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:32:55.154 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:32:55.156 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:32:55.176 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:32:55.176 INFO:teuthology.orchestra.run.trial095.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:32:55.176 INFO:teuthology.orchestra.run.trial095.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T11:32:55.176 INFO:teuthology.orchestra.run.trial095.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:32:55.176 INFO:teuthology.orchestra.run.trial095.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:32:55.177 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:32:55.260 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:32:55.280 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:32:55.280 INFO:teuthology.orchestra.run.trial095.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:32:55.280 INFO:teuthology.orchestra.run.trial095.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T11:32:55.280 INFO:teuthology.orchestra.run.trial095.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:32:55.281 INFO:teuthology.orchestra.run.trial095.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:32:55.281 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:32:55.281 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:32:55.288 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:32:55.311 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:32:56.666 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:32:56.667 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/96 2026-02-20T11:32:56.667 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/96 2026-02-20T11:32:56.667 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/96 2026-02-20T11:32:56.667 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/96 2026-02-20T11:32:56.667 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 5/96 2026-02-20T11:32:56.667 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/96 2026-02-20T11:32:56.667 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 7/96 2026-02-20T11:32:56.667 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 8/96 2026-02-20T11:32:56.667 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 9/96 2026-02-20T11:32:56.668 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 10/96 2026-02-20T11:32:56.668 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 11/96 2026-02-20T11:32:56.668 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 12/96 2026-02-20T11:32:56.668 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 13/96 2026-02-20T11:32:56.668 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 14/96 2026-02-20T11:32:56.668 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 15/96 2026-02-20T11:32:56.668 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 16/96 2026-02-20T11:32:56.668 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 17/96 2026-02-20T11:32:56.668 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-20T11:32:56.668 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-20T11:32:56.668 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-20T11:32:56.668 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-20T11:32:56.669 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-20T11:32:56.669 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-20T11:32:56.669 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-20T11:32:56.669 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-20T11:32:56.669 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-20T11:32:56.669 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-20T11:32:56.669 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-20T11:32:56.669 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-20T11:32:56.669 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-20T11:32:56.669 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-20T11:32:56.669 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-20T11:32:56.669 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-20T11:32:56.670 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-20T11:32:56.670 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-20T11:32:56.670 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-20T11:32:56.670 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-20T11:32:56.670 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-20T11:32:56.670 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-20T11:32:56.670 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-20T11:32:56.670 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-20T11:32:56.670 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-20T11:32:56.670 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-20T11:32:56.670 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-20T11:32:56.670 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-20T11:32:56.670 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-20T11:32:56.671 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-20T11:32:56.671 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-20T11:32:56.671 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-20T11:32:56.671 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-20T11:32:56.671 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-20T11:32:56.671 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-20T11:32:56.671 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-20T11:32:56.671 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-20T11:32:56.671 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-20T11:32:56.671 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-20T11:32:56.671 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-20T11:32:56.671 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-20T11:32:56.671 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-20T11:32:56.672 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-20T11:32:56.672 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-20T11:32:56.672 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-20T11:32:56.672 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-20T11:32:56.672 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-20T11:32:56.672 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-20T11:32:56.672 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-20T11:32:56.672 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-20T11:32:56.672 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-20T11:32:56.672 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-20T11:32:56.672 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-20T11:32:56.672 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-20T11:32:56.672 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-20T11:32:56.673 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-20T11:32:56.673 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-20T11:32:56.673 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-20T11:32:56.673 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-20T11:32:56.673 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-20T11:32:56.673 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-20T11:32:56.673 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-20T11:32:56.673 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-20T11:32:56.673 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-20T11:32:56.673 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-20T11:32:56.673 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-20T11:32:56.673 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-20T11:32:56.673 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-20T11:32:56.674 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-20T11:32:56.674 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-20T11:32:56.674 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-20T11:32:56.674 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-20T11:32:56.674 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-20T11:32:56.674 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-20T11:32:56.674 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-20T11:32:56.674 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-20T11:32:56.674 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-20T11:32:56.674 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-20T11:32:56.732 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-20T11:32:56.732 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:32:56.732 INFO:teuthology.orchestra.run.trial095.stdout:Installed: 2026-02-20T11:32:56.733 INFO:teuthology.orchestra.run.trial095.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T11:32:56.733 INFO:teuthology.orchestra.run.trial095.stdout: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:32:56.733 INFO:teuthology.orchestra.run.trial095.stdout: ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:32:56.733 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:32:56.733 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:32:56.733 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:32:56.733 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:32:56.733 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:32:56.734 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:32:56.734 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:32:56.734 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:32:56.734 INFO:teuthology.orchestra.run.trial095.stdout: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:32:56.734 INFO:teuthology.orchestra.run.trial095.stdout: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:32:56.734 INFO:teuthology.orchestra.run.trial095.stdout: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:32:56.734 INFO:teuthology.orchestra.run.trial095.stdout: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:32:56.734 INFO:teuthology.orchestra.run.trial095.stdout: ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:32:56.735 INFO:teuthology.orchestra.run.trial095.stdout: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:32:56.735 INFO:teuthology.orchestra.run.trial095.stdout: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:32:56.735 INFO:teuthology.orchestra.run.trial095.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T11:32:56.735 INFO:teuthology.orchestra.run.trial095.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T11:32:56.735 INFO:teuthology.orchestra.run.trial095.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T11:32:56.735 INFO:teuthology.orchestra.run.trial095.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T11:32:56.735 INFO:teuthology.orchestra.run.trial095.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T11:32:56.735 INFO:teuthology.orchestra.run.trial095.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T11:32:56.736 INFO:teuthology.orchestra.run.trial095.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T11:32:56.736 INFO:teuthology.orchestra.run.trial095.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T11:32:56.736 INFO:teuthology.orchestra.run.trial095.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T11:32:56.736 INFO:teuthology.orchestra.run.trial095.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:32:56.736 INFO:teuthology.orchestra.run.trial095.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T11:32:56.736 INFO:teuthology.orchestra.run.trial095.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T11:32:56.736 INFO:teuthology.orchestra.run.trial095.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T11:32:56.736 INFO:teuthology.orchestra.run.trial095.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T11:32:56.736 INFO:teuthology.orchestra.run.trial095.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T11:32:56.736 INFO:teuthology.orchestra.run.trial095.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T11:32:56.737 INFO:teuthology.orchestra.run.trial095.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T11:32:56.737 INFO:teuthology.orchestra.run.trial095.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T11:32:56.737 INFO:teuthology.orchestra.run.trial095.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T11:32:56.737 INFO:teuthology.orchestra.run.trial095.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T11:32:56.737 INFO:teuthology.orchestra.run.trial095.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T11:32:56.737 INFO:teuthology.orchestra.run.trial095.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T11:32:56.737 INFO:teuthology.orchestra.run.trial095.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T11:32:56.737 INFO:teuthology.orchestra.run.trial095.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T11:32:56.737 INFO:teuthology.orchestra.run.trial095.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T11:32:56.737 INFO:teuthology.orchestra.run.trial095.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T11:32:56.738 INFO:teuthology.orchestra.run.trial095.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T11:32:56.738 INFO:teuthology.orchestra.run.trial095.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T11:32:56.738 INFO:teuthology.orchestra.run.trial095.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T11:32:56.738 INFO:teuthology.orchestra.run.trial095.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T11:32:56.738 INFO:teuthology.orchestra.run.trial095.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T11:32:56.738 INFO:teuthology.orchestra.run.trial095.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T11:32:56.738 INFO:teuthology.orchestra.run.trial095.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T11:32:56.738 INFO:teuthology.orchestra.run.trial095.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T11:32:56.738 INFO:teuthology.orchestra.run.trial095.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T11:32:56.739 INFO:teuthology.orchestra.run.trial095.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T11:32:56.739 INFO:teuthology.orchestra.run.trial095.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T11:32:56.739 INFO:teuthology.orchestra.run.trial095.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T11:32:56.739 INFO:teuthology.orchestra.run.trial095.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T11:32:56.739 INFO:teuthology.orchestra.run.trial095.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T11:32:56.739 INFO:teuthology.orchestra.run.trial095.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T11:32:56.739 INFO:teuthology.orchestra.run.trial095.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T11:32:56.739 INFO:teuthology.orchestra.run.trial095.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:32:56.739 INFO:teuthology.orchestra.run.trial095.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T11:32:56.739 INFO:teuthology.orchestra.run.trial095.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T11:32:56.740 INFO:teuthology.orchestra.run.trial095.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T11:32:56.740 INFO:teuthology.orchestra.run.trial095.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T11:32:56.740 INFO:teuthology.orchestra.run.trial095.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T11:32:56.740 INFO:teuthology.orchestra.run.trial095.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T11:32:56.740 INFO:teuthology.orchestra.run.trial095.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T11:32:56.740 INFO:teuthology.orchestra.run.trial095.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T11:32:56.740 INFO:teuthology.orchestra.run.trial095.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T11:32:56.740 INFO:teuthology.orchestra.run.trial095.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T11:32:56.741 INFO:teuthology.orchestra.run.trial095.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T11:32:56.741 INFO:teuthology.orchestra.run.trial095.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T11:32:56.741 INFO:teuthology.orchestra.run.trial095.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T11:32:56.741 INFO:teuthology.orchestra.run.trial095.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T11:32:56.741 INFO:teuthology.orchestra.run.trial095.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T11:32:56.741 INFO:teuthology.orchestra.run.trial095.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T11:32:56.741 INFO:teuthology.orchestra.run.trial095.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T11:32:56.741 INFO:teuthology.orchestra.run.trial095.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T11:32:56.741 INFO:teuthology.orchestra.run.trial095.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T11:32:56.742 INFO:teuthology.orchestra.run.trial095.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T11:32:56.742 INFO:teuthology.orchestra.run.trial095.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T11:32:56.742 INFO:teuthology.orchestra.run.trial095.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T11:32:56.742 INFO:teuthology.orchestra.run.trial095.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T11:32:56.742 INFO:teuthology.orchestra.run.trial095.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T11:32:56.742 INFO:teuthology.orchestra.run.trial095.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T11:32:56.742 INFO:teuthology.orchestra.run.trial095.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T11:32:56.742 INFO:teuthology.orchestra.run.trial095.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T11:32:56.742 INFO:teuthology.orchestra.run.trial095.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T11:32:56.742 INFO:teuthology.orchestra.run.trial095.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T11:32:56.742 INFO:teuthology.orchestra.run.trial095.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T11:32:56.743 INFO:teuthology.orchestra.run.trial095.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T11:32:56.743 INFO:teuthology.orchestra.run.trial095.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T11:32:56.743 INFO:teuthology.orchestra.run.trial095.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T11:32:56.743 INFO:teuthology.orchestra.run.trial095.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T11:32:56.743 INFO:teuthology.orchestra.run.trial095.stdout: zip-3.0-35.el9.x86_64 2026-02-20T11:32:56.743 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:32:56.743 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:32:56.797 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-base 2026-02-20T11:32:57.110 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:28 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:32:57.174 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:32:57.193 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:32:57.193 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:32:57.193 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:32:57.214 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install cephadm 2026-02-20T11:32:57.522 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:28 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:32:57.587 INFO:teuthology.orchestra.run.trial095.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:32:57.605 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:32:57.606 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:32:57.606 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:32:57.627 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:32:57.934 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:28 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:32:58.018 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:32:58.018 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:32:58.018 INFO:teuthology.orchestra.run.trial095.stdout: Package Arch Version Repo Size 2026-02-20T11:32:58.018 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:32:58.019 INFO:teuthology.orchestra.run.trial095.stdout:Installing: 2026-02-20T11:32:58.019 INFO:teuthology.orchestra.run.trial095.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 149 k 2026-02-20T11:32:58.019 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:32:58.019 INFO:teuthology.orchestra.run.trial095.stdout:Transaction Summary 2026-02-20T11:32:58.019 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:32:58.019 INFO:teuthology.orchestra.run.trial095.stdout:Install 1 Package 2026-02-20T11:32:58.019 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:32:58.019 INFO:teuthology.orchestra.run.trial095.stdout:Total download size: 149 k 2026-02-20T11:32:58.019 INFO:teuthology.orchestra.run.trial095.stdout:Installed size: 455 k 2026-02-20T11:32:58.019 INFO:teuthology.orchestra.run.trial095.stdout:Downloading Packages: 2026-02-20T11:32:58.509 INFO:teuthology.orchestra.run.trial095.stdout:ceph-immutable-object-cache-20.3.0-5357.g0c3148 305 kB/s | 149 kB 00:00 2026-02-20T11:32:58.509 INFO:teuthology.orchestra.run.trial095.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:32:58.510 INFO:teuthology.orchestra.run.trial095.stdout:Total 304 kB/s | 149 kB 00:00 2026-02-20T11:32:58.510 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction check 2026-02-20T11:32:58.514 INFO:teuthology.orchestra.run.trial095.stdout:Transaction check succeeded. 2026-02-20T11:32:58.514 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction test 2026-02-20T11:32:58.545 INFO:teuthology.orchestra.run.trial095.stdout:Transaction test succeeded. 2026-02-20T11:32:58.545 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction 2026-02-20T11:32:58.601 INFO:teuthology.orchestra.run.trial095.stdout: Preparing : 1/1 2026-02-20T11:32:58.602 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:32:58.624 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:32:58.624 INFO:teuthology.orchestra.run.trial095.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:32:58.624 INFO:teuthology.orchestra.run.trial095.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T11:32:58.625 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:32:58.913 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:32:58.914 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:32:58.914 INFO:teuthology.orchestra.run.trial095.stdout:Installed: 2026-02-20T11:32:58.914 INFO:teuthology.orchestra.run.trial095.stdout: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:32:58.914 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:32:58.914 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:32:58.939 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-mgr 2026-02-20T11:32:59.249 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:30 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:32:59.314 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:32:59.332 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:32:59.333 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:32:59.333 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:32:59.354 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:32:59.659 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:30 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:32:59.724 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:32:59.742 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:32:59.742 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:32:59.742 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:32:59.764 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:33:00.072 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:31 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:00.138 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:33:00.156 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:00.157 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:33:00.157 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:00.178 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:33:00.487 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:31 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:00.553 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:33:00.571 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:00.572 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:33:00.572 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:00.594 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:33:00.898 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:31 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:00.962 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:33:00.980 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:00.981 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:33:00.981 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:01.002 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-osd 2026-02-20T11:33:01.306 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:32 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:01.371 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:33:01.390 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:01.390 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:33:01.390 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:01.411 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-osd-classic 2026-02-20T11:33:01.721 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:32 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:01.784 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:33:01.803 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:01.803 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:33:01.803 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:01.824 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-fuse 2026-02-20T11:33:02.130 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:33 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:02.212 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:02.213 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:02.213 INFO:teuthology.orchestra.run.trial095.stdout: Package Arch Version Repo Size 2026-02-20T11:33:02.213 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:02.213 INFO:teuthology.orchestra.run.trial095.stdout:Installing: 2026-02-20T11:33:02.213 INFO:teuthology.orchestra.run.trial095.stdout: ceph-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 914 k 2026-02-20T11:33:02.213 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:02.213 INFO:teuthology.orchestra.run.trial095.stdout:Transaction Summary 2026-02-20T11:33:02.213 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:02.213 INFO:teuthology.orchestra.run.trial095.stdout:Install 1 Package 2026-02-20T11:33:02.213 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:02.213 INFO:teuthology.orchestra.run.trial095.stdout:Total download size: 914 k 2026-02-20T11:33:02.214 INFO:teuthology.orchestra.run.trial095.stdout:Installed size: 2.9 M 2026-02-20T11:33:02.214 INFO:teuthology.orchestra.run.trial095.stdout:Downloading Packages: 2026-02-20T11:33:03.086 INFO:teuthology.orchestra.run.trial095.stdout:ceph-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 1.0 MB/s | 914 kB 00:00 2026-02-20T11:33:03.087 INFO:teuthology.orchestra.run.trial095.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:33:03.087 INFO:teuthology.orchestra.run.trial095.stdout:Total 1.0 MB/s | 914 kB 00:00 2026-02-20T11:33:03.087 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction check 2026-02-20T11:33:03.092 INFO:teuthology.orchestra.run.trial095.stdout:Transaction check succeeded. 2026-02-20T11:33:03.092 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction test 2026-02-20T11:33:03.126 INFO:teuthology.orchestra.run.trial095.stdout:Transaction test succeeded. 2026-02-20T11:33:03.126 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction 2026-02-20T11:33:03.215 INFO:teuthology.orchestra.run.trial095.stdout: Preparing : 1/1 2026-02-20T11:33:03.233 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:03.477 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:03.534 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:03.534 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:03.534 INFO:teuthology.orchestra.run.trial095.stdout:Installed: 2026-02-20T11:33:03.534 INFO:teuthology.orchestra.run.trial095.stdout: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:33:03.534 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:03.534 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:03.562 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-volume 2026-02-20T11:33:03.878 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:34 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:03.942 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:33:03.961 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:03.961 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:33:03.961 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:03.982 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install librados-devel 2026-02-20T11:33:04.292 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:35 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:04.374 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:04.375 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:04.375 INFO:teuthology.orchestra.run.trial095.stdout: Package Arch Version Repo Size 2026-02-20T11:33:04.375 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:04.375 INFO:teuthology.orchestra.run.trial095.stdout:Installing: 2026-02-20T11:33:04.375 INFO:teuthology.orchestra.run.trial095.stdout: librados-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 124 k 2026-02-20T11:33:04.375 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:04.375 INFO:teuthology.orchestra.run.trial095.stdout:Transaction Summary 2026-02-20T11:33:04.375 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:04.375 INFO:teuthology.orchestra.run.trial095.stdout:Install 1 Package 2026-02-20T11:33:04.375 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:04.376 INFO:teuthology.orchestra.run.trial095.stdout:Total download size: 124 k 2026-02-20T11:33:04.376 INFO:teuthology.orchestra.run.trial095.stdout:Installed size: 434 k 2026-02-20T11:33:04.376 INFO:teuthology.orchestra.run.trial095.stdout:Downloading Packages: 2026-02-20T11:33:05.365 INFO:teuthology.orchestra.run.trial095.stdout:librados-devel-20.3.0-5357.g0c3148ca.el9.x86_64 125 kB/s | 124 kB 00:00 2026-02-20T11:33:05.366 INFO:teuthology.orchestra.run.trial095.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:33:05.366 INFO:teuthology.orchestra.run.trial095.stdout:Total 125 kB/s | 124 kB 00:00 2026-02-20T11:33:05.367 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction check 2026-02-20T11:33:05.369 INFO:teuthology.orchestra.run.trial095.stdout:Transaction check succeeded. 2026-02-20T11:33:05.370 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction test 2026-02-20T11:33:05.405 INFO:teuthology.orchestra.run.trial095.stdout:Transaction test succeeded. 2026-02-20T11:33:05.405 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction 2026-02-20T11:33:05.461 INFO:teuthology.orchestra.run.trial095.stdout: Preparing : 1/1 2026-02-20T11:33:05.478 INFO:teuthology.orchestra.run.trial095.stdout: Installing : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:05.555 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:05.613 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:05.613 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:05.613 INFO:teuthology.orchestra.run.trial095.stdout:Installed: 2026-02-20T11:33:05.613 INFO:teuthology.orchestra.run.trial095.stdout: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:33:05.613 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:05.613 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:05.640 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install libcephfs2 2026-02-20T11:33:05.947 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:36 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:06.011 INFO:teuthology.orchestra.run.trial095.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:33:06.030 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:06.030 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:33:06.030 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:06.051 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install libcephfs-devel 2026-02-20T11:33:06.361 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:37 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:06.445 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:06.445 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:06.446 INFO:teuthology.orchestra.run.trial095.stdout: Package Arch Version Repo Size 2026-02-20T11:33:06.446 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:06.446 INFO:teuthology.orchestra.run.trial095.stdout:Installing: 2026-02-20T11:33:06.446 INFO:teuthology.orchestra.run.trial095.stdout: libcephfs-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:33:06.446 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:06.446 INFO:teuthology.orchestra.run.trial095.stdout:Transaction Summary 2026-02-20T11:33:06.446 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:06.446 INFO:teuthology.orchestra.run.trial095.stdout:Install 1 Package 2026-02-20T11:33:06.446 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:06.446 INFO:teuthology.orchestra.run.trial095.stdout:Total download size: 37 k 2026-02-20T11:33:06.446 INFO:teuthology.orchestra.run.trial095.stdout:Installed size: 171 k 2026-02-20T11:33:06.447 INFO:teuthology.orchestra.run.trial095.stdout:Downloading Packages: 2026-02-20T11:33:06.786 INFO:teuthology.orchestra.run.trial095.stdout:libcephfs-devel-20.3.0-5357.g0c3148ca.el9.x86_6 110 kB/s | 37 kB 00:00 2026-02-20T11:33:06.787 INFO:teuthology.orchestra.run.trial095.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:33:06.787 INFO:teuthology.orchestra.run.trial095.stdout:Total 109 kB/s | 37 kB 00:00 2026-02-20T11:33:06.787 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction check 2026-02-20T11:33:06.789 INFO:teuthology.orchestra.run.trial095.stdout:Transaction check succeeded. 2026-02-20T11:33:06.789 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction test 2026-02-20T11:33:06.792 INFO:teuthology.orchestra.run.trial095.stdout:Transaction test succeeded. 2026-02-20T11:33:06.792 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction 2026-02-20T11:33:06.814 INFO:teuthology.orchestra.run.trial095.stdout: Preparing : 1/1 2026-02-20T11:33:06.832 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:06.892 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:06.950 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:06.950 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:06.950 INFO:teuthology.orchestra.run.trial095.stdout:Installed: 2026-02-20T11:33:06.951 INFO:teuthology.orchestra.run.trial095.stdout: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:33:06.951 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:06.951 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:06.978 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install librados2 2026-02-20T11:33:07.289 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:38 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:07.354 INFO:teuthology.orchestra.run.trial095.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:33:07.372 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:07.373 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:33:07.373 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:07.394 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install librbd1 2026-02-20T11:33:07.704 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:38 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:07.768 INFO:teuthology.orchestra.run.trial095.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:33:07.787 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:07.788 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:33:07.788 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:07.809 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install python3-rados 2026-02-20T11:33:08.115 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:39 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:08.180 INFO:teuthology.orchestra.run.trial095.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:33:08.199 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:08.199 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:33:08.199 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:08.221 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install python3-rgw 2026-02-20T11:33:08.529 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:39 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:08.595 INFO:teuthology.orchestra.run.trial095.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:33:08.613 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:08.614 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:33:08.614 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:08.635 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install python3-cephfs 2026-02-20T11:33:08.944 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:39 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:09.008 INFO:teuthology.orchestra.run.trial095.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:33:09.027 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:09.027 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:33:09.027 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:09.048 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install python3-rbd 2026-02-20T11:33:09.355 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:40 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:09.420 INFO:teuthology.orchestra.run.trial095.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:33:09.438 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:09.439 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:33:09.439 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:09.461 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install rbd-fuse 2026-02-20T11:33:09.772 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:40 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:09.856 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:09.856 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:09.856 INFO:teuthology.orchestra.run.trial095.stdout: Package Architecture Version Repository Size 2026-02-20T11:33:09.856 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:09.856 INFO:teuthology.orchestra.run.trial095.stdout:Installing: 2026-02-20T11:33:09.856 INFO:teuthology.orchestra.run.trial095.stdout: rbd-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 86 k 2026-02-20T11:33:09.856 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:09.857 INFO:teuthology.orchestra.run.trial095.stdout:Transaction Summary 2026-02-20T11:33:09.857 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:09.857 INFO:teuthology.orchestra.run.trial095.stdout:Install 1 Package 2026-02-20T11:33:09.857 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:09.857 INFO:teuthology.orchestra.run.trial095.stdout:Total download size: 86 k 2026-02-20T11:33:09.857 INFO:teuthology.orchestra.run.trial095.stdout:Installed size: 236 k 2026-02-20T11:33:09.857 INFO:teuthology.orchestra.run.trial095.stdout:Downloading Packages: 2026-02-20T11:33:10.264 INFO:teuthology.orchestra.run.trial095.stdout:rbd-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 212 kB/s | 86 kB 00:00 2026-02-20T11:33:10.264 INFO:teuthology.orchestra.run.trial095.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:33:10.264 INFO:teuthology.orchestra.run.trial095.stdout:Total 212 kB/s | 86 kB 00:00 2026-02-20T11:33:10.264 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction check 2026-02-20T11:33:10.268 INFO:teuthology.orchestra.run.trial095.stdout:Transaction check succeeded. 2026-02-20T11:33:10.268 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction test 2026-02-20T11:33:10.299 INFO:teuthology.orchestra.run.trial095.stdout:Transaction test succeeded. 2026-02-20T11:33:10.299 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction 2026-02-20T11:33:10.350 INFO:teuthology.orchestra.run.trial095.stdout: Preparing : 1/1 2026-02-20T11:33:10.367 INFO:teuthology.orchestra.run.trial095.stdout: Installing : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:10.457 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:10.514 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:10.515 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:10.515 INFO:teuthology.orchestra.run.trial095.stdout:Installed: 2026-02-20T11:33:10.515 INFO:teuthology.orchestra.run.trial095.stdout: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:33:10.515 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:10.515 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:10.541 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install rbd-mirror 2026-02-20T11:33:10.847 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:41 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:10.931 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:10.931 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:10.931 INFO:teuthology.orchestra.run.trial095.stdout: Package Arch Version Repo Size 2026-02-20T11:33:10.932 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:10.932 INFO:teuthology.orchestra.run.trial095.stdout:Installing: 2026-02-20T11:33:10.932 INFO:teuthology.orchestra.run.trial095.stdout: rbd-mirror x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.6 M 2026-02-20T11:33:10.932 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:10.932 INFO:teuthology.orchestra.run.trial095.stdout:Transaction Summary 2026-02-20T11:33:10.932 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:10.932 INFO:teuthology.orchestra.run.trial095.stdout:Install 1 Package 2026-02-20T11:33:10.932 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:10.932 INFO:teuthology.orchestra.run.trial095.stdout:Total download size: 2.6 M 2026-02-20T11:33:10.932 INFO:teuthology.orchestra.run.trial095.stdout:Installed size: 11 M 2026-02-20T11:33:10.932 INFO:teuthology.orchestra.run.trial095.stdout:Downloading Packages: 2026-02-20T11:33:13.006 INFO:teuthology.orchestra.run.trial095.stdout:rbd-mirror-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 1.2 MB/s | 2.6 MB 00:02 2026-02-20T11:33:13.007 INFO:teuthology.orchestra.run.trial095.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:33:13.007 INFO:teuthology.orchestra.run.trial095.stdout:Total 1.2 MB/s | 2.6 MB 00:02 2026-02-20T11:33:13.007 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction check 2026-02-20T11:33:13.012 INFO:teuthology.orchestra.run.trial095.stdout:Transaction check succeeded. 2026-02-20T11:33:13.012 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction test 2026-02-20T11:33:13.051 INFO:teuthology.orchestra.run.trial095.stdout:Transaction test succeeded. 2026-02-20T11:33:13.051 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction 2026-02-20T11:33:13.216 INFO:teuthology.orchestra.run.trial095.stdout: Preparing : 1/1 2026-02-20T11:33:13.218 INFO:teuthology.orchestra.run.trial095.stdout: Installing : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:13.241 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:13.242 INFO:teuthology.orchestra.run.trial095.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:33:13.242 INFO:teuthology.orchestra.run.trial095.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T11:33:13.242 INFO:teuthology.orchestra.run.trial095.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:33:13.242 INFO:teuthology.orchestra.run.trial095.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:33:13.242 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:13.539 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:13.539 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:13.539 INFO:teuthology.orchestra.run.trial095.stdout:Installed: 2026-02-20T11:33:13.539 INFO:teuthology.orchestra.run.trial095.stdout: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:33:13.539 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:13.539 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:13.567 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install rbd-nbd 2026-02-20T11:33:13.872 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:44 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:13.955 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:13.956 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:13.956 INFO:teuthology.orchestra.run.trial095.stdout: Package Architecture Version Repository Size 2026-02-20T11:33:13.956 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:13.956 INFO:teuthology.orchestra.run.trial095.stdout:Installing: 2026-02-20T11:33:13.956 INFO:teuthology.orchestra.run.trial095.stdout: rbd-nbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 167 k 2026-02-20T11:33:13.956 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:13.956 INFO:teuthology.orchestra.run.trial095.stdout:Transaction Summary 2026-02-20T11:33:13.956 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:13.956 INFO:teuthology.orchestra.run.trial095.stdout:Install 1 Package 2026-02-20T11:33:13.956 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:13.956 INFO:teuthology.orchestra.run.trial095.stdout:Total download size: 167 k 2026-02-20T11:33:13.956 INFO:teuthology.orchestra.run.trial095.stdout:Installed size: 496 k 2026-02-20T11:33:13.956 INFO:teuthology.orchestra.run.trial095.stdout:Downloading Packages: 2026-02-20T11:33:14.453 INFO:teuthology.orchestra.run.trial095.stdout:rbd-nbd-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 335 kB/s | 167 kB 00:00 2026-02-20T11:33:14.454 INFO:teuthology.orchestra.run.trial095.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:33:14.454 INFO:teuthology.orchestra.run.trial095.stdout:Total 335 kB/s | 167 kB 00:00 2026-02-20T11:33:14.454 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction check 2026-02-20T11:33:14.458 INFO:teuthology.orchestra.run.trial095.stdout:Transaction check succeeded. 2026-02-20T11:33:14.459 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction test 2026-02-20T11:33:14.492 INFO:teuthology.orchestra.run.trial095.stdout:Transaction test succeeded. 2026-02-20T11:33:14.492 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction 2026-02-20T11:33:14.551 INFO:teuthology.orchestra.run.trial095.stdout: Preparing : 1/1 2026-02-20T11:33:14.567 INFO:teuthology.orchestra.run.trial095.stdout: Installing : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:14.647 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:14.705 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:33:14.705 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:14.705 INFO:teuthology.orchestra.run.trial095.stdout:Installed: 2026-02-20T11:33:14.705 INFO:teuthology.orchestra.run.trial095.stdout: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:33:14.705 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:14.705 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:14.732 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-osd-crimson 2026-02-20T11:33:15.041 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:46 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:15.105 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:33:15.123 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:15.124 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:33:15.124 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:33:15.145 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-20T11:33:15.453 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:02:46 ago on Fri 20 Feb 2026 11:30:29 AM UTC. 2026-02-20T11:33:15.536 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:33:15.537 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:15.537 INFO:teuthology.orchestra.run.trial095.stdout: Package Arch Version Repo Size 2026-02-20T11:33:15.537 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:15.537 INFO:teuthology.orchestra.run.trial095.stdout:Installing: 2026-02-20T11:33:15.537 INFO:teuthology.orchestra.run.trial095.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 433 M 2026-02-20T11:33:15.538 INFO:teuthology.orchestra.run.trial095.stdout:Installing weak dependencies: 2026-02-20T11:33:15.538 INFO:teuthology.orchestra.run.trial095.stdout: ceph-debugsource x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 12 M 2026-02-20T11:33:15.538 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:15.538 INFO:teuthology.orchestra.run.trial095.stdout:Transaction Summary 2026-02-20T11:33:15.538 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:33:15.538 INFO:teuthology.orchestra.run.trial095.stdout:Install 2 Packages 2026-02-20T11:33:15.538 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:33:15.538 INFO:teuthology.orchestra.run.trial095.stdout:Total download size: 445 M 2026-02-20T11:33:15.538 INFO:teuthology.orchestra.run.trial095.stdout:Installed size: 2.7 G 2026-02-20T11:33:15.538 INFO:teuthology.orchestra.run.trial095.stdout:Downloading Packages: 2026-02-20T11:33:20.516 INFO:teuthology.orchestra.run.trial095.stdout:(1/2): ceph-debugsource-20.3.0-5357.g0c3148ca.e 2.4 MB/s | 12 MB 00:04 2026-02-20T11:38:57.533 INFO:teuthology.orchestra.run.trial095.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5357.g 1.3 MB/s | 433 MB 05:41 2026-02-20T11:38:57.540 INFO:teuthology.orchestra.run.trial095.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:38:57.540 INFO:teuthology.orchestra.run.trial095.stdout:Total 1.3 MB/s | 445 MB 05:41 2026-02-20T11:38:57.540 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction check 2026-02-20T11:38:57.540 INFO:teuthology.orchestra.run.trial095.stdout:Transaction check succeeded. 2026-02-20T11:38:57.540 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction test 2026-02-20T11:38:58.917 INFO:teuthology.orchestra.run.trial095.stdout:Transaction test succeeded. 2026-02-20T11:38:58.918 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction 2026-02-20T11:39:02.500 INFO:teuthology.orchestra.run.trial095.stdout: Preparing : 1/1 2026-02-20T11:39:24.829 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:39:24.871 INFO:teuthology.orchestra.run.trial095.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:39:26.174 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:39:26.174 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:39:26.232 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:39:26.233 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:26.233 INFO:teuthology.orchestra.run.trial095.stdout:Installed: 2026-02-20T11:39:26.233 INFO:teuthology.orchestra.run.trial095.stdout: ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:39:26.233 INFO:teuthology.orchestra.run.trial095.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:39:26.233 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:26.233 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:26.307 DEBUG:teuthology.parallel:result is None 2026-02-20T11:39:26.308 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:39:26.563 DEBUG:teuthology.orchestra.run.trial095:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:39:26.585 INFO:teuthology.orchestra.run.trial095.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:39:26.586 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:39:26.586 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:39:26.589 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-20T11:39:26.589 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:39:26.589 DEBUG:teuthology.orchestra.run.trial095:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T11:39:26.650 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-20T11:39:26.650 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:39:26.651 DEBUG:teuthology.orchestra.run.trial095:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T11:39:26.715 DEBUG:teuthology.orchestra.run.trial095:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T11:39:26.779 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-20T11:39:26.780 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:39:26.780 DEBUG:teuthology.orchestra.run.trial095:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T11:39:26.844 DEBUG:teuthology.orchestra.run.trial095:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T11:39:26.908 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-20T11:39:26.908 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:39:26.909 DEBUG:teuthology.orchestra.run.trial095:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T11:39:26.975 DEBUG:teuthology.orchestra.run.trial095:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T11:39:27.038 INFO:teuthology.run_tasks:Running task pexec... 2026-02-20T11:39:27.055 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-20T11:39:27.056 DEBUG:teuthology.orchestra.run.trial095:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-20T11:39:27.081 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial095.front.sepia.ceph.com 2026-02-20T11:39:27.081 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-20T11:39:27.132 DEBUG:teuthology.parallel:result is None 2026-02-20T11:39:27.132 INFO:teuthology.run_tasks:Running task install... 2026-02-20T11:39:27.145 DEBUG:teuthology.task.install:project ceph 2026-02-20T11:39:27.146 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}} 2026-02-20T11:39:27.146 DEBUG:teuthology.task.install:config {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'} 2026-02-20T11:39:27.146 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T11:39:27.154 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T11:39:27.155 INFO:teuthology.task.install:extra packages: [] 2026-02-20T11:39:27.155 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:39:27.155 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:39:27.315 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:39:27.315 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:39:27.682 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:39:27.682 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:39:27.682 DEBUG:teuthology.orchestra.run.trial095:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:39:27.708 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-20T11:39:27.709 DEBUG:teuthology.orchestra.run.trial095:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:39:27.773 DEBUG:teuthology.orchestra.run.trial095:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:39:27.838 DEBUG:teuthology.orchestra.run.trial095:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:39:27.894 INFO:teuthology.orchestra.run.trial095.stdout:check_obsoletes = 1 2026-02-20T11:39:27.904 DEBUG:teuthology.orchestra.run.trial095:> sudo yum clean all 2026-02-20T11:39:28.063 INFO:teuthology.orchestra.run.trial095.stdout:56 files removed 2026-02-20T11:39:28.079 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-radosgw 2026-02-20T11:39:28.942 INFO:teuthology.orchestra.run.trial095.stdout:ceph packages for x86_64 132 kB/s | 94 kB 00:00 2026-02-20T11:39:29.523 INFO:teuthology.orchestra.run.trial095.stdout:ceph noarch packages 44 kB/s | 24 kB 00:00 2026-02-20T11:39:30.136 INFO:teuthology.orchestra.run.trial095.stdout:ceph source packages 3.5 kB/s | 2.1 kB 00:00 2026-02-20T11:39:31.196 INFO:teuthology.orchestra.run.trial095.stdout:CentOS Stream 9 - BaseOS 8.5 MB/s | 8.9 MB 00:01 2026-02-20T11:39:33.962 INFO:teuthology.orchestra.run.trial095.stdout:CentOS Stream 9 - AppStream 12 MB/s | 27 MB 00:02 2026-02-20T11:39:37.362 INFO:teuthology.orchestra.run.trial095.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 7.8 MB 00:01 2026-02-20T11:39:38.553 INFO:teuthology.orchestra.run.trial095.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 20 kB 00:00 2026-02-20T11:39:41.576 INFO:teuthology.orchestra.run.trial095.stdout:Extra Packages for Enterprise Linux 6.9 MB/s | 20 MB 00:02 2026-02-20T11:39:44.795 INFO:teuthology.orchestra.run.trial095.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-20T11:39:45.988 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:46.007 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:46.008 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:46.008 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:46.034 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-test 2026-02-20T11:39:46.344 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:46.410 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:46.429 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:46.429 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:46.429 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:46.451 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph 2026-02-20T11:39:46.765 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:46.830 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:46.848 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:46.849 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:46.849 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:46.871 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-base 2026-02-20T11:39:47.179 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:47.243 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:47.262 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:47.262 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:47.263 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:47.283 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install cephadm 2026-02-20T11:39:47.593 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:47.658 INFO:teuthology.orchestra.run.trial095.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:39:47.676 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:47.677 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:47.677 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:47.699 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:39:48.013 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:48.078 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:48.096 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:48.097 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:48.097 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:48.119 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-mgr 2026-02-20T11:39:48.428 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:48.492 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:48.511 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:48.512 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:48.512 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:48.533 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:39:48.843 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:48.907 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:39:48.926 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:48.927 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:48.927 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:48.948 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:39:49.260 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:49.325 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:39:49.343 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:49.344 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:49.344 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:49.366 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:39:49.678 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:49.744 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:39:49.763 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:49.764 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:49.764 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:49.785 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:39:50.095 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:50.161 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:39:50.179 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:50.180 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:50.180 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:50.202 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-osd 2026-02-20T11:39:50.507 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:50.572 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:50.591 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:50.591 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:50.591 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:50.613 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-osd-classic 2026-02-20T11:39:50.928 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:50.992 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:51.011 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:51.011 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:51.012 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:51.033 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-fuse 2026-02-20T11:39:51.336 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:51.400 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:51.419 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:51.419 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:51.419 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:51.440 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install ceph-volume 2026-02-20T11:39:51.752 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:51.817 INFO:teuthology.orchestra.run.trial095.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:39:51.836 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:51.836 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:51.836 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:51.858 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install librados-devel 2026-02-20T11:39:52.174 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:52.239 INFO:teuthology.orchestra.run.trial095.stdout:Package librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:52.258 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:52.258 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:52.259 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:52.281 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install libcephfs2 2026-02-20T11:39:52.594 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:52.659 INFO:teuthology.orchestra.run.trial095.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:52.677 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:52.678 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:52.678 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:52.700 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install libcephfs-devel 2026-02-20T11:39:53.010 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:53.076 INFO:teuthology.orchestra.run.trial095.stdout:Package libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:53.094 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:53.095 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:53.095 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:53.117 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install librados2 2026-02-20T11:39:53.427 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:53.491 INFO:teuthology.orchestra.run.trial095.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:53.510 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:53.511 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:53.511 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:53.532 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install librbd1 2026-02-20T11:39:53.838 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:53.902 INFO:teuthology.orchestra.run.trial095.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:53.920 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:53.921 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:53.921 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:53.943 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install python3-rados 2026-02-20T11:39:54.255 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:54.321 INFO:teuthology.orchestra.run.trial095.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:54.339 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:54.340 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:54.340 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:54.362 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install python3-rgw 2026-02-20T11:39:54.672 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:54.737 INFO:teuthology.orchestra.run.trial095.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:54.756 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:54.757 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:54.757 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:54.778 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install python3-cephfs 2026-02-20T11:39:55.097 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:55.162 INFO:teuthology.orchestra.run.trial095.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:55.180 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:55.181 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:55.181 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:55.203 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install python3-rbd 2026-02-20T11:39:55.513 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:55.578 INFO:teuthology.orchestra.run.trial095.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:55.596 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:55.597 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:55.597 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:55.618 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install rbd-fuse 2026-02-20T11:39:55.929 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:55.993 INFO:teuthology.orchestra.run.trial095.stdout:Package rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:56.012 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:56.013 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:56.013 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:56.035 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install rbd-mirror 2026-02-20T11:39:56.346 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:56.412 INFO:teuthology.orchestra.run.trial095.stdout:Package rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:56.430 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:56.431 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:56.431 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:56.454 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install rbd-nbd 2026-02-20T11:39:56.760 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:39:56.824 INFO:teuthology.orchestra.run.trial095.stdout:Package rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:39:56.843 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:39:56.844 INFO:teuthology.orchestra.run.trial095.stdout:Nothing to do. 2026-02-20T11:39:56.844 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:39:56.867 DEBUG:teuthology.parallel:result is None 2026-02-20T11:39:56.868 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:39:57.008 DEBUG:teuthology.orchestra.run.trial095:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:39:57.028 INFO:teuthology.orchestra.run.trial095.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:39:57.029 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:39:57.029 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:39:57.031 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-20T11:39:57.031 INFO:teuthology.run_tasks:Running task ceph... 2026-02-20T11:39:57.130 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-20T11:39:57.130 DEBUG:teuthology.orchestra.run.trial095:> sudo chmod 777 /var/log/ceph 2026-02-20T11:39:57.155 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-20T11:39:57.155 DEBUG:teuthology.orchestra.run.trial095:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-20T11:39:57.221 INFO:tasks.ceph:Creating extra log directories... 2026-02-20T11:39:57.221 DEBUG:teuthology.orchestra.run.trial095:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-20T11:39:57.294 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-20T11:39:57.294 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}, 'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-20T11:39:57.294 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60536', 'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439', 'description': 'crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} perf_ignorelist settings/optimized workloads/fio_4M_rand_write}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '60536', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439'}, 'ceph': {'conf': {'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '445d5c9ba18a4040e70e25303230c36c77773acb'}}, 'owner': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'priority': 101, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 1736, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '445d5c9ba18a4040e70e25303230c36c77773acb', 'targets': {'trial095.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFw5Mlsjsj+Xyb1Yd/fKfTYc5dBm5VD0Z5d6p2ZyDeTEFJjqEbIJdjM0WparkX9sCR3zuRLpbGBuo6LZ5nmE9KY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}, 'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}}, 'wait-for-scrub': False, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'cluster': 'ceph'}}, {'ssh_keys': None}, {'cbt': {'benchmarks': {'librbdfio': {'iodepth': [32], 'log_avg_msec': 100, 'mode': ['randwrite'], 'norandommap': True, 'op_size': [4194304], 'osd_ra': [4096], 'pool_profile': 'rbd', 'procs_per_volume': [1], 'time': 60, 'vol_size': 4096, 'volumes_per_client': [2]}}, 'cluster': {'iterations': 1, 'osds_per_node': 3, 'pool_profiles': {'rbd': {'pg_size': 128, 'pgp_size': 128, 'replication': 3}}, 'user': 'ubuntu'}, 'monitoring_profiles': {'perf': {'args': 'stat -p {pid} -o {perf_dir}/perf_stat.{pid}', 'nodes': ['osds'], 'perf_cmd': 'perf', 'pid_glob': 'crimson-osd.*.pid'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'reimage-ssh-down', 'teuthology_sha1': 'e6d9099ce03dc21193fda653159ec82465c3a94a', 'timestamp': '2026-02-20_10:21:31', 'tube': 'trial', 'user': 'jjperez', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699'} 2026-02-20T11:39:57.295 DEBUG:teuthology.orchestra.run.trial095:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-20T11:39:57.343 DEBUG:teuthology.orchestra.run.trial095:> sudo install -d -m0777 -- /var/run/ceph 2026-02-20T11:39:57.408 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:39:57.408 DEBUG:teuthology.orchestra.run.trial095:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T11:39:57.465 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T11:39:57.465 DEBUG:teuthology.orchestra.run.trial095:> stat /dev/vg_nvme/lv_1 2026-02-20T11:39:57.522 INFO:teuthology.orchestra.run.trial095.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T11:39:57.523 INFO:teuthology.orchestra.run.trial095.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:39:57.523 INFO:teuthology.orchestra.run.trial095.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-20T11:39:57.523 INFO:teuthology.orchestra.run.trial095.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:39:57.523 INFO:teuthology.orchestra.run.trial095.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:39:57.523 INFO:teuthology.orchestra.run.trial095.stdout:Access: 2026-02-20 11:33:13.381253361 +0000 2026-02-20T11:39:57.523 INFO:teuthology.orchestra.run.trial095.stdout:Modify: 2026-02-20 11:30:39.812885776 +0000 2026-02-20T11:39:57.523 INFO:teuthology.orchestra.run.trial095.stdout:Change: 2026-02-20 11:30:39.812885776 +0000 2026-02-20T11:39:57.523 INFO:teuthology.orchestra.run.trial095.stdout: Birth: 2026-02-20 11:30:39.812885776 +0000 2026-02-20T11:39:57.524 DEBUG:teuthology.orchestra.run.trial095:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T11:39:57.587 INFO:teuthology.orchestra.run.trial095.stderr:1+0 records in 2026-02-20T11:39:57.587 INFO:teuthology.orchestra.run.trial095.stderr:1+0 records out 2026-02-20T11:39:57.587 INFO:teuthology.orchestra.run.trial095.stderr:512 bytes copied, 0.00014526 s, 3.5 MB/s 2026-02-20T11:39:57.588 DEBUG:teuthology.orchestra.run.trial095:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T11:39:57.645 DEBUG:teuthology.orchestra.run.trial095:> stat /dev/vg_nvme/lv_2 2026-02-20T11:39:57.701 INFO:teuthology.orchestra.run.trial095.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T11:39:57.702 INFO:teuthology.orchestra.run.trial095.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:39:57.702 INFO:teuthology.orchestra.run.trial095.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-20T11:39:57.702 INFO:teuthology.orchestra.run.trial095.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:39:57.702 INFO:teuthology.orchestra.run.trial095.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:39:57.702 INFO:teuthology.orchestra.run.trial095.stdout:Access: 2026-02-20 11:33:13.381253361 +0000 2026-02-20T11:39:57.702 INFO:teuthology.orchestra.run.trial095.stdout:Modify: 2026-02-20 11:30:39.812885776 +0000 2026-02-20T11:39:57.702 INFO:teuthology.orchestra.run.trial095.stdout:Change: 2026-02-20 11:30:39.812885776 +0000 2026-02-20T11:39:57.702 INFO:teuthology.orchestra.run.trial095.stdout: Birth: 2026-02-20 11:30:39.812885776 +0000 2026-02-20T11:39:57.703 DEBUG:teuthology.orchestra.run.trial095:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T11:39:57.766 INFO:teuthology.orchestra.run.trial095.stderr:1+0 records in 2026-02-20T11:39:57.766 INFO:teuthology.orchestra.run.trial095.stderr:1+0 records out 2026-02-20T11:39:57.766 INFO:teuthology.orchestra.run.trial095.stderr:512 bytes copied, 0.000153575 s, 3.3 MB/s 2026-02-20T11:39:57.767 DEBUG:teuthology.orchestra.run.trial095:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T11:39:57.826 DEBUG:teuthology.orchestra.run.trial095:> stat /dev/vg_nvme/lv_3 2026-02-20T11:39:57.885 INFO:teuthology.orchestra.run.trial095.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T11:39:57.885 INFO:teuthology.orchestra.run.trial095.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:39:57.885 INFO:teuthology.orchestra.run.trial095.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-20T11:39:57.885 INFO:teuthology.orchestra.run.trial095.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:39:57.885 INFO:teuthology.orchestra.run.trial095.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:39:57.886 INFO:teuthology.orchestra.run.trial095.stdout:Access: 2026-02-20 11:33:13.381253361 +0000 2026-02-20T11:39:57.886 INFO:teuthology.orchestra.run.trial095.stdout:Modify: 2026-02-20 11:30:39.811885773 +0000 2026-02-20T11:39:57.886 INFO:teuthology.orchestra.run.trial095.stdout:Change: 2026-02-20 11:30:39.811885773 +0000 2026-02-20T11:39:57.886 INFO:teuthology.orchestra.run.trial095.stdout: Birth: 2026-02-20 11:30:39.811885773 +0000 2026-02-20T11:39:57.886 DEBUG:teuthology.orchestra.run.trial095:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T11:39:57.950 INFO:teuthology.orchestra.run.trial095.stderr:1+0 records in 2026-02-20T11:39:57.950 INFO:teuthology.orchestra.run.trial095.stderr:1+0 records out 2026-02-20T11:39:57.950 INFO:teuthology.orchestra.run.trial095.stderr:512 bytes copied, 0.00015064 s, 3.4 MB/s 2026-02-20T11:39:57.951 DEBUG:teuthology.orchestra.run.trial095:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T11:39:58.010 DEBUG:teuthology.orchestra.run.trial095:> stat /dev/vg_nvme/lv_4 2026-02-20T11:39:58.066 INFO:teuthology.orchestra.run.trial095.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T11:39:58.066 INFO:teuthology.orchestra.run.trial095.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:39:58.066 INFO:teuthology.orchestra.run.trial095.stdout:Device: 6h/6d Inode: 1282 Links: 1 2026-02-20T11:39:58.066 INFO:teuthology.orchestra.run.trial095.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:39:58.066 INFO:teuthology.orchestra.run.trial095.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:39:58.066 INFO:teuthology.orchestra.run.trial095.stdout:Access: 2026-02-20 11:33:13.382253343 +0000 2026-02-20T11:39:58.066 INFO:teuthology.orchestra.run.trial095.stdout:Modify: 2026-02-20 11:30:39.810885769 +0000 2026-02-20T11:39:58.067 INFO:teuthology.orchestra.run.trial095.stdout:Change: 2026-02-20 11:30:39.810885769 +0000 2026-02-20T11:39:58.067 INFO:teuthology.orchestra.run.trial095.stdout: Birth: 2026-02-20 11:30:39.810885769 +0000 2026-02-20T11:39:58.067 DEBUG:teuthology.orchestra.run.trial095:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T11:39:58.128 INFO:teuthology.orchestra.run.trial095.stderr:1+0 records in 2026-02-20T11:39:58.129 INFO:teuthology.orchestra.run.trial095.stderr:1+0 records out 2026-02-20T11:39:58.129 INFO:teuthology.orchestra.run.trial095.stderr:512 bytes copied, 0.000170968 s, 3.0 MB/s 2026-02-20T11:39:58.130 DEBUG:teuthology.orchestra.run.trial095:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T11:39:58.186 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-20T11:39:58.186 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial095.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-20T11:39:58.186 INFO:tasks.ceph:Generating config... 2026-02-20T11:39:58.189 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-20T11:39:58.189 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-20T11:39:58.189 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-20T11:39:58.189 INFO:tasks.ceph:[osd] debug filestore = 0/0 2026-02-20T11:39:58.189 INFO:tasks.ceph:[osd] debug journal = 0/0 2026-02-20T11:39:58.189 INFO:tasks.ceph:[osd] debug ms = 0/0 2026-02-20T11:39:58.189 INFO:tasks.ceph:[osd] debug osd = 0/0 2026-02-20T11:39:58.189 INFO:tasks.ceph:[osd] debug seastore = 20 2026-02-20T11:39:58.190 INFO:tasks.ceph:[osd] debug seastore backref = 20 2026-02-20T11:39:58.190 INFO:tasks.ceph:[osd] debug seastore cache = 20 2026-02-20T11:39:58.190 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2026-02-20T11:39:58.190 INFO:tasks.ceph:[osd] debug seastore device = 20 2026-02-20T11:39:58.190 INFO:tasks.ceph:[osd] debug seastore epm = 20 2026-02-20T11:39:58.190 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2026-02-20T11:39:58.190 INFO:tasks.ceph:[osd] debug seastore journal = 20 2026-02-20T11:39:58.190 INFO:tasks.ceph:[osd] debug seastore lba = 20 2026-02-20T11:39:58.190 INFO:tasks.ceph:[osd] debug seastore odata = 20 2026-02-20T11:39:58.190 INFO:tasks.ceph:[osd] debug seastore omap = 20 2026-02-20T11:39:58.190 INFO:tasks.ceph:[osd] debug seastore onode = 20 2026-02-20T11:39:58.190 INFO:tasks.ceph:[osd] debug seastore t = 20 2026-02-20T11:39:58.190 INFO:tasks.ceph:[osd] debug seastore tm = 20 2026-02-20T11:39:58.191 INFO:tasks.ceph:[osd] osd objectstore = seastore 2026-02-20T11:39:58.191 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-20T11:39:58.191 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-20T11:39:58.191 INFO:tasks.ceph:[osd] seastore cachepin type = 2Q 2026-02-20T11:39:58.191 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-20T11:39:58.191 INFO:tasks.ceph:[global] auth client required = none 2026-02-20T11:39:58.191 INFO:tasks.ceph:[global] auth cluster required = none 2026-02-20T11:39:58.191 INFO:tasks.ceph:[global] auth service required = none 2026-02-20T11:39:58.191 INFO:tasks.ceph:[global] auth supported = none 2026-02-20T11:39:58.191 INFO:tasks.ceph:[global] debug asok = 0/0 2026-02-20T11:39:58.191 INFO:tasks.ceph:[global] debug auth = 0/0 2026-02-20T11:39:58.191 INFO:tasks.ceph:[global] debug bdev = 0/0 2026-02-20T11:39:58.192 INFO:tasks.ceph:[global] debug bluefs = 0/0 2026-02-20T11:39:58.192 INFO:tasks.ceph:[global] debug bluestore = 0/0 2026-02-20T11:39:58.192 INFO:tasks.ceph:[global] debug buffer = 0/0 2026-02-20T11:39:58.192 INFO:tasks.ceph:[global] debug civetweb = 0/0 2026-02-20T11:39:58.192 INFO:tasks.ceph:[global] debug client = 0/0 2026-02-20T11:39:58.192 INFO:tasks.ceph:[global] debug compressor = 0/0 2026-02-20T11:39:58.192 INFO:tasks.ceph:[global] debug context = 0/0 2026-02-20T11:39:58.192 INFO:tasks.ceph:[global] debug crush = 0/0 2026-02-20T11:39:58.192 INFO:tasks.ceph:[global] debug crypto = 0/0 2026-02-20T11:39:58.192 INFO:tasks.ceph:[global] debug dpdk = 0/0 2026-02-20T11:39:58.192 INFO:tasks.ceph:[global] debug eventtrace = 0/0 2026-02-20T11:39:58.192 INFO:tasks.ceph:[global] debug filer = 0/0 2026-02-20T11:39:58.192 INFO:tasks.ceph:[global] debug filestore = 0/0 2026-02-20T11:39:58.193 INFO:tasks.ceph:[global] debug finisher = 0/0 2026-02-20T11:39:58.193 INFO:tasks.ceph:[global] debug fuse = 0/0 2026-02-20T11:39:58.193 INFO:tasks.ceph:[global] debug heartbeatmap = 0/0 2026-02-20T11:39:58.193 INFO:tasks.ceph:[global] debug javaclient = 0/0 2026-02-20T11:39:58.193 INFO:tasks.ceph:[global] debug journal = 0/0 2026-02-20T11:39:58.193 INFO:tasks.ceph:[global] debug journaler = 0/0 2026-02-20T11:39:58.193 INFO:tasks.ceph:[global] debug kstore = 0/0 2026-02-20T11:39:58.193 INFO:tasks.ceph:[global] debug leveldb = 0/0 2026-02-20T11:39:58.193 INFO:tasks.ceph:[global] debug lockdep = 0/0 2026-02-20T11:39:58.193 INFO:tasks.ceph:[global] debug mds = 0/0 2026-02-20T11:39:58.193 INFO:tasks.ceph:[global] debug mds balancer = 0/0 2026-02-20T11:39:58.193 INFO:tasks.ceph:[global] debug mds locker = 0/0 2026-02-20T11:39:58.193 INFO:tasks.ceph:[global] debug mds log = 0/0 2026-02-20T11:39:58.193 INFO:tasks.ceph:[global] debug mds log expire = 0/0 2026-02-20T11:39:58.194 INFO:tasks.ceph:[global] debug mds migrator = 0/0 2026-02-20T11:39:58.194 INFO:tasks.ceph:[global] debug memdb = 0/0 2026-02-20T11:39:58.194 INFO:tasks.ceph:[global] debug mgr = 0/0 2026-02-20T11:39:58.194 INFO:tasks.ceph:[global] debug mgrc = 0/0 2026-02-20T11:39:58.194 INFO:tasks.ceph:[global] debug mon = 0/0 2026-02-20T11:39:58.194 INFO:tasks.ceph:[global] debug monc = 0/0 2026-02-20T11:39:58.194 INFO:tasks.ceph:[global] debug ms = 0/0 2026-02-20T11:39:58.194 INFO:tasks.ceph:[global] debug objclass = 0/0 2026-02-20T11:39:58.194 INFO:tasks.ceph:[global] debug objectcacher = 0/0 2026-02-20T11:39:58.194 INFO:tasks.ceph:[global] debug objecter = 0/0 2026-02-20T11:39:58.194 INFO:tasks.ceph:[global] debug optracker = 0/0 2026-02-20T11:39:58.194 INFO:tasks.ceph:[global] debug osd = 0/0 2026-02-20T11:39:58.194 INFO:tasks.ceph:[global] debug paxos = 0/0 2026-02-20T11:39:58.195 INFO:tasks.ceph:[global] debug perfcounter = 0/0 2026-02-20T11:39:58.195 INFO:tasks.ceph:[global] debug rados = 0/0 2026-02-20T11:39:58.195 INFO:tasks.ceph:[global] debug rbd = 0/0 2026-02-20T11:39:58.195 INFO:tasks.ceph:[global] debug rbd mirror = 0/0 2026-02-20T11:39:58.195 INFO:tasks.ceph:[global] debug rbd replay = 0/0 2026-02-20T11:39:58.195 INFO:tasks.ceph:[global] debug refs = 0/0 2026-02-20T11:39:58.195 INFO:tasks.ceph:[global] debug rgw = 0/0 2026-02-20T11:39:58.195 INFO:tasks.ceph:[global] debug rgw lifecycle = 0/0 2026-02-20T11:39:58.195 INFO:tasks.ceph:[global] debug rgw notification = 0/0 2026-02-20T11:39:58.195 INFO:tasks.ceph:[global] debug rgw sync = 0/0 2026-02-20T11:39:58.195 INFO:tasks.ceph:[global] debug rocksdb = 0/0 2026-02-20T11:39:58.195 INFO:tasks.ceph:[global] debug striper = 0/0 2026-02-20T11:39:58.195 INFO:tasks.ceph:[global] debug throttle = 0/0 2026-02-20T11:39:58.196 INFO:tasks.ceph:[global] debug timer = 0/0 2026-02-20T11:39:58.196 INFO:tasks.ceph:[global] debug tp = 0/0 2026-02-20T11:39:58.196 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-20T11:39:58.196 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-20T11:39:58.196 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-20T11:39:58.196 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-20T11:39:58.196 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-20T11:39:58.196 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-20T11:39:58.196 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-20T11:39:58.196 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-20T11:39:58.196 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-20T11:39:58.196 INFO:tasks.ceph:[mon] debug mon = 0/0 2026-02-20T11:39:58.196 INFO:tasks.ceph:[mon] debug ms = 0/0 2026-02-20T11:39:58.197 INFO:tasks.ceph:[mon] debug paxos = 0/0 2026-02-20T11:39:58.197 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-20T11:39:58.197 INFO:tasks.ceph:Setting up mon.a... 2026-02-20T11:39:58.197 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-20T11:39:58.266 INFO:teuthology.orchestra.run.trial095.stdout:creating /etc/ceph/ceph.keyring 2026-02-20T11:39:58.268 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-20T11:39:58.355 DEBUG:teuthology.orchestra.run.trial095:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T11:39:58.380 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.95')] 2026-02-20T11:39:58.381 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'none', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.95', 'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': '0/0', 'debug mon': '0/0', 'debug paxos': '0/0', 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-20T11:39:58.383 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:39:58.383 DEBUG:teuthology.orchestra.run.trial095:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T11:39:58.435 DEBUG:teuthology.orchestra.run.trial095:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.95 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:39:58.515 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:39:58.512+0000 7f68dc82ef40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:58.515 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:39:58.512+0000 7f68dc82ef40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:58.515 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:39:58.512+0000 7f68dc82ef40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:58.516 INFO:teuthology.orchestra.run.trial095.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:39:58.516 INFO:teuthology.orchestra.run.trial095.stdout:monmaptool: generated fsid c325c6cc-b5e6-4605-89e5-d4f698fcae7d 2026-02-20T11:39:58.516 INFO:teuthology.orchestra.run.trial095.stdout:setting min_mon_release = tentacle 2026-02-20T11:39:58.517 INFO:teuthology.orchestra.run.trial095.stdout:epoch 0 2026-02-20T11:39:58.517 INFO:teuthology.orchestra.run.trial095.stdout:fsid c325c6cc-b5e6-4605-89e5-d4f698fcae7d 2026-02-20T11:39:58.517 INFO:teuthology.orchestra.run.trial095.stdout:last_changed 2026-02-20T11:39:58.513488+0000 2026-02-20T11:39:58.517 INFO:teuthology.orchestra.run.trial095.stdout:created 2026-02-20T11:39:58.513488+0000 2026-02-20T11:39:58.517 INFO:teuthology.orchestra.run.trial095.stdout:min_mon_release 20 (tentacle) 2026-02-20T11:39:58.517 INFO:teuthology.orchestra.run.trial095.stdout:election_strategy: 1 2026-02-20T11:39:58.517 INFO:teuthology.orchestra.run.trial095.stdout:0: [v2:10.20.193.95:3300/0,v1:10.20.193.95:6789/0] mon.a 2026-02-20T11:39:58.517 INFO:teuthology.orchestra.run.trial095.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-20T11:39:58.518 DEBUG:teuthology.orchestra.run.trial095:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T11:39:58.572 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c325c6cc-b5e6-4605-89e5-d4f698fcae7d... 2026-02-20T11:39:58.574 DEBUG:teuthology.orchestra.run.trial095:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-20T11:39:58.654 INFO:teuthology.orchestra.run.trial095.stdout:[global] 2026-02-20T11:39:58.654 INFO:teuthology.orchestra.run.trial095.stdout: chdir = "" 2026-02-20T11:39:58.654 INFO:teuthology.orchestra.run.trial095.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-20T11:39:58.654 INFO:teuthology.orchestra.run.trial095.stdout: auth supported = none 2026-02-20T11:39:58.655 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.655 INFO:teuthology.orchestra.run.trial095.stdout: filestore xattr use omap = true 2026-02-20T11:39:58.655 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.655 INFO:teuthology.orchestra.run.trial095.stdout: mon clock drift allowed = 1.000 2026-02-20T11:39:58.655 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.655 INFO:teuthology.orchestra.run.trial095.stdout: osd crush chooseleaf type = 0 2026-02-20T11:39:58.655 INFO:teuthology.orchestra.run.trial095.stdout: auth debug = true 2026-02-20T11:39:58.655 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.655 INFO:teuthology.orchestra.run.trial095.stdout: ms die on old message = true 2026-02-20T11:39:58.655 INFO:teuthology.orchestra.run.trial095.stdout: ms die on bug = true 2026-02-20T11:39:58.655 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.655 INFO:teuthology.orchestra.run.trial095.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-20T11:39:58.656 INFO:teuthology.orchestra.run.trial095.stdout: mon pg warn max object skew = 0 2026-02-20T11:39:58.656 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.656 INFO:teuthology.orchestra.run.trial095.stdout: # disable pg_autoscaler by default for new pools 2026-02-20T11:39:58.656 INFO:teuthology.orchestra.run.trial095.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-20T11:39:58.656 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.656 INFO:teuthology.orchestra.run.trial095.stdout: osd pool default size = 2 2026-02-20T11:39:58.656 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.656 INFO:teuthology.orchestra.run.trial095.stdout: mon osd allow primary affinity = true 2026-02-20T11:39:58.656 INFO:teuthology.orchestra.run.trial095.stdout: mon osd allow pg remap = true 2026-02-20T11:39:58.656 INFO:teuthology.orchestra.run.trial095.stdout: mon warn on legacy crush tunables = false 2026-02-20T11:39:58.656 INFO:teuthology.orchestra.run.trial095.stdout: mon warn on crush straw calc version zero = false 2026-02-20T11:39:58.656 INFO:teuthology.orchestra.run.trial095.stdout: mon warn on no sortbitwise = false 2026-02-20T11:39:58.657 INFO:teuthology.orchestra.run.trial095.stdout: mon warn on osd down out interval zero = false 2026-02-20T11:39:58.657 INFO:teuthology.orchestra.run.trial095.stdout: mon warn on too few osds = false 2026-02-20T11:39:58.657 INFO:teuthology.orchestra.run.trial095.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-20T11:39:58.657 INFO:teuthology.orchestra.run.trial095.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-20T11:39:58.657 INFO:teuthology.orchestra.run.trial095.stdout: mon_allow_pool_size_one = true 2026-02-20T11:39:58.657 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.657 INFO:teuthology.orchestra.run.trial095.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-20T11:39:58.657 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.657 INFO:teuthology.orchestra.run.trial095.stdout: osd default data pool replay window = 5 2026-02-20T11:39:58.657 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.657 INFO:teuthology.orchestra.run.trial095.stdout: mon allow pool delete = true 2026-02-20T11:39:58.657 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.658 INFO:teuthology.orchestra.run.trial095.stdout: mon cluster log file level = debug 2026-02-20T11:39:58.658 INFO:teuthology.orchestra.run.trial095.stdout: debug asserts on shutdown = true 2026-02-20T11:39:58.658 INFO:teuthology.orchestra.run.trial095.stdout: mon health detail to clog = false 2026-02-20T11:39:58.658 INFO:teuthology.orchestra.run.trial095.stdout: mon host = 10.20.193.95 2026-02-20T11:39:58.658 INFO:teuthology.orchestra.run.trial095.stdout: auth client required = none 2026-02-20T11:39:58.658 INFO:teuthology.orchestra.run.trial095.stdout: auth cluster required = none 2026-02-20T11:39:58.658 INFO:teuthology.orchestra.run.trial095.stdout: auth service required = none 2026-02-20T11:39:58.658 INFO:teuthology.orchestra.run.trial095.stdout: debug asok = 0/0 2026-02-20T11:39:58.658 INFO:teuthology.orchestra.run.trial095.stdout: debug auth = 0/0 2026-02-20T11:39:58.658 INFO:teuthology.orchestra.run.trial095.stdout: debug bdev = 0/0 2026-02-20T11:39:58.658 INFO:teuthology.orchestra.run.trial095.stdout: debug bluefs = 0/0 2026-02-20T11:39:58.658 INFO:teuthology.orchestra.run.trial095.stdout: debug bluestore = 0/0 2026-02-20T11:39:58.658 INFO:teuthology.orchestra.run.trial095.stdout: debug buffer = 0/0 2026-02-20T11:39:58.659 INFO:teuthology.orchestra.run.trial095.stdout: debug civetweb = 0/0 2026-02-20T11:39:58.659 INFO:teuthology.orchestra.run.trial095.stdout: debug client = 0/0 2026-02-20T11:39:58.659 INFO:teuthology.orchestra.run.trial095.stdout: debug compressor = 0/0 2026-02-20T11:39:58.659 INFO:teuthology.orchestra.run.trial095.stdout: debug context = 0/0 2026-02-20T11:39:58.659 INFO:teuthology.orchestra.run.trial095.stdout: debug crush = 0/0 2026-02-20T11:39:58.659 INFO:teuthology.orchestra.run.trial095.stdout: debug crypto = 0/0 2026-02-20T11:39:58.659 INFO:teuthology.orchestra.run.trial095.stdout: debug dpdk = 0/0 2026-02-20T11:39:58.659 INFO:teuthology.orchestra.run.trial095.stdout: debug eventtrace = 0/0 2026-02-20T11:39:58.659 INFO:teuthology.orchestra.run.trial095.stdout: debug filer = 0/0 2026-02-20T11:39:58.659 INFO:teuthology.orchestra.run.trial095.stdout: debug filestore = 0/0 2026-02-20T11:39:58.659 INFO:teuthology.orchestra.run.trial095.stdout: debug finisher = 0/0 2026-02-20T11:39:58.659 INFO:teuthology.orchestra.run.trial095.stdout: debug fuse = 0/0 2026-02-20T11:39:58.659 INFO:teuthology.orchestra.run.trial095.stdout: debug heartbeatmap = 0/0 2026-02-20T11:39:58.660 INFO:teuthology.orchestra.run.trial095.stdout: debug javaclient = 0/0 2026-02-20T11:39:58.660 INFO:teuthology.orchestra.run.trial095.stdout: debug journal = 0/0 2026-02-20T11:39:58.660 INFO:teuthology.orchestra.run.trial095.stdout: debug journaler = 0/0 2026-02-20T11:39:58.660 INFO:teuthology.orchestra.run.trial095.stdout: debug kstore = 0/0 2026-02-20T11:39:58.660 INFO:teuthology.orchestra.run.trial095.stdout: debug leveldb = 0/0 2026-02-20T11:39:58.660 INFO:teuthology.orchestra.run.trial095.stdout: debug lockdep = 0/0 2026-02-20T11:39:58.660 INFO:teuthology.orchestra.run.trial095.stdout: debug mds = 0/0 2026-02-20T11:39:58.660 INFO:teuthology.orchestra.run.trial095.stdout: debug mds balancer = 0/0 2026-02-20T11:39:58.660 INFO:teuthology.orchestra.run.trial095.stdout: debug mds locker = 0/0 2026-02-20T11:39:58.660 INFO:teuthology.orchestra.run.trial095.stdout: debug mds log = 0/0 2026-02-20T11:39:58.660 INFO:teuthology.orchestra.run.trial095.stdout: debug mds log expire = 0/0 2026-02-20T11:39:58.660 INFO:teuthology.orchestra.run.trial095.stdout: debug mds migrator = 0/0 2026-02-20T11:39:58.660 INFO:teuthology.orchestra.run.trial095.stdout: debug memdb = 0/0 2026-02-20T11:39:58.661 INFO:teuthology.orchestra.run.trial095.stdout: debug mgr = 0/0 2026-02-20T11:39:58.661 INFO:teuthology.orchestra.run.trial095.stdout: debug mgrc = 0/0 2026-02-20T11:39:58.661 INFO:teuthology.orchestra.run.trial095.stdout: debug mon = 0/0 2026-02-20T11:39:58.661 INFO:teuthology.orchestra.run.trial095.stdout: debug monc = 0/0 2026-02-20T11:39:58.661 INFO:teuthology.orchestra.run.trial095.stdout: debug ms = 0/0 2026-02-20T11:39:58.661 INFO:teuthology.orchestra.run.trial095.stdout: debug objclass = 0/0 2026-02-20T11:39:58.661 INFO:teuthology.orchestra.run.trial095.stdout: debug objectcacher = 0/0 2026-02-20T11:39:58.661 INFO:teuthology.orchestra.run.trial095.stdout: debug objecter = 0/0 2026-02-20T11:39:58.661 INFO:teuthology.orchestra.run.trial095.stdout: debug optracker = 0/0 2026-02-20T11:39:58.661 INFO:teuthology.orchestra.run.trial095.stdout: debug osd = 0/0 2026-02-20T11:39:58.661 INFO:teuthology.orchestra.run.trial095.stdout: debug paxos = 0/0 2026-02-20T11:39:58.661 INFO:teuthology.orchestra.run.trial095.stdout: debug perfcounter = 0/0 2026-02-20T11:39:58.661 INFO:teuthology.orchestra.run.trial095.stdout: debug rados = 0/0 2026-02-20T11:39:58.661 INFO:teuthology.orchestra.run.trial095.stdout: debug rbd = 0/0 2026-02-20T11:39:58.662 INFO:teuthology.orchestra.run.trial095.stdout: debug rbd mirror = 0/0 2026-02-20T11:39:58.662 INFO:teuthology.orchestra.run.trial095.stdout: debug rbd replay = 0/0 2026-02-20T11:39:58.662 INFO:teuthology.orchestra.run.trial095.stdout: debug refs = 0/0 2026-02-20T11:39:58.662 INFO:teuthology.orchestra.run.trial095.stdout: debug rgw = 0/0 2026-02-20T11:39:58.662 INFO:teuthology.orchestra.run.trial095.stdout: debug rgw lifecycle = 0/0 2026-02-20T11:39:58.662 INFO:teuthology.orchestra.run.trial095.stdout: debug rgw notification = 0/0 2026-02-20T11:39:58.662 INFO:teuthology.orchestra.run.trial095.stdout: debug rgw sync = 0/0 2026-02-20T11:39:58.662 INFO:teuthology.orchestra.run.trial095.stdout: debug rocksdb = 0/0 2026-02-20T11:39:58.662 INFO:teuthology.orchestra.run.trial095.stdout: debug striper = 0/0 2026-02-20T11:39:58.662 INFO:teuthology.orchestra.run.trial095.stdout: debug throttle = 0/0 2026-02-20T11:39:58.662 INFO:teuthology.orchestra.run.trial095.stdout: debug timer = 0/0 2026-02-20T11:39:58.662 INFO:teuthology.orchestra.run.trial095.stdout: debug tp = 0/0 2026-02-20T11:39:58.662 INFO:teuthology.orchestra.run.trial095.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-20T11:39:58.662 INFO:teuthology.orchestra.run.trial095.stdout: ms client mode = crc 2026-02-20T11:39:58.663 INFO:teuthology.orchestra.run.trial095.stdout: ms cluster mode = crc 2026-02-20T11:39:58.663 INFO:teuthology.orchestra.run.trial095.stdout: ms mon client mode = crc 2026-02-20T11:39:58.663 INFO:teuthology.orchestra.run.trial095.stdout: ms mon cluster mode = crc 2026-02-20T11:39:58.663 INFO:teuthology.orchestra.run.trial095.stdout: ms mon service mode = crc 2026-02-20T11:39:58.663 INFO:teuthology.orchestra.run.trial095.stdout: ms service mode = crc 2026-02-20T11:39:58.663 INFO:teuthology.orchestra.run.trial095.stdout: fsid = c325c6cc-b5e6-4605-89e5-d4f698fcae7d 2026-02-20T11:39:58.663 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.663 INFO:teuthology.orchestra.run.trial095.stdout:[osd] 2026-02-20T11:39:58.663 INFO:teuthology.orchestra.run.trial095.stdout: osd journal size = 100 2026-02-20T11:39:58.663 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.663 INFO:teuthology.orchestra.run.trial095.stdout: osd scrub load threshold = 5.0 2026-02-20T11:39:58.663 INFO:teuthology.orchestra.run.trial095.stdout: osd scrub max interval = 600 2026-02-20T11:39:58.663 INFO:teuthology.orchestra.run.trial095.stdout: osd mclock profile = high_recovery_ops 2026-02-20T11:39:58.664 INFO:teuthology.orchestra.run.trial095.stdout: osd mclock skip benchmark = true 2026-02-20T11:39:58.664 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.664 INFO:teuthology.orchestra.run.trial095.stdout: osd recover clone overlap = true 2026-02-20T11:39:58.664 INFO:teuthology.orchestra.run.trial095.stdout: osd recovery max chunk = 1048576 2026-02-20T11:39:58.664 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.664 INFO:teuthology.orchestra.run.trial095.stdout: osd debug shutdown = true 2026-02-20T11:39:58.664 INFO:teuthology.orchestra.run.trial095.stdout: osd debug op order = true 2026-02-20T11:39:58.665 INFO:teuthology.orchestra.run.trial095.stdout: osd debug verify stray on activate = true 2026-02-20T11:39:58.665 INFO:teuthology.orchestra.run.trial095.stdout: osd debug trim objects = true 2026-02-20T11:39:58.665 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.665 INFO:teuthology.orchestra.run.trial095.stdout: osd open classes on start = true 2026-02-20T11:39:58.665 INFO:teuthology.orchestra.run.trial095.stdout: osd debug pg log writeout = true 2026-02-20T11:39:58.665 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.665 INFO:teuthology.orchestra.run.trial095.stdout: osd deep scrub update digest min age = 30 2026-02-20T11:39:58.665 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.665 INFO:teuthology.orchestra.run.trial095.stdout: osd map max advance = 10 2026-02-20T11:39:58.665 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.665 INFO:teuthology.orchestra.run.trial095.stdout: journal zero on create = true 2026-02-20T11:39:58.665 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.666 INFO:teuthology.orchestra.run.trial095.stdout: filestore ondisk finisher threads = 3 2026-02-20T11:39:58.666 INFO:teuthology.orchestra.run.trial095.stdout: filestore apply finisher threads = 3 2026-02-20T11:39:58.666 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.666 INFO:teuthology.orchestra.run.trial095.stdout: bdev debug aio = true 2026-02-20T11:39:58.666 INFO:teuthology.orchestra.run.trial095.stdout: osd debug misdirected ops = true 2026-02-20T11:39:58.666 INFO:teuthology.orchestra.run.trial095.stdout: debug monc = 20 2026-02-20T11:39:58.666 INFO:teuthology.orchestra.run.trial095.stdout: crimson cpu num = 4 2026-02-20T11:39:58.666 INFO:teuthology.orchestra.run.trial095.stdout: crimson osd obc lru size = 10 2026-02-20T11:39:58.666 INFO:teuthology.orchestra.run.trial095.stdout: debug filestore = 0/0 2026-02-20T11:39:58.666 INFO:teuthology.orchestra.run.trial095.stdout: debug journal = 0/0 2026-02-20T11:39:58.666 INFO:teuthology.orchestra.run.trial095.stdout: debug ms = 0/0 2026-02-20T11:39:58.666 INFO:teuthology.orchestra.run.trial095.stdout: debug osd = 0/0 2026-02-20T11:39:58.666 INFO:teuthology.orchestra.run.trial095.stdout: debug seastore = 20 2026-02-20T11:39:58.667 INFO:teuthology.orchestra.run.trial095.stdout: debug seastore backref = 20 2026-02-20T11:39:58.667 INFO:teuthology.orchestra.run.trial095.stdout: debug seastore cache = 20 2026-02-20T11:39:58.667 INFO:teuthology.orchestra.run.trial095.stdout: debug seastore cleaner = 20 2026-02-20T11:39:58.667 INFO:teuthology.orchestra.run.trial095.stdout: debug seastore device = 20 2026-02-20T11:39:58.667 INFO:teuthology.orchestra.run.trial095.stdout: debug seastore epm = 20 2026-02-20T11:39:58.667 INFO:teuthology.orchestra.run.trial095.stdout: debug seastore fixedkv tree = 20 2026-02-20T11:39:58.667 INFO:teuthology.orchestra.run.trial095.stdout: debug seastore journal = 20 2026-02-20T11:39:58.667 INFO:teuthology.orchestra.run.trial095.stdout: debug seastore lba = 20 2026-02-20T11:39:58.667 INFO:teuthology.orchestra.run.trial095.stdout: debug seastore odata = 20 2026-02-20T11:39:58.667 INFO:teuthology.orchestra.run.trial095.stdout: debug seastore omap = 20 2026-02-20T11:39:58.667 INFO:teuthology.orchestra.run.trial095.stdout: debug seastore onode = 20 2026-02-20T11:39:58.667 INFO:teuthology.orchestra.run.trial095.stdout: debug seastore t = 20 2026-02-20T11:39:58.667 INFO:teuthology.orchestra.run.trial095.stdout: debug seastore tm = 20 2026-02-20T11:39:58.667 INFO:teuthology.orchestra.run.trial095.stdout: osd objectstore = seastore 2026-02-20T11:39:58.668 INFO:teuthology.orchestra.run.trial095.stdout: osd shutdown pgref assert = True 2026-02-20T11:39:58.668 INFO:teuthology.orchestra.run.trial095.stdout: seastore cachepin size pershard = 64M 2026-02-20T11:39:58.668 INFO:teuthology.orchestra.run.trial095.stdout: seastore cachepin type = 2Q 2026-02-20T11:39:58.668 INFO:teuthology.orchestra.run.trial095.stdout: seastore max concurrent transactions = 8 2026-02-20T11:39:58.668 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.668 INFO:teuthology.orchestra.run.trial095.stdout:[mgr] 2026-02-20T11:39:58.668 INFO:teuthology.orchestra.run.trial095.stdout: debug ms = 1 2026-02-20T11:39:58.668 INFO:teuthology.orchestra.run.trial095.stdout: debug mgr = 20 2026-02-20T11:39:58.668 INFO:teuthology.orchestra.run.trial095.stdout: debug mon = 20 2026-02-20T11:39:58.668 INFO:teuthology.orchestra.run.trial095.stdout: debug auth = 20 2026-02-20T11:39:58.668 INFO:teuthology.orchestra.run.trial095.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:39:58.668 INFO:teuthology.orchestra.run.trial095.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:39:58.669 INFO:teuthology.orchestra.run.trial095.stdout: mgr/telemetry/nag = false 2026-02-20T11:39:58.669 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.669 INFO:teuthology.orchestra.run.trial095.stdout:[mon] 2026-02-20T11:39:58.669 INFO:teuthology.orchestra.run.trial095.stdout: debug ms = 0/0 2026-02-20T11:39:58.669 INFO:teuthology.orchestra.run.trial095.stdout: debug mon = 0/0 2026-02-20T11:39:58.669 INFO:teuthology.orchestra.run.trial095.stdout: debug paxos = 0/0 2026-02-20T11:39:58.669 INFO:teuthology.orchestra.run.trial095.stdout: debug auth = 20 2026-02-20T11:39:58.669 INFO:teuthology.orchestra.run.trial095.stdout: mon data avail warn = 5 2026-02-20T11:39:58.669 INFO:teuthology.orchestra.run.trial095.stdout: mon mgr mkfs grace = 240 2026-02-20T11:39:58.669 INFO:teuthology.orchestra.run.trial095.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:39:58.669 INFO:teuthology.orchestra.run.trial095.stdout: mon osd reporter subtree level = osd 2026-02-20T11:39:58.669 INFO:teuthology.orchestra.run.trial095.stdout: mon osd prime pg temp = true 2026-02-20T11:39:58.669 INFO:teuthology.orchestra.run.trial095.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:39:58.670 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.670 INFO:teuthology.orchestra.run.trial095.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-20T11:39:58.670 INFO:teuthology.orchestra.run.trial095.stdout: auth mon ticket ttl = 660 # 11m 2026-02-20T11:39:58.670 INFO:teuthology.orchestra.run.trial095.stdout: auth service ticket ttl = 240 # 4m 2026-02-20T11:39:58.670 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.670 INFO:teuthology.orchestra.run.trial095.stdout: # don't complain about insecure global_id in the test suite 2026-02-20T11:39:58.670 INFO:teuthology.orchestra.run.trial095.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-20T11:39:58.670 INFO:teuthology.orchestra.run.trial095.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-20T11:39:58.670 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.670 INFO:teuthology.orchestra.run.trial095.stdout: # 1m isn't quite enough 2026-02-20T11:39:58.670 INFO:teuthology.orchestra.run.trial095.stdout: mon_down_mkfs_grace = 2m 2026-02-20T11:39:58.670 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.670 INFO:teuthology.orchestra.run.trial095.stdout: mon_warn_on_filestore_osds = false 2026-02-20T11:39:58.671 INFO:teuthology.orchestra.run.trial095.stdout: osd pool default crimson = True 2026-02-20T11:39:58.671 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:39:58.671 INFO:teuthology.orchestra.run.trial095.stdout:[client] 2026-02-20T11:39:58.671 INFO:teuthology.orchestra.run.trial095.stdout: rgw cache enabled = true 2026-02-20T11:39:58.671 INFO:teuthology.orchestra.run.trial095.stdout: rgw enable ops log = true 2026-02-20T11:39:58.671 INFO:teuthology.orchestra.run.trial095.stdout: rgw enable usage log = true 2026-02-20T11:39:58.671 INFO:teuthology.orchestra.run.trial095.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-20T11:39:58.671 INFO:teuthology.orchestra.run.trial095.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-20T11:39:58.671 INFO:teuthology.orchestra.run.trial095.stdout:[mon.a] 2026-02-20T11:39:58.672 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-20T11:39:58.673 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-20T11:39:58.764 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-20T11:39:58.764 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:39:58.764 DEBUG:teuthology.orchestra.run.trial095:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-20T11:39:58.781 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:39:58.782 DEBUG:teuthology.orchestra.run.trial095:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-20T11:39:58.837 INFO:tasks.ceph:Sending monmap to node ubuntu@trial095.front.sepia.ceph.com 2026-02-20T11:39:58.838 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:39:58.838 DEBUG:teuthology.orchestra.run.trial095:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-20T11:39:58.838 DEBUG:teuthology.orchestra.run.trial095:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T11:39:58.910 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:39:58.911 DEBUG:teuthology.orchestra.run.trial095:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:39:58.968 INFO:tasks.ceph:Setting up mon nodes... 2026-02-20T11:39:58.968 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-20T11:39:58.969 DEBUG:teuthology.orchestra.run.trial095:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T11:39:59.059 INFO:teuthology.orchestra.run.trial095.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T11:39:59.062 INFO:tasks.ceph:Setting up mds nodes... 2026-02-20T11:39:59.062 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-20T11:39:59.062 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-20T11:39:59.103 INFO:teuthology.orchestra.run.trial095.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-20T11:39:59.115 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-20T11:39:59.116 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial095.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-20T11:39:59.116 DEBUG:teuthology.orchestra.run.trial095:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-20T11:39:59.180 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-20T11:39:59.180 INFO:tasks.ceph:role: osd.0 2026-02-20T11:39:59.181 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial095.front.sepia.ceph.com 2026-02-20T11:39:59.181 DEBUG:teuthology.orchestra.run.trial095:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-20T11:39:59.247 INFO:teuthology.orchestra.run.trial095.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:39:59.247 INFO:teuthology.orchestra.run.trial095.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:39:59.247 INFO:teuthology.orchestra.run.trial095.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:39:59.247 INFO:teuthology.orchestra.run.trial095.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:39:59.247 INFO:teuthology.orchestra.run.trial095.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:39:59.247 INFO:teuthology.orchestra.run.trial095.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:39:59.247 INFO:teuthology.orchestra.run.trial095.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:39:59.247 INFO:teuthology.orchestra.run.trial095.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:39:59.248 INFO:teuthology.orchestra.run.trial095.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:39:59.248 INFO:teuthology.orchestra.run.trial095.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:39:59.868 INFO:teuthology.orchestra.run.trial095.stdout:Discarding blocks...Done. 2026-02-20T11:39:59.870 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial095.front.sepia.ceph.com -o noatime 2026-02-20T11:39:59.870 DEBUG:teuthology.orchestra.run.trial095:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-20T11:39:59.941 DEBUG:teuthology.orchestra.run.trial095:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-20T11:40:00.007 DEBUG:teuthology.orchestra.run.trial095:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-20T11:40:00.072 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-20T11:40:00.072 INFO:tasks.ceph:role: osd.1 2026-02-20T11:40:00.072 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial095.front.sepia.ceph.com 2026-02-20T11:40:00.072 DEBUG:teuthology.orchestra.run.trial095:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-20T11:40:00.138 INFO:teuthology.orchestra.run.trial095.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:40:00.138 INFO:teuthology.orchestra.run.trial095.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:40:00.138 INFO:teuthology.orchestra.run.trial095.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:40:00.138 INFO:teuthology.orchestra.run.trial095.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:40:00.138 INFO:teuthology.orchestra.run.trial095.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:40:00.139 INFO:teuthology.orchestra.run.trial095.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:40:00.139 INFO:teuthology.orchestra.run.trial095.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:40:00.139 INFO:teuthology.orchestra.run.trial095.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:40:00.139 INFO:teuthology.orchestra.run.trial095.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:40:00.139 INFO:teuthology.orchestra.run.trial095.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:40:00.713 INFO:teuthology.orchestra.run.trial095.stdout:Discarding blocks...Done. 2026-02-20T11:40:00.715 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial095.front.sepia.ceph.com -o noatime 2026-02-20T11:40:00.715 DEBUG:teuthology.orchestra.run.trial095:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-20T11:40:00.783 DEBUG:teuthology.orchestra.run.trial095:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-20T11:40:00.849 DEBUG:teuthology.orchestra.run.trial095:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-20T11:40:00.913 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-20T11:40:00.913 INFO:tasks.ceph:role: osd.2 2026-02-20T11:40:00.913 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial095.front.sepia.ceph.com 2026-02-20T11:40:00.913 DEBUG:teuthology.orchestra.run.trial095:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-20T11:40:00.979 INFO:teuthology.orchestra.run.trial095.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:40:00.979 INFO:teuthology.orchestra.run.trial095.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:40:00.979 INFO:teuthology.orchestra.run.trial095.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:40:00.979 INFO:teuthology.orchestra.run.trial095.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:40:00.979 INFO:teuthology.orchestra.run.trial095.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:40:00.979 INFO:teuthology.orchestra.run.trial095.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:40:00.979 INFO:teuthology.orchestra.run.trial095.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:40:00.979 INFO:teuthology.orchestra.run.trial095.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:40:00.979 INFO:teuthology.orchestra.run.trial095.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:40:00.980 INFO:teuthology.orchestra.run.trial095.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:40:01.589 INFO:teuthology.orchestra.run.trial095.stdout:Discarding blocks...Done. 2026-02-20T11:40:01.591 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial095.front.sepia.ceph.com -o noatime 2026-02-20T11:40:01.591 DEBUG:teuthology.orchestra.run.trial095:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-20T11:40:01.659 DEBUG:teuthology.orchestra.run.trial095:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-20T11:40:01.726 DEBUG:teuthology.orchestra.run.trial095:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:40:01.877 INFO:teuthology.orchestra.run.trial095.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:40:01.938 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:01,937 seastar - Reactor backend: linux-aio 2026-02-20T11:40:01.948 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:01,946 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:40:01.948 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:01,946 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:40:01.950 INFO:teuthology.orchestra.run.trial095.stderr:==39019==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:40:02.009 INFO:teuthology.orchestra.run.trial095.stderr:DEBUG 2026-02-20 11:40:02,008 [shard 0:main] seastar - reactor::drain 2026-02-20T11:40:04.078 INFO:teuthology.orchestra.run.trial095.stderr:----------------------------------------------------- 2026-02-20T11:40:04.078 INFO:teuthology.orchestra.run.trial095.stderr:Suppressions used: 2026-02-20T11:40:04.079 INFO:teuthology.orchestra.run.trial095.stderr: count bytes template 2026-02-20T11:40:04.079 INFO:teuthology.orchestra.run.trial095.stderr: 1 8 MallocExtension::Register 2026-02-20T11:40:04.079 INFO:teuthology.orchestra.run.trial095.stderr:----------------------------------------------------- 2026-02-20T11:40:04.079 INFO:teuthology.orchestra.run.trial095.stderr: 2026-02-20T11:40:04.098 INFO:teuthology.orchestra.run.trial095.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:40:04.098 INFO:teuthology.orchestra.run.trial095.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:40:04.144 INFO:teuthology.orchestra.run.trial095.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:40:04.144 INFO:teuthology.orchestra.run.trial095.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:40:04.151 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:04,149 seastar - Reactor backend: linux-aio 2026-02-20T11:40:04.162 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:04,160 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:40:04.162 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:04,160 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:40:04.166 INFO:teuthology.orchestra.run.trial095.stderr:==39017==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:40:04.166 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:04,164 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:40:04.306 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1586f 0x10a3723 0xf4865a 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e20729 0x9e2f237 0x9e2f649 0x9f0762a 0x9f07a5e 0x9f07df1 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:04.307 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xb1383 0xb7b689 0x10a36ac 0xf4865a 0x9e22cec 0x9e2362b 0x9f16b01 0x9f17a21 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:04.307 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65d8 /lib64/libasan.so.8+0x15197 0x1138fc8 0xf4864f 0x9e22cec 0x9e22f99 0x9f17991 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:04.339 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0xccaa52 0x1138f5f 0xf4864f 0x9e21fb0 0x9e228ef 0x9f13d3d 0x9f1e423 0x78bcf19 0x7b9d4a5 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f76cf2 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:40:04.409 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297ad /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:40:04.446 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cc0c /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:04.446 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6585 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:04.446 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d88f6 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:04.572 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9e1ebd5 0x9e1f27a 0x9e27721 0x9e27e01 0x9f17e54 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:04.573 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15835 0x10a3723 0xf4865a 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:04.573 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0xe2a875 0x1138f71 0xf4864f 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f27a 0x9e27721 0x9e27e01 0x9f17e54 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:04.655 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d78fb 0x7d69b08 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:40:04.670 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d79b5 0x7d69b08 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:04.671 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:04.671 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1521e 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:06.846 INFO:teuthology.orchestra.run.trial095.stderr:----------------------------------------------------- 2026-02-20T11:40:06.847 INFO:teuthology.orchestra.run.trial095.stderr:Suppressions used: 2026-02-20T11:40:06.847 INFO:teuthology.orchestra.run.trial095.stderr: count bytes template 2026-02-20T11:40:06.847 INFO:teuthology.orchestra.run.trial095.stderr: 1 8 MallocExtension::Register 2026-02-20T11:40:06.847 INFO:teuthology.orchestra.run.trial095.stderr:----------------------------------------------------- 2026-02-20T11:40:06.847 INFO:teuthology.orchestra.run.trial095.stderr: 2026-02-20T11:40:06.884 DEBUG:teuthology.orchestra.run.trial095:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-20T11:40:06.909 DEBUG:teuthology.orchestra.run.trial095:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:40:07.059 INFO:teuthology.orchestra.run.trial095.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:40:07.116 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:07,114 seastar - Reactor backend: linux-aio 2026-02-20T11:40:07.127 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:07,125 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:40:07.127 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:07,125 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:40:07.129 INFO:teuthology.orchestra.run.trial095.stderr:==39089==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:40:07.162 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x35543a6 0x35544ba 0x35545d9 0x350ae22 0x350b1ce 0x350b414 0x350b4ed 0x355f970 0x35d38e1 0x35d3f54 0x360c21f 0x360c51a 0x360c8b7 0x360cc16 0x360cd4c 0x35fa172 0x35fe2d5 0x35fe58e 0x35ff6b3 0x35ff9f3 0x361e13f 0x361e4d1 0x361e804 0x361eb61 0x361ed99 0x361f3d4 0x361f704 0x361fa6a 0x361ff17 0x3620356 0x35ffbf2 0x3600001 0x36002b8 0x3600409 0x3624bcc 0x3624f57 0x362528a 0x362577d 0x3625b5f 0x3625ceb 0x3626123 0x362648f 0x36267f4 0x3626b17 0x3626bf9 0x3626e87 0x362705e 0x36272c5 0x362757b 0x3627ccb 0x36281b7 0x3628531 0x36287b0 0x3628865 0x350a512 0x35e3799 0x35e3dd3 0x350a512 0x350a921 0x350abd8 0x350b6d9 0x3520d3b 0x33d614b 0x45f3998 0x467ed29 0x46801d1 0x4680256 0x4680358 0x4680450 0x468065b 0x4680841 0x46808bc 0x4680937 0x46809b2 0x468131f 0x46816c0 0x46818eb 0x4681b52 0x4681e1d 0x468203b 0x46820f3 0x46821ab 0x4682264 0x468231c 0x46823e2 0x46824c3 0x30ae778 0x30ae87e 0x30ae936 0x30ae9ee 0x30aeaa6 2026-02-20T11:40:07.188 INFO:teuthology.orchestra.run.trial095.stderr:DEBUG 2026-02-20 11:40:07,187 [shard 0:main] seastar - reactor::drain 2026-02-20T11:40:09.237 INFO:teuthology.orchestra.run.trial095.stderr:----------------------------------------------------- 2026-02-20T11:40:09.238 INFO:teuthology.orchestra.run.trial095.stderr:Suppressions used: 2026-02-20T11:40:09.238 INFO:teuthology.orchestra.run.trial095.stderr: count bytes template 2026-02-20T11:40:09.238 INFO:teuthology.orchestra.run.trial095.stderr: 1 8 MallocExtension::Register 2026-02-20T11:40:09.238 INFO:teuthology.orchestra.run.trial095.stderr:----------------------------------------------------- 2026-02-20T11:40:09.238 INFO:teuthology.orchestra.run.trial095.stderr: 2026-02-20T11:40:09.259 INFO:teuthology.orchestra.run.trial095.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:40:09.259 INFO:teuthology.orchestra.run.trial095.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:40:09.305 INFO:teuthology.orchestra.run.trial095.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:40:09.305 INFO:teuthology.orchestra.run.trial095.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:40:09.312 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:09,310 seastar - Reactor backend: linux-aio 2026-02-20T11:40:09.323 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:09,321 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:40:09.323 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:09,321 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:40:09.327 INFO:teuthology.orchestra.run.trial095.stderr:==39087==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:40:09.327 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:09,325 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:40:09.468 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297e4 /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x157c7 0x10a3723 0xf4865a 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f767 0x9e1fc65 0x9e20295 0x9e203ff 0x9f07c75 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:09.468 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9e1e56c 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f767 0x9e1fc65 0x9e20295 0x9e203ff 0x9f07c75 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:09.468 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x9cf0b5b 0x9d70916 0x9d70a2c 0x9d70b08 0x9d711c4 0x9d70e3d 0x9d7132b 0x9d7172f 0x9d719ec 0x9f1a6cd 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:09.468 INFO:teuthology.orchestra.run.trial095.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffa241f6b4 0xffffffffa241fb20 0xffffffffa229525e 0xffffffffa25e61a9 0xffffffffa25c9715 0xffffffffa25d3aeb 0xffffffffa25d3f4b 0xffffffffa22910d2 0xffffffffa2f4d451 0xffffffffa3000ba2 2026-02-20T11:40:09.500 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0xe13e74 0xe781c3 0xe78474 0xe78603 0x9c3357d 0x9640ae3 0x9640c44 0x7a42984 0x718b8df 0x6f76cf2 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:40:09.542 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15829 0x10a3723 0xf4865a 0x9e22cec 0x9e22f99 0x9f17991 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7f67185 0x7fb45b4 0x911dcdf 0x912064d 0x7862725 0x7a52d48 0x6f770d1 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:09.567 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297db /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:40:09.607 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d79ec 0x7d69b08 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:09.608 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d8815 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:09.608 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d780d 0x7d69b08 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:09.729 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xb04ab /lib64/libasan.so.8+0xb1437 0xb7b689 0x10a36ac 0xf4865a 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e20729 0x9f0b8b2 0x9f0d258 0x9f0d8b2 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:09.729 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x9cf0b5b 0x9d70916 0x9d70a2c 0x9d70b08 0x9d711c4 0x9d70e3d 0x9d7132b 0x9d7172f 0x9d719ec 0x9d72834 0x9ef0163 0x9ef025d 0x7b9c6c3 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:09.729 INFO:teuthology.orchestra.run.trial095.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffa241f8c2 0xffffffffa241fb20 0xffffffffa229525e 0xffffffffa25e61a9 0xffffffffa25c9715 0xffffffffa25d3aeb 0xffffffffa25d3f4b 0xffffffffa22910d2 0xffffffffa2f4d451 0xffffffffa3000ba2 2026-02-20T11:40:09.730 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x16b364 /lib64/libasan.so.8+0xb0541 /lib64/libasan.so.8+0xb1437 0xb7b689 0x10a36ac 0xf4865a 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:09.812 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xf4e9a /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:40:09.827 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x297f446 0x29d89ca 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:09.828 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x151f5 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:09.828 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x129787 /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:11.949 INFO:teuthology.orchestra.run.trial095.stderr:----------------------------------------------------- 2026-02-20T11:40:11.949 INFO:teuthology.orchestra.run.trial095.stderr:Suppressions used: 2026-02-20T11:40:11.949 INFO:teuthology.orchestra.run.trial095.stderr: count bytes template 2026-02-20T11:40:11.949 INFO:teuthology.orchestra.run.trial095.stderr: 1 8 MallocExtension::Register 2026-02-20T11:40:11.949 INFO:teuthology.orchestra.run.trial095.stderr:----------------------------------------------------- 2026-02-20T11:40:11.949 INFO:teuthology.orchestra.run.trial095.stderr: 2026-02-20T11:40:11.985 DEBUG:teuthology.orchestra.run.trial095:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-20T11:40:12.010 DEBUG:teuthology.orchestra.run.trial095:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:40:12.161 INFO:teuthology.orchestra.run.trial095.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:40:12.226 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:12,224 seastar - Reactor backend: linux-aio 2026-02-20T11:40:12.244 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:12,242 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:40:12.244 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:12,242 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:40:12.246 INFO:teuthology.orchestra.run.trial095.stderr:==39154==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:40:12.306 INFO:teuthology.orchestra.run.trial095.stderr:DEBUG 2026-02-20 11:40:12,304 [shard 0:main] seastar - reactor::drain 2026-02-20T11:40:14.365 INFO:teuthology.orchestra.run.trial095.stderr:----------------------------------------------------- 2026-02-20T11:40:14.365 INFO:teuthology.orchestra.run.trial095.stderr:Suppressions used: 2026-02-20T11:40:14.365 INFO:teuthology.orchestra.run.trial095.stderr: count bytes template 2026-02-20T11:40:14.365 INFO:teuthology.orchestra.run.trial095.stderr: 1 8 MallocExtension::Register 2026-02-20T11:40:14.365 INFO:teuthology.orchestra.run.trial095.stderr:----------------------------------------------------- 2026-02-20T11:40:14.365 INFO:teuthology.orchestra.run.trial095.stderr: 2026-02-20T11:40:14.385 INFO:teuthology.orchestra.run.trial095.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:40:14.385 INFO:teuthology.orchestra.run.trial095.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:40:14.430 INFO:teuthology.orchestra.run.trial095.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:40:14.430 INFO:teuthology.orchestra.run.trial095.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:40:14.436 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:14,435 seastar - Reactor backend: linux-aio 2026-02-20T11:40:14.449 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:14,447 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:40:14.449 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:14,447 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:40:14.453 INFO:teuthology.orchestra.run.trial095.stderr:==39152==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:40:14.453 INFO:teuthology.orchestra.run.trial095.stderr:INFO 2026-02-20 11:40:14,451 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:40:14.595 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x1138ef9 0xf4864f 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e20729 0x9f0b606 0x9f0d258 0x9f0d8b2 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:14.595 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x151f5 0x30f33e2 0x4cb11cb 0x9efa8f3 0x9efaa98 0x9efaf8c 0x9f17817 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:14.595 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x10a35bf 0xf4865a 0x9e22cec 0x9e22f99 0x9f17991 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:14.627 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x91675fd 0x7a42cf7 0x718b8df 0x6f76cf2 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:40:14.669 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9e68cfa 0x9edc862 0x9f1e43e 0x78bcf19 0x7ba12bf 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f76cf2 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:14.670 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cc0c /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x157c7 0x10a3723 0xf4865a 0x9e22cec 0x9e22f99 0x9f17991 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b8bc1a 0x7ba0607 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f76cf2 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:14.694 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d88f6 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:40:14.735 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65c6 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:14.736 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297e4 /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:14.738 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d7d3d 0x7d69b1d 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:14.866 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x7841f41 0x9f1e4e1 0x78bcf19 0x7b9c081 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:14.866 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xb051b /lib64/libasan.so.8+0xb1437 0xb7b689 0x10a36ac 0xf4865a 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:14.866 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1294d2 /lib64/libasan.so.8+0x1297ad /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x359d229 0x9e30705 0x9e3089d 0x9ef7d44 0x9ef7ed9 0x9ef826b 0x9ef9851 0x9efab6c 0x9efaf8c 0x9f17817 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:14.932 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d7df9 0x7d69b1d 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:14.949 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x361f /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:40:14.965 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d835f 0x7d69b2a 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:14.965 INFO:teuthology.orchestra.run.trial095.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d7998 0x7d69b08 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:40:17.123 INFO:teuthology.orchestra.run.trial095.stderr:----------------------------------------------------- 2026-02-20T11:40:17.123 INFO:teuthology.orchestra.run.trial095.stderr:Suppressions used: 2026-02-20T11:40:17.123 INFO:teuthology.orchestra.run.trial095.stderr: count bytes template 2026-02-20T11:40:17.124 INFO:teuthology.orchestra.run.trial095.stderr: 1 8 MallocExtension::Register 2026-02-20T11:40:17.124 INFO:teuthology.orchestra.run.trial095.stderr:----------------------------------------------------- 2026-02-20T11:40:17.124 INFO:teuthology.orchestra.run.trial095.stderr: 2026-02-20T11:40:17.161 DEBUG:teuthology.orchestra.run.trial095:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-20T11:40:17.186 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-20T11:40:17.187 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:40:17.187 DEBUG:teuthology.orchestra.run.trial095:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-20T11:40:17.251 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:40:17.251 DEBUG:teuthology.orchestra.run.trial095:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-20T11:40:17.317 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:40:17.317 DEBUG:teuthology.orchestra.run.trial095:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-20T11:40:17.380 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:40:17.380 DEBUG:teuthology.orchestra.run.trial095:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-20T11:40:17.445 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:40:17.445 DEBUG:teuthology.orchestra.run.trial095:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-20T11:40:17.501 INFO:tasks.ceph:Adding keys to all mons... 2026-02-20T11:40:17.501 DEBUG:teuthology.orchestra.run.trial095:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-20T11:40:17.562 INFO:teuthology.orchestra.run.trial095.stdout:[mgr.x] 2026-02-20T11:40:17.563 INFO:teuthology.orchestra.run.trial095.stdout: key = AQAPSJhpXkZtAxAAPVUoEOuazJhL0BrKkbMzGQ== 2026-02-20T11:40:17.563 INFO:teuthology.orchestra.run.trial095.stdout:[osd.0] 2026-02-20T11:40:17.563 INFO:teuthology.orchestra.run.trial095.stdout: key = AQAUSJhpkdObDRAA7BVAd/HnJr6VrjFI/q4KLQ== 2026-02-20T11:40:17.563 INFO:teuthology.orchestra.run.trial095.stdout:[osd.1] 2026-02-20T11:40:17.563 INFO:teuthology.orchestra.run.trial095.stdout: key = AQAZSJhpaAwuFxAA6snd8P5Hl8pkxYP38j4n9A== 2026-02-20T11:40:17.563 INFO:teuthology.orchestra.run.trial095.stdout:[osd.2] 2026-02-20T11:40:17.563 INFO:teuthology.orchestra.run.trial095.stdout: key = AQAeSJhpIV+7HhAAqfDH4RkbDQ9sPSVJ5QmWqg== 2026-02-20T11:40:17.563 INFO:teuthology.orchestra.run.trial095.stdout:[client.0] 2026-02-20T11:40:17.563 INFO:teuthology.orchestra.run.trial095.stdout: key = AQAPSJhp6L4TBhAAQgo/EFXJ1cnxy2o7qFSABA== 2026-02-20T11:40:17.565 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-20T11:40:17.654 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:40:17.701 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:40:17.749 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:40:17.798 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-20T11:40:17.848 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-20T11:40:17.848 DEBUG:teuthology.orchestra.run.trial095:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-20T11:40:17.873 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-20T11:40:17.958 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:17.956+0000 7f147c034c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:17.959 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:17.956+0000 7f147c034c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:17.966 DEBUG:teuthology.orchestra.run.trial095:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-20T11:40:17.991 DEBUG:teuthology.orchestra.run.trial095:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:40:18.048 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-20T11:40:18.048 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-20T11:40:18.048 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-20T11:40:18.089 INFO:tasks.ceph.mon.a:Started 2026-02-20T11:40:18.090 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-20T11:40:18.090 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-20T11:40:18.090 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-20T11:40:18.092 INFO:tasks.ceph.mgr.x:Started 2026-02-20T11:40:18.093 DEBUG:tasks.ceph:set 0 configs 2026-02-20T11:40:18.093 DEBUG:teuthology.orchestra.run.trial095:> sudo ceph --cluster ceph config dump 2026-02-20T11:40:18.153 INFO:tasks.ceph.mon.a.trial095.stderr:2026-02-20T11:40:18.150+0000 7fc150eb0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:18.153 INFO:tasks.ceph.mon.a.trial095.stderr:2026-02-20T11:40:18.150+0000 7fc150eb0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:18.153 INFO:tasks.ceph.mon.a.trial095.stderr:2026-02-20T11:40:18.151+0000 7fc150eb0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:18.158 INFO:tasks.ceph.mgr.x.trial095.stderr:2026-02-20T11:40:18.155+0000 7f7b5f024fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:18.167 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:18.163+0000 7fcddeecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:18.169 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:18.167+0000 7fcddeecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:18.201 INFO:teuthology.orchestra.run.trial095.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-20T11:40:18.208 INFO:tasks.ceph:Setting crush tunables to default 2026-02-20T11:40:18.209 DEBUG:teuthology.orchestra.run.trial095:> sudo ceph --cluster ceph osd crush tunables default 2026-02-20T11:40:18.282 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:18.277+0000 7f50aff5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:18.284 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:18.281+0000 7f50aff5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:18.317 INFO:teuthology.orchestra.run.trial095.stderr:adjusted tunables profile to default 2026-02-20T11:40:18.327 INFO:tasks.ceph:check_enable_crimson: True 2026-02-20T11:40:18.328 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-20T11:40:18.328 DEBUG:teuthology.orchestra.run.trial095:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-20T11:40:18.360 INFO:tasks.ceph.mgr.x.trial095.stderr:2026-02-20T11:40:18.358+0000 7f7b5f024fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:18.361 INFO:tasks.ceph.mgr.x.trial095.stderr:2026-02-20T11:40:18.358+0000 7f7b5f024fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:18.402 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:18.397+0000 7f87b0acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:18.403 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:18.401+0000 7f87b0acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:18.440 INFO:tasks.ceph.mon.a.trial095.stderr:2026-02-20T11:40:18.438+0000 7fc1485f1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-20T11:40:18.440 INFO:tasks.ceph.mon.a.trial095.stderr:Please be aware that this feature is experimental, untested, 2026-02-20T11:40:18.440 INFO:tasks.ceph.mon.a.trial095.stderr:unsupported, and may result in data corruption, data loss, 2026-02-20T11:40:18.440 INFO:tasks.ceph.mon.a.trial095.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-20T11:40:18.440 INFO:tasks.ceph.mon.a.trial095.stderr:feature with important data. 2026-02-20T11:40:18.440 INFO:tasks.ceph.mon.a.trial095.stderr: 2026-02-20T11:40:19.196 INFO:tasks.ceph.mgr.x.trial095.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T11:40:19.196 INFO:tasks.ceph.mgr.x.trial095.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T11:40:19.196 INFO:tasks.ceph.mgr.x.trial095.stderr: from numpy import show_config as show_numpy_config 2026-02-20T11:40:19.328 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-20T11:40:19.328 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:40:19.328 DEBUG:teuthology.orchestra.run.trial095:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-20T11:40:19.392 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:40:19.393 DEBUG:teuthology.orchestra.run.trial095:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-20T11:40:19.455 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:40:19.455 DEBUG:teuthology.orchestra.run.trial095:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-20T11:40:19.520 DEBUG:teuthology.orchestra.run.trial095:> sudo ceph --cluster ceph osd new f6f7b362-2d6f-43ce-b41d-522cb36797aa 0 2026-02-20T11:40:19.633 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:19.628+0000 7f6128a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:19.634 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:19.632+0000 7f6128a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:19.671 INFO:teuthology.orchestra.run.trial095.stdout:0 2026-02-20T11:40:19.679 DEBUG:teuthology.orchestra.run.trial095:> sudo ceph --cluster ceph osd new 2fbd1ae9-5ba5-4141-8939-6527a6272584 1 2026-02-20T11:40:19.754 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:19.749+0000 7fb3269dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:19.756 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:19.753+0000 7fb3269dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:19.792 INFO:teuthology.orchestra.run.trial095.stdout:1 2026-02-20T11:40:19.801 DEBUG:teuthology.orchestra.run.trial095:> sudo ceph --cluster ceph osd new 095a133b-01d5-4ff0-ad50-af5bd6fc7575 2 2026-02-20T11:40:19.877 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:19.871+0000 7f82e970b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:19.878 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:19.876+0000 7f82e970b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:19.915 INFO:teuthology.orchestra.run.trial095.stdout:2 2026-02-20T11:40:19.924 DEBUG:teuthology.orchestra.run.trial095:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-20T11:40:19.953 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-20T11:40:19.953 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-20T11:40:19.995 INFO:tasks.ceph.osd.0:Started 2026-02-20T11:40:19.995 DEBUG:teuthology.orchestra.run.trial095:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-20T11:40:20.024 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-20T11:40:20.024 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-20T11:40:20.066 INFO:tasks.ceph.osd.1:Started 2026-02-20T11:40:20.066 DEBUG:teuthology.orchestra.run.trial095:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-20T11:40:20.092 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-20T11:40:20.093 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-20T11:40:20.136 INFO:tasks.ceph.osd.2:Started 2026-02-20T11:40:20.136 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:40:20.212 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:20.207+0000 7f6757a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:20.213 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:20.210+0000 7f6757a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:20.244 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:40:20.245 INFO:teuthology.orchestra.run.trial095.stdout:{"epoch":6,"fsid":"c325c6cc-b5e6-4605-89e5-d4f698fcae7d","created":"2026-02-20T11:40:18.161861+0000","modified":"2026-02-20T11:40:19.913206+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T11:40:19.913206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"f6f7b362-2d6f-43ce-b41d-522cb36797aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2fbd1ae9-5ba5-4141-8939-6527a6272584","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"095a133b-01d5-4ff0-ad50-af5bd6fc7575","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:40:20.253 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-20T11:40:20.253 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-20T11:40:20.555 DEBUG:teuthology.orchestra.run.trial095:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T11:40:20.623 INFO:teuthology.misc.health.trial095.stderr:2026-02-20T11:40:20.618+0000 7facbe65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:20.624 INFO:teuthology.misc.health.trial095.stderr:2026-02-20T11:40:20.621+0000 7facbe65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:20.655 INFO:teuthology.misc.health.trial095.stdout: 2026-02-20T11:40:20.655 INFO:teuthology.misc.health.trial095.stdout:{"epoch":6,"fsid":"c325c6cc-b5e6-4605-89e5-d4f698fcae7d","created":"2026-02-20T11:40:18.161861+0000","modified":"2026-02-20T11:40:19.913206+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T11:40:19.913206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"f6f7b362-2d6f-43ce-b41d-522cb36797aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2fbd1ae9-5ba5-4141-8939-6527a6272584","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"095a133b-01d5-4ff0-ad50-af5bd6fc7575","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:40:20.663 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-20T11:40:21.596 INFO:tasks.ceph.mgr.x.trial095.stderr:2026-02-20T11:40:21.593+0000 7f7a79fce640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-20T11:40:26.965 DEBUG:teuthology.orchestra.run.trial095:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T11:40:27.039 INFO:teuthology.misc.health.trial095.stderr:2026-02-20T11:40:27.034+0000 7f95a885a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:27.040 INFO:teuthology.misc.health.trial095.stderr:2026-02-20T11:40:27.038+0000 7f95a885a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:27.161 INFO:teuthology.misc.health.trial095.stdout: 2026-02-20T11:40:27.161 INFO:teuthology.misc.health.trial095.stdout:{"epoch":8,"fsid":"c325c6cc-b5e6-4605-89e5-d4f698fcae7d","created":"2026-02-20T11:40:18.161861+0000","modified":"2026-02-20T11:40:26.694181+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T11:40:19.913206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"f6f7b362-2d6f-43ce-b41d-522cb36797aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2fbd1ae9-5ba5-4141-8939-6527a6272584","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"095a133b-01d5-4ff0-ad50-af5bd6fc7575","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:40:27.173 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-20T11:40:33.475 DEBUG:teuthology.orchestra.run.trial095:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T11:40:33.545 INFO:teuthology.misc.health.trial095.stderr:2026-02-20T11:40:33.541+0000 7f66586cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:33.547 INFO:teuthology.misc.health.trial095.stderr:2026-02-20T11:40:33.544+0000 7f66586cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:33.658 INFO:teuthology.misc.health.trial095.stdout: 2026-02-20T11:40:33.658 INFO:teuthology.misc.health.trial095.stdout:{"epoch":14,"fsid":"c325c6cc-b5e6-4605-89e5-d4f698fcae7d","created":"2026-02-20T11:40:18.161861+0000","modified":"2026-02-20T11:40:32.708673+0000","last_up_change":"2026-02-20T11:40:29.695994+0000","last_in_change":"2026-02-20T11:40:19.913206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T11:40:30.603915+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6f7b362-2d6f-43ce-b41d-522cb36797aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6809","nonce":1127151553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6804","nonce":1127151553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6813","nonce":1127151553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6812","nonce":1127151553}]},"public_addr":"10.20.193.95:6809/1127151553","cluster_addr":"10.20.193.95:6804/1127151553","heartbeat_back_addr":"10.20.193.95:6813/1127151553","heartbeat_front_addr":"10.20.193.95:6812/1127151553","state":["exists","up"]},{"osd":1,"uuid":"2fbd1ae9-5ba5-4141-8939-6527a6272584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6806","nonce":1963712620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6807","nonce":1963712620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6805","nonce":1963712620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6808","nonce":1963712620}]},"public_addr":"10.20.193.95:6806/1963712620","cluster_addr":"10.20.193.95:6807/1963712620","heartbeat_back_addr":"10.20.193.95:6805/1963712620","heartbeat_front_addr":"10.20.193.95:6808/1963712620","state":["exists","up"]},{"osd":2,"uuid":"095a133b-01d5-4ff0-ad50-af5bd6fc7575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6803","nonce":2870357775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6802","nonce":2870357775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6811","nonce":2870357775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6810","nonce":2870357775}]},"public_addr":"10.20.193.95:6803/2870357775","cluster_addr":"10.20.193.95:6802/2870357775","heartbeat_back_addr":"10.20.193.95:6811/2870357775","heartbeat_front_addr":"10.20.193.95:6810/2870357775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:40:33.666 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-20T11:40:33.666 INFO:tasks.ceph:Creating RBD pool 2026-02-20T11:40:33.667 DEBUG:teuthology.orchestra.run.trial095:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-20T11:40:33.741 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:33.735+0000 7fa823ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:33.742 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:33.740+0000 7fa823ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:34.716 INFO:teuthology.orchestra.run.trial095.stderr:pool 'rbd' created 2026-02-20T11:40:34.729 DEBUG:teuthology.orchestra.run.trial095:> rbd --cluster ceph pool init rbd 2026-02-20T11:40:34.772 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:34.769+0000 7f2570ef2240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:34.772 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:34.769+0000 7f2570ef2240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:34.773 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:34.771+0000 7f2570ef2240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:37.748 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-20T11:40:37.749 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-20T11:40:37.749 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-20T11:40:37.866 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:37.860+0000 7f79681d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:37.867 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:37.864+0000 7f79681d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:37.974 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:40:37.983 INFO:teuthology.orchestra.run.trial095.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-20T11:40:37.983 INFO:tasks.ceph_manager:config epoch is 1 2026-02-20T11:40:37.983 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-20T11:40:37.984 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-20T11:40:37.984 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-20T11:40:38.060 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.055+0000 7fbcdb374640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.061 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.058+0000 7fbcdb374640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.209 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:40:38.219 INFO:teuthology.orchestra.run.trial095.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6800","nonce":1204929931},{"type":"v1","addr":"10.20.193.95:6801","nonce":1204929931}]},"active_addr":"10.20.193.95:6801/1204929931","active_change":"2026-02-20T11:40:20.588612+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.95:0","nonce":3573791069}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.95:0","nonce":918377024}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.95:0","nonce":3443915202}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.95:0","nonce":2124226560}]}]} 2026-02-20T11:40:38.223 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-20T11:40:38.223 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T11:40:38.223 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:40:38.298 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.293+0000 7fb3b3f7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.300 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.296+0000 7fb3b3f7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.408 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:40:38.408 INFO:teuthology.orchestra.run.trial095.stdout:{"epoch":18,"fsid":"c325c6cc-b5e6-4605-89e5-d4f698fcae7d","created":"2026-02-20T11:40:18.161861+0000","modified":"2026-02-20T11:40:37.721866+0000","last_up_change":"2026-02-20T11:40:29.695994+0000","last_in_change":"2026-02-20T11:40:19.913206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T11:40:30.603915+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T11:40:33.853176+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6f7b362-2d6f-43ce-b41d-522cb36797aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6809","nonce":1127151553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6804","nonce":1127151553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6813","nonce":1127151553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6812","nonce":1127151553}]},"public_addr":"10.20.193.95:6809/1127151553","cluster_addr":"10.20.193.95:6804/1127151553","heartbeat_back_addr":"10.20.193.95:6813/1127151553","heartbeat_front_addr":"10.20.193.95:6812/1127151553","state":["exists","up"]},{"osd":1,"uuid":"2fbd1ae9-5ba5-4141-8939-6527a6272584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6806","nonce":1963712620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6807","nonce":1963712620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6805","nonce":1963712620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6808","nonce":1963712620}]},"public_addr":"10.20.193.95:6806/1963712620","cluster_addr":"10.20.193.95:6807/1963712620","heartbeat_back_addr":"10.20.193.95:6805/1963712620","heartbeat_front_addr":"10.20.193.95:6808/1963712620","state":["exists","up"]},{"osd":2,"uuid":"095a133b-01d5-4ff0-ad50-af5bd6fc7575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6803","nonce":2870357775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6802","nonce":2870357775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6811","nonce":2870357775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6810","nonce":2870357775}]},"public_addr":"10.20.193.95:6803/2870357775","cluster_addr":"10.20.193.95:6802/2870357775","heartbeat_back_addr":"10.20.193.95:6811/2870357775","heartbeat_front_addr":"10.20.193.95:6810/2870357775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:40:38.418 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-20T11:40:38.418 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:40:38.493 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.488+0000 7f0692db8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.494 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.491+0000 7f0692db8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.604 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:40:38.604 INFO:teuthology.orchestra.run.trial095.stdout:{"epoch":18,"fsid":"c325c6cc-b5e6-4605-89e5-d4f698fcae7d","created":"2026-02-20T11:40:18.161861+0000","modified":"2026-02-20T11:40:37.721866+0000","last_up_change":"2026-02-20T11:40:29.695994+0000","last_in_change":"2026-02-20T11:40:19.913206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T11:40:30.603915+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T11:40:33.853176+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6f7b362-2d6f-43ce-b41d-522cb36797aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6809","nonce":1127151553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6804","nonce":1127151553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6813","nonce":1127151553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6812","nonce":1127151553}]},"public_addr":"10.20.193.95:6809/1127151553","cluster_addr":"10.20.193.95:6804/1127151553","heartbeat_back_addr":"10.20.193.95:6813/1127151553","heartbeat_front_addr":"10.20.193.95:6812/1127151553","state":["exists","up"]},{"osd":1,"uuid":"2fbd1ae9-5ba5-4141-8939-6527a6272584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6806","nonce":1963712620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6807","nonce":1963712620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6805","nonce":1963712620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6808","nonce":1963712620}]},"public_addr":"10.20.193.95:6806/1963712620","cluster_addr":"10.20.193.95:6807/1963712620","heartbeat_back_addr":"10.20.193.95:6805/1963712620","heartbeat_front_addr":"10.20.193.95:6808/1963712620","state":["exists","up"]},{"osd":2,"uuid":"095a133b-01d5-4ff0-ad50-af5bd6fc7575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6803","nonce":2870357775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6802","nonce":2870357775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6811","nonce":2870357775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.95:6810","nonce":2870357775}]},"public_addr":"10.20.193.95:6803/2870357775","cluster_addr":"10.20.193.95:6802/2870357775","heartbeat_back_addr":"10.20.193.95:6811/2870357775","heartbeat_front_addr":"10.20.193.95:6810/2870357775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:40:38.614 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-20T11:40:38.615 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-20T11:40:38.615 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-20T11:40:38.695 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.689+0000 7fab1ba5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.696 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.690+0000 7f59f84cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.697 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.693+0000 7fab1ba5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.697 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.694+0000 7f59f84cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.698 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.692+0000 7f9f0cc35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.699 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.696+0000 7f9f0cc35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.712 INFO:teuthology.orchestra.run.trial095.stdout:47244640264 2026-02-20T11:40:38.713 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T11:40:38.714 INFO:teuthology.orchestra.run.trial095.stdout:38654705674 2026-02-20T11:40:38.714 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T11:40:38.715 INFO:teuthology.orchestra.run.trial095.stdout:42949672969 2026-02-20T11:40:38.716 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T11:40:38.832 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.826+0000 7f7b014cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.833 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.826+0000 7f5eaa562640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.833 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.827+0000 7faeead0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.834 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.830+0000 7f7b014cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.834 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.830+0000 7f5eaa562640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.835 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:38.832+0000 7faeead0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:38.944 INFO:teuthology.orchestra.run.trial095.stdout:47244640264 2026-02-20T11:40:38.948 INFO:teuthology.orchestra.run.trial095.stdout:38654705674 2026-02-20T11:40:38.951 INFO:teuthology.orchestra.run.trial095.stdout:42949672969 2026-02-20T11:40:38.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640264 got 47244640264 for osd.0 2026-02-20T11:40:38.954 DEBUG:teuthology.parallel:result is None 2026-02-20T11:40:38.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705674 got 38654705674 for osd.1 2026-02-20T11:40:38.959 DEBUG:teuthology.parallel:result is None 2026-02-20T11:40:38.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672969 got 42949672969 for osd.2 2026-02-20T11:40:38.961 DEBUG:teuthology.parallel:result is None 2026-02-20T11:40:38.961 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T11:40:38.961 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:40:39.078 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:39.073+0000 7fafe778c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:39.079 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:39.076+0000 7fafe778c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:39.187 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:40:39.187 INFO:teuthology.orchestra.run.trial095.stderr:dumped all 2026-02-20T11:40:39.196 INFO:teuthology.orchestra.run.trial095.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-20T11:40:38.705513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156499968,"kb_used":2836,"kb_used_data":2836,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156497132,"statfs":{"total":160255967232,"available":160253063168,"internally_reserved":0,"allocated":2904064,"data_stored":2904064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.990736"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.734390+0000","last_change":"2026-02-20T11:40:37.737467+0000","last_active":"2026-02-20T11:40:37.734390+0000","last_peered":"2026-02-20T11:40:37.734390+0000","last_clean":"2026-02-20T11:40:37.734390+0000","last_became_active":"2026-02-20T11:40:35.752153+0000","last_became_peered":"2026-02-20T11:40:35.752153+0000","last_unstale":"2026-02-20T11:40:37.734390+0000","last_undegraded":"2026-02-20T11:40:37.734390+0000","last_fullsized":"2026-02-20T11:40:37.734390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_clean_scrub_stamp":"2026-02-20T11:40:34.712084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.735193+0000","last_change":"2026-02-20T11:40:37.737133+0000","last_active":"2026-02-20T11:40:37.735193+0000","last_peered":"2026-02-20T11:40:37.735193+0000","last_clean":"2026-02-20T11:40:37.735193+0000","last_became_active":"2026-02-20T11:40:35.749817+0000","last_became_peered":"2026-02-20T11:40:35.749817+0000","last_unstale":"2026-02-20T11:40:37.735193+0000","last_undegraded":"2026-02-20T11:40:37.735193+0000","last_fullsized":"2026-02-20T11:40:37.735193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_clean_scrub_stamp":"2026-02-20T11:40:34.712084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.735176+0000","last_change":"2026-02-20T11:40:37.738327+0000","last_active":"2026-02-20T11:40:37.735176+0000","last_peered":"2026-02-20T11:40:37.735176+0000","last_clean":"2026-02-20T11:40:37.735176+0000","last_became_active":"2026-02-20T11:40:35.755429+0000","last_became_peered":"2026-02-20T11:40:35.755429+0000","last_unstale":"2026-02-20T11:40:37.735176+0000","last_undegraded":"2026-02-20T11:40:37.735176+0000","last_fullsized":"2026-02-20T11:40:37.735176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_clean_scrub_stamp":"2026-02-20T11:40:34.712084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.735853+0000","last_change":"2026-02-20T11:40:37.738336+0000","last_active":"2026-02-20T11:40:37.735853+0000","last_peered":"2026-02-20T11:40:37.735853+0000","last_clean":"2026-02-20T11:40:37.735853+0000","last_became_active":"2026-02-20T11:40:35.751070+0000","last_became_peered":"2026-02-20T11:40:35.751070+0000","last_unstale":"2026-02-20T11:40:37.735853+0000","last_undegraded":"2026-02-20T11:40:37.735853+0000","last_fullsized":"2026-02-20T11:40:37.735853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_clean_scrub_stamp":"2026-02-20T11:40:34.712084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.734874+0000","last_change":"2026-02-20T11:40:37.734874+0000","last_active":"2026-02-20T11:40:37.734874+0000","last_peered":"2026-02-20T11:40:37.734874+0000","last_clean":"2026-02-20T11:40:37.734874+0000","last_became_active":"2026-02-20T11:40:35.757524+0000","last_became_peered":"2026-02-20T11:40:35.757524+0000","last_unstale":"2026-02-20T11:40:37.734874+0000","last_undegraded":"2026-02-20T11:40:37.734874+0000","last_fullsized":"2026-02-20T11:40:37.734874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_clean_scrub_stamp":"2026-02-20T11:40:34.712084+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.734048+0000","last_change":"2026-02-20T11:40:37.736324+0000","last_active":"2026-02-20T11:40:37.734048+0000","last_peered":"2026-02-20T11:40:37.734048+0000","last_clean":"2026-02-20T11:40:37.734048+0000","last_became_active":"2026-02-20T11:40:35.761055+0000","last_became_peered":"2026-02-20T11:40:35.761055+0000","last_unstale":"2026-02-20T11:40:37.734048+0000","last_undegraded":"2026-02-20T11:40:37.734048+0000","last_fullsized":"2026-02-20T11:40:37.734048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_clean_scrub_stamp":"2026-02-20T11:40:34.712084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.732059+0000","last_change":"2026-02-20T11:40:37.734088+0000","last_active":"2026-02-20T11:40:37.732059+0000","last_peered":"2026-02-20T11:40:37.732059+0000","last_clean":"2026-02-20T11:40:37.732059+0000","last_became_active":"2026-02-20T11:40:35.757596+0000","last_became_peered":"2026-02-20T11:40:35.757596+0000","last_unstale":"2026-02-20T11:40:37.732059+0000","last_undegraded":"2026-02-20T11:40:37.732059+0000","last_fullsized":"2026-02-20T11:40:37.732059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_clean_scrub_stamp":"2026-02-20T11:40:34.712084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.735477+0000","last_change":"2026-02-20T11:40:37.737319+0000","last_active":"2026-02-20T11:40:37.735477+0000","last_peered":"2026-02-20T11:40:37.735477+0000","last_clean":"2026-02-20T11:40:37.735477+0000","last_became_active":"2026-02-20T11:40:35.751392+0000","last_became_peered":"2026-02-20T11:40:35.751392+0000","last_unstale":"2026-02-20T11:40:37.735477+0000","last_undegraded":"2026-02-20T11:40:37.735477+0000","last_fullsized":"2026-02-20T11:40:37.735477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_clean_scrub_stamp":"2026-02-20T11:40:34.712084+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":90,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.734498+0000","last_change":"2026-02-20T11:40:31.736808+0000","last_active":"2026-02-20T11:40:37.734498+0000","last_peered":"2026-02-20T11:40:37.734498+0000","last_clean":"2026-02-20T11:40:37.734498+0000","last_became_active":"2026-02-20T11:40:31.730069+0000","last_became_peered":"2026-02-20T11:40:31.730069+0000","last_unstale":"2026-02-20T11:40:37.734498+0000","last_undegraded":"2026-02-20T11:40:37.734498+0000","last_fullsized":"2026-02-20T11:40:37.734498+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:30.700114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:30.700114+0000","last_clean_scrub_stamp":"2026-02-20T11:40:30.700114+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160253014016,"internally_reserved":0,"allocated":2953216,"data_stored":2953216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53417308160,"internally_reserved":0,"allocated":1347584,"data_stored":1347584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":364,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166292,"statfs":{"total":53418655744,"available":53418283008,"internally_reserved":0,"allocated":372736,"data_stored":372736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1284,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165372,"statfs":{"total":53418655744,"available":53417340928,"internally_reserved":0,"allocated":1314816,"data_stored":1314816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1188,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165468,"statfs":{"total":53418655744,"available":53417439232,"internally_reserved":0,"allocated":1216512,"data_stored":1216512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53418655744,"available":53417308160,"internally_reserved":0,"allocated":1347584,"data_stored":1347584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53418655744,"available":53417431040,"internally_reserved":0,"allocated":1224704,"data_stored":1224704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53418655744,"available":53417308160,"internally_reserved":0,"allocated":1347584,"data_stored":1347584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53418655744,"available":53418274816,"internally_reserved":0,"allocated":380928,"data_stored":380928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:40:39.197 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:40:39.273 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:39.268+0000 7f35d75b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:39.274 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:39.271+0000 7f35d75b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:39.382 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:40:39.383 INFO:teuthology.orchestra.run.trial095.stderr:dumped all 2026-02-20T11:40:39.391 INFO:teuthology.orchestra.run.trial095.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-20T11:40:38.705513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156499968,"kb_used":2836,"kb_used_data":2836,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156497132,"statfs":{"total":160255967232,"available":160253063168,"internally_reserved":0,"allocated":2904064,"data_stored":2904064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.990736"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.734390+0000","last_change":"2026-02-20T11:40:37.737467+0000","last_active":"2026-02-20T11:40:37.734390+0000","last_peered":"2026-02-20T11:40:37.734390+0000","last_clean":"2026-02-20T11:40:37.734390+0000","last_became_active":"2026-02-20T11:40:35.752153+0000","last_became_peered":"2026-02-20T11:40:35.752153+0000","last_unstale":"2026-02-20T11:40:37.734390+0000","last_undegraded":"2026-02-20T11:40:37.734390+0000","last_fullsized":"2026-02-20T11:40:37.734390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_clean_scrub_stamp":"2026-02-20T11:40:34.712084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.735193+0000","last_change":"2026-02-20T11:40:37.737133+0000","last_active":"2026-02-20T11:40:37.735193+0000","last_peered":"2026-02-20T11:40:37.735193+0000","last_clean":"2026-02-20T11:40:37.735193+0000","last_became_active":"2026-02-20T11:40:35.749817+0000","last_became_peered":"2026-02-20T11:40:35.749817+0000","last_unstale":"2026-02-20T11:40:37.735193+0000","last_undegraded":"2026-02-20T11:40:37.735193+0000","last_fullsized":"2026-02-20T11:40:37.735193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_clean_scrub_stamp":"2026-02-20T11:40:34.712084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.735176+0000","last_change":"2026-02-20T11:40:37.738327+0000","last_active":"2026-02-20T11:40:37.735176+0000","last_peered":"2026-02-20T11:40:37.735176+0000","last_clean":"2026-02-20T11:40:37.735176+0000","last_became_active":"2026-02-20T11:40:35.755429+0000","last_became_peered":"2026-02-20T11:40:35.755429+0000","last_unstale":"2026-02-20T11:40:37.735176+0000","last_undegraded":"2026-02-20T11:40:37.735176+0000","last_fullsized":"2026-02-20T11:40:37.735176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_clean_scrub_stamp":"2026-02-20T11:40:34.712084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.735853+0000","last_change":"2026-02-20T11:40:37.738336+0000","last_active":"2026-02-20T11:40:37.735853+0000","last_peered":"2026-02-20T11:40:37.735853+0000","last_clean":"2026-02-20T11:40:37.735853+0000","last_became_active":"2026-02-20T11:40:35.751070+0000","last_became_peered":"2026-02-20T11:40:35.751070+0000","last_unstale":"2026-02-20T11:40:37.735853+0000","last_undegraded":"2026-02-20T11:40:37.735853+0000","last_fullsized":"2026-02-20T11:40:37.735853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_clean_scrub_stamp":"2026-02-20T11:40:34.712084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.734874+0000","last_change":"2026-02-20T11:40:37.734874+0000","last_active":"2026-02-20T11:40:37.734874+0000","last_peered":"2026-02-20T11:40:37.734874+0000","last_clean":"2026-02-20T11:40:37.734874+0000","last_became_active":"2026-02-20T11:40:35.757524+0000","last_became_peered":"2026-02-20T11:40:35.757524+0000","last_unstale":"2026-02-20T11:40:37.734874+0000","last_undegraded":"2026-02-20T11:40:37.734874+0000","last_fullsized":"2026-02-20T11:40:37.734874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_clean_scrub_stamp":"2026-02-20T11:40:34.712084+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.734048+0000","last_change":"2026-02-20T11:40:37.736324+0000","last_active":"2026-02-20T11:40:37.734048+0000","last_peered":"2026-02-20T11:40:37.734048+0000","last_clean":"2026-02-20T11:40:37.734048+0000","last_became_active":"2026-02-20T11:40:35.761055+0000","last_became_peered":"2026-02-20T11:40:35.761055+0000","last_unstale":"2026-02-20T11:40:37.734048+0000","last_undegraded":"2026-02-20T11:40:37.734048+0000","last_fullsized":"2026-02-20T11:40:37.734048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_clean_scrub_stamp":"2026-02-20T11:40:34.712084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.732059+0000","last_change":"2026-02-20T11:40:37.734088+0000","last_active":"2026-02-20T11:40:37.732059+0000","last_peered":"2026-02-20T11:40:37.732059+0000","last_clean":"2026-02-20T11:40:37.732059+0000","last_became_active":"2026-02-20T11:40:35.757596+0000","last_became_peered":"2026-02-20T11:40:35.757596+0000","last_unstale":"2026-02-20T11:40:37.732059+0000","last_undegraded":"2026-02-20T11:40:37.732059+0000","last_fullsized":"2026-02-20T11:40:37.732059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_clean_scrub_stamp":"2026-02-20T11:40:34.712084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.735477+0000","last_change":"2026-02-20T11:40:37.737319+0000","last_active":"2026-02-20T11:40:37.735477+0000","last_peered":"2026-02-20T11:40:37.735477+0000","last_clean":"2026-02-20T11:40:37.735477+0000","last_became_active":"2026-02-20T11:40:35.751392+0000","last_became_peered":"2026-02-20T11:40:35.751392+0000","last_unstale":"2026-02-20T11:40:37.735477+0000","last_undegraded":"2026-02-20T11:40:37.735477+0000","last_fullsized":"2026-02-20T11:40:37.735477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:34.712084+0000","last_clean_scrub_stamp":"2026-02-20T11:40:34.712084+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":90,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:40:37.734498+0000","last_change":"2026-02-20T11:40:31.736808+0000","last_active":"2026-02-20T11:40:37.734498+0000","last_peered":"2026-02-20T11:40:37.734498+0000","last_clean":"2026-02-20T11:40:37.734498+0000","last_became_active":"2026-02-20T11:40:31.730069+0000","last_became_peered":"2026-02-20T11:40:31.730069+0000","last_unstale":"2026-02-20T11:40:37.734498+0000","last_undegraded":"2026-02-20T11:40:37.734498+0000","last_fullsized":"2026-02-20T11:40:37.734498+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:40:30.700114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:40:30.700114+0000","last_clean_scrub_stamp":"2026-02-20T11:40:30.700114+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160253014016,"internally_reserved":0,"allocated":2953216,"data_stored":2953216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53417308160,"internally_reserved":0,"allocated":1347584,"data_stored":1347584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":364,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166292,"statfs":{"total":53418655744,"available":53418283008,"internally_reserved":0,"allocated":372736,"data_stored":372736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1284,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165372,"statfs":{"total":53418655744,"available":53417340928,"internally_reserved":0,"allocated":1314816,"data_stored":1314816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1188,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165468,"statfs":{"total":53418655744,"available":53417439232,"internally_reserved":0,"allocated":1216512,"data_stored":1216512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53418655744,"available":53417308160,"internally_reserved":0,"allocated":1347584,"data_stored":1347584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53418655744,"available":53417431040,"internally_reserved":0,"allocated":1224704,"data_stored":1224704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53418655744,"available":53417308160,"internally_reserved":0,"allocated":1347584,"data_stored":1347584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53418655744,"available":53418274816,"internally_reserved":0,"allocated":380928,"data_stored":380928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:40:39.393 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T11:40:39.393 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-20T11:40:39.393 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-20T11:40:39.393 DEBUG:teuthology.orchestra.run.trial095:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-20T11:40:39.468 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:39.464+0000 7f048175b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:39.469 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:40:39.466+0000 7f048175b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:39.605 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:40:39.606 INFO:teuthology.orchestra.run.trial095.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-20T11:40:39.615 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-20T11:40:39.615 INFO:teuthology.run_tasks:Running task ssh_keys... 2026-02-20T11:40:39.678 DEBUG:teuthology.orchestra.run.trial095:> echo 'StrictHostKeyChecking no 2026-02-20T11:40:39.678 DEBUG:teuthology.orchestra.run.trial095:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2026-02-20T11:40:39.693 INFO:teuthology.task.ssh_keys:generated public key AAAAB3NzaC1yc2EAAAADAQABAAABAQCeUhdiSADBaprQCNAkEPQlztX1T86PMmJ2RujQV1Bp1Pl5J6UX4LcP1woc5eBWVdGignLkqrv+hrUjIEHasHbFCUAWh/2QC6/PQ+FLsRtWUxHt58oi3VyprZ9jyZ+lFz68UROneNBaoOGATnrsCbLEJtBUvSyopHGCP3rgwKqi6cXqJRmqNUtiFKf9qIkupxGIgY9YhIzGywAlKgbJwSdin/O/kBCVQMezpKVb7/h9j05Tfkw8c4EKfnGccB1KD8FH2ElspWIkVhwD6/NfVmRcTEeWXPoZ8U9rdkTZn/XJwuMD2btvw0D54bz9DEUajKJJTJGw4AVUb2YCt8FuY8jP 2026-02-20T11:40:39.694 INFO:teuthology.task.ssh_keys:pushing keys to trial095.front.sepia.ceph.com for ubuntu 2026-02-20T11:40:39.694 DEBUG:teuthology.orchestra.run.trial095:> rm -f -- /home/ubuntu/.ssh/id_rsa 2026-02-20T11:40:39.749 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:40:39.749 DEBUG:teuthology.orchestra.run.trial095:> dd of=/home/ubuntu/.ssh/id_rsa 2026-02-20T11:40:39.750 DEBUG:teuthology.orchestra.run.trial095:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2026-02-20T11:40:39.806 DEBUG:teuthology.orchestra.run.trial095:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2026-02-20T11:40:39.862 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:40:39.863 DEBUG:teuthology.orchestra.run.trial095:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2026-02-20T11:40:39.919 DEBUG:teuthology.orchestra.run.trial095:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2026-02-20_11:40:39:919355 2026-02-20T11:40:39.976 INFO:teuthology.orchestra.run.trial095.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2026-02-20_11:40:39:919355' 2026-02-20T11:40:39.976 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:40:39.977 DEBUG:teuthology.orchestra.run.trial095:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2026-02-20T11:40:40.032 INFO:teuthology.run_tasks:Running task cbt... 2026-02-20T11:40:40.058 INFO:tasks.cbt:cbt configuration is {'cluster': {'user': 'ubuntu', 'head': 'ubuntu@trial095.front.sepia.ceph.com', 'osds': ['ubuntu@trial095.front.sepia.ceph.com'], 'mons': ['ubuntu@trial095.front.sepia.ceph.com'], 'clients': ['ubuntu@trial095.front.sepia.ceph.com'], 'rgws': {'ubuntu@trial095.front.sepia.ceph.com': None}, 'osds_per_node': 3, 'rebuild_every_test': False, 'use_existing': True, 'is_teuthology': True, 'iterations': 1, 'tmp_dir': '/tmp/cbt', 'pool_profiles': {'rbd': {'pg_size': 128, 'pgp_size': 128, 'replication': 3}}, 'pid_dir': '/var/run/ceph'}, 'benchmarks': {'librbdfio': {'iodepth': [32], 'log_avg_msec': 100, 'mode': ['randwrite'], 'norandommap': True, 'op_size': [4194304], 'osd_ra': [4096], 'pool_profile': 'rbd', 'procs_per_volume': [1], 'time': 60, 'vol_size': 4096, 'volumes_per_client': [2], 'cmd_path': '/home/ubuntu/cephtest/fio/fio'}}, 'client_endpoints': None, 'monitoring_profiles': {'perf': {'args': 'stat -p {pid} -o {perf_dir}/perf_stat.{pid}', 'nodes': ['osds'], 'perf_cmd': 'perf', 'pid_glob': 'crimson-osd.*.pid'}}} 2026-02-20T11:40:40.058 DEBUG:teuthology.orchestra.run.trial095:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/cbt 2026-02-20T11:40:40.093 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:40:40.093 DEBUG:teuthology.orchestra.run.trial095:> dd of=/home/ubuntu/cephtest/archive/cbt/cbt_config.yaml 2026-02-20T11:40:40.144 DEBUG:teuthology.orchestra.run.trial095:> git clone --depth 1 -b master https://github.com/ceph/cbt.git /home/ubuntu/cephtest/cbt 2026-02-20T11:40:40.206 INFO:teuthology.orchestra.run.trial095.stderr:Cloning into '/home/ubuntu/cephtest/cbt'... 2026-02-20T11:40:41.383 INFO:tasks.cbt:Installing collectl 2026-02-20T11:40:41.383 DEBUG:teuthology.orchestra.run.trial095:> sudo mkdir collectl && cd collectl && sudo wget https://sourceforge.net/projects/collectl/files/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz/download -O collectl.tar.gz && sudo tar -xvf collectl.tar.gz && cd collectl-4.3.1 && sudo ./INSTALL 2026-02-20T11:40:41.459 INFO:teuthology.orchestra.run.trial095.stderr:--2026-02-20 11:40:41-- https://sourceforge.net/projects/collectl/files/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz/download 2026-02-20T11:40:41.587 INFO:teuthology.orchestra.run.trial095.stderr:Resolving sourceforge.net (sourceforge.net)... 104.18.13.149, 104.18.12.149, 2606:4700::6812:d95, ... 2026-02-20T11:40:41.667 INFO:teuthology.orchestra.run.trial095.stderr:Connecting to sourceforge.net (sourceforge.net)|104.18.13.149|:443... connected. 2026-02-20T11:40:42.019 INFO:teuthology.orchestra.run.trial095.stderr:HTTP request sent, awaiting response... 302 Found 2026-02-20T11:40:42.019 INFO:teuthology.orchestra.run.trial095.stderr:Location: https://downloads.sourceforge.net/project/collectl/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz?ts=gAAAAABpmEg5oTM8bNRVlkagZ4b1wSgEDOVYc-w-fXjIvcHiAW0wRcQl4VkHm5-KL-lRpOH6b8RJXk0qq_dg9pY1IZzglwc6yQ%3D%3D&use_mirror=cfhcable&r= [following] 2026-02-20T11:40:42.019 INFO:teuthology.orchestra.run.trial095.stderr:--2026-02-20 11:40:42-- https://downloads.sourceforge.net/project/collectl/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz?ts=gAAAAABpmEg5oTM8bNRVlkagZ4b1wSgEDOVYc-w-fXjIvcHiAW0wRcQl4VkHm5-KL-lRpOH6b8RJXk0qq_dg9pY1IZzglwc6yQ%3D%3D&use_mirror=cfhcable&r= 2026-02-20T11:40:42.139 INFO:teuthology.orchestra.run.trial095.stderr:Resolving downloads.sourceforge.net (downloads.sourceforge.net)... 104.18.12.149, 104.18.13.149, 2606:4700::6812:d95, ... 2026-02-20T11:40:42.225 INFO:teuthology.orchestra.run.trial095.stderr:Connecting to downloads.sourceforge.net (downloads.sourceforge.net)|104.18.12.149|:443... connected. 2026-02-20T11:40:42.558 INFO:teuthology.orchestra.run.trial095.stderr:HTTP request sent, awaiting response... 302 Found 2026-02-20T11:40:42.558 INFO:teuthology.orchestra.run.trial095.stderr:Location: https://cfhcable.dl.sourceforge.net/project/collectl/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz?viasf=1 [following] 2026-02-20T11:40:42.558 INFO:teuthology.orchestra.run.trial095.stderr:--2026-02-20 11:40:42-- https://cfhcable.dl.sourceforge.net/project/collectl/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz?viasf=1 2026-02-20T11:40:42.632 INFO:teuthology.orchestra.run.trial095.stderr:Resolving cfhcable.dl.sourceforge.net (cfhcable.dl.sourceforge.net)... 146.71.73.6 2026-02-20T11:40:42.673 INFO:teuthology.orchestra.run.trial095.stderr:Connecting to cfhcable.dl.sourceforge.net (cfhcable.dl.sourceforge.net)|146.71.73.6|:443... connected. 2026-02-20T11:40:48.038 INFO:teuthology.orchestra.run.trial095.stderr:HTTP request sent, awaiting response... 200 OK 2026-02-20T11:40:48.038 INFO:teuthology.orchestra.run.trial095.stderr:Length: 620693 (606K) [application/x-gzip] 2026-02-20T11:40:48.039 INFO:teuthology.orchestra.run.trial095.stderr:Saving to: ‘collectl.tar.gz’ 2026-02-20T11:40:48.039 INFO:teuthology.orchestra.run.trial095.stderr: 2026-02-20T11:40:48.079 INFO:teuthology.orchestra.run.trial095.stderr: 0K .......... .......... .......... .......... .......... 8% 1.20M 0s 2026-02-20T11:40:48.120 INFO:teuthology.orchestra.run.trial095.stderr: 50K .......... .......... .......... .......... .......... 16% 1.20M 0s 2026-02-20T11:40:48.120 INFO:teuthology.orchestra.run.trial095.stderr: 100K .......... .......... .......... .......... .......... 24% 364M 0s 2026-02-20T11:40:48.162 INFO:teuthology.orchestra.run.trial095.stderr: 150K .......... .......... .......... .......... .......... 32% 1.20M 0s 2026-02-20T11:40:48.163 INFO:teuthology.orchestra.run.trial095.stderr: 200K .......... .......... .......... .......... .......... 41% 393M 0s 2026-02-20T11:40:48.163 INFO:teuthology.orchestra.run.trial095.stderr: 250K .......... .......... .......... .......... .......... 49% 386M 0s 2026-02-20T11:40:48.207 INFO:teuthology.orchestra.run.trial095.stderr: 300K .......... .......... .......... .......... .......... 57% 1.21M 0s 2026-02-20T11:40:48.207 INFO:teuthology.orchestra.run.trial095.stderr: 350K .......... .......... .......... .......... .......... 65% 281M 0s 2026-02-20T11:40:48.207 INFO:teuthology.orchestra.run.trial095.stderr: 400K .......... .......... .......... .......... .......... 74% 374M 0s 2026-02-20T11:40:48.207 INFO:teuthology.orchestra.run.trial095.stderr: 450K .......... .......... .......... .......... .......... 82% 407M 0s 2026-02-20T11:40:48.207 INFO:teuthology.orchestra.run.trial095.stderr: 500K .......... .......... .......... .......... .......... 90% 264M 0s 2026-02-20T11:40:48.207 INFO:teuthology.orchestra.run.trial095.stderr: 550K .......... .......... .......... .......... .......... 98% 339M 0s 2026-02-20T11:40:48.208 INFO:teuthology.orchestra.run.trial095.stderr: 600K ...... 100% 11.4T=0.2s 2026-02-20T11:40:48.208 INFO:teuthology.orchestra.run.trial095.stderr: 2026-02-20T11:40:48.208 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20 11:40:48 (3.62 MB/s) - ‘collectl.tar.gz’ saved [620693/620693] 2026-02-20T11:40:48.208 INFO:teuthology.orchestra.run.trial095.stderr: 2026-02-20T11:40:48.223 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/ 2026-02-20T11:40:48.224 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/collectl.conf 2026-02-20T11:40:48.224 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/ 2026-02-20T11:40:48.224 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/SlowProc.html 2026-02-20T11:40:48.224 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/BuddyInfo.html 2026-02-20T11:40:48.224 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/WhySummary.html 2026-02-20T11:40:48.224 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Socket.html 2026-02-20T11:40:48.224 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/colmux.html 2026-02-20T11:40:48.224 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Tutorial.html 2026-02-20T11:40:48.224 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Gexpr.html 2026-02-20T11:40:48.224 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Import.html 2026-02-20T11:40:48.224 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/style.css 2026-02-20T11:40:48.224 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Ganglia3.jpg 2026-02-20T11:40:48.225 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Ganglia2.jpg 2026-02-20T11:40:48.225 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/FileNaming.html 2026-02-20T11:40:48.225 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/TheMath.html 2026-02-20T11:40:48.225 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Environmental.html 2026-02-20T11:40:48.225 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Process.html 2026-02-20T11:40:48.225 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/OutputFiles.html 2026-02-20T11:40:48.225 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/HiResTime.html 2026-02-20T11:40:48.225 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/OutputFormats.html 2026-02-20T11:40:48.225 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/slub.jpg 2026-02-20T11:40:48.225 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Lustre.html 2026-02-20T11:40:48.225 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Documentation.html 2026-02-20T11:40:48.225 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Inodes.html 2026-02-20T11:40:48.226 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Graphite.html 2026-02-20T11:40:48.226 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/InputFiles.html 2026-02-20T11:40:48.226 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Export.html 2026-02-20T11:40:48.226 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Interrupts.html 2026-02-20T11:40:48.226 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Startup.html 2026-02-20T11:40:48.226 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Performance.html 2026-02-20T11:40:48.226 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Messages.html 2026-02-20T11:40:48.226 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Logging.html 2026-02-20T11:40:48.226 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Data-detail.html 2026-02-20T11:40:48.226 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/CPUs.html 2026-02-20T11:40:48.226 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Matrix.html 2026-02-20T11:40:48.226 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Data-brief.html 2026-02-20T11:40:48.226 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/SlabInfo.html 2026-02-20T11:40:48.227 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Misc.html 2026-02-20T11:40:48.227 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Examples.html 2026-02-20T11:40:48.227 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/OpenStack.html 2026-02-20T11:40:48.227 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Plotfiles.html 2026-02-20T11:40:48.227 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/ColmuxCPU.jpg 2026-02-20T11:40:48.227 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Tutorial-Lustre.html 2026-02-20T11:40:48.227 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Data-verbose.html 2026-02-20T11:40:48.227 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Data.html 2026-02-20T11:40:48.227 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Exceptions.html 2026-02-20T11:40:48.227 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/RunningAsAService.html 2026-02-20T11:40:48.227 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/FAQ-collectl.html 2026-02-20T11:40:48.227 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Ganglia.jpg 2026-02-20T11:40:48.227 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/OperationalModes.html 2026-02-20T11:40:48.228 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Playback.html 2026-02-20T11:40:48.228 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Hello.html 2026-02-20T11:40:48.228 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Sockets.html 2026-02-20T11:40:48.228 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Network.html 2026-02-20T11:40:48.228 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Infiniband.html 2026-02-20T11:40:48.228 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Memory.html 2026-02-20T11:40:48.228 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/ColmuxLustre.jpg 2026-02-20T11:40:48.228 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/Disks.html 2026-02-20T11:40:48.228 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/docs/NfsInfo.html 2026-02-20T11:40:48.228 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/service/ 2026-02-20T11:40:48.228 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/service/collectl.service 2026-02-20T11:40:48.228 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/initd/ 2026-02-20T11:40:48.228 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/initd/collectl-suse 2026-02-20T11:40:48.229 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/initd/collectl-debian 2026-02-20T11:40:48.229 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/initd/collectl-generic 2026-02-20T11:40:48.229 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/initd/collectl 2026-02-20T11:40:48.229 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/misc.ph 2026-02-20T11:40:48.229 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/gexpr.ph 2026-02-20T11:40:48.229 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/statsd.ph 2026-02-20T11:40:48.229 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/envrules.std 2026-02-20T11:40:48.229 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/hello.ph 2026-02-20T11:40:48.229 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/vmsum.ph 2026-02-20T11:40:48.229 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/proctree.ph 2026-02-20T11:40:48.229 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/README-WINDOWS 2026-02-20T11:40:48.229 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/formatit.ph 2026-02-20T11:40:48.229 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/colmux 2026-02-20T11:40:48.230 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/INSTALL 2026-02-20T11:40:48.230 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/graphite.ph 2026-02-20T11:40:48.230 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/RELEASE-collectl 2026-02-20T11:40:48.230 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/vmstat.ph 2026-02-20T11:40:48.230 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/README 2026-02-20T11:40:48.230 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/man1/ 2026-02-20T11:40:48.230 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/man1/collectl.1 2026-02-20T11:40:48.230 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/man1/colmux.1 2026-02-20T11:40:48.230 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/lexpr.ph 2026-02-20T11:40:48.230 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/client.pl 2026-02-20T11:40:48.230 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/collectl 2026-02-20T11:40:48.230 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/COPYING 2026-02-20T11:40:48.230 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/vnet.ph 2026-02-20T11:40:48.230 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/GPL 2026-02-20T11:40:48.231 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/UNINSTALL 2026-02-20T11:40:48.231 INFO:teuthology.orchestra.run.trial095.stdout:collectl-4.3.1/ARTISTIC 2026-02-20T11:40:48.266 INFO:teuthology.orchestra.run.trial095.stderr:./INSTALL: line 90: chkconfig: command not found 2026-02-20T11:40:48.268 DEBUG:teuthology.orchestra.run.trial095:> sudo yum -y install librbd-devel pdsh pdsh-rcmd-ssh perf 2026-02-20T11:40:48.622 INFO:teuthology.orchestra.run.trial095.stdout:Last metadata expiration check: 0:01:04 ago on Fri 20 Feb 2026 11:39:44 AM UTC. 2026-02-20T11:40:48.707 INFO:teuthology.orchestra.run.trial095.stdout:Dependencies resolved. 2026-02-20T11:40:48.708 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:40:48.708 INFO:teuthology.orchestra.run.trial095.stdout: Package Arch Version Repository Size 2026-02-20T11:40:48.708 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:40:48.708 INFO:teuthology.orchestra.run.trial095.stdout:Installing: 2026-02-20T11:40:48.708 INFO:teuthology.orchestra.run.trial095.stdout: librbd-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 24 k 2026-02-20T11:40:48.708 INFO:teuthology.orchestra.run.trial095.stdout: pdsh x86_64 2.34-7.el9 epel 118 k 2026-02-20T11:40:48.708 INFO:teuthology.orchestra.run.trial095.stdout: pdsh-rcmd-ssh x86_64 2.34-7.el9 epel 13 k 2026-02-20T11:40:48.708 INFO:teuthology.orchestra.run.trial095.stdout: perf x86_64 5.14.0-681.el9 appstream 3.2 M 2026-02-20T11:40:48.708 INFO:teuthology.orchestra.run.trial095.stdout:Installing dependencies: 2026-02-20T11:40:48.708 INFO:teuthology.orchestra.run.trial095.stdout: libradospp-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 31 k 2026-02-20T11:40:48.709 INFO:teuthology.orchestra.run.trial095.stdout: libtraceevent x86_64 1.8.4-2.el9 baseos 290 k 2026-02-20T11:40:48.709 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:40:48.709 INFO:teuthology.orchestra.run.trial095.stdout:Transaction Summary 2026-02-20T11:40:48.709 INFO:teuthology.orchestra.run.trial095.stdout:================================================================================ 2026-02-20T11:40:48.709 INFO:teuthology.orchestra.run.trial095.stdout:Install 6 Packages 2026-02-20T11:40:48.709 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:40:48.709 INFO:teuthology.orchestra.run.trial095.stdout:Total download size: 3.7 M 2026-02-20T11:40:48.709 INFO:teuthology.orchestra.run.trial095.stdout:Installed size: 14 M 2026-02-20T11:40:48.709 INFO:teuthology.orchestra.run.trial095.stdout:Downloading Packages: 2026-02-20T11:40:49.149 INFO:teuthology.orchestra.run.trial095.stdout:(1/6): libtraceevent-1.8.4-2.el9.x86_64.rpm 1.4 MB/s | 290 kB 00:00 2026-02-20T11:40:49.289 INFO:teuthology.orchestra.run.trial095.stdout:(2/6): librbd-devel-20.3.0-5357.g0c3148ca.el9.x 68 kB/s | 24 kB 00:00 2026-02-20T11:40:49.443 INFO:teuthology.orchestra.run.trial095.stdout:(3/6): pdsh-2.34-7.el9.x86_64.rpm 773 kB/s | 118 kB 00:00 2026-02-20T11:40:49.470 INFO:teuthology.orchestra.run.trial095.stdout:(4/6): pdsh-rcmd-ssh-2.34-7.el9.x86_64.rpm 482 kB/s | 13 kB 00:00 2026-02-20T11:40:49.603 INFO:teuthology.orchestra.run.trial095.stdout:(5/6): libradospp-devel-20.3.0-5357.g0c3148ca.e 47 kB/s | 31 kB 00:00 2026-02-20T11:40:50.249 INFO:teuthology.orchestra.run.trial095.stdout:(6/6): perf-5.14.0-681.el9.x86_64.rpm 2.9 MB/s | 3.2 MB 00:01 2026-02-20T11:40:50.251 INFO:teuthology.orchestra.run.trial095.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:40:50.252 INFO:teuthology.orchestra.run.trial095.stdout:Total 2.4 MB/s | 3.7 MB 00:01 2026-02-20T11:40:50.275 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction check 2026-02-20T11:40:50.284 INFO:teuthology.orchestra.run.trial095.stdout:Transaction check succeeded. 2026-02-20T11:40:50.284 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction test 2026-02-20T11:40:50.340 INFO:teuthology.orchestra.run.trial095.stdout:Transaction test succeeded. 2026-02-20T11:40:50.341 INFO:teuthology.orchestra.run.trial095.stdout:Running transaction 2026-02-20T11:40:50.414 INFO:teuthology.orchestra.run.trial095.stdout: Preparing : 1/1 2026-02-20T11:40:50.420 INFO:teuthology.orchestra.run.trial095.stdout: Installing : pdsh-rcmd-ssh-2.34-7.el9.x86_64 1/6 2026-02-20T11:40:50.459 INFO:teuthology.orchestra.run.trial095.stdout: Installing : pdsh-2.34-7.el9.x86_64 2/6 2026-02-20T11:40:50.464 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libtraceevent-1.8.4-2.el9.x86_64 3/6 2026-02-20T11:40:50.466 INFO:teuthology.orchestra.run.trial095.stdout: Installing : libradospp-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/6 2026-02-20T11:40:50.629 INFO:teuthology.orchestra.run.trial095.stdout: Installing : librbd-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 5/6 2026-02-20T11:40:50.650 INFO:teuthology.orchestra.run.trial095.stdout: Installing : perf-5.14.0-681.el9.x86_64 6/6 2026-02-20T11:40:50.763 INFO:teuthology.orchestra.run.trial095.stdout: Running scriptlet: perf-5.14.0-681.el9.x86_64 6/6 2026-02-20T11:40:50.763 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libradospp-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/6 2026-02-20T11:40:50.763 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : librbd-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/6 2026-02-20T11:40:50.763 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : libtraceevent-1.8.4-2.el9.x86_64 3/6 2026-02-20T11:40:50.763 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : perf-5.14.0-681.el9.x86_64 4/6 2026-02-20T11:40:50.763 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : pdsh-2.34-7.el9.x86_64 5/6 2026-02-20T11:40:50.822 INFO:teuthology.orchestra.run.trial095.stdout: Verifying : pdsh-rcmd-ssh-2.34-7.el9.x86_64 6/6 2026-02-20T11:40:50.823 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:40:50.823 INFO:teuthology.orchestra.run.trial095.stdout:Installed: 2026-02-20T11:40:50.823 INFO:teuthology.orchestra.run.trial095.stdout: libradospp-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:40:50.823 INFO:teuthology.orchestra.run.trial095.stdout: librbd-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:40:50.823 INFO:teuthology.orchestra.run.trial095.stdout: libtraceevent-1.8.4-2.el9.x86_64 2026-02-20T11:40:50.823 INFO:teuthology.orchestra.run.trial095.stdout: pdsh-2.34-7.el9.x86_64 2026-02-20T11:40:50.823 INFO:teuthology.orchestra.run.trial095.stdout: pdsh-rcmd-ssh-2.34-7.el9.x86_64 2026-02-20T11:40:50.823 INFO:teuthology.orchestra.run.trial095.stdout: perf-5.14.0-681.el9.x86_64 2026-02-20T11:40:50.823 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:40:50.823 INFO:teuthology.orchestra.run.trial095.stdout:Complete! 2026-02-20T11:40:50.853 DEBUG:teuthology.orchestra.run.trial095:> python3 -m pip install -r /home/ubuntu/cephtest/cbt/requirements.txt 2026-02-20T11:40:50.991 INFO:teuthology.orchestra.run.trial095.stdout:Defaulting to user installation because normal site-packages is not writeable 2026-02-20T11:40:51.001 INFO:teuthology.orchestra.run.trial095.stdout:Requirement already satisfied: pyyaml in /usr/lib64/python3.9/site-packages (from -r /home/ubuntu/cephtest/cbt/requirements.txt (line 1)) (5.4.1) 2026-02-20T11:40:51.001 INFO:teuthology.orchestra.run.trial095.stdout:Requirement already satisfied: lxml in /usr/lib64/python3.9/site-packages (from -r /home/ubuntu/cephtest/cbt/requirements.txt (line 2)) (4.6.5) 2026-02-20T11:40:51.852 INFO:teuthology.orchestra.run.trial095.stdout:Collecting matplotlib 2026-02-20T11:40:52.117 INFO:teuthology.orchestra.run.trial095.stdout: Downloading matplotlib-3.9.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.3 MB) 2026-02-20T11:40:52.796 INFO:teuthology.orchestra.run.trial095.stdout:Requirement already satisfied: packaging>=20.0 in /usr/lib/python3.9/site-packages (from matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (20.9) 2026-02-20T11:40:52.796 INFO:teuthology.orchestra.run.trial095.stdout:Requirement already satisfied: numpy>=1.23 in /usr/lib64/python3.9/site-packages (from matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (1.23.5) 2026-02-20T11:40:53.235 INFO:teuthology.orchestra.run.trial095.stdout:Collecting fonttools>=4.22.0 2026-02-20T11:40:53.320 INFO:teuthology.orchestra.run.trial095.stdout: Downloading fonttools-4.60.2-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (4.8 MB) 2026-02-20T11:40:53.556 INFO:teuthology.orchestra.run.trial095.stdout:Collecting importlib-resources>=3.2.0 2026-02-20T11:40:53.640 INFO:teuthology.orchestra.run.trial095.stdout: Downloading importlib_resources-6.5.2-py3-none-any.whl (37 kB) 2026-02-20T11:40:53.867 INFO:teuthology.orchestra.run.trial095.stdout:Collecting kiwisolver>=1.3.1 2026-02-20T11:40:53.951 INFO:teuthology.orchestra.run.trial095.stdout: Downloading kiwisolver-1.4.7-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.6 MB) 2026-02-20T11:40:54.207 INFO:teuthology.orchestra.run.trial095.stdout:Collecting contourpy>=1.0.1 2026-02-20T11:40:54.298 INFO:teuthology.orchestra.run.trial095.stdout: Downloading contourpy-1.3.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (321 kB) 2026-02-20T11:40:54.302 INFO:teuthology.orchestra.run.trial095.stdout:Requirement already satisfied: pyparsing>=2.3.1 in /usr/lib/python3.9/site-packages (from matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (2.4.7) 2026-02-20T11:40:54.396 INFO:teuthology.orchestra.run.trial095.stdout:Collecting cycler>=0.10 2026-02-20T11:40:54.482 INFO:teuthology.orchestra.run.trial095.stdout: Downloading cycler-0.12.1-py3-none-any.whl (8.3 kB) 2026-02-20T11:40:54.996 INFO:teuthology.orchestra.run.trial095.stdout:Collecting pillow>=8 2026-02-20T11:40:55.084 INFO:teuthology.orchestra.run.trial095.stdout: Downloading pillow-11.3.0-cp39-cp39-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (6.6 MB) 2026-02-20T11:40:55.196 INFO:teuthology.orchestra.run.trial095.stdout:Requirement already satisfied: python-dateutil>=2.7 in /usr/lib/python3.9/site-packages (from matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (2.9.0.post0) 2026-02-20T11:40:55.323 INFO:teuthology.orchestra.run.trial095.stdout:Collecting zipp>=3.1.0 2026-02-20T11:40:55.397 INFO:teuthology.orchestra.run.trial095.stdout: Downloading zipp-3.23.0-py3-none-any.whl (10 kB) 2026-02-20T11:40:55.408 INFO:teuthology.orchestra.run.trial095.stdout:Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil>=2.7->matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (1.15.0) 2026-02-20T11:40:55.524 INFO:teuthology.orchestra.run.trial095.stdout:Installing collected packages: zipp, pillow, kiwisolver, importlib-resources, fonttools, cycler, contourpy, matplotlib 2026-02-20T11:40:56.588 INFO:teuthology.orchestra.run.trial095.stdout:Successfully installed contourpy-1.3.0 cycler-0.12.1 fonttools-4.60.2 importlib-resources-6.5.2 kiwisolver-1.4.7 matplotlib-3.9.4 pillow-11.3.0 zipp-3.23.0 2026-02-20T11:40:57.063 INFO:tasks.cbt:benchmark: librbdfio 2026-02-20T11:40:57.064 DEBUG:teuthology.orchestra.run.trial095:> git clone -b master https://github.com/axboe/fio.git /home/ubuntu/cephtest/fio 2026-02-20T11:40:57.081 INFO:teuthology.orchestra.run.trial095.stderr:Cloning into '/home/ubuntu/cephtest/fio'... 2026-02-20T11:40:57.861 DEBUG:teuthology.orchestra.run.trial095:> cd /home/ubuntu/cephtest/fio && ./configure && make 2026-02-20T11:40:58.026 INFO:teuthology.orchestra.run.trial095.stdout:Operating system Linux 2026-02-20T11:40:58.027 INFO:teuthology.orchestra.run.trial095.stdout:CPU x86_64 2026-02-20T11:40:58.027 INFO:teuthology.orchestra.run.trial095.stdout:Big endian no 2026-02-20T11:40:58.027 INFO:teuthology.orchestra.run.trial095.stdout:Compiler gcc 2026-02-20T11:40:58.027 INFO:teuthology.orchestra.run.trial095.stdout:Cross compile no 2026-02-20T11:40:58.027 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:40:58.027 INFO:teuthology.orchestra.run.trial095.stdout:Static build no 2026-02-20T11:40:58.073 INFO:teuthology.orchestra.run.trial095.stdout:Wordsize 64 2026-02-20T11:40:58.078 INFO:teuthology.orchestra.run.trial095.stdout:zlib no 2026-02-20T11:40:58.089 INFO:teuthology.orchestra.run.trial095.stdout:fcntl(F_FULLFSYNC) no 2026-02-20T11:40:58.100 INFO:teuthology.orchestra.run.trial095.stdout:Linux AIO support no 2026-02-20T11:40:58.100 INFO:teuthology.orchestra.run.trial095.stdout:Linux AIO support rw flags no 2026-02-20T11:40:58.126 INFO:teuthology.orchestra.run.trial095.stdout:POSIX AIO support yes 2026-02-20T11:40:58.126 INFO:teuthology.orchestra.run.trial095.stdout:POSIX AIO support needs -lrt no 2026-02-20T11:40:58.146 INFO:teuthology.orchestra.run.trial095.stdout:POSIX AIO fsync yes 2026-02-20T11:40:58.166 INFO:teuthology.orchestra.run.trial095.stdout:POSIX pshared support yes 2026-02-20T11:40:58.192 INFO:teuthology.orchestra.run.trial095.stdout:pthread_condattr_setclock() yes 2026-02-20T11:40:58.218 INFO:teuthology.orchestra.run.trial095.stdout:pthread_sigmask() yes 2026-02-20T11:40:58.240 INFO:teuthology.orchestra.run.trial095.stdout:pthread_getaffinity_np() yes 2026-02-20T11:40:58.247 INFO:teuthology.orchestra.run.trial095.stdout:Solaris AIO support no 2026-02-20T11:40:58.269 INFO:teuthology.orchestra.run.trial095.stdout:__sync_fetch_and_add yes 2026-02-20T11:40:58.289 INFO:teuthology.orchestra.run.trial095.stdout:__sync_synchronize yes 2026-02-20T11:40:58.308 INFO:teuthology.orchestra.run.trial095.stdout:__sync_val_compare_and_swap yes 2026-02-20T11:40:58.313 INFO:teuthology.orchestra.run.trial095.stdout:libverbs no 2026-02-20T11:40:58.321 INFO:teuthology.orchestra.run.trial095.stdout:rdmacm no 2026-02-20T11:40:58.342 INFO:teuthology.orchestra.run.trial095.stdout:asprintf() yes 2026-02-20T11:40:58.363 INFO:teuthology.orchestra.run.trial095.stdout:vasprintf() yes 2026-02-20T11:40:58.384 INFO:teuthology.orchestra.run.trial095.stdout:Linux fallocate yes 2026-02-20T11:40:58.405 INFO:teuthology.orchestra.run.trial095.stdout:POSIX fadvise yes 2026-02-20T11:40:58.426 INFO:teuthology.orchestra.run.trial095.stdout:POSIX fallocate yes 2026-02-20T11:40:58.446 INFO:teuthology.orchestra.run.trial095.stdout:sched_setaffinity(3 arg) yes 2026-02-20T11:40:58.447 INFO:teuthology.orchestra.run.trial095.stdout:sched_setaffinity(2 arg) no 2026-02-20T11:40:58.467 INFO:teuthology.orchestra.run.trial095.stdout:clock_gettime yes 2026-02-20T11:40:58.489 INFO:teuthology.orchestra.run.trial095.stdout:CLOCK_MONOTONIC yes 2026-02-20T11:40:58.510 INFO:teuthology.orchestra.run.trial095.stdout:gettimeofday yes 2026-02-20T11:40:58.533 INFO:teuthology.orchestra.run.trial095.stdout:fdatasync yes 2026-02-20T11:40:58.554 INFO:teuthology.orchestra.run.trial095.stdout:pipe() yes 2026-02-20T11:40:58.575 INFO:teuthology.orchestra.run.trial095.stdout:pipe2() yes 2026-02-20T11:40:58.595 INFO:teuthology.orchestra.run.trial095.stdout:pread() yes 2026-02-20T11:40:58.618 INFO:teuthology.orchestra.run.trial095.stdout:sync_file_range yes 2026-02-20T11:40:58.623 INFO:teuthology.orchestra.run.trial095.stdout:ASharedMemory_create no 2026-02-20T11:40:58.631 INFO:teuthology.orchestra.run.trial095.stdout:EXT4 move extent yes 2026-02-20T11:40:58.653 INFO:teuthology.orchestra.run.trial095.stdout:Linux splice(2) yes 2026-02-20T11:40:58.659 INFO:teuthology.orchestra.run.trial095.stdout:libnuma no 2026-02-20T11:40:58.680 INFO:teuthology.orchestra.run.trial095.stdout:strsep yes 2026-02-20T11:40:58.700 INFO:teuthology.orchestra.run.trial095.stdout:strcasestr yes 2026-02-20T11:40:58.709 INFO:teuthology.orchestra.run.trial095.stdout:strlcat no 2026-02-20T11:40:58.731 INFO:teuthology.orchestra.run.trial095.stdout:getopt_long_only() yes 2026-02-20T11:40:58.757 INFO:teuthology.orchestra.run.trial095.stdout:inet_aton yes 2026-02-20T11:40:58.777 INFO:teuthology.orchestra.run.trial095.stdout:socklen_t yes 2026-02-20T11:40:58.799 INFO:teuthology.orchestra.run.trial095.stdout:__thread yes 2026-02-20T11:40:58.820 INFO:teuthology.orchestra.run.trial095.stdout:RUSAGE_THREAD yes 2026-02-20T11:40:58.839 INFO:teuthology.orchestra.run.trial095.stdout:SCHED_IDLE yes 2026-02-20T11:40:58.863 INFO:teuthology.orchestra.run.trial095.stdout:TCP_NODELAY yes 2026-02-20T11:40:58.884 INFO:teuthology.orchestra.run.trial095.stdout:vsock yes 2026-02-20T11:40:58.905 INFO:teuthology.orchestra.run.trial095.stdout:Net engine window_size yes 2026-02-20T11:40:58.927 INFO:teuthology.orchestra.run.trial095.stdout:TCP_MAXSEG yes 2026-02-20T11:40:58.946 INFO:teuthology.orchestra.run.trial095.stdout:RLIMIT_MEMLOCK yes 2026-02-20T11:40:58.968 INFO:teuthology.orchestra.run.trial095.stdout:pwritev/preadv yes 2026-02-20T11:40:58.990 INFO:teuthology.orchestra.run.trial095.stdout:pwritev2/preadv2 yes 2026-02-20T11:40:59.012 INFO:teuthology.orchestra.run.trial095.stdout:IPv6 helpers yes 2026-02-20T11:40:59.024 INFO:teuthology.orchestra.run.trial095.stdout:http engine no 2026-02-20T11:40:59.075 INFO:teuthology.orchestra.run.trial095.stdout:Rados engine yes 2026-02-20T11:40:59.144 INFO:teuthology.orchestra.run.trial095.stdout:Rados Block Device engine yes 2026-02-20T11:40:59.209 INFO:teuthology.orchestra.run.trial095.stdout:rbd_poll yes 2026-02-20T11:40:59.274 INFO:teuthology.orchestra.run.trial095.stdout:rbd_invalidate_cache yes 2026-02-20T11:40:59.340 INFO:teuthology.orchestra.run.trial095.stdout:rbd_encryption_load yes 2026-02-20T11:40:59.362 INFO:teuthology.orchestra.run.trial095.stdout:setvbuf yes 2026-02-20T11:40:59.367 INFO:teuthology.orchestra.run.trial095.stdout:Gluster API engine no 2026-02-20T11:40:59.379 INFO:teuthology.orchestra.run.trial095.stdout:s390_z196_facilities no 2026-02-20T11:40:59.379 INFO:teuthology.orchestra.run.trial095.stdout:HDFS engine no 2026-02-20T11:40:59.399 INFO:teuthology.orchestra.run.trial095.stdout:MTD yes 2026-02-20T11:40:59.404 INFO:teuthology.orchestra.run.trial095.stdout:libpmem no 2026-02-20T11:40:59.405 INFO:teuthology.orchestra.run.trial095.stdout:libpmem1_5 no 2026-02-20T11:40:59.409 INFO:teuthology.orchestra.run.trial095.stdout:libpmem2 no 2026-02-20T11:40:59.409 INFO:teuthology.orchestra.run.trial095.stdout:PMDK dev-dax engine no 2026-02-20T11:40:59.409 INFO:teuthology.orchestra.run.trial095.stdout:PMDK libpmem engine no 2026-02-20T11:40:59.414 INFO:teuthology.orchestra.run.trial095.stdout:DDN's Infinite Memory Engine no 2026-02-20T11:40:59.414 INFO:teuthology.orchestra.run.trial095.stdout:iscsi engine no 2026-02-20T11:40:59.414 INFO:teuthology.orchestra.run.trial095.stdout:NBD engine no 2026-02-20T11:40:59.421 INFO:teuthology.orchestra.run.trial095.stdout:DAOS File System (dfs) Engine no 2026-02-20T11:40:59.429 INFO:teuthology.orchestra.run.trial095.stdout:NFS engine no 2026-02-20T11:40:59.429 INFO:teuthology.orchestra.run.trial095.stdout:lex/yacc for arithmetic no 2026-02-20T11:40:59.449 INFO:teuthology.orchestra.run.trial095.stdout:getmntent yes 2026-02-20T11:40:59.462 INFO:teuthology.orchestra.run.trial095.stdout:getmntinfo no 2026-02-20T11:40:59.492 INFO:teuthology.orchestra.run.trial095.stdout:Static Assert yes 2026-02-20T11:40:59.509 INFO:teuthology.orchestra.run.trial095.stdout:bool yes 2026-02-20T11:40:59.533 INFO:teuthology.orchestra.run.trial095.stdout:strndup yes 2026-02-20T11:40:59.539 INFO:teuthology.orchestra.run.trial095.stdout:Valgrind headers no 2026-02-20T11:40:59.559 INFO:teuthology.orchestra.run.trial095.stdout:Zoned block device support yes 2026-02-20T11:40:59.578 INFO:teuthology.orchestra.run.trial095.stdout:Zoned block device capacity yes 2026-02-20T11:40:59.583 INFO:teuthology.orchestra.run.trial095.stdout:libzbc engine no 2026-02-20T11:40:59.603 INFO:teuthology.orchestra.run.trial095.stdout:NVMe uring command support yes 2026-02-20T11:40:59.615 INFO:teuthology.orchestra.run.trial095.stdout:xnvme engine no 2026-02-20T11:40:59.621 INFO:teuthology.orchestra.run.trial095.stdout:isal no 2026-02-20T11:40:59.622 INFO:teuthology.orchestra.run.trial095.stdout:isal CRC64 no 2026-02-20T11:40:59.633 INFO:teuthology.orchestra.run.trial095.stdout:libblkio engine no 2026-02-20T11:40:59.633 INFO:teuthology.orchestra.run.trial095.stdout:march_armv8_a_crc_crypto no 2026-02-20T11:40:59.633 INFO:teuthology.orchestra.run.trial095.stdout:cuda no 2026-02-20T11:40:59.633 INFO:teuthology.orchestra.run.trial095.stdout:libcufile no 2026-02-20T11:40:59.655 INFO:teuthology.orchestra.run.trial095.stdout:Build march=native yes 2026-02-20T11:40:59.660 INFO:teuthology.orchestra.run.trial095.stdout:CUnit no 2026-02-20T11:40:59.680 INFO:teuthology.orchestra.run.trial095.stdout:__kernel_rwf_t yes 2026-02-20T11:40:59.698 INFO:teuthology.orchestra.run.trial095.stdout:-Wimplicit-fallthrough=2 yes 2026-02-20T11:40:59.719 INFO:teuthology.orchestra.run.trial095.stdout:-Wno-stringop-truncation yes 2026-02-20T11:40:59.740 INFO:teuthology.orchestra.run.trial095.stdout:MADV_HUGEPAGE yes 2026-02-20T11:40:59.762 INFO:teuthology.orchestra.run.trial095.stdout:gettid yes 2026-02-20T11:40:59.788 INFO:teuthology.orchestra.run.trial095.stdout:statx(2)/libc yes 2026-02-20T11:40:59.810 INFO:teuthology.orchestra.run.trial095.stdout:statx(2)/syscall yes 2026-02-20T11:40:59.811 INFO:teuthology.orchestra.run.trial095.stdout:Windows PDB generation no 2026-02-20T11:40:59.831 INFO:teuthology.orchestra.run.trial095.stdout:timerfd_create yes 2026-02-20T11:40:59.833 INFO:teuthology.orchestra.run.trial095.stdout:Consider installing zlib1g-dev (zlib-devel) as some fio features depend on it. 2026-02-20T11:40:59.833 INFO:teuthology.orchestra.run.trial095.stdout:Lib-based ioengines dynamic no 2026-02-20T11:40:59.875 INFO:teuthology.orchestra.run.trial095.stdout:TCMalloc support yes 2026-02-20T11:40:59.876 INFO:teuthology.orchestra.run.trial095.stdout:seed_buckets 4 2026-02-20T11:40:59.921 INFO:teuthology.orchestra.run.trial095.stderr:FIO_VERSION = fio-3.41-110-g1a04e5 2026-02-20T11:40:59.944 INFO:teuthology.orchestra.run.trial095.stdout: CC crc/crc16.o 2026-02-20T11:40:59.978 INFO:teuthology.orchestra.run.trial095.stdout: CC crc/crc32.o 2026-02-20T11:41:00.005 INFO:teuthology.orchestra.run.trial095.stdout: CC crc/crc32c-arm64.o 2026-02-20T11:41:00.049 INFO:teuthology.orchestra.run.trial095.stdout: CC crc/crc32c-intel.o 2026-02-20T11:41:00.080 INFO:teuthology.orchestra.run.trial095.stdout: CC crc/crc32c.o 2026-02-20T11:41:00.109 INFO:teuthology.orchestra.run.trial095.stdout: CC crc/crc64.o 2026-02-20T11:41:00.137 INFO:teuthology.orchestra.run.trial095.stdout: CC crc/crc7.o 2026-02-20T11:41:00.162 INFO:teuthology.orchestra.run.trial095.stdout: CC crc/crct10dif_common.o 2026-02-20T11:41:00.187 INFO:teuthology.orchestra.run.trial095.stdout: CC crc/fnv.o 2026-02-20T11:41:00.216 INFO:teuthology.orchestra.run.trial095.stdout: CC crc/md5.o 2026-02-20T11:41:00.272 INFO:teuthology.orchestra.run.trial095.stdout: CC crc/murmur3.o 2026-02-20T11:41:00.302 INFO:teuthology.orchestra.run.trial095.stdout: CC crc/sha1.o 2026-02-20T11:41:00.398 INFO:teuthology.orchestra.run.trial095.stdout: CC crc/sha256.o 2026-02-20T11:41:00.538 INFO:teuthology.orchestra.run.trial095.stdout: CC crc/sha3.o 2026-02-20T11:41:00.620 INFO:teuthology.orchestra.run.trial095.stdout: CC crc/sha512.o 2026-02-20T11:41:00.688 INFO:teuthology.orchestra.run.trial095.stdout: CC crc/test.o 2026-02-20T11:41:00.781 INFO:teuthology.orchestra.run.trial095.stdout: CC crc/xxhash.o 2026-02-20T11:41:00.836 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/axmap.o 2026-02-20T11:41:00.908 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/bloom.o 2026-02-20T11:41:00.959 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/flist_sort.o 2026-02-20T11:41:01.004 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/gauss.o 2026-02-20T11:41:01.055 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/getrusage.o 2026-02-20T11:41:01.084 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/hweight.o 2026-02-20T11:41:01.113 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/ieee754.o 2026-02-20T11:41:01.145 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/lfsr.o 2026-02-20T11:41:01.203 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/memalign.o 2026-02-20T11:41:01.236 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/memcpy.o 2026-02-20T11:41:01.320 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/mountcheck.o 2026-02-20T11:41:01.349 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/num2str.o 2026-02-20T11:41:01.394 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/output_buffer.o 2026-02-20T11:41:01.427 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/pattern.o 2026-02-20T11:41:01.508 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/prio_tree.o 2026-02-20T11:41:01.577 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/rand.o 2026-02-20T11:41:01.654 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/rbtree.o 2026-02-20T11:41:01.726 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/strntol.o 2026-02-20T11:41:01.761 INFO:teuthology.orchestra.run.trial095.stdout: CC lib/zipf.o 2026-02-20T11:41:01.828 INFO:teuthology.orchestra.run.trial095.stdout: CC gettime.o 2026-02-20T11:41:01.981 INFO:teuthology.orchestra.run.trial095.stdout: CC ioengines.o 2026-02-20T11:41:02.120 INFO:teuthology.orchestra.run.trial095.stdout: CC init.o 2026-02-20T11:41:02.501 INFO:teuthology.orchestra.run.trial095.stdout: CC stat.o 2026-02-20T11:41:03.204 INFO:teuthology.orchestra.run.trial095.stdout: CC log.o 2026-02-20T11:41:03.277 INFO:teuthology.orchestra.run.trial095.stdout: CC time.o 2026-02-20T11:41:03.366 INFO:teuthology.orchestra.run.trial095.stdout: CC filesetup.o 2026-02-20T11:41:03.697 INFO:teuthology.orchestra.run.trial095.stdout: CC eta.o 2026-02-20T11:41:03.863 INFO:teuthology.orchestra.run.trial095.stdout: CC verify.o 2026-02-20T11:41:04.202 INFO:teuthology.orchestra.run.trial095.stdout: CC memory.o 2026-02-20T11:41:04.296 INFO:teuthology.orchestra.run.trial095.stdout: CC io_u.o 2026-02-20T11:41:04.677 INFO:teuthology.orchestra.run.trial095.stdout: CC parse.o 2026-02-20T11:41:04.901 INFO:teuthology.orchestra.run.trial095.stdout: CC fio_sem.o 2026-02-20T11:41:04.966 INFO:teuthology.orchestra.run.trial095.stdout: CC rwlock.o 2026-02-20T11:41:05.016 INFO:teuthology.orchestra.run.trial095.stdout: CC pshared.o 2026-02-20T11:41:05.057 INFO:teuthology.orchestra.run.trial095.stdout: CC options.o 2026-02-20T11:41:05.457 INFO:teuthology.orchestra.run.trial095.stdout: CC fio_shared_sem.o 2026-02-20T11:41:05.491 INFO:teuthology.orchestra.run.trial095.stdout: CC smalloc.o 2026-02-20T11:41:05.595 INFO:teuthology.orchestra.run.trial095.stdout: CC filehash.o 2026-02-20T11:41:05.682 INFO:teuthology.orchestra.run.trial095.stdout: CC profile.o 2026-02-20T11:41:05.755 INFO:teuthology.orchestra.run.trial095.stdout: CC debug.o 2026-02-20T11:41:05.784 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/cpu.o 2026-02-20T11:41:05.863 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/mmap.o 2026-02-20T11:41:05.955 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/sync.o 2026-02-20T11:41:06.077 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/null.o 2026-02-20T11:41:06.147 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/net.o 2026-02-20T11:41:06.354 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/ftruncate.o 2026-02-20T11:41:06.415 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/fileoperations.o 2026-02-20T11:41:06.502 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/exec.o 2026-02-20T11:41:06.587 INFO:teuthology.orchestra.run.trial095.stdout: CC server.o 2026-02-20T11:41:06.939 INFO:teuthology.orchestra.run.trial095.stdout: CC client.o 2026-02-20T11:41:07.222 INFO:teuthology.orchestra.run.trial095.stdout: CC iolog.o 2026-02-20T11:41:07.450 INFO:teuthology.orchestra.run.trial095.stdout: CC backend.o 2026-02-20T11:41:07.866 INFO:teuthology.orchestra.run.trial095.stdout: CC libfio.o 2026-02-20T11:41:07.964 INFO:teuthology.orchestra.run.trial095.stdout: CC flow.o 2026-02-20T11:41:08.033 INFO:teuthology.orchestra.run.trial095.stdout: CC cconv.o 2026-02-20T11:41:08.254 INFO:teuthology.orchestra.run.trial095.stdout: CC gettime-thread.o 2026-02-20T11:41:08.318 INFO:teuthology.orchestra.run.trial095.stdout: CC helpers.o 2026-02-20T11:41:08.360 INFO:teuthology.orchestra.run.trial095.stdout: CC json.o 2026-02-20T11:41:08.458 INFO:teuthology.orchestra.run.trial095.stdout: CC idletime.o 2026-02-20T11:41:08.577 INFO:teuthology.orchestra.run.trial095.stdout: CC td_error.o 2026-02-20T11:41:08.637 INFO:teuthology.orchestra.run.trial095.stdout: CC profiles/tiobench.o 2026-02-20T11:41:08.698 INFO:teuthology.orchestra.run.trial095.stdout: CC profiles/act.o 2026-02-20T11:41:08.786 INFO:teuthology.orchestra.run.trial095.stdout: CC io_u_queue.o 2026-02-20T11:41:08.820 INFO:teuthology.orchestra.run.trial095.stdout: CC filelock.o 2026-02-20T11:41:08.891 INFO:teuthology.orchestra.run.trial095.stdout: CC workqueue.o 2026-02-20T11:41:08.990 INFO:teuthology.orchestra.run.trial095.stdout: CC rate-submit.o 2026-02-20T11:41:09.076 INFO:teuthology.orchestra.run.trial095.stdout: CC optgroup.o 2026-02-20T11:41:09.107 INFO:teuthology.orchestra.run.trial095.stdout: CC helper_thread.o 2026-02-20T11:41:09.205 INFO:teuthology.orchestra.run.trial095.stdout: CC steadystate.o 2026-02-20T11:41:09.347 INFO:teuthology.orchestra.run.trial095.stdout: CC zone-dist.o 2026-02-20T11:41:09.423 INFO:teuthology.orchestra.run.trial095.stdout: CC zbd.o 2026-02-20T11:41:09.787 INFO:teuthology.orchestra.run.trial095.stdout: CC dedupe.o 2026-02-20T11:41:09.867 INFO:teuthology.orchestra.run.trial095.stdout: CC dataplacement.o 2026-02-20T11:41:09.961 INFO:teuthology.orchestra.run.trial095.stdout: CC sprandom.o 2026-02-20T11:41:10.120 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/posixaio.o 2026-02-20T11:41:10.199 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/falloc.o 2026-02-20T11:41:10.264 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/e4defrag.o 2026-02-20T11:41:10.342 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/splice.o 2026-02-20T11:41:10.441 INFO:teuthology.orchestra.run.trial095.stdout: CC oslib/asprintf.o 2026-02-20T11:41:10.467 INFO:teuthology.orchestra.run.trial095.stdout: CC oslib/strlcat.o 2026-02-20T11:41:10.498 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/mtd.o 2026-02-20T11:41:10.584 INFO:teuthology.orchestra.run.trial095.stdout: CC oslib/libmtd.o 2026-02-20T11:41:10.775 INFO:teuthology.orchestra.run.trial095.stdout: CC oslib/libmtd_legacy.o 2026-02-20T11:41:10.850 INFO:teuthology.orchestra.run.trial095.stdout: CC diskutil.o 2026-02-20T11:41:10.962 INFO:teuthology.orchestra.run.trial095.stdout: CC fifo.o 2026-02-20T11:41:10.999 INFO:teuthology.orchestra.run.trial095.stdout: CC blktrace.o 2026-02-20T11:41:11.164 INFO:teuthology.orchestra.run.trial095.stdout: CC cgroup.o 2026-02-20T11:41:11.250 INFO:teuthology.orchestra.run.trial095.stdout: CC trim.o 2026-02-20T11:41:11.319 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/sg.o 2026-02-20T11:41:11.513 INFO:teuthology.orchestra.run.trial095.stdout: CC oslib/linux-dev-lookup.o 2026-02-20T11:41:11.552 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/io_uring.o 2026-02-20T11:41:11.791 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/nvme.o 2026-02-20T11:41:11.953 INFO:teuthology.orchestra.run.trial095.stdout: CC oslib/linux-blkzoned.o 2026-02-20T11:41:12.045 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/cmdprio.o 2026-02-20T11:41:12.171 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/rados.o 2026-02-20T11:41:12.272 INFO:teuthology.orchestra.run.trial095.stdout: CC engines/rbd.o 2026-02-20T11:41:12.374 INFO:teuthology.orchestra.run.trial095.stdout: CC fio.o 2026-02-20T11:41:12.428 INFO:teuthology.orchestra.run.trial095.stdout: LINK fio 2026-02-20T11:41:12.550 INFO:teuthology.orchestra.run.trial095.stdout: CC t/log.o 2026-02-20T11:41:12.580 INFO:teuthology.orchestra.run.trial095.stdout: CC t/genzipf.o 2026-02-20T11:41:12.656 INFO:teuthology.orchestra.run.trial095.stdout: CC oslib/strcasestr.o 2026-02-20T11:41:12.677 INFO:teuthology.orchestra.run.trial095.stdout: CC oslib/strndup.o 2026-02-20T11:41:12.697 INFO:teuthology.orchestra.run.trial095.stdout: LINK t/fio-genzipf 2026-02-20T11:41:12.754 INFO:teuthology.orchestra.run.trial095.stdout: CC t/btrace2fio.o 2026-02-20T11:41:12.950 INFO:teuthology.orchestra.run.trial095.stdout: LINK t/fio-btrace2fio 2026-02-20T11:41:13.005 INFO:teuthology.orchestra.run.trial095.stdout: CC t/verify-state.o 2026-02-20T11:41:13.066 INFO:teuthology.orchestra.run.trial095.stdout: CC t/debug.o 2026-02-20T11:41:13.092 INFO:teuthology.orchestra.run.trial095.stdout: LINK t/fio-verify-state 2026-02-20T11:41:13.146 INFO:teuthology.orchestra.run.trial095.stdout: CC t/stest.o 2026-02-20T11:41:13.195 INFO:teuthology.orchestra.run.trial095.stdout: CC t/arch.o 2026-02-20T11:41:13.221 INFO:teuthology.orchestra.run.trial095.stdout: LINK t/stest 2026-02-20T11:41:13.277 INFO:teuthology.orchestra.run.trial095.stdout: CC t/ieee754.o 2026-02-20T11:41:13.306 INFO:teuthology.orchestra.run.trial095.stdout: LINK t/ieee754 2026-02-20T11:41:13.358 INFO:teuthology.orchestra.run.trial095.stdout: CC t/axmap.o 2026-02-20T11:41:13.416 INFO:teuthology.orchestra.run.trial095.stdout: LINK t/axmap 2026-02-20T11:41:13.471 INFO:teuthology.orchestra.run.trial095.stdout: CC t/lfsr-test.o 2026-02-20T11:41:13.526 INFO:teuthology.orchestra.run.trial095.stdout: LINK t/lfsr-test 2026-02-20T11:41:13.581 INFO:teuthology.orchestra.run.trial095.stdout: CC t/gen-rand.o 2026-02-20T11:41:13.636 INFO:teuthology.orchestra.run.trial095.stdout: LINK t/gen-rand 2026-02-20T11:41:13.690 INFO:teuthology.orchestra.run.trial095.stdout: CC t/memlock.o 2026-02-20T11:41:13.731 INFO:teuthology.orchestra.run.trial095.stdout: LINK t/memlock 2026-02-20T11:41:13.784 INFO:teuthology.orchestra.run.trial095.stdout: CC t/read-to-pipe-async.o 2026-02-20T11:41:13.888 INFO:teuthology.orchestra.run.trial095.stdout: LINK t/read-to-pipe-async 2026-02-20T11:41:13.940 INFO:teuthology.orchestra.run.trial095.stdout: CC t/io_uring.o 2026-02-20T11:41:14.211 INFO:teuthology.orchestra.run.trial095.stdout: LINK t/io_uring 2026-02-20T11:41:14.266 DEBUG:teuthology.orchestra.run.trial095:> sudo /sbin/sysctl -q -w kernel.perf_event_paranoid=0 2026-02-20T11:41:14.294 DEBUG:teuthology.orchestra.run.trial095:> /home/ubuntu/cephtest/cbt/cbt.py -a /home/ubuntu/cephtest/archive/cbt /home/ubuntu/cephtest/archive/cbt/cbt_config.yaml 2026-02-20T11:41:14.406 INFO:teuthology.orchestra.run.trial095.stderr:11:41:14 - DEBUG - cbt - Settings.cluster: 2026-02-20T11:41:14.406 INFO:teuthology.orchestra.run.trial095.stderr: {'archive_dir': '/home/ubuntu/cephtest/archive/cbt', 2026-02-20T11:41:14.406 INFO:teuthology.orchestra.run.trial095.stderr: 'clients': ['ubuntu@trial095.front.sepia.ceph.com'], 2026-02-20T11:41:14.406 INFO:teuthology.orchestra.run.trial095.stderr: 'conf_file': '/etc/ceph/ceph.conf', 2026-02-20T11:41:14.407 INFO:teuthology.orchestra.run.trial095.stderr: 'head': 'ubuntu@trial095.front.sepia.ceph.com', 2026-02-20T11:41:14.407 INFO:teuthology.orchestra.run.trial095.stderr: 'is_teuthology': True, 2026-02-20T11:41:14.407 INFO:teuthology.orchestra.run.trial095.stderr: 'iterations': 1, 2026-02-20T11:41:14.407 INFO:teuthology.orchestra.run.trial095.stderr: 'mons': ['ubuntu@trial095.front.sepia.ceph.com'], 2026-02-20T11:41:14.407 INFO:teuthology.orchestra.run.trial095.stderr: 'osds': ['ubuntu@trial095.front.sepia.ceph.com'], 2026-02-20T11:41:14.407 INFO:teuthology.orchestra.run.trial095.stderr: 'osds_per_node': 3, 2026-02-20T11:41:14.407 INFO:teuthology.orchestra.run.trial095.stderr: 'pid_dir': '/var/run/ceph', 2026-02-20T11:41:14.407 INFO:teuthology.orchestra.run.trial095.stderr: 'pool_profiles': {'rbd': {'pg_size': 128, 'pgp_size': 128, 'replication': 3}}, 2026-02-20T11:41:14.407 INFO:teuthology.orchestra.run.trial095.stderr: 'rebuild_every_test': False, 2026-02-20T11:41:14.407 INFO:teuthology.orchestra.run.trial095.stderr: 'rgws': {'ubuntu@trial095.front.sepia.ceph.com': None}, 2026-02-20T11:41:14.407 INFO:teuthology.orchestra.run.trial095.stderr: 'tmp_dir': '/tmp/cbt', 2026-02-20T11:41:14.407 INFO:teuthology.orchestra.run.trial095.stderr: 'use_existing': True, 2026-02-20T11:41:14.408 INFO:teuthology.orchestra.run.trial095.stderr: 'user': 'ubuntu'} 2026-02-20T11:41:14.408 INFO:teuthology.orchestra.run.trial095.stderr:11:41:14 - INFO - cbt - Results dir: /home/ubuntu/cephtest/archive/cbt/results/00000000/id-7d4bb5d5 2026-02-20T11:41:14.408 INFO:teuthology.orchestra.run.trial095.stderr:11:41:14 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com if [ -d "/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite" ]; then rm -rf /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite; fi 2026-02-20T11:41:14.572 INFO:teuthology.orchestra.run.trial095.stderr:11:41:14 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite 2026-02-20T11:41:14.734 INFO:teuthology.orchestra.run.trial095.stderr:11:41:14 - INFO - cbt - Pausing for 60s for idle monitoring. 2026-02-20T11:41:14.734 INFO:teuthology.orchestra.run.trial095.stderr:11:41:14 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/idle_monitoring/collectl 2026-02-20T11:41:14.895 INFO:teuthology.orchestra.run.trial095.stderr:11:41:14 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com collectl -s+mYZ -i 1:10 -F0 -f /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/idle_monitoring/collectl --rawdskfilt \"+cciss/c\d+d\d+ |hd[ab] | sd[a-z]+ |dm-\d+ |xvd[a-z] |fio[a-z]+ | vd[a-z]+ |emcpower[a-z]+ |psv\d+ |nvme[0-9]n[0-9]+p[0-9]+ \" 2026-02-20T11:41:14.897 INFO:teuthology.orchestra.run.trial095.stderr:11:41:14 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/idle_monitoring/perf 2026-02-20T11:41:15.064 INFO:teuthology.orchestra.run.trial095.stderr:11:41:15 - DEBUG - cbt - PerfMonitoring: remote_node 2026-02-20T11:41:15.065 INFO:teuthology.orchestra.run.trial095.stderr:11:41:15 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com for pid in `cat /var/run/ceph/crimson-osd.*.pid`; do perf stat -p ${pid} -o /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/idle_monitoring/perf/perf_stat.${pid} & done 2026-02-20T11:42:15.127 INFO:teuthology.orchestra.run.trial095.stderr:11:42:15 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com pkill -SIGINT -f collectl 2026-02-20T11:42:15.304 INFO:teuthology.orchestra.run.trial095.stderr:11:42:15 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo pkill -SIGINT -f perf\ 2026-02-20T11:42:15.485 INFO:teuthology.orchestra.run.trial095.stderr:11:42:15 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo chown -R ubuntu.ubuntu /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/* 2026-02-20T11:42:15.662 INFO:teuthology.orchestra.run.trial095.stderr:11:42:15 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=rpdcp -f 10 -R ssh -w ubuntu@trial095.front.sepia.ceph.com -r /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/* /home/ubuntu/cephtest/archive/cbt/results/00000000/id-7d4bb5d5 2026-02-20T11:42:15.823 INFO:teuthology.orchestra.run.trial095.stderr:11:42:15 - INFO - cbt - Creating fio images... 2026-02-20T11:42:15.823 INFO:teuthology.orchestra.run.trial095.stderr:11:42:15 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/pool_monitoring/collectl 2026-02-20T11:42:15.988 INFO:teuthology.orchestra.run.trial095.stderr:11:42:15 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com collectl -s+mYZ -i 1:10 -F0 -f /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/pool_monitoring/collectl --rawdskfilt \"+cciss/c\d+d\d+ |hd[ab] | sd[a-z]+ |dm-\d+ |xvd[a-z] |fio[a-z]+ | vd[a-z]+ |emcpower[a-z]+ |psv\d+ |nvme[0-9]n[0-9]+p[0-9]+ \" 2026-02-20T11:42:15.989 INFO:teuthology.orchestra.run.trial095.stderr:11:42:15 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/pool_monitoring/perf 2026-02-20T11:42:16.152 INFO:teuthology.orchestra.run.trial095.stderr:11:42:16 - DEBUG - cbt - PerfMonitoring: remote_node 2026-02-20T11:42:16.152 INFO:teuthology.orchestra.run.trial095.stderr:11:42:16 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com for pid in `cat /var/run/ceph/crimson-osd.*.pid`; do perf stat -p ${pid} -o /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/pool_monitoring/perf/perf_stat.${pid} & done 2026-02-20T11:42:16.154 INFO:teuthology.orchestra.run.trial095.stderr:11:42:16 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool delete cbt-librbdfio cbt-librbdfio --yes-i-really-really-mean-it 2026-02-20T11:42:16.500 INFO:teuthology.orchestra.run.trial095.stderr:11:42:16 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool create cbt-librbdfio 128 128 2026-02-20T11:42:17.798 INFO:teuthology.orchestra.run.trial095.stderr:11:42:17 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool application enable cbt-librbdfio rbd 2026-02-20T11:42:18.801 INFO:teuthology.orchestra.run.trial095.stderr:11:42:18 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool set cbt-librbdfio size 3 2026-02-20T11:42:19.806 INFO:teuthology.orchestra.run.trial095.stderr:11:42:19 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool set cbt-librbdfio min_size 2 2026-02-20T11:42:20.807 INFO:teuthology.orchestra.run.trial095.stderr:11:42:20 - INFO - cbt - Checking Health after pool creation. 2026-02-20T11:42:25.813 INFO:teuthology.orchestra.run.trial095.stderr:11:42:25 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com /usr/bin/ceph -c /etc/ceph/ceph.conf health 2026-02-20T11:42:26.171 INFO:teuthology.orchestra.run.trial095.stderr:11:42:26 - INFO - cbt - Final Pool Health Check. 2026-02-20T11:42:31.177 INFO:teuthology.orchestra.run.trial095.stderr:11:42:31 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com /usr/bin/ceph -c /etc/ceph/ceph.conf health 2026-02-20T11:42:31.538 INFO:teuthology.orchestra.run.trial095.stderr:11:42:31 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com hostname -f 2026-02-20T11:42:31.704 INFO:teuthology.orchestra.run.trial095.stderr:11:42:31 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com /usr/bin/rbd -c /etc/ceph/ceph.conf create cbt-librbdfio-trial095-0 --size 4096 --pool cbt-librbdfio --order 22 2026-02-20T11:42:33.928 INFO:teuthology.orchestra.run.trial095.stderr:11:42:33 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com /usr/bin/rbd -c /etc/ceph/ceph.conf create cbt-librbdfio-trial095-1 --size 4096 --pool cbt-librbdfio --order 22 2026-02-20T11:42:34.175 INFO:teuthology.orchestra.run.trial095.stderr:11:42:34 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com pkill -SIGINT -f collectl 2026-02-20T11:42:34.349 INFO:teuthology.orchestra.run.trial095.stderr:11:42:34 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo pkill -SIGINT -f perf\ 2026-02-20T11:42:34.526 INFO:teuthology.orchestra.run.trial095.stderr:11:42:34 - INFO - cbt - Attempting to prefill fio images... 2026-02-20T11:42:34.527 INFO:teuthology.orchestra.run.trial095.stderr:11:42:34 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-0 --invalidate=0 --rw=write --numjobs=1 --bs=4M --size 4096M --name=cbt-librbdfio-`hostname -f`-file-0 --output-format=json,normal > /dev/null 2026-02-20T11:42:34.528 INFO:teuthology.orchestra.run.trial095.stderr:11:42:34 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-1 --invalidate=0 --rw=write --numjobs=1 --bs=4M --size 4096M --name=cbt-librbdfio-`hostname -f`-file-0 --output-format=json,normal > /dev/null 2026-02-20T11:43:11.578 INFO:teuthology.orchestra.run.trial095.stderr:11:43:11 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-0 --invalidate=0 --rw=write --numjobs=1 --bs=4M --size 4096M --name=cbt-librbdfio-`hostname -f`-file-0 --output-format=json,normal > /dev/null 2026-02-20T11:43:11.580 INFO:teuthology.orchestra.run.trial095.stderr:11:43:11 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-1 --invalidate=0 --rw=write --numjobs=1 --bs=4M --size 4096M --name=cbt-librbdfio-`hostname -f`-file-0 --output-format=json,normal > /dev/null 2026-02-20T11:43:34.420 INFO:teuthology.orchestra.run.trial095.stderr:11:43:34 - INFO - cbt - Results dir: /home/ubuntu/cephtest/archive/cbt/results/00000000/id-7d4bb5d5 2026-02-20T11:43:34.421 INFO:teuthology.orchestra.run.trial095.stderr:11:43:34 - INFO - cbt - Skipping existing test in /home/ubuntu/cephtest/archive/cbt/results/00000000/id-7d4bb5d5. 2026-02-20T11:43:34.421 INFO:teuthology.orchestra.run.trial095.stderr:11:43:34 - INFO - cbt - Running benchmark /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite 2026-02-20T11:43:34.421 INFO:teuthology.orchestra.run.trial095.stderr:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-7d4bb5d5 2026-02-20T11:43:34.421 INFO:teuthology.orchestra.run.trial095.stderr:{'cmd_path': '/home/ubuntu/cephtest/fio/fio', 'log_avg_msec': 100, 'norandommap': True, 'pool_profile': 'rbd', 'time': 60, 'vol_size': 4096, 'iodepth': 32, 'mode': 'randwrite', 'op_size': 4194304, 'osd_ra': 4096, 'procs_per_volume': 1, 'volumes_per_client': 2, 'benchmark': 'librbdfio', 'iteration': 0} == iteration 0 == 2026-02-20T11:43:34.421 INFO:teuthology.orchestra.run.trial095.stderr:11:43:34 - INFO - cbt - Setting OSD Read Ahead to: 4096 2026-02-20T11:43:34.421 INFO:teuthology.orchestra.run.trial095.stderr:11:43:34 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com find /dev/disk/by-partlabel/osd-device-*data -exec readlink {} \; | cut -d"/" -f 3 | sed "s/[0-9]$//" | xargs -I{} sudo sh -c "echo 4096 > /sys/block/'{}'/queue/read_ahead_kb" 2026-02-20T11:43:34.422 INFO:teuthology.orchestra.run.trial095.stderr:11:43:34 - DEBUG - cbt - Cleaning existing temporary run directory: /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite 2026-02-20T11:43:34.422 INFO:teuthology.orchestra.run.trial095.stderr:11:43:34 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo rm -rf /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite 2026-02-20T11:43:34.603 INFO:teuthology.orchestra.run.trial095.stderr:11:43:34 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sync 2026-02-20T11:43:34.981 INFO:teuthology.orchestra.run.trial095.stderr:11:43:34 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com echo 3 | sudo tee /proc/sys/vm/drop_caches 2026-02-20T11:43:36.136 INFO:teuthology.orchestra.run.trial095.stderr:11:43:36 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite 2026-02-20T11:43:36.325 INFO:teuthology.orchestra.run.trial095.stderr:11:43:36 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf daemon osd.0 config show > /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/ceph_settings.out 2026-02-20T11:44:01.639 INFO:teuthology.orchestra.run.trial095.stderr:11:44:01 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com echo "[`date`] ceph progress" >> /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/pgautoscaler.log;/usr/bin/ceph -c /etc/ceph/ceph.conf progress | tee -a /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/pgautoscaler.log 2026-02-20T11:44:02.005 INFO:teuthology.orchestra.run.trial095.stderr:11:44:02 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/collectl 2026-02-20T11:44:02.169 INFO:teuthology.orchestra.run.trial095.stderr:11:44:02 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com collectl -s+mYZ -i 1:10 -F0 -f /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/collectl --rawdskfilt \"+cciss/c\d+d\d+ |hd[ab] | sd[a-z]+ |dm-\d+ |xvd[a-z] |fio[a-z]+ | vd[a-z]+ |emcpower[a-z]+ |psv\d+ |nvme[0-9]n[0-9]+p[0-9]+ \" 2026-02-20T11:44:02.170 INFO:teuthology.orchestra.run.trial095.stderr:11:44:02 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/perf 2026-02-20T11:44:02.331 INFO:teuthology.orchestra.run.trial095.stderr:11:44:02 - DEBUG - cbt - PerfMonitoring: remote_node 2026-02-20T11:44:02.331 INFO:teuthology.orchestra.run.trial095.stderr:11:44:02 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com for pid in `cat /var/run/ceph/crimson-osd.*.pid`; do perf stat -p ${pid} -o /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/perf/perf_stat.${pid} & done 2026-02-20T11:44:02.333 INFO:teuthology.orchestra.run.trial095.stderr:11:44:02 - INFO - cbt - Running rbd fio randwrite test. 2026-02-20T11:44:02.333 INFO:teuthology.orchestra.run.trial095.stderr:11:44:02 - DEBUG - cbt - Using rbdname cbt-librbdfio-`hostname -f`-0 2026-02-20T11:44:02.333 INFO:teuthology.orchestra.run.trial095.stderr:11:44:02 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-0 --invalidate=0 --rw=randwrite --output-format=json,normal --runtime=60 --numjobs=1 --direct=1 --bs=4194304B --iodepth=32 --end_fsync=0 --norandommap --write_iops_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/output.0 --write_bw_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/output.0 --write_lat_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/output.0 --log_avg_msec=100 --name=cbt-librbdfio-`hostname -f`-file-0 > /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/output.0 2026-02-20T11:44:02.334 INFO:teuthology.orchestra.run.trial095.stderr:11:44:02 - DEBUG - cbt - Using rbdname cbt-librbdfio-`hostname -f`-1 2026-02-20T11:44:02.335 INFO:teuthology.orchestra.run.trial095.stderr:11:44:02 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-1 --invalidate=0 --rw=randwrite --output-format=json,normal --runtime=60 --numjobs=1 --direct=1 --bs=4194304B --iodepth=32 --end_fsync=0 --norandommap --write_iops_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/output.1 --write_bw_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/output.1 --write_lat_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/output.1 --log_avg_msec=100 --name=cbt-librbdfio-`hostname -f`-file-0 > /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/output.1 2026-02-20T11:44:27.190 INFO:teuthology.orchestra.run.trial095.stderr:11:44:27 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com pkill -SIGINT -f collectl 2026-02-20T11:44:27.367 INFO:teuthology.orchestra.run.trial095.stderr:11:44:27 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo pkill -SIGINT -f perf\ 2026-02-20T11:44:27.548 INFO:teuthology.orchestra.run.trial095.stderr:11:44:27 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/perf/perf.data 2026-02-20T11:44:27.550 INFO:teuthology.orchestra.run.trial095.stderr:11:44:27 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/perf/perf_stat.* 2026-02-20T11:44:27.551 INFO:teuthology.orchestra.run.trial095.stderr:11:44:27 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com find /var/run/ceph/ceph-osd*.asok -maxdepth 1 -exec sudo /usr/bin/ceph --admin-daemon {} dump_historic_ops \; > /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/historic_ops.out 2026-02-20T11:44:27.903 INFO:teuthology.orchestra.run.trial095.stderr:11:44:27 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial095.front.sepia.ceph.com sudo chown -R ubuntu.ubuntu /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/* 2026-02-20T11:44:28.083 INFO:teuthology.orchestra.run.trial095.stderr:11:44:28 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=rpdcp -f 10 -R ssh -w ubuntu@trial095.front.sepia.ceph.com -r /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite/* /home/ubuntu/cephtest/archive/cbt/results/00000000/id-7d4bb5d5 2026-02-20T11:44:28.248 INFO:teuthology.orchestra.run.trial095.stderr:11:44:28 - INFO - cbt - Convert results to json format. 2026-02-20T11:44:28.249 INFO:teuthology.orchestra.run.trial095.stdout:cleaning remote dir /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randwrite 2026-02-20T11:44:28.249 INFO:teuthology.orchestra.run.trial095.stdout:trial095: trial095 2026-02-20T11:44:28.249 INFO:teuthology.orchestra.run.trial095.stdout: 2026-02-20T11:44:28.249 INFO:teuthology.orchestra.run.trial095.stdout:['trial095'] 2026-02-20T11:44:28.258 DEBUG:teuthology.run_tasks:Unwinding manager cbt 2026-02-20T11:44:28.281 DEBUG:teuthology.orchestra.run.trial095:> rm --one-file-system -rf -- /home/ubuntu/cephtest/cbt 2026-02-20T11:44:28.308 DEBUG:teuthology.orchestra.run.trial095:> rm --one-file-system -rf -- /home/ubuntu/cephtest/fio 2026-02-20T11:44:28.388 INFO:tasks.cbt_performance:Collecting CBT performance data config 2026-02-20T11:44:28.388 INFO:tasks.cbt_performance:reading cbt preferences 2026-02-20T11:44:28.388 DEBUG:teuthology.orchestra.run.trial095:> find /home/ubuntu/cephtest -name 'json_output.*' 2026-02-20T11:44:28.445 INFO:teuthology.orchestra.run.trial095.stdout:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-7d4bb5d5/json_output.0.trial095.front.sepia.ceph.com 2026-02-20T11:44:28.446 INFO:teuthology.orchestra.run.trial095.stdout:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-7d4bb5d5/json_output.1.trial095.front.sepia.ceph.com 2026-02-20T11:44:28.446 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:44:28.447 DEBUG:teuthology.orchestra.run.trial095:> dd if=/home/ubuntu/cephtest/archive/cbt/results/00000000/id-7d4bb5d5/json_output.0.trial095.front.sepia.ceph.com of=/dev/stdout 2026-02-20T11:44:28.504 INFO:tasks.cbt_performance:reading total cpu cycles 2026-02-20T11:44:28.505 DEBUG:teuthology.orchestra.run.trial095:> find /home/ubuntu/cephtest/archive/cbt/results/00000000/id-7d4bb5d5 -name 'perf_stat.*' 2026-02-20T11:44:28.561 INFO:tasks.cbt_performance:cpu_cycles_paths: [''] 2026-02-20T11:44:28.561 INFO:tasks.cbt_performance:total cpu cycles: 0 2026-02-20T11:44:28.562 DEBUG:teuthology.orchestra.run.trial095:> set -ex 2026-02-20T11:44:28.562 DEBUG:teuthology.orchestra.run.trial095:> dd if=/home/ubuntu/cephtest/archive/cbt/results/00000000/id-7d4bb5d5/json_output.1.trial095.front.sepia.ceph.com of=/dev/stdout 2026-02-20T11:44:28.620 INFO:tasks.cbt_performance:reading total cpu cycles 2026-02-20T11:44:28.621 DEBUG:teuthology.orchestra.run.trial095:> find /home/ubuntu/cephtest/archive/cbt/results/00000000/id-7d4bb5d5 -name 'perf_stat.*' 2026-02-20T11:44:28.676 INFO:tasks.cbt_performance:cpu_cycles_paths: [''] 2026-02-20T11:44:28.677 INFO:tasks.cbt_performance:total cpu cycles: 0 2026-02-20T11:44:28.682 WARNING:tasks.cbt_performance:Could not send performance data to http://mira118.front.sepia.ceph.com:4000/cbt_performance: HTTPConnectionPool(host='mira118.front.sepia.ceph.com', port=4000): Max retries exceeded with url: /cbt_performance (Caused by NewConnectionError(': Failed to establish a new connection: [Errno -2] Name or service not known')) 2026-02-20T11:44:28.682 WARNING:tasks.cbt_performance:Continuing without performance data collection 2026-02-20T11:44:28.683 DEBUG:teuthology.run_tasks:Unwinding manager ssh_keys 2026-02-20T11:44:28.699 INFO:teuthology.task.ssh_keys:Cleaning up SSH keys 2026-02-20T11:44:28.699 INFO:teuthology.task.ssh_keys:cleaning up keys added for testing 2026-02-20T11:44:28.699 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on trial095.front.sepia.ceph.com 2026-02-20T11:44:28.700 DEBUG:teuthology.orchestra.run.trial095:> rm -- /home/ubuntu/.ssh/id_rsa 2026-02-20T11:44:28.733 DEBUG:teuthology.orchestra.run.trial095:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2026-02-20T11:44:28.790 DEBUG:teuthology.orchestra.run.trial095:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2026-02-20T11:44:28.846 INFO:teuthology.orchestra.run.trial095.stdout:"600" 2026-02-20T11:44:28.847 DEBUG:teuthology.orchestra.run.trial095:> mv -- /home/ubuntu/.ssh/authorized_keys_2026-02-20_11:40:39:919355 /home/ubuntu/.ssh/authorized_keys 2026-02-20T11:44:28.904 DEBUG:teuthology.orchestra.run.trial095:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2026-02-20T11:44:28.961 DEBUG:teuthology.orchestra.run.trial095:> rm /home/ubuntu/.ssh/config 2026-02-20T11:44:29.018 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-20T11:44:29.034 DEBUG:teuthology.orchestra.run.trial095:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-20T11:44:29.134 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:44:29.128+0000 7f2aa05d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:44:29.135 INFO:teuthology.orchestra.run.trial095.stderr:2026-02-20T11:44:29.133+0000 7f2aa05d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:44:29.265 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-20T11:44:29.265 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-20T11:44:29.266 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-20T11:44:29.266 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:44:29.358 INFO:tasks.ceph.osd.0:Stopped 2026-02-20T11:44:29.358 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-20T11:44:29.359 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:44:29.459 INFO:tasks.ceph.osd.1:Stopped 2026-02-20T11:44:29.460 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-20T11:44:29.460 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:44:29.546 INFO:tasks.ceph.osd.2:Stopped 2026-02-20T11:44:29.546 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-20T11:44:29.546 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-20T11:44:29.546 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:44:29.585 INFO:tasks.ceph.mgr.x:Stopped 2026-02-20T11:44:29.585 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-20T11:44:29.585 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-20T11:44:29.585 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:44:29.634 INFO:tasks.ceph.mon.a:Stopped 2026-02-20T11:44:29.635 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-20T11:44:29.635 DEBUG:teuthology.orchestra.run.trial095:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v '\(PG_' | grep -E -v '\(OSD_' | grep -E -v '\(OBJECT_' | grep -E -v 'overall HEALTH' | head -n 1 2026-02-20T11:44:29.703 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial095.front.sepia.ceph.com 2026-02-20T11:44:29.704 DEBUG:teuthology.orchestra.run.trial095:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-20T11:44:29.963 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial095.front.sepia.ceph.com 2026-02-20T11:44:29.963 DEBUG:teuthology.orchestra.run.trial095:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-20T11:44:29.992 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial095.front.sepia.ceph.com 2026-02-20T11:44:29.993 DEBUG:teuthology.orchestra.run.trial095:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-20T11:44:30.062 INFO:tasks.ceph:Archiving mon data... 2026-02-20T11:44:30.063 DEBUG:teuthology.misc:Transferring archived files from trial095:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60536/data/mon.a.tgz 2026-02-20T11:44:30.064 DEBUG:teuthology.orchestra.run.trial095:> mktemp 2026-02-20T11:44:30.119 INFO:teuthology.orchestra.run.trial095.stdout:/tmp/tmp.ybydHQ9Mc9 2026-02-20T11:44:30.120 DEBUG:teuthology.orchestra.run.trial095:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ybydHQ9Mc9 2026-02-20T11:44:30.210 DEBUG:teuthology.orchestra.run.trial095:> sudo chmod 0666 /tmp/tmp.ybydHQ9Mc9 2026-02-20T11:44:30.293 DEBUG:teuthology.orchestra.remote:trial095:/tmp/tmp.ybydHQ9Mc9 is 200KB 2026-02-20T11:44:30.345 DEBUG:teuthology.orchestra.run.trial095:> rm -fr /tmp/tmp.ybydHQ9Mc9 2026-02-20T11:44:30.361 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-20T11:44:30.361 DEBUG:teuthology.orchestra.run.trial095:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-20T11:44:30.484 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-20T11:44:30.484 INFO:tasks.ceph:Archiving crash dumps... 2026-02-20T11:44:30.486 DEBUG:teuthology.misc:Transferring archived files from trial095:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60536/remote/trial095/crash 2026-02-20T11:44:30.488 DEBUG:teuthology.orchestra.run.trial095:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-20T11:44:30.547 INFO:tasks.ceph:Compressing logs... 2026-02-20T11:44:30.548 DEBUG:teuthology.orchestra.run.trial095:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T11:44:30.612 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-20T11:44:30.628 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-20T11:44:30.628 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47037.log 2026-02-20T11:44:30.628 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47206.log 2026-02-20T11:44:30.628 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.47037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47036.log 2026-02-20T11:44:30.628 INFO:teuthology.orchestra.run.trial095.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47037.log.gz 2026-02-20T11:44:30.628 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40626.log 2026-02-20T11:44:30.628 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.47206.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47206.log.gzgzip 2026-02-20T11:44:30.628 INFO:teuthology.orchestra.run.trial095.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46811.log 2026-02-20T11:44:30.629 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.47036.log: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-20T11:44:30.629 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.40626.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47036.log.gz 2026-02-20T11:44:30.629 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46639.log 2026-02-20T11:44:30.629 INFO:teuthology.orchestra.run.trial095.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.40626.log.gz 2026-02-20T11:44:30.629 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.46811.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-20T11:44:30.629 INFO:teuthology.orchestra.run.trial095.stderr: 66.9% -- replaced with /var/log/ceph/ceph-client.admin.46811.log.gz 2026-02-20T11:44:30.629 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.46639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40005.log 2026-02-20T11:44:30.629 INFO:teuthology.orchestra.run.trial095.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46639.log.gz 2026-02-20T11:44:30.629 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47776.log 2026-02-20T11:44:30.629 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.40005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40941.log 2026-02-20T11:44:30.629 INFO:teuthology.orchestra.run.trial095.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40005.log.gz 2026-02-20T11:44:30.630 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.47776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40838.log 2026-02-20T11:44:30.630 INFO:teuthology.orchestra.run.trial095.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.47776.log.gz 2026-02-20T11:44:30.630 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.40941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46527.log 2026-02-20T11:44:30.630 INFO:teuthology.orchestra.run.trial095.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40941.log.gz 2026-02-20T11:44:30.630 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.40838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39958.log 2026-02-20T11:44:30.630 INFO:teuthology.orchestra.run.trial095.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40838.log.gz 2026-02-20T11:44:30.630 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41087.log 2026-02-20T11:44:30.630 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.46527.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46527.log.gz 2026-02-20T11:44:30.630 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.39958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40531.log 2026-02-20T11:44:30.630 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40940.log 2026-02-20T11:44:30.630 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.41087.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39958.log.gz 2026-02-20T11:44:30.630 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.40531.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41087.log.gz 2026-02-20T11:44:30.630 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39679.log 2026-02-20T11:44:30.631 INFO:teuthology.orchestra.run.trial095.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40531.log.gz 2026-02-20T11:44:30.631 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46583.log 2026-02-20T11:44:30.631 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.40940.log: /var/log/ceph/ceph-client.admin.39679.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40940.log.gz 2026-02-20T11:44:30.631 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47775.log 2026-02-20T11:44:30.631 INFO:teuthology.orchestra.run.trial095.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39679.log.gz 2026-02-20T11:44:30.631 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.46583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40740.log 2026-02-20T11:44:30.631 INFO:teuthology.orchestra.run.trial095.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46583.log.gz 2026-02-20T11:44:30.631 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.47775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47540.log 2026-02-20T11:44:30.631 INFO:teuthology.orchestra.run.trial095.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47775.log.gz 2026-02-20T11:44:30.631 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.40740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40459.log 2026-02-20T11:44:30.631 INFO:teuthology.orchestra.run.trial095.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40740.log.gz 2026-02-20T11:44:30.631 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-20T11:44:30.631 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.47540.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47540.log.gz 2026-02-20T11:44:30.632 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.40459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46671.log 2026-02-20T11:44:30.632 INFO:teuthology.orchestra.run.trial095.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40459.log.gz 2026-02-20T11:44:30.632 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-20T11:44:30.632 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.46671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40601.log 2026-02-20T11:44:30.632 INFO:teuthology.orchestra.run.trial095.stderr: 86.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-20T11:44:30.632 INFO:teuthology.orchestra.run.trial095.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46671.log.gz 2026-02-20T11:44:30.632 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40789.log 2026-02-20T11:44:30.632 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.40601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39821.log 2026-02-20T11:44:30.632 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48437.log 2026-02-20T11:44:30.632 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.40789.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40601.log.gz 2026-02-20T11:44:30.632 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46413.log 2026-02-20T11:44:30.632 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.39821.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40789.log.gz 2026-02-20T11:44:30.632 INFO:teuthology.orchestra.run.trial095.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39821.log.gz 2026-02-20T11:44:30.633 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.48437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39774.log 2026-02-20T11:44:30.633 INFO:teuthology.orchestra.run.trial095.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48437.log.gz 2026-02-20T11:44:30.633 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.46413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41086.log 2026-02-20T11:44:30.633 INFO:teuthology.orchestra.run.trial095.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46413.log.gz 2026-02-20T11:44:30.633 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40939.log 2026-02-20T11:44:30.633 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.39774.log: /var/log/ceph/ceph-client.admin.41086.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39774.log.gz 2026-02-20T11:44:30.633 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41230.log 2026-02-20T11:44:30.633 INFO:teuthology.orchestra.run.trial095.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41086.log.gz 2026-02-20T11:44:30.633 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.40939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40301.log 2026-02-20T11:44:30.633 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.41230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40052.log 2026-02-20T11:44:30.633 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.40301.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-20T11:44:30.633 INFO:teuthology.orchestra.run.trial095.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41230.log.gz 2026-02-20T11:44:30.634 INFO:teuthology.orchestra.run.trial095.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40939.log.gz 2026-02-20T11:44:30.634 INFO:teuthology.orchestra.run.trial095.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40301.log.gz 2026-02-20T11:44:30.634 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.40052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41088.log 2026-02-20T11:44:30.634 INFO:teuthology.orchestra.run.trial095.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40052.log.gz 2026-02-20T11:44:30.634 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41181.log 2026-02-20T11:44:30.634 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46859.log 2026-02-20T11:44:30.634 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.41088.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-20T11:44:30.634 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.41181.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41088.log.gz 2026-02-20T11:44:30.634 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.46859.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41181.log.gz 2026-02-20T11:44:30.634 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40271.log 2026-02-20T11:44:30.634 INFO:teuthology.orchestra.run.trial095.stderr: 66.9% -- replaced with /var/log/ceph/ceph-client.admin.46859.log.gz 2026-02-20T11:44:30.634 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40691.log 2026-02-20T11:44:30.634 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.40271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47205.log 2026-02-20T11:44:30.635 INFO:teuthology.orchestra.run.trial095.stderr: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-20T11:44:30.635 INFO:teuthology.orchestra.run.trial095.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40271.log.gz 2026-02-20T11:44:30.635 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5/var/log/ceph/ceph-client.admin.40691.log: --verbose -- /var/log/ceph/ceph.tmp-client.admin.38382.log 2026-02-20T11:44:30.635 INFO:teuthology.orchestra.run.trial095.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40691.log.gz 2026-02-20T11:44:30.635 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5/var/log/ceph/ceph-client.admin.47205.log: --verbose -- /var/log/ceph/ceph-client.admin.41279.log 2026-02-20T11:44:30.635 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph.tmp-client.admin.38382.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47205.log.gz 2026-02-20T11:44:30.635 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46469.log 2026-02-20T11:44:30.635 INFO:teuthology.orchestra.run.trial095.stderr: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.38382.log.gz 2026-02-20T11:44:30.635 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.41279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46725.log 2026-02-20T11:44:30.635 INFO:teuthology.orchestra.run.trial095.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41279.log.gz 2026-02-20T11:44:30.635 INFO:teuthology.orchestra.run.trial095.stderr:/var/log/ceph/ceph-client.admin.46469.log: /var/log/ceph/ceph-client.admin.46725.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46469.log.gz 2026-02-20T11:44:30.635 INFO:teuthology.orchestra.run.trial095.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46725.log.gz 2026-02-20T11:44:30.636 INFO:teuthology.orchestra.run.trial095.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-20T11:44:33.299 INFO:teuthology.orchestra.run.trial095.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-20T11:44:33.414 INFO:teuthology.orchestra.run.trial095.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-20T11:44:33.417 INFO:teuthology.orchestra.run.trial095.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-20T11:44:33.419 INFO:teuthology.orchestra.run.trial095.stderr: 2026-02-20T11:44:33.419 INFO:teuthology.orchestra.run.trial095.stderr:real 0m2.815s 2026-02-20T11:44:33.419 INFO:teuthology.orchestra.run.trial095.stderr:user 0m7.763s 2026-02-20T11:44:33.419 INFO:teuthology.orchestra.run.trial095.stderr:sys 0m0.548s 2026-02-20T11:44:33.420 INFO:tasks.ceph:Archiving logs... 2026-02-20T11:44:33.420 DEBUG:teuthology.misc:Transferring archived files from trial095:/var/log/ceph to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60536/remote/trial095/log 2026-02-20T11:44:33.421 DEBUG:teuthology.orchestra.run.trial095:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T11:44:34.316 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T11:44:34.498 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T11:44:34.513 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-20T11:44:34.514 DEBUG:teuthology.orchestra.run.trial095:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T11:44:34.541 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-20T11:44:34.555 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-20T11:44:34.556 DEBUG:teuthology.orchestra.run.trial095:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T11:44:34.595 INFO:teuthology.orchestra.run.trial095.stderr:bash: line 1: ntpq: command not found 2026-02-20T11:44:34.958 INFO:teuthology.orchestra.run.trial095.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T11:44:34.958 INFO:teuthology.orchestra.run.trial095.stdout:=============================================================================== 2026-02-20T11:44:34.958 INFO:teuthology.orchestra.run.trial095.stdout:^- 172-234-44-141.ip.linode> 2 6 377 5 +15ms[ +15ms] +/- 93ms 2026-02-20T11:44:34.958 INFO:teuthology.orchestra.run.trial095.stdout:^+ ntp11.kernfusion.at 2 6 377 14 -303us[ -296us] +/- 73ms 2026-02-20T11:44:34.958 INFO:teuthology.orchestra.run.trial095.stdout:^+ 173.249.203.227 2 6 377 9 +1381us[+1381us] +/- 32ms 2026-02-20T11:44:34.958 INFO:teuthology.orchestra.run.trial095.stdout:^* 209.205.228.50 2 6 377 13 -709us[ -703us] +/- 26ms 2026-02-20T11:44:34.958 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-20T11:44:34.970 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-20T11:44:34.971 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-20T11:44:34.984 DEBUG:teuthology.orchestra.run.trial095:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T11:44:35.060 DEBUG:teuthology.orchestra.run.trial095:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T11:44:35.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:44:35.088 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-20T11:44:35.105 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-20T11:44:35.123 INFO:teuthology.task.internal:Duration was 1026.209238 seconds 2026-02-20T11:44:35.123 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-20T11:44:35.140 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-20T11:44:35.140 DEBUG:teuthology.orchestra.run.trial095:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T11:44:35.181 INFO:teuthology.orchestra.run.trial095.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T11:44:35.401 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-20T11:44:35.401 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial095.front.sepia.ceph.com 2026-02-20T11:44:35.402 DEBUG:teuthology.orchestra.run.trial095:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T11:44:35.460 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-20T11:44:35.460 DEBUG:teuthology.orchestra.run.trial095:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T11:44:35.565 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-20T11:44:35.565 DEBUG:teuthology.orchestra.run.trial095:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T11:44:35.588 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:44:35.589 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:44:35.589 INFO:teuthology.orchestra.run.trial095.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T11:44:35.589 INFO:teuthology.orchestra.run.trial095.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T11:44:35.589 INFO:teuthology.orchestra.run.trial095.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T11:44:35.600 INFO:teuthology.orchestra.run.trial095.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T11:44:35.602 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-20T11:44:35.625 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-20T11:44:35.625 DEBUG:teuthology.orchestra.run.trial095:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T11:44:35.666 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-20T11:44:35.685 DEBUG:teuthology.orchestra.run.trial095:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T11:44:35.729 INFO:teuthology.orchestra.run.trial095.stdout:kernel.core_pattern = core 2026-02-20T11:44:35.748 DEBUG:teuthology.orchestra.run.trial095:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T11:44:35.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:44:35.804 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-20T11:44:35.827 INFO:teuthology.task.internal:Transferring archived files... 2026-02-20T11:44:35.828 DEBUG:teuthology.misc:Transferring archived files from trial095:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60536/remote/trial095 2026-02-20T11:44:35.828 DEBUG:teuthology.orchestra.run.trial095:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T11:44:35.908 INFO:teuthology.task.internal:Removing archive directory... 2026-02-20T11:44:35.909 DEBUG:teuthology.orchestra.run.trial095:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T11:44:35.938 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-20T11:44:35.959 INFO:teuthology.task.internal:Not uploading archives. 2026-02-20T11:44:35.959 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-20T11:44:35.984 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-20T11:44:35.985 DEBUG:teuthology.orchestra.run.trial095:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T11:44:36.000 INFO:teuthology.orchestra.run.trial095.stdout: 917522 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 11:44 /home/ubuntu/cephtest 2026-02-20T11:44:36.002 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-20T11:44:36.019 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-20T11:44:36.067 INFO:teuthology.run:Summary data: description: crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} perf_ignorelist settings/optimized workloads/fio_4M_rand_write} duration: 1026.2092382907867 flavor: debug owner: scheduled_jjperez@soko04.front.sepia.ceph.com success: true 2026-02-20T11:44:36.067 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T11:44:36.178 INFO:teuthology.run:pass