2026-02-20T12:02:09.779 INFO:root:teuthology version: 1.2.4.dev11+ge6d9099ce 2026-02-20T12:02:09.794 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T12:02:09.876 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60620 branch: wip-perezjos-crimson-only-12-02-2026-PR66245 description: crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/crimson_bluestore perf_ignorelist settings/optimized workloads/fio_4K_rand_read} email: null first_in_suite: false flavor: debug job_id: '60620' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-perezjos-crimson-only-12-02-2026-PR66245 ceph: conf: global: auth client required: none auth cluster required: none auth service required: none auth supported: none debug asok: 0/0 debug auth: 0/0 debug bdev: 0/0 debug bluefs: 0/0 debug bluestore: 0/0 debug buffer: 0/0 debug civetweb: 0/0 debug client: 0/0 debug compressor: 0/0 debug context: 0/0 debug crush: 0/0 debug crypto: 0/0 debug dpdk: 0/0 debug eventtrace: 0/0 debug filer: 0/0 debug filestore: 0/0 debug finisher: 0/0 debug fuse: 0/0 debug heartbeatmap: 0/0 debug javaclient: 0/0 debug journal: 0/0 debug journaler: 0/0 debug kstore: 0/0 debug leveldb: 0/0 debug lockdep: 0/0 debug mds: 0/0 debug mds balancer: 0/0 debug mds locker: 0/0 debug mds log: 0/0 debug mds log expire: 0/0 debug mds migrator: 0/0 debug memdb: 0/0 debug mgr: 0/0 debug mgrc: 0/0 debug mon: 0/0 debug monc: 0/0 debug ms: 0/0 debug objclass: 0/0 debug objectcacher: 0/0 debug objecter: 0/0 debug optracker: 0/0 debug osd: 0/0 debug paxos: 0/0 debug perfcounter: 0/0 debug rados: 0/0 debug rbd: 0/0 debug rbd mirror: 0/0 debug rbd replay: 0/0 debug refs: 0/0 debug rgw: 0/0 debug rgw lifecycle: 0/0 debug rgw notification: 0/0 debug rgw sync: 0/0 debug rocksdb: 0/0 debug striper: 0/0 debug throttle: 0/0 debug timer: 0/0 debug tp: 0/0 enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 0/0 debug ms: 0/0 debug paxos: 0/0 osd pool default crimson: true osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson cpu num: 4 crimson osd obc lru size: 10 debug alienstore: 20 debug bluefs: 20 debug bluestore: 20 debug filestore: 0/0 debug journal: 0/0 debug ms: 0/0 debug osd: 0/0 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true seastore cachepin size pershard: 64M seastore max concurrent transactions: 8 crimson_compat: true flavor: debug fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - \(PG_ - \(OSD_ - \(OBJECT_ - overall HEALTH sha1: 26bc97655ae0056b78c14ab91d1307332bd6dfca ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} install: ceph: flavor: debug sha1: 26bc97655ae0056b78c14ab91d1307332bd6dfca workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 445d5c9ba18a4040e70e25303230c36c77773acb owner: scheduled_jjperez@soko04.front.sepia.ceph.com priority: 101 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 5547 sha1: 26bc97655ae0056b78c14ab91d1307332bd6dfca sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 445d5c9ba18a4040e70e25303230c36c77773acb targets: trial063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIJYZjnqibUMeAHNxdxh2feQgult/r76XoZj2DgOZv1SKIrU5BJE4E79KXi+jFx5RgDMSOWc9Fqaxl4Gp9Cw8x0= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: osd: debug monc: 20 wait-for-scrub: false - ssh_keys: null - cbt: benchmarks: librbdfio: iodepth: - 32 log_avg_msec: 100 mode: - randread norandommap: true op_size: - 4096 osd_ra: - 4096 pool_profile: rbd procs_per_volume: - 1 time: 60 vol_size: 4096 volumes_per_client: - 2 cluster: iterations: 1 osds_per_node: 3 pool_profiles: rbd: pg_size: 128 pgp_size: 128 replication: 3 user: ubuntu monitoring_profiles: perf: args: stat -p {pid} -o {perf_dir}/perf_stat.{pid} nodes: - osds perf_cmd: perf pid_glob: crimson-osd.*.pid teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: reimage-ssh-down teuthology_sha1: e6d9099ce03dc21193fda653159ec82465c3a94a timestamp: 2026-02-20_10:29:19 tube: trial user: jjperez verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-20T12:02:09.876 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa; will attempt to use it 2026-02-20T12:02:09.877 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks 2026-02-20T12:02:09.877 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-20T12:02:09.878 INFO:teuthology.task.internal:Checking packages... 2026-02-20T12:02:09.878 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash '26bc97655ae0056b78c14ab91d1307332bd6dfca' 2026-02-20T12:02:09.878 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T12:02:09.878 INFO:teuthology.packaging:ref: None 2026-02-20T12:02:09.878 INFO:teuthology.packaging:tag: None 2026-02-20T12:02:09.878 INFO:teuthology.packaging:branch: wip-perezjos-crimson-only-12-02-2026-PR66245 2026-02-20T12:02:09.878 INFO:teuthology.packaging:sha1: 26bc97655ae0056b78c14ab91d1307332bd6dfca 2026-02-20T12:02:09.879 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=wip-perezjos-crimson-only-12-02-2026-PR66245 2026-02-20T12:02:10.080 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5312.g26bc9765 2026-02-20T12:02:10.083 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-20T12:02:10.095 INFO:teuthology.task.internal:no buildpackages task found 2026-02-20T12:02:10.095 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-20T12:02:10.109 INFO:teuthology.task.internal:Saving configuration 2026-02-20T12:02:10.118 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-20T12:02:10.133 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-20T12:02:10.194 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial063.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60620', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 11:58:47.710841', 'locked_by': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIJYZjnqibUMeAHNxdxh2feQgult/r76XoZj2DgOZv1SKIrU5BJE4E79KXi+jFx5RgDMSOWc9Fqaxl4Gp9Cw8x0='} 2026-02-20T12:02:10.194 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-20T12:02:10.205 INFO:teuthology.task.internal:roles: ubuntu@trial063.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-20T12:02:10.205 INFO:teuthology.run_tasks:Running task console_log... 2026-02-20T12:02:10.282 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x744dde223b00>, signals=[15]) 2026-02-20T12:02:10.282 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-20T12:02:10.294 INFO:teuthology.task.internal:Opening connections... 2026-02-20T12:02:10.294 DEBUG:teuthology.task.internal:connecting to ubuntu@trial063.front.sepia.ceph.com 2026-02-20T12:02:10.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T12:02:10.356 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-20T12:02:10.368 DEBUG:teuthology.orchestra.run.trial063:> uname -m 2026-02-20T12:02:10.442 INFO:teuthology.orchestra.run.trial063.stdout:x86_64 2026-02-20T12:02:10.442 DEBUG:teuthology.orchestra.run.trial063:> cat /etc/os-release 2026-02-20T12:02:10.498 INFO:teuthology.orchestra.run.trial063.stdout:NAME="CentOS Stream" 2026-02-20T12:02:10.498 INFO:teuthology.orchestra.run.trial063.stdout:VERSION="9" 2026-02-20T12:02:10.498 INFO:teuthology.orchestra.run.trial063.stdout:ID="centos" 2026-02-20T12:02:10.499 INFO:teuthology.orchestra.run.trial063.stdout:ID_LIKE="rhel fedora" 2026-02-20T12:02:10.499 INFO:teuthology.orchestra.run.trial063.stdout:VERSION_ID="9" 2026-02-20T12:02:10.499 INFO:teuthology.orchestra.run.trial063.stdout:PLATFORM_ID="platform:el9" 2026-02-20T12:02:10.499 INFO:teuthology.orchestra.run.trial063.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T12:02:10.499 INFO:teuthology.orchestra.run.trial063.stdout:ANSI_COLOR="0;31" 2026-02-20T12:02:10.499 INFO:teuthology.orchestra.run.trial063.stdout:LOGO="fedora-logo-icon" 2026-02-20T12:02:10.499 INFO:teuthology.orchestra.run.trial063.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T12:02:10.499 INFO:teuthology.orchestra.run.trial063.stdout:HOME_URL="https://centos.org/" 2026-02-20T12:02:10.499 INFO:teuthology.orchestra.run.trial063.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T12:02:10.499 INFO:teuthology.orchestra.run.trial063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T12:02:10.499 INFO:teuthology.orchestra.run.trial063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T12:02:10.500 INFO:teuthology.lock.ops:Updating trial063.front.sepia.ceph.com on lock server 2026-02-20T12:02:10.588 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-20T12:02:10.600 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-20T12:02:10.612 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-20T12:02:10.612 DEBUG:teuthology.orchestra.run.trial063:> test '!' -e /home/ubuntu/cephtest 2026-02-20T12:02:10.627 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-20T12:02:10.639 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-20T12:02:10.639 DEBUG:teuthology.orchestra.run.trial063:> test -z $(ls -A /var/lib/ceph) 2026-02-20T12:02:10.684 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-20T12:02:10.789 INFO:teuthology.run_tasks:Running task kernel... 2026-02-20T12:02:10.811 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-20T12:02:10.811 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-20T12:02:10.811 DEBUG:teuthology.orchestra.run.trial063:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T12:02:10.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:02:10.826 DEBUG:teuthology.orchestra.run.trial063:> uname -r 2026-02-20T12:02:10.881 INFO:teuthology.orchestra.run.trial063.stdout:5.14.0-681.el9.x86_64 2026-02-20T12:02:10.881 INFO:teuthology.task.kernel:Running kernel on trial063: 5.14.0-681.el9.x86_64 2026-02-20T12:02:10.882 DEBUG:teuthology.orchestra.run.trial063:> sudo yum install -y kernel 2026-02-20T12:02:12.072 INFO:teuthology.orchestra.run.trial063.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-20T12:02:15.374 INFO:teuthology.orchestra.run.trial063.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 27 MB 00:02 2026-02-20T12:02:19.525 INFO:teuthology.orchestra.run.trial063.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 7.8 MB 00:01 2026-02-20T12:02:20.646 INFO:teuthology.orchestra.run.trial063.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 20 kB 00:00 2026-02-20T12:02:21.020 INFO:teuthology.orchestra.run.trial063.stdout:Extra Packages for Enterprise Linux 65 MB/s | 20 MB 00:00 2026-02-20T12:02:24.181 INFO:teuthology.orchestra.run.trial063.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-20T12:02:25.189 INFO:teuthology.orchestra.run.trial063.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T12:02:25.189 INFO:teuthology.orchestra.run.trial063.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T12:02:25.208 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:02:25.209 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:02:25.209 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:02:25.232 DEBUG:teuthology.orchestra.run.trial063:> echo no | sudo yum reinstall kernel || true 2026-02-20T12:02:25.529 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 12:02:24 PM UTC. 2026-02-20T12:02:25.609 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:02:25.611 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:02:25.611 INFO:teuthology.orchestra.run.trial063.stdout: Package Architecture Version Repository Size 2026-02-20T12:02:25.611 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:02:25.611 INFO:teuthology.orchestra.run.trial063.stdout:Reinstalling: 2026-02-20T12:02:25.611 INFO:teuthology.orchestra.run.trial063.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T12:02:25.611 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:02:25.611 INFO:teuthology.orchestra.run.trial063.stdout:Transaction Summary 2026-02-20T12:02:25.611 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:02:25.611 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:02:25.611 INFO:teuthology.orchestra.run.trial063.stdout:Total download size: 803 k 2026-02-20T12:02:25.612 INFO:teuthology.orchestra.run.trial063.stdout:Installed size: 0 2026-02-20T12:02:25.612 INFO:teuthology.orchestra.run.trial063.stderr:Operation aborted. 2026-02-20T12:02:25.630 INFO:teuthology.orchestra.run.trial063.stdout:Is this ok [y/N]: 2026-02-20T12:02:25.631 DEBUG:teuthology.orchestra.run.trial063:> sudo yum reinstall -y kernel || true 2026-02-20T12:02:25.929 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 12:02:24 PM UTC. 2026-02-20T12:02:26.010 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:02:26.010 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:02:26.010 INFO:teuthology.orchestra.run.trial063.stdout: Package Architecture Version Repository Size 2026-02-20T12:02:26.010 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:02:26.011 INFO:teuthology.orchestra.run.trial063.stdout:Reinstalling: 2026-02-20T12:02:26.011 INFO:teuthology.orchestra.run.trial063.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T12:02:26.011 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:02:26.011 INFO:teuthology.orchestra.run.trial063.stdout:Transaction Summary 2026-02-20T12:02:26.011 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:02:26.011 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:02:26.011 INFO:teuthology.orchestra.run.trial063.stdout:Total download size: 803 k 2026-02-20T12:02:26.011 INFO:teuthology.orchestra.run.trial063.stdout:Installed size: 0 2026-02-20T12:02:26.011 INFO:teuthology.orchestra.run.trial063.stdout:Downloading Packages: 2026-02-20T12:02:26.837 INFO:teuthology.orchestra.run.trial063.stdout:kernel-5.14.0-681.el9.x86_64.rpm 1.1 MB/s | 803 kB 00:00 2026-02-20T12:02:26.837 INFO:teuthology.orchestra.run.trial063.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:02:26.837 INFO:teuthology.orchestra.run.trial063.stdout:Total 971 kB/s | 803 kB 00:00 2026-02-20T12:02:26.847 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction check 2026-02-20T12:02:26.881 INFO:teuthology.orchestra.run.trial063.stdout:Transaction check succeeded. 2026-02-20T12:02:26.881 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction test 2026-02-20T12:02:26.885 INFO:teuthology.orchestra.run.trial063.stdout:Transaction test succeeded. 2026-02-20T12:02:26.886 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction 2026-02-20T12:02:26.909 INFO:teuthology.orchestra.run.trial063.stdout: Preparing : 1/1 2026-02-20T12:02:26.913 INFO:teuthology.orchestra.run.trial063.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T12:02:26.913 INFO:teuthology.orchestra.run.trial063.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T12:02:27.028 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T12:02:27.028 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T12:02:27.084 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T12:02:27.084 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:02:27.084 INFO:teuthology.orchestra.run.trial063.stdout:Reinstalled: 2026-02-20T12:02:27.085 INFO:teuthology.orchestra.run.trial063.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T12:02:27.085 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:02:27.085 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:02:27.111 DEBUG:teuthology.orchestra.run.trial063:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T12:02:27.134 INFO:teuthology.orchestra.run.trial063.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T12:02:27.135 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T12:02:27.136 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T12:02:27.136 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-20T12:02:27.136 DEBUG:teuthology.orchestra.run.trial063:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T12:02:27.198 INFO:teuthology.orchestra.run.trial063.stdout:ttyS1 2026-02-20T12:02:27.233 DEBUG:teuthology.parallel:result is None 2026-02-20T12:02:27.233 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-20T12:02:27.249 INFO:teuthology.task.internal:Creating test directory... 2026-02-20T12:02:27.249 DEBUG:teuthology.orchestra.run.trial063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T12:02:27.289 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-20T12:02:27.301 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-20T12:02:27.314 INFO:teuthology.task.internal:Creating archive directory... 2026-02-20T12:02:27.314 DEBUG:teuthology.orchestra.run.trial063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T12:02:27.350 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-20T12:02:27.362 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-20T12:02:27.362 DEBUG:teuthology.orchestra.run.trial063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T12:02:27.409 INFO:teuthology.orchestra.run.trial063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T12:02:27.417 INFO:teuthology.orchestra.run.trial063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T12:02:27.419 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-20T12:02:27.430 INFO:teuthology.task.internal:Configuring sudo... 2026-02-20T12:02:27.431 DEBUG:teuthology.orchestra.run.trial063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T12:02:27.484 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-20T12:02:27.506 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-20T12:02:27.507 DEBUG:teuthology.orchestra.run.trial063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T12:02:27.540 DEBUG:teuthology.orchestra.run.trial063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T12:02:27.702 DEBUG:teuthology.orchestra.run.trial063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T12:02:27.726 DEBUG:teuthology.orchestra.run.trial063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T12:02:27.877 DEBUG:teuthology.orchestra.run.trial063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T12:02:27.900 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:02:27.900 DEBUG:teuthology.orchestra.run.trial063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T12:02:27.964 DEBUG:teuthology.orchestra.run.trial063:> sudo service rsyslog restart 2026-02-20T12:02:28.032 INFO:teuthology.orchestra.run.trial063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T12:02:28.343 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-20T12:02:28.354 INFO:teuthology.task.internal:Starting timer... 2026-02-20T12:02:28.354 INFO:teuthology.run_tasks:Running task pcp... 2026-02-20T12:02:28.372 INFO:teuthology.run_tasks:Running task selinux... 2026-02-20T12:02:28.385 DEBUG:teuthology.orchestra.run.trial063:> sudo service auditd rotate 2026-02-20T12:02:28.413 INFO:teuthology.orchestra.run.trial063.stdout:Rotating logs: 2026-02-20T12:02:28.414 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-20T12:02:28.414 DEBUG:teuthology.orchestra.run.trial063:> /usr/sbin/getenforce 2026-02-20T12:02:28.470 INFO:teuthology.orchestra.run.trial063.stdout:Permissive 2026-02-20T12:02:28.471 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial063.front.sepia.ceph.com': 'permissive'} 2026-02-20T12:02:28.471 DEBUG:teuthology.orchestra.run.trial063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T12:02:28.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:02:28.535 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-20T12:02:28.536 DEBUG:teuthology.orchestra.run.trial063:> sudo /usr/sbin/setenforce permissive 2026-02-20T12:02:28.599 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-20T12:02:28.615 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-20T12:02:28.617 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-20T12:02:28.816 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-20T12:02:28.822 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-20T12:02:28.823 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial063.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-20T12:05:35.389 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial063.front.sepia.ceph.com')] 2026-02-20T12:05:35.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial063.front.sepia.ceph.com' 2026-02-20T12:05:35.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T12:05:35.500 DEBUG:teuthology.orchestra.run.trial063:> true 2026-02-20T12:05:35.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial063.front.sepia.ceph.com' 2026-02-20T12:05:35.577 INFO:teuthology.run_tasks:Running task clock... 2026-02-20T12:05:35.590 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-20T12:05:35.590 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T12:05:35.590 DEBUG:teuthology.orchestra.run.trial063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T12:05:35.644 INFO:teuthology.orchestra.run.trial063.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T12:05:35.655 INFO:teuthology.orchestra.run.trial063.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T12:05:35.675 INFO:teuthology.orchestra.run.trial063.stderr:sudo: ntpd: command not found 2026-02-20T12:05:35.684 INFO:teuthology.orchestra.run.trial063.stdout:506 Cannot talk to daemon 2026-02-20T12:05:35.695 INFO:teuthology.orchestra.run.trial063.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T12:05:35.708 INFO:teuthology.orchestra.run.trial063.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T12:05:35.760 INFO:teuthology.orchestra.run.trial063.stderr:bash: line 1: ntpq: command not found 2026-02-20T12:05:36.106 INFO:teuthology.orchestra.run.trial063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T12:05:36.106 INFO:teuthology.orchestra.run.trial063.stdout:=============================================================================== 2026-02-20T12:05:36.106 INFO:teuthology.orchestra.run.trial063.stdout:^? ip216-250-115-174.pbiaas> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T12:05:36.106 INFO:teuthology.orchestra.run.trial063.stdout:^? 50.205.57.38 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T12:05:36.106 INFO:teuthology.orchestra.run.trial063.stdout:^? 144.202.62.209.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T12:05:36.107 INFO:teuthology.orchestra.run.trial063.stdout:^? 155.248.202.205 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T12:05:36.108 INFO:teuthology.run_tasks:Running task install... 2026-02-20T12:05:36.121 DEBUG:teuthology.task.install:project ceph 2026-02-20T12:05:36.121 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'}} 2026-02-20T12:05:36.121 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'} 2026-02-20T12:05:36.121 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T12:05:36.131 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T12:05:36.131 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-20T12:05:36.132 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca', 'tag': None, 'wait_for_package': False} 2026-02-20T12:05:36.132 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=26bc97655ae0056b78c14ab91d1307332bd6dfca 2026-02-20T12:05:36.299 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/ 2026-02-20T12:05:36.299 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5312.g26bc9765 2026-02-20T12:05:36.621 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T12:05:36.622 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:05:36.622 DEBUG:teuthology.orchestra.run.trial063:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T12:05:36.648 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-20T12:05:36.648 DEBUG:teuthology.orchestra.run.trial063:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/26bc97655ae0056b78c14ab91d1307332bd6dfca/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T12:05:36.713 DEBUG:teuthology.orchestra.run.trial063:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T12:05:36.785 DEBUG:teuthology.orchestra.run.trial063:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T12:05:36.850 INFO:teuthology.orchestra.run.trial063.stdout:check_obsoletes = 1 2026-02-20T12:05:36.852 DEBUG:teuthology.orchestra.run.trial063:> sudo yum clean all 2026-02-20T12:05:37.009 INFO:teuthology.orchestra.run.trial063.stdout:41 files removed 2026-02-20T12:05:37.022 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-radosgw 2026-02-20T12:05:37.853 INFO:teuthology.orchestra.run.trial063.stdout:ceph packages for x86_64 136 kB/s | 94 kB 00:00 2026-02-20T12:05:38.488 INFO:teuthology.orchestra.run.trial063.stdout:ceph noarch packages 40 kB/s | 24 kB 00:00 2026-02-20T12:05:39.040 INFO:teuthology.orchestra.run.trial063.stdout:ceph source packages 3.9 kB/s | 2.1 kB 00:00 2026-02-20T12:05:39.995 INFO:teuthology.orchestra.run.trial063.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.9 MB 00:00 2026-02-20T12:05:43.652 INFO:teuthology.orchestra.run.trial063.stdout:CentOS Stream 9 - AppStream 8.6 MB/s | 27 MB 00:03 2026-02-20T12:05:47.600 INFO:teuthology.orchestra.run.trial063.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 7.8 MB 00:01 2026-02-20T12:05:49.034 INFO:teuthology.orchestra.run.trial063.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 20 kB 00:00 2026-02-20T12:05:50.260 INFO:teuthology.orchestra.run.trial063.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2026-02-20T12:05:53.492 INFO:teuthology.orchestra.run.trial063.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-20T12:05:54.703 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:05:54.704 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:05:54.704 INFO:teuthology.orchestra.run.trial063.stdout: Package Arch Version Repository Size 2026-02-20T12:05:54.704 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:05:54.705 INFO:teuthology.orchestra.run.trial063.stdout:Installing: 2026-02-20T12:05:54.705 INFO:teuthology.orchestra.run.trial063.stdout: ceph-radosgw x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 11 M 2026-02-20T12:05:54.705 INFO:teuthology.orchestra.run.trial063.stdout:Upgrading: 2026-02-20T12:05:54.705 INFO:teuthology.orchestra.run.trial063.stdout: librados2 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 3.3 M 2026-02-20T12:05:54.705 INFO:teuthology.orchestra.run.trial063.stdout: librbd1 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 2.7 M 2026-02-20T12:05:54.705 INFO:teuthology.orchestra.run.trial063.stdout:Installing dependencies: 2026-02-20T12:05:54.705 INFO:teuthology.orchestra.run.trial063.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T12:05:54.705 INFO:teuthology.orchestra.run.trial063.stdout: ceph-base x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 5.1 M 2026-02-20T12:05:54.705 INFO:teuthology.orchestra.run.trial063.stdout: ceph-common x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 21 M 2026-02-20T12:05:54.705 INFO:teuthology.orchestra.run.trial063.stdout: ceph-selinux x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 25 k 2026-02-20T12:05:54.705 INFO:teuthology.orchestra.run.trial063.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T12:05:54.705 INFO:teuthology.orchestra.run.trial063.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T12:05:54.706 INFO:teuthology.orchestra.run.trial063.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T12:05:54.706 INFO:teuthology.orchestra.run.trial063.stdout: libcephfs2 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 860 k 2026-02-20T12:05:54.706 INFO:teuthology.orchestra.run.trial063.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T12:05:54.706 INFO:teuthology.orchestra.run.trial063.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T12:05:54.706 INFO:teuthology.orchestra.run.trial063.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T12:05:54.706 INFO:teuthology.orchestra.run.trial063.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T12:05:54.706 INFO:teuthology.orchestra.run.trial063.stdout: libradosstriper1 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 263 k 2026-02-20T12:05:54.706 INFO:teuthology.orchestra.run.trial063.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T12:05:54.706 INFO:teuthology.orchestra.run.trial063.stdout: librgw2 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 5.6 M 2026-02-20T12:05:54.706 INFO:teuthology.orchestra.run.trial063.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T12:05:54.706 INFO:teuthology.orchestra.run.trial063.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T12:05:54.706 INFO:teuthology.orchestra.run.trial063.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T12:05:54.707 INFO:teuthology.orchestra.run.trial063.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T12:05:54.707 INFO:teuthology.orchestra.run.trial063.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T12:05:54.707 INFO:teuthology.orchestra.run.trial063.stdout: python3-ceph-argparse x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 45 k 2026-02-20T12:05:54.707 INFO:teuthology.orchestra.run.trial063.stdout: python3-ceph-common x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 185 k 2026-02-20T12:05:54.707 INFO:teuthology.orchestra.run.trial063.stdout: python3-cephfs x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 203 k 2026-02-20T12:05:54.707 INFO:teuthology.orchestra.run.trial063.stdout: python3-rados x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 324 k 2026-02-20T12:05:54.707 INFO:teuthology.orchestra.run.trial063.stdout: python3-rbd x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 305 k 2026-02-20T12:05:54.707 INFO:teuthology.orchestra.run.trial063.stdout: python3-rgw x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 100 k 2026-02-20T12:05:54.707 INFO:teuthology.orchestra.run.trial063.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T12:05:54.707 INFO:teuthology.orchestra.run.trial063.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T12:05:54.707 INFO:teuthology.orchestra.run.trial063.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T12:05:54.707 INFO:teuthology.orchestra.run.trial063.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T12:05:54.707 INFO:teuthology.orchestra.run.trial063.stdout:Installing weak dependencies: 2026-02-20T12:05:54.708 INFO:teuthology.orchestra.run.trial063.stdout: libcephfs-daemon x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 36 k 2026-02-20T12:05:54.708 INFO:teuthology.orchestra.run.trial063.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 25 k 2026-02-20T12:05:54.708 INFO:teuthology.orchestra.run.trial063.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T12:05:54.708 INFO:teuthology.orchestra.run.trial063.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T12:05:54.708 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:05:54.708 INFO:teuthology.orchestra.run.trial063.stdout:Transaction Summary 2026-02-20T12:05:54.708 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:05:54.708 INFO:teuthology.orchestra.run.trial063.stdout:Install 35 Packages 2026-02-20T12:05:54.708 INFO:teuthology.orchestra.run.trial063.stdout:Upgrade 2 Packages 2026-02-20T12:05:54.708 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:05:54.709 INFO:teuthology.orchestra.run.trial063.stdout:Total download size: 61 M 2026-02-20T12:05:54.709 INFO:teuthology.orchestra.run.trial063.stdout:Downloading Packages: 2026-02-20T12:05:55.472 INFO:teuthology.orchestra.run.trial063.stdout:(1/37): ceph-base-20.3.0-5312.g26bc9765.el9.x86 17 MB/s | 5.1 MB 00:00 2026-02-20T12:05:55.501 INFO:teuthology.orchestra.run.trial063.stdout:(2/37): ceph-selinux-20.3.0-5312.g26bc9765.el9. 864 kB/s | 25 kB 00:00 2026-02-20T12:05:55.555 INFO:teuthology.orchestra.run.trial063.stdout:(3/37): libcephfs-daemon-20.3.0-5312.g26bc9765. 672 kB/s | 36 kB 00:00 2026-02-20T12:05:55.612 INFO:teuthology.orchestra.run.trial063.stdout:(4/37): libcephfs-proxy2-20.3.0-5312.g26bc9765. 435 kB/s | 25 kB 00:00 2026-02-20T12:05:55.684 INFO:teuthology.orchestra.run.trial063.stdout:(5/37): libcephfs2-20.3.0-5312.g26bc9765.el9.x8 12 MB/s | 860 kB 00:00 2026-02-20T12:05:55.714 INFO:teuthology.orchestra.run.trial063.stdout:(6/37): libradosstriper1-20.3.0-5312.g26bc9765. 8.5 MB/s | 263 kB 00:00 2026-02-20T12:05:55.749 INFO:teuthology.orchestra.run.trial063.stdout:(7/37): ceph-radosgw-20.3.0-5312.g26bc9765.el9. 19 MB/s | 11 MB 00:00 2026-02-20T12:05:55.766 INFO:teuthology.orchestra.run.trial063.stdout:(8/37): python3-ceph-argparse-20.3.0-5312.g26bc 2.6 MB/s | 45 kB 00:00 2026-02-20T12:05:55.797 INFO:teuthology.orchestra.run.trial063.stdout:(9/37): python3-ceph-common-20.3.0-5312.g26bc97 5.9 MB/s | 185 kB 00:00 2026-02-20T12:05:55.830 INFO:teuthology.orchestra.run.trial063.stdout:(10/37): python3-cephfs-20.3.0-5312.g26bc9765.e 6.0 MB/s | 203 kB 00:00 2026-02-20T12:05:55.852 INFO:teuthology.orchestra.run.trial063.stdout:(11/37): librgw2-20.3.0-5312.g26bc9765.el9.x86_ 41 MB/s | 5.6 MB 00:00 2026-02-20T12:05:55.867 INFO:teuthology.orchestra.run.trial063.stdout:(12/37): python3-rados-20.3.0-5312.g26bc9765.el 8.7 MB/s | 324 kB 00:00 2026-02-20T12:05:55.875 INFO:teuthology.orchestra.run.trial063.stdout:(13/37): python3-rbd-20.3.0-5312.g26bc9765.el9. 13 MB/s | 305 kB 00:00 2026-02-20T12:05:55.881 INFO:teuthology.orchestra.run.trial063.stdout:(14/37): python3-rgw-20.3.0-5312.g26bc9765.el9. 7.1 MB/s | 100 kB 00:00 2026-02-20T12:05:56.149 INFO:teuthology.orchestra.run.trial063.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 121 kB/s | 33 kB 00:00 2026-02-20T12:05:56.392 INFO:teuthology.orchestra.run.trial063.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 384 kB/s | 93 kB 00:00 2026-02-20T12:05:56.542 INFO:teuthology.orchestra.run.trial063.stdout:(17/37): ceph-common-20.3.0-5312.g26bc9765.el9. 15 MB/s | 21 MB 00:01 2026-02-20T12:05:56.603 INFO:teuthology.orchestra.run.trial063.stdout:(18/37): nvme-cli-2.16-1.el9.x86_64.rpm 1.6 MB/s | 1.2 MB 00:00 2026-02-20T12:05:56.794 INFO:teuthology.orchestra.run.trial063.stdout:(19/37): boost-program-options-1.75.0-13.el9.x8 259 kB/s | 104 kB 00:00 2026-02-20T12:05:56.903 INFO:teuthology.orchestra.run.trial063.stdout:(20/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 534 kB/s | 160 kB 00:00 2026-02-20T12:05:56.923 INFO:teuthology.orchestra.run.trial063.stdout:(21/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 349 kB/s | 45 kB 00:00 2026-02-20T12:05:57.102 INFO:teuthology.orchestra.run.trial063.stdout:(22/37): libnbd-1.20.3-4.el9.x86_64.rpm 292 kB/s | 164 kB 00:00 2026-02-20T12:05:57.177 INFO:teuthology.orchestra.run.trial063.stdout:(23/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.1 MB/s | 292 kB 00:00 2026-02-20T12:05:57.179 INFO:teuthology.orchestra.run.trial063.stdout:(24/37): librdkafka-1.6.1-102.el9.x86_64.rpm 2.3 MB/s | 662 kB 00:00 2026-02-20T12:05:57.225 INFO:teuthology.orchestra.run.trial063.stdout:(25/37): qatlib-25.08.0-2.el9.x86_64.rpm 1.9 MB/s | 240 kB 00:00 2026-02-20T12:05:57.284 INFO:teuthology.orchestra.run.trial063.stdout:(26/37): qatlib-service-25.08.0-2.el9.x86_64.rp 348 kB/s | 37 kB 00:00 2026-02-20T12:05:57.288 INFO:teuthology.orchestra.run.trial063.stdout:(27/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 609 kB/s | 66 kB 00:00 2026-02-20T12:05:57.292 INFO:teuthology.orchestra.run.trial063.stdout:(28/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.5 MB/s | 308 kB 00:00 2026-02-20T12:05:57.334 INFO:teuthology.orchestra.run.trial063.stdout:(29/37): libarrow-9.0.0-15.el9.x86_64.rpm 89 MB/s | 4.4 MB 00:00 2026-02-20T12:05:57.334 INFO:teuthology.orchestra.run.trial063.stdout:(30/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 546 kB/s | 25 kB 00:00 2026-02-20T12:05:57.335 INFO:teuthology.orchestra.run.trial063.stdout:(31/37): liboath-2.6.12-1.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2026-02-20T12:05:57.343 INFO:teuthology.orchestra.run.trial063.stdout:(32/37): libunwind-1.6.2-1.el9.x86_64.rpm 7.4 MB/s | 67 kB 00:00 2026-02-20T12:05:57.345 INFO:teuthology.orchestra.run.trial063.stdout:(33/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 75 MB/s | 838 kB 00:00 2026-02-20T12:05:57.346 INFO:teuthology.orchestra.run.trial063.stdout:(34/37): re2-20211101-20.el9.x86_64.rpm 17 MB/s | 191 kB 00:00 2026-02-20T12:05:57.356 INFO:teuthology.orchestra.run.trial063.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 125 MB/s | 1.6 MB 00:00 2026-02-20T12:05:57.618 INFO:teuthology.orchestra.run.trial063.stdout:(36/37): librbd1-20.3.0-5312.g26bc9765.el9.x86_ 9.9 MB/s | 2.7 MB 00:00 2026-02-20T12:05:57.713 INFO:teuthology.orchestra.run.trial063.stdout:(37/37): librados2-20.3.0-5312.g26bc9765.el9.x8 8.9 MB/s | 3.3 MB 00:00 2026-02-20T12:05:57.716 INFO:teuthology.orchestra.run.trial063.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:05:57.716 INFO:teuthology.orchestra.run.trial063.stdout:Total 20 MB/s | 61 MB 00:03 2026-02-20T12:05:57.817 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction check 2026-02-20T12:05:57.835 INFO:teuthology.orchestra.run.trial063.stdout:Transaction check succeeded. 2026-02-20T12:05:57.836 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction test 2026-02-20T12:05:58.085 INFO:teuthology.orchestra.run.trial063.stdout:Transaction test succeeded. 2026-02-20T12:05:58.085 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction 2026-02-20T12:05:58.375 INFO:teuthology.orchestra.run.trial063.stdout: Preparing : 1/1 2026-02-20T12:05:58.515 INFO:teuthology.orchestra.run.trial063.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-20T12:05:58.519 INFO:teuthology.orchestra.run.trial063.stdout: Upgrading : librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 2/39 2026-02-20T12:05:58.569 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 2/39 2026-02-20T12:05:58.570 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 3/39 2026-02-20T12:05:58.581 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 3/39 2026-02-20T12:05:58.584 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libcephfs-daemon-2:20.3.0-5312.g26bc9765.el9.x86_6 4/39 2026-02-20T12:05:58.584 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libcephfs-proxy2-2:20.3.0-5312.g26bc9765.el9.x86_6 5/39 2026-02-20T12:05:58.612 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5312.g26bc9765.el9.x86_6 5/39 2026-02-20T12:05:58.614 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-rados-2:20.3.0-5312.g26bc9765.el9.x86_64 6/39 2026-02-20T12:05:58.623 INFO:teuthology.orchestra.run.trial063.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-20T12:05:58.626 INFO:teuthology.orchestra.run.trial063.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-20T12:05:58.629 INFO:teuthology.orchestra.run.trial063.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-20T12:05:58.633 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-20T12:05:58.646 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-ceph-argparse-2:20.3.0-5312.g26bc9765.el9. 11/39 2026-02-20T12:05:58.658 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-cephfs-2:20.3.0-5312.g26bc9765.el9.x86_64 12/39 2026-02-20T12:05:58.659 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libradosstriper1-2:20.3.0-5312.g26bc9765.el9.x86_6 13/39 2026-02-20T12:05:58.681 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5312.g26bc9765.el9.x86_6 13/39 2026-02-20T12:05:58.685 INFO:teuthology.orchestra.run.trial063.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-20T12:05:58.716 INFO:teuthology.orchestra.run.trial063.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-20T12:05:58.720 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-20T12:05:58.726 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-20T12:05:58.728 INFO:teuthology.orchestra.run.trial063.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-20T12:05:58.733 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-20T12:05:58.849 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T12:05:58.850 INFO:teuthology.orchestra.run.trial063.stdout: Upgrading : librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 21/39 2026-02-20T12:05:58.877 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 21/39 2026-02-20T12:05:58.879 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-rbd-2:20.3.0-5312.g26bc9765.el9.x86_64 22/39 2026-02-20T12:05:58.885 INFO:teuthology.orchestra.run.trial063.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-20T12:05:59.134 INFO:teuthology.orchestra.run.trial063.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-20T12:05:59.135 INFO:teuthology.orchestra.run.trial063.stdout: Installing : librgw2-2:20.3.0-5312.g26bc9765.el9.x86_64 25/39 2026-02-20T12:05:59.151 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: librgw2-2:20.3.0-5312.g26bc9765.el9.x86_64 25/39 2026-02-20T12:05:59.157 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-rgw-2:20.3.0-5312.g26bc9765.el9.x86_64 26/39 2026-02-20T12:05:59.162 INFO:teuthology.orchestra.run.trial063.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-20T12:05:59.165 INFO:teuthology.orchestra.run.trial063.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-20T12:05:59.165 INFO:teuthology.orchestra.run.trial063.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T12:05:59.183 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T12:05:59.299 INFO:teuthology.orchestra.run.trial063.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-20T12:05:59.309 INFO:teuthology.orchestra.run.trial063.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T12:05:59.583 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T12:05:59.583 INFO:teuthology.orchestra.run.trial063.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T12:05:59.584 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:05:59.630 INFO:teuthology.orchestra.run.trial063.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-20T12:05:59.632 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-ceph-common-2:20.3.0-5312.g26bc9765.el9.x8 33/39 2026-02-20T12:06:00.578 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 34/39 2026-02-20T12:06:00.580 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 34/39 2026-02-20T12:06:00.844 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 34/39 2026-02-20T12:06:00.847 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 35/39 2026-02-20T12:06:00.888 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 35/39 2026-02-20T12:06:00.888 INFO:teuthology.orchestra.run.trial063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T12:06:00.888 INFO:teuthology.orchestra.run.trial063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T12:06:00.888 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:00.891 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-selinux-2:20.3.0-5312.g26bc9765.el9.x86_64 36/39 2026-02-20T12:06:05.450 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5312.g26bc9765.el9.x86_64 36/39 2026-02-20T12:06:05.450 INFO:teuthology.orchestra.run.trial063.stdout:skipping the directory /sys 2026-02-20T12:06:05.450 INFO:teuthology.orchestra.run.trial063.stdout:skipping the directory /proc 2026-02-20T12:06:05.450 INFO:teuthology.orchestra.run.trial063.stdout:skipping the directory /mnt 2026-02-20T12:06:05.450 INFO:teuthology.orchestra.run.trial063.stdout:skipping the directory /var/tmp 2026-02-20T12:06:05.450 INFO:teuthology.orchestra.run.trial063.stdout:skipping the directory /home 2026-02-20T12:06:05.450 INFO:teuthology.orchestra.run.trial063.stdout:skipping the directory /root 2026-02-20T12:06:05.450 INFO:teuthology.orchestra.run.trial063.stdout:skipping the directory /tmp 2026-02-20T12:06:05.450 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:05.944 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-radosgw-2:20.3.0-5312.g26bc9765.el9.x86_64 37/39 2026-02-20T12:06:05.968 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5312.g26bc9765.el9.x86_64 37/39 2026-02-20T12:06:05.968 INFO:teuthology.orchestra.run.trial063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:06:05.968 INFO:teuthology.orchestra.run.trial063.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T12:06:05.968 INFO:teuthology.orchestra.run.trial063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T12:06:05.968 INFO:teuthology.orchestra.run.trial063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T12:06:05.968 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:05.969 INFO:teuthology.orchestra.run.trial063.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T12:06:05.982 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T12:06:05.982 INFO:teuthology.orchestra.run.trial063.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T12:06:06.039 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T12:06:06.039 INFO:teuthology.orchestra.run.trial063.stdout:Creating group 'qat' with GID 992. 2026-02-20T12:06:06.039 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:06.352 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 1/39 2026-02-20T12:06:06.352 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 2/39 2026-02-20T12:06:06.352 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-radosgw-2:20.3.0-5312.g26bc9765.el9.x86_64 3/39 2026-02-20T12:06:06.352 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-selinux-2:20.3.0-5312.g26bc9765.el9.x86_64 4/39 2026-02-20T12:06:06.352 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libcephfs-daemon-2:20.3.0-5312.g26bc9765.el9.x86_6 5/39 2026-02-20T12:06:06.352 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5312.g26bc9765.el9.x86_6 6/39 2026-02-20T12:06:06.352 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 7/39 2026-02-20T12:06:06.352 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libradosstriper1-2:20.3.0-5312.g26bc9765.el9.x86_6 8/39 2026-02-20T12:06:06.353 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : librgw2-2:20.3.0-5312.g26bc9765.el9.x86_64 9/39 2026-02-20T12:06:06.353 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5312.g26bc9765.el9. 10/39 2026-02-20T12:06:06.353 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-ceph-common-2:20.3.0-5312.g26bc9765.el9.x8 11/39 2026-02-20T12:06:06.353 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-cephfs-2:20.3.0-5312.g26bc9765.el9.x86_64 12/39 2026-02-20T12:06:06.353 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-rados-2:20.3.0-5312.g26bc9765.el9.x86_64 13/39 2026-02-20T12:06:06.353 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-rbd-2:20.3.0-5312.g26bc9765.el9.x86_64 14/39 2026-02-20T12:06:06.353 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-rgw-2:20.3.0-5312.g26bc9765.el9.x86_64 15/39 2026-02-20T12:06:06.353 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-20T12:06:06.353 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-20T12:06:06.353 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-20T12:06:06.353 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-20T12:06:06.353 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T12:06:06.354 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-20T12:06:06.354 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-20T12:06:06.354 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-20T12:06:06.354 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-20T12:06:06.354 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-20T12:06:06.354 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-20T12:06:06.354 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-20T12:06:06.354 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-20T12:06:06.354 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-20T12:06:06.354 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-20T12:06:06.354 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-20T12:06:06.354 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-20T12:06:06.354 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-20T12:06:06.355 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-20T12:06:06.355 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-20T12:06:06.355 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 36/39 2026-02-20T12:06:06.355 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-20T12:06:06.355 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 38/39 2026-02-20T12:06:06.412 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T12:06:06.413 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:06.413 INFO:teuthology.orchestra.run.trial063.stdout:Upgraded: 2026-02-20T12:06:06.413 INFO:teuthology.orchestra.run.trial063.stdout: librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:06.413 INFO:teuthology.orchestra.run.trial063.stdout: librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:06.413 INFO:teuthology.orchestra.run.trial063.stdout:Installed: 2026-02-20T12:06:06.413 INFO:teuthology.orchestra.run.trial063.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T12:06:06.413 INFO:teuthology.orchestra.run.trial063.stdout: ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:06.413 INFO:teuthology.orchestra.run.trial063.stdout: ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:06.413 INFO:teuthology.orchestra.run.trial063.stdout: ceph-radosgw-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:06.413 INFO:teuthology.orchestra.run.trial063.stdout: ceph-selinux-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:06.413 INFO:teuthology.orchestra.run.trial063.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T12:06:06.414 INFO:teuthology.orchestra.run.trial063.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T12:06:06.414 INFO:teuthology.orchestra.run.trial063.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T12:06:06.414 INFO:teuthology.orchestra.run.trial063.stdout: libcephfs-daemon-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:06.414 INFO:teuthology.orchestra.run.trial063.stdout: libcephfs-proxy2-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:06.414 INFO:teuthology.orchestra.run.trial063.stdout: libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:06.414 INFO:teuthology.orchestra.run.trial063.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T12:06:06.414 INFO:teuthology.orchestra.run.trial063.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T12:06:06.414 INFO:teuthology.orchestra.run.trial063.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T12:06:06.414 INFO:teuthology.orchestra.run.trial063.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T12:06:06.414 INFO:teuthology.orchestra.run.trial063.stdout: libradosstriper1-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:06.414 INFO:teuthology.orchestra.run.trial063.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T12:06:06.414 INFO:teuthology.orchestra.run.trial063.stdout: librgw2-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:06.415 INFO:teuthology.orchestra.run.trial063.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T12:06:06.415 INFO:teuthology.orchestra.run.trial063.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T12:06:06.415 INFO:teuthology.orchestra.run.trial063.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T12:06:06.415 INFO:teuthology.orchestra.run.trial063.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T12:06:06.415 INFO:teuthology.orchestra.run.trial063.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T12:06:06.415 INFO:teuthology.orchestra.run.trial063.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T12:06:06.415 INFO:teuthology.orchestra.run.trial063.stdout: python3-ceph-argparse-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:06.415 INFO:teuthology.orchestra.run.trial063.stdout: python3-ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:06.415 INFO:teuthology.orchestra.run.trial063.stdout: python3-cephfs-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:06.415 INFO:teuthology.orchestra.run.trial063.stdout: python3-rados-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:06.415 INFO:teuthology.orchestra.run.trial063.stdout: python3-rbd-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:06.415 INFO:teuthology.orchestra.run.trial063.stdout: python3-rgw-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:06.416 INFO:teuthology.orchestra.run.trial063.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T12:06:06.416 INFO:teuthology.orchestra.run.trial063.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T12:06:06.416 INFO:teuthology.orchestra.run.trial063.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T12:06:06.416 INFO:teuthology.orchestra.run.trial063.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T12:06:06.416 INFO:teuthology.orchestra.run.trial063.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T12:06:06.416 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:06.416 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:06.455 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-test 2026-02-20T12:06:06.771 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:13 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:06.855 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:06.856 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:06.857 INFO:teuthology.orchestra.run.trial063.stdout: Package Arch Version Repository Size 2026-02-20T12:06:06.857 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:06.857 INFO:teuthology.orchestra.run.trial063.stdout:Installing: 2026-02-20T12:06:06.857 INFO:teuthology.orchestra.run.trial063.stdout: ceph-test x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 125 M 2026-02-20T12:06:06.857 INFO:teuthology.orchestra.run.trial063.stdout:Installing dependencies: 2026-02-20T12:06:06.857 INFO:teuthology.orchestra.run.trial063.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-20T12:06:06.857 INFO:teuthology.orchestra.run.trial063.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-20T12:06:06.857 INFO:teuthology.orchestra.run.trial063.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-20T12:06:06.858 INFO:teuthology.orchestra.run.trial063.stdout: libcephsqlite x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 153 k 2026-02-20T12:06:06.858 INFO:teuthology.orchestra.run.trial063.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-20T12:06:06.858 INFO:teuthology.orchestra.run.trial063.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T12:06:06.858 INFO:teuthology.orchestra.run.trial063.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-20T12:06:06.858 INFO:teuthology.orchestra.run.trial063.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T12:06:06.858 INFO:teuthology.orchestra.run.trial063.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T12:06:06.858 INFO:teuthology.orchestra.run.trial063.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T12:06:06.858 INFO:teuthology.orchestra.run.trial063.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-20T12:06:06.858 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:06.858 INFO:teuthology.orchestra.run.trial063.stdout:Transaction Summary 2026-02-20T12:06:06.858 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:06.858 INFO:teuthology.orchestra.run.trial063.stdout:Install 12 Packages 2026-02-20T12:06:06.859 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:06.859 INFO:teuthology.orchestra.run.trial063.stdout:Total download size: 129 M 2026-02-20T12:06:06.859 INFO:teuthology.orchestra.run.trial063.stdout:Installed size: 963 M 2026-02-20T12:06:06.859 INFO:teuthology.orchestra.run.trial063.stdout:Downloading Packages: 2026-02-20T12:06:07.384 INFO:teuthology.orchestra.run.trial063.stdout:(1/12): libcephsqlite-20.3.0-5312.g26bc9765.el9 1.6 MB/s | 153 kB 00:00 2026-02-20T12:06:07.408 INFO:teuthology.orchestra.run.trial063.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 955 kB/s | 23 kB 00:00 2026-02-20T12:06:07.426 INFO:teuthology.orchestra.run.trial063.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 5.1 MB/s | 94 kB 00:00 2026-02-20T12:06:07.445 INFO:teuthology.orchestra.run.trial063.stdout:(4/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 14 MB/s | 2.1 MB 00:00 2026-02-20T12:06:08.005 INFO:teuthology.orchestra.run.trial063.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 314 kB/s | 176 kB 00:00 2026-02-20T12:06:08.145 INFO:teuthology.orchestra.run.trial063.stdout:(6/12): libasan8-15.2.1-7.el9.x86_64.rpm 730 kB/s | 525 kB 00:00 2026-02-20T12:06:08.169 INFO:teuthology.orchestra.run.trial063.stdout:(7/12): libxslt-1.1.34-12.el9.x86_64.rpm 1.4 MB/s | 233 kB 00:00 2026-02-20T12:06:08.254 INFO:teuthology.orchestra.run.trial063.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 3.5 MB/s | 303 kB 00:00 2026-02-20T12:06:08.307 INFO:teuthology.orchestra.run.trial063.stdout:(9/12): protobuf-3.14.0-17.el9.x86_64.rpm 6.2 MB/s | 1.0 MB 00:00 2026-02-20T12:06:08.337 INFO:teuthology.orchestra.run.trial063.stdout:(10/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 763 kB/s | 64 kB 00:00 2026-02-20T12:06:08.422 INFO:teuthology.orchestra.run.trial063.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.0 MB/s | 122 kB 00:00 2026-02-20T12:06:09.704 INFO:teuthology.orchestra.run.trial063.stdout:(12/12): ceph-test-20.3.0-5312.g26bc9765.el9.x8 52 MB/s | 125 MB 00:02 2026-02-20T12:06:09.706 INFO:teuthology.orchestra.run.trial063.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:06:09.706 INFO:teuthology.orchestra.run.trial063.stdout:Total 45 MB/s | 129 MB 00:02 2026-02-20T12:06:09.786 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction check 2026-02-20T12:06:09.797 INFO:teuthology.orchestra.run.trial063.stdout:Transaction check succeeded. 2026-02-20T12:06:09.797 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction test 2026-02-20T12:06:10.217 INFO:teuthology.orchestra.run.trial063.stdout:Transaction test succeeded. 2026-02-20T12:06:10.217 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction 2026-02-20T12:06:10.665 INFO:teuthology.orchestra.run.trial063.stdout: Preparing : 1/1 2026-02-20T12:06:10.673 INFO:teuthology.orchestra.run.trial063.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-20T12:06:10.682 INFO:teuthology.orchestra.run.trial063.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-20T12:06:10.687 INFO:teuthology.orchestra.run.trial063.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-20T12:06:10.691 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-20T12:06:10.693 INFO:teuthology.orchestra.run.trial063.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-20T12:06:10.698 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-20T12:06:10.698 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T12:06:10.715 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T12:06:10.717 INFO:teuthology.orchestra.run.trial063.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-20T12:06:10.727 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-20T12:06:10.735 INFO:teuthology.orchestra.run.trial063.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-20T12:06:10.736 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libcephsqlite-2:20.3.0-5312.g26bc9765.el9.x86_64 11/12 2026-02-20T12:06:17.538 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5312.g26bc9765.el9.x86_64 11/12 2026-02-20T12:06:17.556 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-test-2:20.3.0-5312.g26bc9765.el9.x86_64 12/12 2026-02-20T12:06:18.362 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-test-2:20.3.0-5312.g26bc9765.el9.x86_64 12/12 2026-02-20T12:06:18.363 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-test-2:20.3.0-5312.g26bc9765.el9.x86_64 1/12 2026-02-20T12:06:18.363 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libcephsqlite-2:20.3.0-5312.g26bc9765.el9.x86_64 2/12 2026-02-20T12:06:18.363 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-20T12:06:18.363 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-20T12:06:18.363 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-20T12:06:18.363 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-20T12:06:18.363 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-20T12:06:18.363 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-20T12:06:18.363 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-20T12:06:18.363 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-20T12:06:18.363 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-20T12:06:18.416 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-20T12:06:18.417 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:18.417 INFO:teuthology.orchestra.run.trial063.stdout:Installed: 2026-02-20T12:06:18.417 INFO:teuthology.orchestra.run.trial063.stdout: ceph-test-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:18.417 INFO:teuthology.orchestra.run.trial063.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-20T12:06:18.417 INFO:teuthology.orchestra.run.trial063.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-20T12:06:18.417 INFO:teuthology.orchestra.run.trial063.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-20T12:06:18.417 INFO:teuthology.orchestra.run.trial063.stdout: libcephsqlite-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:18.417 INFO:teuthology.orchestra.run.trial063.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-20T12:06:18.417 INFO:teuthology.orchestra.run.trial063.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T12:06:18.417 INFO:teuthology.orchestra.run.trial063.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-20T12:06:18.417 INFO:teuthology.orchestra.run.trial063.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T12:06:18.418 INFO:teuthology.orchestra.run.trial063.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T12:06:18.418 INFO:teuthology.orchestra.run.trial063.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T12:06:18.418 INFO:teuthology.orchestra.run.trial063.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-20T12:06:18.418 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:18.418 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:18.457 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph 2026-02-20T12:06:18.753 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:25 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:18.839 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout:======================================================================================= 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: Package Arch Version Repository Size 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout:======================================================================================= 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout:Installing: 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: ceph x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 6.5 k 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout:Installing dependencies: 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 57 k 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mds x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 2.0 M 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mgr x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 937 k 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 297 k 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mon x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 4.9 M 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: ceph-osd x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 163 k 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: ceph-osd-classic x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 15 M 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: ceph-osd-crimson x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 85 M 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 17 k 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: cephadm noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 1.0 M 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T12:06:18.842 INFO:teuthology.orchestra.run.trial063.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T12:06:18.843 INFO:teuthology.orchestra.run.trial063.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T12:06:18.844 INFO:teuthology.orchestra.run.trial063.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout:Installing weak dependencies: 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 184 k 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 51 M 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 7.4 M 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 22 k 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mgr-rook noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 50 k 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout: ceph-volume noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 299 k 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout:Transaction Summary 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout:======================================================================================= 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout:Install 96 Packages 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout:Total download size: 223 M 2026-02-20T12:06:18.845 INFO:teuthology.orchestra.run.trial063.stdout:Installed size: 1.5 G 2026-02-20T12:06:18.846 INFO:teuthology.orchestra.run.trial063.stdout:Downloading Packages: 2026-02-20T12:06:19.765 INFO:teuthology.orchestra.run.trial063.stdout:(1/96): ceph-20.3.0-5312.g26bc9765.el9.x86_64.r 94 kB/s | 6.5 kB 00:00 2026-02-20T12:06:19.855 INFO:teuthology.orchestra.run.trial063.stdout:(2/96): ceph-mgr-20.3.0-5312.g26bc9765.el9.x86_ 5.8 MB/s | 937 kB 00:00 2026-02-20T12:06:19.873 INFO:teuthology.orchestra.run.trial063.stdout:(3/96): ceph-mds-20.3.0-5312.g26bc9765.el9.x86_ 11 MB/s | 2.0 MB 00:00 2026-02-20T12:06:19.879 INFO:teuthology.orchestra.run.trial063.stdout:(4/96): ceph-osd-20.3.0-5312.g26bc9765.el9.x86_ 7.0 MB/s | 163 kB 00:00 2026-02-20T12:06:20.044 INFO:teuthology.orchestra.run.trial063.stdout:(5/96): ceph-mon-20.3.0-5312.g26bc9765.el9.x86_ 17 MB/s | 4.9 MB 00:00 2026-02-20T12:06:20.082 INFO:teuthology.orchestra.run.trial063.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5312.g26 1.5 MB/s | 57 kB 00:00 2026-02-20T12:06:20.127 INFO:teuthology.orchestra.run.trial063.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5312.g26bc9765. 4.0 MB/s | 184 kB 00:00 2026-02-20T12:06:20.503 INFO:teuthology.orchestra.run.trial063.stdout:(8/96): ceph-osd-classic-20.3.0-5312.g26bc9765. 23 MB/s | 15 MB 00:00 2026-02-20T12:06:20.862 INFO:teuthology.orchestra.run.trial063.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-53 21 MB/s | 7.4 MB 00:00 2026-02-20T12:06:20.891 INFO:teuthology.orchestra.run.trial063.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5312.g26bc97 785 kB/s | 22 kB 00:00 2026-02-20T12:06:20.930 INFO:teuthology.orchestra.run.trial063.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5312.g26b 7.4 MB/s | 297 kB 00:00 2026-02-20T12:06:20.965 INFO:teuthology.orchestra.run.trial063.stdout:(12/96): ceph-mgr-rook-20.3.0-5312.g26bc9765.el 1.4 MB/s | 50 kB 00:00 2026-02-20T12:06:21.000 INFO:teuthology.orchestra.run.trial063.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5312.g26 495 kB/s | 17 kB 00:00 2026-02-20T12:06:21.042 INFO:teuthology.orchestra.run.trial063.stdout:(14/96): ceph-volume-20.3.0-5312.g26bc9765.el9. 6.9 MB/s | 299 kB 00:00 2026-02-20T12:06:21.102 INFO:teuthology.orchestra.run.trial063.stdout:(15/96): cephadm-20.3.0-5312.g26bc9765.el9.noar 17 MB/s | 1.0 MB 00:00 2026-02-20T12:06:21.151 INFO:teuthology.orchestra.run.trial063.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 7.0 MB/s | 351 kB 00:00 2026-02-20T12:06:21.159 INFO:teuthology.orchestra.run.trial063.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 4.6 MB/s | 40 kB 00:00 2026-02-20T12:06:21.168 INFO:teuthology.orchestra.run.trial063.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 7.8 MB/s | 72 kB 00:00 2026-02-20T12:06:21.188 INFO:teuthology.orchestra.run.trial063.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 40 MB/s | 794 kB 00:00 2026-02-20T12:06:21.200 INFO:teuthology.orchestra.run.trial063.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 16 MB/s | 184 kB 00:00 2026-02-20T12:06:21.211 INFO:teuthology.orchestra.run.trial063.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 22 MB/s | 253 kB 00:00 2026-02-20T12:06:21.244 INFO:teuthology.orchestra.run.trial063.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 37 MB/s | 1.2 MB 00:00 2026-02-20T12:06:21.255 INFO:teuthology.orchestra.run.trial063.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 10 MB/s | 106 kB 00:00 2026-02-20T12:06:21.265 INFO:teuthology.orchestra.run.trial063.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 13 MB/s | 135 kB 00:00 2026-02-20T12:06:21.276 INFO:teuthology.orchestra.run.trial063.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 14 MB/s | 150 kB 00:00 2026-02-20T12:06:21.286 INFO:teuthology.orchestra.run.trial063.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 11 MB/s | 126 kB 00:00 2026-02-20T12:06:21.298 INFO:teuthology.orchestra.run.trial063.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 20 MB/s | 218 kB 00:00 2026-02-20T12:06:21.309 INFO:teuthology.orchestra.run.trial063.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 16 MB/s | 182 kB 00:00 2026-02-20T12:06:21.320 INFO:teuthology.orchestra.run.trial063.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 25 MB/s | 266 kB 00:00 2026-02-20T12:06:22.070 INFO:teuthology.orchestra.run.trial063.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 39 kB/s | 30 kB 00:00 2026-02-20T12:06:22.781 INFO:teuthology.orchestra.run.trial063.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 4.2 MB/s | 3.0 MB 00:00 2026-02-20T12:06:22.908 INFO:teuthology.orchestra.run.trial063.stdout:(32/96): ceph-mgr-dashboard-20.3.0-5312.g26bc97 18 MB/s | 51 MB 00:02 2026-02-20T12:06:22.987 INFO:teuthology.orchestra.run.trial063.stdout:(33/96): flexiblas-openblas-openmp-3.0.4-9.el9. 72 kB/s | 15 kB 00:00 2026-02-20T12:06:23.148 INFO:teuthology.orchestra.run.trial063.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2026-02-20T12:06:23.306 INFO:teuthology.orchestra.run.trial063.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 266 kB/s | 42 kB 00:00 2026-02-20T12:06:23.640 INFO:teuthology.orchestra.run.trial063.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 16 MB/s | 5.3 MB 00:00 2026-02-20T12:06:23.697 INFO:teuthology.orchestra.run.trial063.stdout:(37/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 312 kB/s | 246 kB 00:00 2026-02-20T12:06:23.876 INFO:teuthology.orchestra.run.trial063.stdout:(38/96): ceph-osd-crimson-20.3.0-5312.g26bc9765 21 MB/s | 85 MB 00:03 2026-02-20T12:06:23.994 INFO:teuthology.orchestra.run.trial063.stdout:(39/96): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2026-02-20T12:06:24.153 INFO:teuthology.orchestra.run.trial063.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 299 kB/s | 48 kB 00:00 2026-02-20T12:06:24.192 INFO:teuthology.orchestra.run.trial063.stdout:(41/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 788 kB/s | 249 kB 00:00 2026-02-20T12:06:24.313 INFO:teuthology.orchestra.run.trial063.stdout:(42/96): python3-libstoragemgmt-1.10.1-1.el9.x8 1.1 MB/s | 177 kB 00:00 2026-02-20T12:06:24.472 INFO:teuthology.orchestra.run.trial063.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 219 kB/s | 35 kB 00:00 2026-02-20T12:06:24.509 INFO:teuthology.orchestra.run.trial063.stdout:(44/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 3.9 MB/s | 1.2 MB 00:00 2026-02-20T12:06:24.668 INFO:teuthology.orchestra.run.trial063.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 2.7 MB/s | 442 kB 00:00 2026-02-20T12:06:24.672 INFO:teuthology.orchestra.run.trial063.stdout:(46/96): python3-devel-3.9.25-3.el9.x86_64.rpm 251 kB/s | 244 kB 00:00 2026-02-20T12:06:24.801 INFO:teuthology.orchestra.run.trial063.stdout:(47/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 19 MB/s | 6.1 MB 00:00 2026-02-20T12:06:24.827 INFO:teuthology.orchestra.run.trial063.stdout:(48/96): python3-packaging-20.9-5.el9.noarch.rp 486 kB/s | 77 kB 00:00 2026-02-20T12:06:24.961 INFO:teuthology.orchestra.run.trial063.stdout:(49/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 993 kB/s | 159 kB 00:00 2026-02-20T12:06:24.987 INFO:teuthology.orchestra.run.trial063.stdout:(50/96): python3-pyasn1-modules-0.4.8-6.el9.noa 1.7 MB/s | 279 kB 00:00 2026-02-20T12:06:25.070 INFO:teuthology.orchestra.run.trial063.stdout:(51/96): python3-protobuf-3.14.0-17.el9.noarch. 673 kB/s | 267 kB 00:00 2026-02-20T12:06:25.123 INFO:teuthology.orchestra.run.trial063.stdout:(52/96): python3-requests-oauthlib-1.3.0-12.el9 331 kB/s | 54 kB 00:00 2026-02-20T12:06:25.229 INFO:teuthology.orchestra.run.trial063.stdout:(53/96): python3-toml-0.10.2-6.el9.noarch.rpm 261 kB/s | 42 kB 00:00 2026-02-20T12:06:25.388 INFO:teuthology.orchestra.run.trial063.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 570 kB/s | 90 kB 00:00 2026-02-20T12:06:25.439 INFO:teuthology.orchestra.run.trial063.stdout:(55/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 598 kB/s | 189 kB 00:00 2026-02-20T12:06:25.475 INFO:teuthology.orchestra.run.trial063.stdout:(56/96): lua-devel-5.4.4-4.el9.x86_64.rpm 256 kB/s | 22 kB 00:00 2026-02-20T12:06:25.683 INFO:teuthology.orchestra.run.trial063.stdout:(57/96): protobuf-compiler-3.14.0-17.el9.x86_64 3.5 MB/s | 862 kB 00:00 2026-02-20T12:06:25.769 INFO:teuthology.orchestra.run.trial063.stdout:(58/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.8 MB/s | 551 kB 00:00 2026-02-20T12:06:25.780 INFO:teuthology.orchestra.run.trial063.stdout:(59/96): grpc-data-1.46.7-10.el9.noarch.rpm 200 kB/s | 19 kB 00:00 2026-02-20T12:06:25.798 INFO:teuthology.orchestra.run.trial063.stdout:(60/96): luarocks-3.9.2-5.el9.noarch.rpm 5.1 MB/s | 151 kB 00:00 2026-02-20T12:06:25.824 INFO:teuthology.orchestra.run.trial063.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 1.1 MB/s | 29 kB 00:00 2026-02-20T12:06:25.849 INFO:teuthology.orchestra.run.trial063.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 2.4 MB/s | 60 kB 00:00 2026-02-20T12:06:25.875 INFO:teuthology.orchestra.run.trial063.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.6 MB/s | 43 kB 00:00 2026-02-20T12:06:25.898 INFO:teuthology.orchestra.run.trial063.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 1.3 MB/s | 32 kB 00:00 2026-02-20T12:06:25.900 INFO:teuthology.orchestra.run.trial063.stdout:(65/96): python3-asyncssh-2.13.2-5.el9.noarch.r 4.5 MB/s | 548 kB 00:00 2026-02-20T12:06:25.921 INFO:teuthology.orchestra.run.trial063.stdout:(66/96): python3-certifi-2023.05.07-4.el9.noarc 615 kB/s | 14 kB 00:00 2026-02-20T12:06:25.927 INFO:teuthology.orchestra.run.trial063.stdout:(67/96): python3-cheroot-10.0.1-4.el9.noarch.rp 6.3 MB/s | 173 kB 00:00 2026-02-20T12:06:25.957 INFO:teuthology.orchestra.run.trial063.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 8.4 MB/s | 254 kB 00:00 2026-02-20T12:06:25.957 INFO:teuthology.orchestra.run.trial063.stdout:(69/96): python3-cherrypy-18.6.1-2.el9.noarch.r 9.7 MB/s | 358 kB 00:00 2026-02-20T12:06:25.985 INFO:teuthology.orchestra.run.trial063.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 5.1 MB/s | 144 kB 00:00 2026-02-20T12:06:26.025 INFO:teuthology.orchestra.run.trial063.stdout:(71/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 19 MB/s | 19 MB 00:01 2026-02-20T12:06:26.040 INFO:teuthology.orchestra.run.trial063.stdout:(72/96): python3-influxdb-5.3.1-1.el9.noarch.rp 2.5 MB/s | 139 kB 00:00 2026-02-20T12:06:26.049 INFO:teuthology.orchestra.run.trial063.stdout:(73/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 22 MB/s | 2.0 MB 00:00 2026-02-20T12:06:26.064 INFO:teuthology.orchestra.run.trial063.stdout:(74/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 442 kB/s | 11 kB 00:00 2026-02-20T12:06:26.076 INFO:teuthology.orchestra.run.trial063.stdout:(75/96): python3-jaraco-classes-3.2.1-5.el9.noa 730 kB/s | 18 kB 00:00 2026-02-20T12:06:26.088 INFO:teuthology.orchestra.run.trial063.stdout:(76/96): python3-jaraco-collections-3.0.0-8.el9 974 kB/s | 23 kB 00:00 2026-02-20T12:06:26.099 INFO:teuthology.orchestra.run.trial063.stdout:(77/96): python3-jaraco-context-6.0.1-3.el9.noa 857 kB/s | 20 kB 00:00 2026-02-20T12:06:26.111 INFO:teuthology.orchestra.run.trial063.stdout:(78/96): python3-jaraco-functools-3.5.0-2.el9.n 842 kB/s | 19 kB 00:00 2026-02-20T12:06:26.122 INFO:teuthology.orchestra.run.trial063.stdout:(79/96): python3-jaraco-text-4.0.0-2.el9.noarch 1.1 MB/s | 26 kB 00:00 2026-02-20T12:06:26.145 INFO:teuthology.orchestra.run.trial063.stdout:(80/96): python3-isodate-0.6.1-3.el9.noarch.rpm 466 kB/s | 56 kB 00:00 2026-02-20T12:06:26.146 INFO:teuthology.orchestra.run.trial063.stdout:(81/96): python3-more-itertools-8.12.0-2.el9.no 3.3 MB/s | 79 kB 00:00 2026-02-20T12:06:26.169 INFO:teuthology.orchestra.run.trial063.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 2.4 MB/s | 58 kB 00:00 2026-02-20T12:06:26.171 INFO:teuthology.orchestra.run.trial063.stdout:(83/96): python3-kubernetes-26.1.0-3.el9.noarch 17 MB/s | 1.0 MB 00:00 2026-02-20T12:06:26.192 INFO:teuthology.orchestra.run.trial063.stdout:(84/96): python3-portend-3.1.0-2.el9.noarch.rpm 714 kB/s | 16 kB 00:00 2026-02-20T12:06:26.195 INFO:teuthology.orchestra.run.trial063.stdout:(85/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2026-02-20T12:06:26.197 INFO:teuthology.orchestra.run.trial063.stdout:(86/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.4 MB/s | 90 kB 00:00 2026-02-20T12:06:26.215 INFO:teuthology.orchestra.run.trial063.stdout:(87/96): python3-repoze-lru-0.7-16.el9.noarch.r 1.3 MB/s | 31 kB 00:00 2026-02-20T12:06:26.222 INFO:teuthology.orchestra.run.trial063.stdout:(88/96): python3-rsa-4.9-2.el9.noarch.rpm 2.4 MB/s | 59 kB 00:00 2026-02-20T12:06:26.239 INFO:teuthology.orchestra.run.trial063.stdout:(89/96): python3-saml-1.16.0-1.el9.noarch.rpm 5.1 MB/s | 125 kB 00:00 2026-02-20T12:06:26.246 INFO:teuthology.orchestra.run.trial063.stdout:(90/96): python3-tempora-5.0.0-2.el9.noarch.rpm 1.5 MB/s | 36 kB 00:00 2026-02-20T12:06:26.247 INFO:teuthology.orchestra.run.trial063.stdout:(91/96): python3-routes-2.5.1-5.el9.noarch.rpm 3.6 MB/s | 188 kB 00:00 2026-02-20T12:06:26.263 INFO:teuthology.orchestra.run.trial063.stdout:(92/96): python3-typing-extensions-4.15.0-1.el9 3.5 MB/s | 86 kB 00:00 2026-02-20T12:06:26.271 INFO:teuthology.orchestra.run.trial063.stdout:(93/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.0 MB/s | 48 kB 00:00 2026-02-20T12:06:26.272 INFO:teuthology.orchestra.run.trial063.stdout:(94/96): python3-websocket-client-1.2.3-2.el9.n 3.4 MB/s | 90 kB 00:00 2026-02-20T12:06:26.286 INFO:teuthology.orchestra.run.trial063.stdout:(95/96): python3-xmltodict-0.12.0-15.el9.noarch 964 kB/s | 22 kB 00:00 2026-02-20T12:06:26.295 INFO:teuthology.orchestra.run.trial063.stdout:(96/96): python3-zc-lockfile-2.0-10.el9.noarch. 825 kB/s | 20 kB 00:00 2026-02-20T12:06:26.299 INFO:teuthology.orchestra.run.trial063.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:06:26.299 INFO:teuthology.orchestra.run.trial063.stdout:Total 30 MB/s | 223 MB 00:07 2026-02-20T12:06:26.708 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction check 2026-02-20T12:06:26.746 INFO:teuthology.orchestra.run.trial063.stdout:Transaction check succeeded. 2026-02-20T12:06:26.746 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction test 2026-02-20T12:06:27.535 INFO:teuthology.orchestra.run.trial063.stdout:Transaction test succeeded. 2026-02-20T12:06:27.535 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction 2026-02-20T12:06:28.368 INFO:teuthology.orchestra.run.trial063.stdout: Preparing : 1/1 2026-02-20T12:06:28.369 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-20T12:06:28.373 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-20T12:06:28.398 INFO:teuthology.orchestra.run.trial063.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-20T12:06:28.433 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-20T12:06:28.439 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-20T12:06:28.442 INFO:teuthology.orchestra.run.trial063.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-20T12:06:28.446 INFO:teuthology.orchestra.run.trial063.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-20T12:06:28.469 INFO:teuthology.orchestra.run.trial063.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-20T12:06:28.482 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-20T12:06:28.485 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-20T12:06:28.492 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-20T12:06:28.493 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-20T12:06:28.505 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-20T12:06:28.511 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-20T12:06:28.535 INFO:teuthology.orchestra.run.trial063.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-20T12:06:28.538 INFO:teuthology.orchestra.run.trial063.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-20T12:06:28.588 INFO:teuthology.orchestra.run.trial063.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-20T12:06:28.601 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-20T12:06:28.604 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-20T12:06:28.608 INFO:teuthology.orchestra.run.trial063.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-20T12:06:28.614 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-20T12:06:28.618 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-20T12:06:28.621 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-20T12:06:28.636 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-20T12:06:28.640 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-20T12:06:28.645 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-20T12:06:28.657 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-20T12:06:28.666 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-20T12:06:28.672 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-20T12:06:28.692 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-20T12:06:28.703 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-20T12:06:28.718 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-20T12:06:28.723 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-20T12:06:28.730 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-20T12:06:28.771 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-20T12:06:29.097 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-20T12:06:29.107 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-20T12:06:29.111 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-20T12:06:29.117 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-20T12:06:29.118 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-20T12:06:29.146 INFO:teuthology.orchestra.run.trial063.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-20T12:06:29.190 INFO:teuthology.orchestra.run.trial063.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-20T12:06:29.198 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-20T12:06:29.203 INFO:teuthology.orchestra.run.trial063.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-20T12:06:29.207 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-20T12:06:29.212 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-20T12:06:29.217 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-20T12:06:29.223 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-20T12:06:29.226 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-20T12:06:29.254 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-20T12:06:29.264 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-20T12:06:29.270 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-20T12:06:29.277 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-20T12:06:29.311 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-20T12:06:29.537 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-20T12:06:29.560 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-20T12:06:29.564 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-20T12:06:29.623 INFO:teuthology.orchestra.run.trial063.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-20T12:06:29.624 INFO:teuthology.orchestra.run.trial063.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-20T12:06:29.645 INFO:teuthology.orchestra.run.trial063.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-20T12:06:29.972 INFO:teuthology.orchestra.run.trial063.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-20T12:06:30.046 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-20T12:06:30.721 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-20T12:06:30.737 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-20T12:06:30.747 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-20T12:06:30.754 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-20T12:06:30.767 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-20T12:06:30.783 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-20T12:06:30.859 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-20T12:06:30.868 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-20T12:06:30.892 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-20T12:06:30.921 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-20T12:06:30.972 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-20T12:06:30.978 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-20T12:06:30.982 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-20T12:06:30.983 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-20T12:06:31.001 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T12:06:31.001 INFO:teuthology.orchestra.run.trial063.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T12:06:31.001 INFO:teuthology.orchestra.run.trial063.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T12:06:31.001 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:31.010 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T12:06:31.036 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T12:06:31.036 INFO:teuthology.orchestra.run.trial063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T12:06:31.036 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:31.071 INFO:teuthology.orchestra.run.trial063.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-20T12:06:31.660 INFO:teuthology.orchestra.run.trial063.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-20T12:06:36.932 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_6 80/96 2026-02-20T12:06:36.996 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-osd-crimson-2:20.3.0-5312.g26bc9765.el9.x86_6 81/96 2026-02-20T12:06:36.998 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch 82/96 2026-02-20T12:06:37.013 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch 82/96 2026-02-20T12:06:37.013 INFO:teuthology.orchestra.run.trial063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:06:37.013 INFO:teuthology.orchestra.run.trial063.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T12:06:37.013 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:37.025 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 83/96 2026-02-20T12:06:37.049 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 83/96 2026-02-20T12:06:37.050 INFO:teuthology.orchestra.run.trial063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:06:37.050 INFO:teuthology.orchestra.run.trial063.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T12:06:37.050 INFO:teuthology.orchestra.run.trial063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T12:06:37.050 INFO:teuthology.orchestra.run.trial063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T12:06:37.050 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:37.109 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: cephadm-2:20.3.0-5312.g26bc9765.el9.noarch 84/96 2026-02-20T12:06:37.110 INFO:teuthology.orchestra.run.trial063.stdout: Installing : cephadm-2:20.3.0-5312.g26bc9765.el9.noarch 84/96 2026-02-20T12:06:37.120 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5312.g26bc9765.el9 85/96 2026-02-20T12:06:37.144 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5312.g26bc9765.el 86/96 2026-02-20T12:06:37.145 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarc 87/96 2026-02-20T12:06:40.047 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarc 87/96 2026-02-20T12:06:40.054 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noa 88/96 2026-02-20T12:06:40.510 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noa 88/96 2026-02-20T12:06:40.511 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9 89/96 2026-02-20T12:06:40.523 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9 89/96 2026-02-20T12:06:40.524 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5312.g26bc9765.el9.noa 90/96 2026-02-20T12:06:40.586 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5312.g26bc9765.el9.noa 90/96 2026-02-20T12:06:40.626 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5312.g26bc9765.el9. 91/96 2026-02-20T12:06:40.627 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 92/96 2026-02-20T12:06:40.649 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 92/96 2026-02-20T12:06:40.649 INFO:teuthology.orchestra.run.trial063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:06:40.649 INFO:teuthology.orchestra.run.trial063.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T12:06:40.649 INFO:teuthology.orchestra.run.trial063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T12:06:40.649 INFO:teuthology.orchestra.run.trial063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T12:06:40.649 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:40.660 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch 93/96 2026-02-20T12:06:40.877 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch 93/96 2026-02-20T12:06:40.878 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-mon-2:20.3.0-5312.g26bc9765.el9.x86_64 94/96 2026-02-20T12:06:40.899 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-mon-2:20.3.0-5312.g26bc9765.el9.x86_64 94/96 2026-02-20T12:06:40.899 INFO:teuthology.orchestra.run.trial063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:06:40.899 INFO:teuthology.orchestra.run.trial063.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T12:06:40.899 INFO:teuthology.orchestra.run.trial063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T12:06:40.899 INFO:teuthology.orchestra.run.trial063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T12:06:40.900 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:40.982 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-mds-2:20.3.0-5312.g26bc9765.el9.x86_64 95/96 2026-02-20T12:06:41.003 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-mds-2:20.3.0-5312.g26bc9765.el9.x86_64 95/96 2026-02-20T12:06:41.003 INFO:teuthology.orchestra.run.trial063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:06:41.003 INFO:teuthology.orchestra.run.trial063.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T12:06:41.003 INFO:teuthology.orchestra.run.trial063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T12:06:41.003 INFO:teuthology.orchestra.run.trial063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T12:06:41.003 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:41.004 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-2:20.3.0-5312.g26bc9765.el9.x86_64 96/96 2026-02-20T12:06:41.010 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_6 96/96 2026-02-20T12:06:41.034 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5312.g26bc9765.el9.x86_6 96/96 2026-02-20T12:06:42.402 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-2:20.3.0-5312.g26bc9765.el9.x86_64 96/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-2:20.3.0-5312.g26bc9765.el9.x86_64 1/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-mds-2:20.3.0-5312.g26bc9765.el9.x86_64 2/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 3/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-mon-2:20.3.0-5312.g26bc9765.el9.x86_64 4/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 5/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_6 6/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5312.g26bc9765.el9.x86_6 7/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5312.g26bc9765.el 8/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarc 9/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noa 10/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9 11/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5312.g26bc9765.el9.noa 12/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5312.g26bc9765.el9. 13/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch 14/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5312.g26bc9765.el9 15/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch 16/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : cephadm-2:20.3.0-5312.g26bc9765.el9.noarch 17/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-20T12:06:42.403 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-20T12:06:42.404 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-20T12:06:42.405 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-20T12:06:42.405 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-20T12:06:42.405 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-20T12:06:42.472 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-20T12:06:42.473 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:42.473 INFO:teuthology.orchestra.run.trial063.stdout:Installed: 2026-02-20T12:06:42.473 INFO:teuthology.orchestra.run.trial063.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T12:06:42.473 INFO:teuthology.orchestra.run.trial063.stdout: ceph-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:42.473 INFO:teuthology.orchestra.run.trial063.stdout: ceph-grafana-dashboards-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T12:06:42.473 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mds-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:42.473 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:42.473 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T12:06:42.473 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T12:06:42.474 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T12:06:42.474 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mgr-k8sevents-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T12:06:42.474 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mgr-modules-core-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T12:06:42.474 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T12:06:42.474 INFO:teuthology.orchestra.run.trial063.stdout: ceph-mon-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:42.474 INFO:teuthology.orchestra.run.trial063.stdout: ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:42.474 INFO:teuthology.orchestra.run.trial063.stdout: ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:42.474 INFO:teuthology.orchestra.run.trial063.stdout: ceph-osd-crimson-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:42.474 INFO:teuthology.orchestra.run.trial063.stdout: ceph-prometheus-alerts-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T12:06:42.474 INFO:teuthology.orchestra.run.trial063.stdout: ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T12:06:42.474 INFO:teuthology.orchestra.run.trial063.stdout: cephadm-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T12:06:42.474 INFO:teuthology.orchestra.run.trial063.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T12:06:42.475 INFO:teuthology.orchestra.run.trial063.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T12:06:42.475 INFO:teuthology.orchestra.run.trial063.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T12:06:42.475 INFO:teuthology.orchestra.run.trial063.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T12:06:42.475 INFO:teuthology.orchestra.run.trial063.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T12:06:42.475 INFO:teuthology.orchestra.run.trial063.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T12:06:42.475 INFO:teuthology.orchestra.run.trial063.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T12:06:42.475 INFO:teuthology.orchestra.run.trial063.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T12:06:42.475 INFO:teuthology.orchestra.run.trial063.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T12:06:42.475 INFO:teuthology.orchestra.run.trial063.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T12:06:42.475 INFO:teuthology.orchestra.run.trial063.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T12:06:42.475 INFO:teuthology.orchestra.run.trial063.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T12:06:42.475 INFO:teuthology.orchestra.run.trial063.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T12:06:42.476 INFO:teuthology.orchestra.run.trial063.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T12:06:42.476 INFO:teuthology.orchestra.run.trial063.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T12:06:42.476 INFO:teuthology.orchestra.run.trial063.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T12:06:42.476 INFO:teuthology.orchestra.run.trial063.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T12:06:42.476 INFO:teuthology.orchestra.run.trial063.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T12:06:42.476 INFO:teuthology.orchestra.run.trial063.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T12:06:42.476 INFO:teuthology.orchestra.run.trial063.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T12:06:42.476 INFO:teuthology.orchestra.run.trial063.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T12:06:42.476 INFO:teuthology.orchestra.run.trial063.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T12:06:42.476 INFO:teuthology.orchestra.run.trial063.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T12:06:42.476 INFO:teuthology.orchestra.run.trial063.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T12:06:42.476 INFO:teuthology.orchestra.run.trial063.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T12:06:42.477 INFO:teuthology.orchestra.run.trial063.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T12:06:42.477 INFO:teuthology.orchestra.run.trial063.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T12:06:42.477 INFO:teuthology.orchestra.run.trial063.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T12:06:42.477 INFO:teuthology.orchestra.run.trial063.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T12:06:42.477 INFO:teuthology.orchestra.run.trial063.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T12:06:42.477 INFO:teuthology.orchestra.run.trial063.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T12:06:42.477 INFO:teuthology.orchestra.run.trial063.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T12:06:42.477 INFO:teuthology.orchestra.run.trial063.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T12:06:42.477 INFO:teuthology.orchestra.run.trial063.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T12:06:42.477 INFO:teuthology.orchestra.run.trial063.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T12:06:42.477 INFO:teuthology.orchestra.run.trial063.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T12:06:42.477 INFO:teuthology.orchestra.run.trial063.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T12:06:42.478 INFO:teuthology.orchestra.run.trial063.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T12:06:42.478 INFO:teuthology.orchestra.run.trial063.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T12:06:42.478 INFO:teuthology.orchestra.run.trial063.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T12:06:42.478 INFO:teuthology.orchestra.run.trial063.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T12:06:42.478 INFO:teuthology.orchestra.run.trial063.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T12:06:42.478 INFO:teuthology.orchestra.run.trial063.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T12:06:42.478 INFO:teuthology.orchestra.run.trial063.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T12:06:42.478 INFO:teuthology.orchestra.run.trial063.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T12:06:42.478 INFO:teuthology.orchestra.run.trial063.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T12:06:42.479 INFO:teuthology.orchestra.run.trial063.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T12:06:42.479 INFO:teuthology.orchestra.run.trial063.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T12:06:42.479 INFO:teuthology.orchestra.run.trial063.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T12:06:42.479 INFO:teuthology.orchestra.run.trial063.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T12:06:42.479 INFO:teuthology.orchestra.run.trial063.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T12:06:42.479 INFO:teuthology.orchestra.run.trial063.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T12:06:42.479 INFO:teuthology.orchestra.run.trial063.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T12:06:42.479 INFO:teuthology.orchestra.run.trial063.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T12:06:42.479 INFO:teuthology.orchestra.run.trial063.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T12:06:42.479 INFO:teuthology.orchestra.run.trial063.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T12:06:42.480 INFO:teuthology.orchestra.run.trial063.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T12:06:42.480 INFO:teuthology.orchestra.run.trial063.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T12:06:42.480 INFO:teuthology.orchestra.run.trial063.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T12:06:42.480 INFO:teuthology.orchestra.run.trial063.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T12:06:42.480 INFO:teuthology.orchestra.run.trial063.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T12:06:42.480 INFO:teuthology.orchestra.run.trial063.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T12:06:42.480 INFO:teuthology.orchestra.run.trial063.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T12:06:42.480 INFO:teuthology.orchestra.run.trial063.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T12:06:42.480 INFO:teuthology.orchestra.run.trial063.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T12:06:42.480 INFO:teuthology.orchestra.run.trial063.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T12:06:42.480 INFO:teuthology.orchestra.run.trial063.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T12:06:42.480 INFO:teuthology.orchestra.run.trial063.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T12:06:42.481 INFO:teuthology.orchestra.run.trial063.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T12:06:42.481 INFO:teuthology.orchestra.run.trial063.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T12:06:42.481 INFO:teuthology.orchestra.run.trial063.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T12:06:42.481 INFO:teuthology.orchestra.run.trial063.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T12:06:42.481 INFO:teuthology.orchestra.run.trial063.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T12:06:42.481 INFO:teuthology.orchestra.run.trial063.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T12:06:42.481 INFO:teuthology.orchestra.run.trial063.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T12:06:42.481 INFO:teuthology.orchestra.run.trial063.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T12:06:42.481 INFO:teuthology.orchestra.run.trial063.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T12:06:42.481 INFO:teuthology.orchestra.run.trial063.stdout: zip-3.0-35.el9.x86_64 2026-02-20T12:06:42.481 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:42.482 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:42.539 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-base 2026-02-20T12:06:42.849 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:49 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:42.913 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:06:42.931 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:42.931 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:42.931 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:42.952 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install cephadm 2026-02-20T12:06:43.260 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:50 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:43.324 INFO:teuthology.orchestra.run.trial063.stdout:Package cephadm-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T12:06:43.343 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:43.343 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:43.343 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:43.364 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T12:06:43.671 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:50 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:43.754 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:43.754 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:43.754 INFO:teuthology.orchestra.run.trial063.stdout: Package Arch Version Repo Size 2026-02-20T12:06:43.754 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:43.754 INFO:teuthology.orchestra.run.trial063.stdout:Installing: 2026-02-20T12:06:43.754 INFO:teuthology.orchestra.run.trial063.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 149 k 2026-02-20T12:06:43.754 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:43.754 INFO:teuthology.orchestra.run.trial063.stdout:Transaction Summary 2026-02-20T12:06:43.754 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:43.754 INFO:teuthology.orchestra.run.trial063.stdout:Install 1 Package 2026-02-20T12:06:43.754 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:43.754 INFO:teuthology.orchestra.run.trial063.stdout:Total download size: 149 k 2026-02-20T12:06:43.755 INFO:teuthology.orchestra.run.trial063.stdout:Installed size: 455 k 2026-02-20T12:06:43.755 INFO:teuthology.orchestra.run.trial063.stdout:Downloading Packages: 2026-02-20T12:06:44.145 INFO:teuthology.orchestra.run.trial063.stdout:ceph-immutable-object-cache-20.3.0-5312.g26bc97 383 kB/s | 149 kB 00:00 2026-02-20T12:06:44.145 INFO:teuthology.orchestra.run.trial063.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:06:44.145 INFO:teuthology.orchestra.run.trial063.stdout:Total 382 kB/s | 149 kB 00:00 2026-02-20T12:06:44.145 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction check 2026-02-20T12:06:44.150 INFO:teuthology.orchestra.run.trial063.stdout:Transaction check succeeded. 2026-02-20T12:06:44.150 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction test 2026-02-20T12:06:44.181 INFO:teuthology.orchestra.run.trial063.stdout:Transaction test succeeded. 2026-02-20T12:06:44.181 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction 2026-02-20T12:06:44.237 INFO:teuthology.orchestra.run.trial063.stdout: Preparing : 1/1 2026-02-20T12:06:44.238 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5312.g26bc9765. 1/1 2026-02-20T12:06:44.260 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5312.g26bc9765. 1/1 2026-02-20T12:06:44.260 INFO:teuthology.orchestra.run.trial063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:06:44.260 INFO:teuthology.orchestra.run.trial063.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T12:06:44.260 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:44.551 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5312.g26bc9765. 1/1 2026-02-20T12:06:44.552 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:44.552 INFO:teuthology.orchestra.run.trial063.stdout:Installed: 2026-02-20T12:06:44.552 INFO:teuthology.orchestra.run.trial063.stdout: ceph-immutable-object-cache-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:44.552 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:44.552 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:44.579 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-mgr 2026-02-20T12:06:44.892 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:51 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:44.956 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:06:44.975 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:44.975 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:44.975 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:44.996 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T12:06:45.310 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:52 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:45.375 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T12:06:45.393 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:45.395 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:45.395 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:45.415 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T12:06:45.723 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:52 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:45.789 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T12:06:45.807 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:45.808 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:45.808 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:45.829 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-mgr-rook 2026-02-20T12:06:46.138 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:53 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:46.203 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T12:06:46.221 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:46.222 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:46.222 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:46.242 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T12:06:46.545 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:53 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:46.609 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T12:06:46.627 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:46.628 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:46.628 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:46.648 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-osd 2026-02-20T12:06:46.954 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:53 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:47.018 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:06:47.037 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:47.037 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:47.037 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:47.059 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-osd-classic 2026-02-20T12:06:47.371 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:54 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:47.434 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:06:47.452 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:47.453 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:47.453 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:47.473 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-fuse 2026-02-20T12:06:47.775 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:54 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:47.858 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:47.858 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:47.858 INFO:teuthology.orchestra.run.trial063.stdout: Package Arch Version Repo Size 2026-02-20T12:06:47.858 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:47.858 INFO:teuthology.orchestra.run.trial063.stdout:Installing: 2026-02-20T12:06:47.858 INFO:teuthology.orchestra.run.trial063.stdout: ceph-fuse x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 914 k 2026-02-20T12:06:47.858 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:47.858 INFO:teuthology.orchestra.run.trial063.stdout:Transaction Summary 2026-02-20T12:06:47.858 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:47.858 INFO:teuthology.orchestra.run.trial063.stdout:Install 1 Package 2026-02-20T12:06:47.858 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:47.858 INFO:teuthology.orchestra.run.trial063.stdout:Total download size: 914 k 2026-02-20T12:06:47.858 INFO:teuthology.orchestra.run.trial063.stdout:Installed size: 2.9 M 2026-02-20T12:06:47.858 INFO:teuthology.orchestra.run.trial063.stdout:Downloading Packages: 2026-02-20T12:06:47.978 INFO:teuthology.orchestra.run.trial063.stdout:ceph-fuse-20.3.0-5312.g26bc9765.el9.x86_64.rpm 7.5 MB/s | 914 kB 00:00 2026-02-20T12:06:47.979 INFO:teuthology.orchestra.run.trial063.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:06:47.979 INFO:teuthology.orchestra.run.trial063.stdout:Total 7.4 MB/s | 914 kB 00:00 2026-02-20T12:06:47.980 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction check 2026-02-20T12:06:47.984 INFO:teuthology.orchestra.run.trial063.stdout:Transaction check succeeded. 2026-02-20T12:06:47.984 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction test 2026-02-20T12:06:48.017 INFO:teuthology.orchestra.run.trial063.stdout:Transaction test succeeded. 2026-02-20T12:06:48.018 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction 2026-02-20T12:06:48.107 INFO:teuthology.orchestra.run.trial063.stdout: Preparing : 1/1 2026-02-20T12:06:48.124 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:48.358 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:48.415 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:48.415 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:48.415 INFO:teuthology.orchestra.run.trial063.stdout:Installed: 2026-02-20T12:06:48.415 INFO:teuthology.orchestra.run.trial063.stdout: ceph-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:48.415 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:48.415 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:48.442 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-volume 2026-02-20T12:06:48.755 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:55 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:48.820 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T12:06:48.838 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:48.839 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:48.839 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:48.859 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install librados-devel 2026-02-20T12:06:49.172 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:56 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:49.255 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:49.255 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:49.255 INFO:teuthology.orchestra.run.trial063.stdout: Package Arch Version Repo Size 2026-02-20T12:06:49.255 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:49.256 INFO:teuthology.orchestra.run.trial063.stdout:Installing: 2026-02-20T12:06:49.256 INFO:teuthology.orchestra.run.trial063.stdout: librados-devel x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 124 k 2026-02-20T12:06:49.256 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:49.256 INFO:teuthology.orchestra.run.trial063.stdout:Transaction Summary 2026-02-20T12:06:49.256 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:49.256 INFO:teuthology.orchestra.run.trial063.stdout:Install 1 Package 2026-02-20T12:06:49.256 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:49.256 INFO:teuthology.orchestra.run.trial063.stdout:Total download size: 124 k 2026-02-20T12:06:49.256 INFO:teuthology.orchestra.run.trial063.stdout:Installed size: 434 k 2026-02-20T12:06:49.256 INFO:teuthology.orchestra.run.trial063.stdout:Downloading Packages: 2026-02-20T12:06:49.339 INFO:teuthology.orchestra.run.trial063.stdout:librados-devel-20.3.0-5312.g26bc9765.el9.x86_64 1.4 MB/s | 124 kB 00:00 2026-02-20T12:06:49.340 INFO:teuthology.orchestra.run.trial063.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:06:49.340 INFO:teuthology.orchestra.run.trial063.stdout:Total 1.4 MB/s | 124 kB 00:00 2026-02-20T12:06:49.341 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction check 2026-02-20T12:06:49.342 INFO:teuthology.orchestra.run.trial063.stdout:Transaction check succeeded. 2026-02-20T12:06:49.343 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction test 2026-02-20T12:06:49.374 INFO:teuthology.orchestra.run.trial063.stdout:Transaction test succeeded. 2026-02-20T12:06:49.375 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction 2026-02-20T12:06:49.429 INFO:teuthology.orchestra.run.trial063.stdout: Preparing : 1/1 2026-02-20T12:06:49.445 INFO:teuthology.orchestra.run.trial063.stdout: Installing : librados-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:49.526 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: librados-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:49.583 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : librados-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:49.583 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:49.583 INFO:teuthology.orchestra.run.trial063.stdout:Installed: 2026-02-20T12:06:49.583 INFO:teuthology.orchestra.run.trial063.stdout: librados-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:49.583 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:49.583 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:49.610 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install libcephfs2 2026-02-20T12:06:49.923 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:56 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:49.987 INFO:teuthology.orchestra.run.trial063.stdout:Package libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:06:50.006 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:50.006 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:50.006 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:50.028 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install libcephfs-devel 2026-02-20T12:06:50.336 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:57 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:50.418 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:50.418 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:50.418 INFO:teuthology.orchestra.run.trial063.stdout: Package Arch Version Repo Size 2026-02-20T12:06:50.419 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:50.419 INFO:teuthology.orchestra.run.trial063.stdout:Installing: 2026-02-20T12:06:50.419 INFO:teuthology.orchestra.run.trial063.stdout: libcephfs-devel x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 37 k 2026-02-20T12:06:50.419 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:50.419 INFO:teuthology.orchestra.run.trial063.stdout:Transaction Summary 2026-02-20T12:06:50.419 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:50.419 INFO:teuthology.orchestra.run.trial063.stdout:Install 1 Package 2026-02-20T12:06:50.419 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:50.419 INFO:teuthology.orchestra.run.trial063.stdout:Total download size: 37 k 2026-02-20T12:06:50.419 INFO:teuthology.orchestra.run.trial063.stdout:Installed size: 171 k 2026-02-20T12:06:50.420 INFO:teuthology.orchestra.run.trial063.stdout:Downloading Packages: 2026-02-20T12:06:50.483 INFO:teuthology.orchestra.run.trial063.stdout:libcephfs-devel-20.3.0-5312.g26bc9765.el9.x86_6 582 kB/s | 37 kB 00:00 2026-02-20T12:06:50.484 INFO:teuthology.orchestra.run.trial063.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:06:50.484 INFO:teuthology.orchestra.run.trial063.stdout:Total 569 kB/s | 37 kB 00:00 2026-02-20T12:06:50.484 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction check 2026-02-20T12:06:50.486 INFO:teuthology.orchestra.run.trial063.stdout:Transaction check succeeded. 2026-02-20T12:06:50.486 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction test 2026-02-20T12:06:50.488 INFO:teuthology.orchestra.run.trial063.stdout:Transaction test succeeded. 2026-02-20T12:06:50.488 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction 2026-02-20T12:06:50.510 INFO:teuthology.orchestra.run.trial063.stdout: Preparing : 1/1 2026-02-20T12:06:50.529 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libcephfs-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:50.583 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:50.640 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libcephfs-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:50.640 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:50.640 INFO:teuthology.orchestra.run.trial063.stdout:Installed: 2026-02-20T12:06:50.640 INFO:teuthology.orchestra.run.trial063.stdout: libcephfs-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:50.640 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:50.641 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:50.666 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install librados2 2026-02-20T12:06:50.978 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:57 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:51.042 INFO:teuthology.orchestra.run.trial063.stdout:Package librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:06:51.061 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:51.061 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:51.062 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:51.082 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install librbd1 2026-02-20T12:06:51.384 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:58 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:51.448 INFO:teuthology.orchestra.run.trial063.stdout:Package librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:06:51.466 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:51.467 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:51.467 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:51.488 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install python3-rados 2026-02-20T12:06:51.792 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:58 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:51.857 INFO:teuthology.orchestra.run.trial063.stdout:Package python3-rados-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:06:51.875 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:51.876 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:51.876 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:51.897 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install python3-rgw 2026-02-20T12:06:52.203 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:59 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:52.268 INFO:teuthology.orchestra.run.trial063.stdout:Package python3-rgw-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:06:52.286 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:52.286 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:52.286 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:52.307 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install python3-cephfs 2026-02-20T12:06:52.609 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:59 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:52.673 INFO:teuthology.orchestra.run.trial063.stdout:Package python3-cephfs-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:06:52.691 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:52.692 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:52.692 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:52.713 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install python3-rbd 2026-02-20T12:06:53.018 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:01:00 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:53.083 INFO:teuthology.orchestra.run.trial063.stdout:Package python3-rbd-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:06:53.101 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:53.101 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:53.102 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:53.123 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install rbd-fuse 2026-02-20T12:06:53.431 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:01:00 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:53.514 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:53.514 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:53.514 INFO:teuthology.orchestra.run.trial063.stdout: Package Architecture Version Repository Size 2026-02-20T12:06:53.514 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:53.515 INFO:teuthology.orchestra.run.trial063.stdout:Installing: 2026-02-20T12:06:53.515 INFO:teuthology.orchestra.run.trial063.stdout: rbd-fuse x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 87 k 2026-02-20T12:06:53.515 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:53.515 INFO:teuthology.orchestra.run.trial063.stdout:Transaction Summary 2026-02-20T12:06:53.515 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:53.515 INFO:teuthology.orchestra.run.trial063.stdout:Install 1 Package 2026-02-20T12:06:53.515 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:53.515 INFO:teuthology.orchestra.run.trial063.stdout:Total download size: 87 k 2026-02-20T12:06:53.515 INFO:teuthology.orchestra.run.trial063.stdout:Installed size: 236 k 2026-02-20T12:06:53.515 INFO:teuthology.orchestra.run.trial063.stdout:Downloading Packages: 2026-02-20T12:06:53.589 INFO:teuthology.orchestra.run.trial063.stdout:rbd-fuse-20.3.0-5312.g26bc9765.el9.x86_64.rpm 1.2 MB/s | 87 kB 00:00 2026-02-20T12:06:53.589 INFO:teuthology.orchestra.run.trial063.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:06:53.589 INFO:teuthology.orchestra.run.trial063.stdout:Total 1.1 MB/s | 87 kB 00:00 2026-02-20T12:06:53.589 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction check 2026-02-20T12:06:53.593 INFO:teuthology.orchestra.run.trial063.stdout:Transaction check succeeded. 2026-02-20T12:06:53.593 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction test 2026-02-20T12:06:53.624 INFO:teuthology.orchestra.run.trial063.stdout:Transaction test succeeded. 2026-02-20T12:06:53.624 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction 2026-02-20T12:06:53.675 INFO:teuthology.orchestra.run.trial063.stdout: Preparing : 1/1 2026-02-20T12:06:53.691 INFO:teuthology.orchestra.run.trial063.stdout: Installing : rbd-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:53.767 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:53.824 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : rbd-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:53.825 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:53.825 INFO:teuthology.orchestra.run.trial063.stdout:Installed: 2026-02-20T12:06:53.825 INFO:teuthology.orchestra.run.trial063.stdout: rbd-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:53.825 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:53.825 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:53.851 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install rbd-mirror 2026-02-20T12:06:54.161 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:01:01 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:54.244 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:54.244 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:54.244 INFO:teuthology.orchestra.run.trial063.stdout: Package Arch Version Repo Size 2026-02-20T12:06:54.244 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:54.244 INFO:teuthology.orchestra.run.trial063.stdout:Installing: 2026-02-20T12:06:54.244 INFO:teuthology.orchestra.run.trial063.stdout: rbd-mirror x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 2.6 M 2026-02-20T12:06:54.244 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:54.244 INFO:teuthology.orchestra.run.trial063.stdout:Transaction Summary 2026-02-20T12:06:54.244 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:54.244 INFO:teuthology.orchestra.run.trial063.stdout:Install 1 Package 2026-02-20T12:06:54.244 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:54.244 INFO:teuthology.orchestra.run.trial063.stdout:Total download size: 2.6 M 2026-02-20T12:06:54.245 INFO:teuthology.orchestra.run.trial063.stdout:Installed size: 11 M 2026-02-20T12:06:54.245 INFO:teuthology.orchestra.run.trial063.stdout:Downloading Packages: 2026-02-20T12:06:54.385 INFO:teuthology.orchestra.run.trial063.stdout:rbd-mirror-20.3.0-5312.g26bc9765.el9.x86_64.rpm 18 MB/s | 2.6 MB 00:00 2026-02-20T12:06:54.385 INFO:teuthology.orchestra.run.trial063.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:06:54.385 INFO:teuthology.orchestra.run.trial063.stdout:Total 18 MB/s | 2.6 MB 00:00 2026-02-20T12:06:54.385 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction check 2026-02-20T12:06:54.390 INFO:teuthology.orchestra.run.trial063.stdout:Transaction check succeeded. 2026-02-20T12:06:54.390 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction test 2026-02-20T12:06:54.430 INFO:teuthology.orchestra.run.trial063.stdout:Transaction test succeeded. 2026-02-20T12:06:54.430 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction 2026-02-20T12:06:54.597 INFO:teuthology.orchestra.run.trial063.stdout: Preparing : 1/1 2026-02-20T12:06:54.598 INFO:teuthology.orchestra.run.trial063.stdout: Installing : rbd-mirror-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:54.622 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:54.622 INFO:teuthology.orchestra.run.trial063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:06:54.622 INFO:teuthology.orchestra.run.trial063.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T12:06:54.622 INFO:teuthology.orchestra.run.trial063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T12:06:54.622 INFO:teuthology.orchestra.run.trial063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T12:06:54.622 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:54.960 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : rbd-mirror-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:54.960 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:54.960 INFO:teuthology.orchestra.run.trial063.stdout:Installed: 2026-02-20T12:06:54.960 INFO:teuthology.orchestra.run.trial063.stdout: rbd-mirror-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:54.960 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:54.960 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:54.986 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install rbd-nbd 2026-02-20T12:06:55.297 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:01:02 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:55.380 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:55.380 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:55.380 INFO:teuthology.orchestra.run.trial063.stdout: Package Architecture Version Repository Size 2026-02-20T12:06:55.381 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:55.381 INFO:teuthology.orchestra.run.trial063.stdout:Installing: 2026-02-20T12:06:55.381 INFO:teuthology.orchestra.run.trial063.stdout: rbd-nbd x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 166 k 2026-02-20T12:06:55.381 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:55.381 INFO:teuthology.orchestra.run.trial063.stdout:Transaction Summary 2026-02-20T12:06:55.381 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:55.381 INFO:teuthology.orchestra.run.trial063.stdout:Install 1 Package 2026-02-20T12:06:55.381 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:55.381 INFO:teuthology.orchestra.run.trial063.stdout:Total download size: 166 k 2026-02-20T12:06:55.381 INFO:teuthology.orchestra.run.trial063.stdout:Installed size: 496 k 2026-02-20T12:06:55.381 INFO:teuthology.orchestra.run.trial063.stdout:Downloading Packages: 2026-02-20T12:06:55.466 INFO:teuthology.orchestra.run.trial063.stdout:rbd-nbd-20.3.0-5312.g26bc9765.el9.x86_64.rpm 1.9 MB/s | 166 kB 00:00 2026-02-20T12:06:55.466 INFO:teuthology.orchestra.run.trial063.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:06:55.467 INFO:teuthology.orchestra.run.trial063.stdout:Total 1.9 MB/s | 166 kB 00:00 2026-02-20T12:06:55.467 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction check 2026-02-20T12:06:55.471 INFO:teuthology.orchestra.run.trial063.stdout:Transaction check succeeded. 2026-02-20T12:06:55.471 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction test 2026-02-20T12:06:55.502 INFO:teuthology.orchestra.run.trial063.stdout:Transaction test succeeded. 2026-02-20T12:06:55.502 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction 2026-02-20T12:06:55.558 INFO:teuthology.orchestra.run.trial063.stdout: Preparing : 1/1 2026-02-20T12:06:55.574 INFO:teuthology.orchestra.run.trial063.stdout: Installing : rbd-nbd-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:55.651 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:55.709 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : rbd-nbd-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T12:06:55.709 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:55.709 INFO:teuthology.orchestra.run.trial063.stdout:Installed: 2026-02-20T12:06:55.709 INFO:teuthology.orchestra.run.trial063.stdout: rbd-nbd-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:06:55.709 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:55.709 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:55.737 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-osd-crimson 2026-02-20T12:06:56.051 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:01:03 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:56.115 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-osd-crimson-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:06:56.133 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:56.133 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:06:56.134 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:06:56.155 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-20T12:06:56.467 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:01:03 ago on Fri 20 Feb 2026 12:05:53 PM UTC. 2026-02-20T12:06:56.551 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:06:56.551 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:56.551 INFO:teuthology.orchestra.run.trial063.stdout: Package Arch Version Repo Size 2026-02-20T12:06:56.551 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:56.551 INFO:teuthology.orchestra.run.trial063.stdout:Installing: 2026-02-20T12:06:56.551 INFO:teuthology.orchestra.run.trial063.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 425 M 2026-02-20T12:06:56.552 INFO:teuthology.orchestra.run.trial063.stdout:Installing weak dependencies: 2026-02-20T12:06:56.552 INFO:teuthology.orchestra.run.trial063.stdout: ceph-debugsource x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 12 M 2026-02-20T12:06:56.552 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:56.552 INFO:teuthology.orchestra.run.trial063.stdout:Transaction Summary 2026-02-20T12:06:56.552 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:06:56.552 INFO:teuthology.orchestra.run.trial063.stdout:Install 2 Packages 2026-02-20T12:06:56.552 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:06:56.552 INFO:teuthology.orchestra.run.trial063.stdout:Total download size: 437 M 2026-02-20T12:06:56.552 INFO:teuthology.orchestra.run.trial063.stdout:Installed size: 2.6 G 2026-02-20T12:06:56.553 INFO:teuthology.orchestra.run.trial063.stdout:Downloading Packages: 2026-02-20T12:06:56.987 INFO:teuthology.orchestra.run.trial063.stdout:(1/2): ceph-debugsource-20.3.0-5312.g26bc9765.e 28 MB/s | 12 MB 00:00 2026-02-20T12:07:10.326 INFO:teuthology.orchestra.run.trial063.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5312.g 31 MB/s | 425 MB 00:13 2026-02-20T12:07:10.327 INFO:teuthology.orchestra.run.trial063.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:07:10.327 INFO:teuthology.orchestra.run.trial063.stdout:Total 32 MB/s | 437 MB 00:13 2026-02-20T12:07:10.327 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction check 2026-02-20T12:07:10.332 INFO:teuthology.orchestra.run.trial063.stdout:Transaction check succeeded. 2026-02-20T12:07:10.332 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction test 2026-02-20T12:07:11.678 INFO:teuthology.orchestra.run.trial063.stdout:Transaction test succeeded. 2026-02-20T12:07:11.678 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction 2026-02-20T12:07:15.229 INFO:teuthology.orchestra.run.trial063.stdout: Preparing : 1/1 2026-02-20T12:07:36.985 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-debugsource-2:20.3.0-5312.g26bc9765.el9.x86_64 1/2 2026-02-20T12:07:37.002 INFO:teuthology.orchestra.run.trial063.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5312.g26bc9765.e 2/2 2026-02-20T12:07:38.930 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5312.g26bc9765.e 2/2 2026-02-20T12:07:38.930 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-debugsource-2:20.3.0-5312.g26bc9765.el9.x86_64 1/2 2026-02-20T12:07:38.989 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5312.g26bc9765.e 2/2 2026-02-20T12:07:38.989 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:07:38.989 INFO:teuthology.orchestra.run.trial063.stdout:Installed: 2026-02-20T12:07:38.989 INFO:teuthology.orchestra.run.trial063.stdout: ceph-debugsource-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:07:38.989 INFO:teuthology.orchestra.run.trial063.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:07:38.989 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:07:38.989 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:07:39.063 DEBUG:teuthology.parallel:result is None 2026-02-20T12:07:39.063 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=26bc97655ae0056b78c14ab91d1307332bd6dfca 2026-02-20T12:07:39.339 DEBUG:teuthology.orchestra.run.trial063:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T12:07:39.361 INFO:teuthology.orchestra.run.trial063.stdout:20.3.0-5312.g26bc9765.el9 2026-02-20T12:07:39.361 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5312.g26bc9765.el9 2026-02-20T12:07:39.361 INFO:teuthology.task.install:The correct ceph version 20.3.0-5312.g26bc9765 is installed. 2026-02-20T12:07:39.364 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-20T12:07:39.364 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:07:39.364 DEBUG:teuthology.orchestra.run.trial063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T12:07:39.426 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-20T12:07:39.426 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:07:39.427 DEBUG:teuthology.orchestra.run.trial063:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T12:07:39.490 DEBUG:teuthology.orchestra.run.trial063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T12:07:39.555 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-20T12:07:39.555 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:07:39.555 DEBUG:teuthology.orchestra.run.trial063:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T12:07:39.619 DEBUG:teuthology.orchestra.run.trial063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T12:07:39.684 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-20T12:07:39.685 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:07:39.685 DEBUG:teuthology.orchestra.run.trial063:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T12:07:39.748 DEBUG:teuthology.orchestra.run.trial063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T12:07:39.812 INFO:teuthology.run_tasks:Running task pexec... 2026-02-20T12:07:39.828 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-20T12:07:39.828 DEBUG:teuthology.orchestra.run.trial063:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-20T12:07:39.854 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial063.front.sepia.ceph.com 2026-02-20T12:07:39.854 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-20T12:07:39.904 DEBUG:teuthology.parallel:result is None 2026-02-20T12:07:39.905 INFO:teuthology.run_tasks:Running task install... 2026-02-20T12:07:39.918 DEBUG:teuthology.task.install:project ceph 2026-02-20T12:07:39.918 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'}} 2026-02-20T12:07:39.918 DEBUG:teuthology.task.install:config {'flavor': 'debug', 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'} 2026-02-20T12:07:39.918 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T12:07:39.926 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T12:07:39.927 INFO:teuthology.task.install:extra packages: [] 2026-02-20T12:07:39.927 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca', 'tag': None, 'wait_for_package': False} 2026-02-20T12:07:39.927 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=26bc97655ae0056b78c14ab91d1307332bd6dfca 2026-02-20T12:07:40.090 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/ 2026-02-20T12:07:40.090 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5312.g26bc9765 2026-02-20T12:07:40.442 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T12:07:40.442 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:07:40.443 DEBUG:teuthology.orchestra.run.trial063:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T12:07:40.467 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-20T12:07:40.467 DEBUG:teuthology.orchestra.run.trial063:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/26bc97655ae0056b78c14ab91d1307332bd6dfca/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T12:07:40.533 DEBUG:teuthology.orchestra.run.trial063:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T12:07:40.598 DEBUG:teuthology.orchestra.run.trial063:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T12:07:40.655 INFO:teuthology.orchestra.run.trial063.stdout:check_obsoletes = 1 2026-02-20T12:07:40.665 DEBUG:teuthology.orchestra.run.trial063:> sudo yum clean all 2026-02-20T12:07:40.824 INFO:teuthology.orchestra.run.trial063.stdout:56 files removed 2026-02-20T12:07:40.838 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-radosgw 2026-02-20T12:07:41.547 INFO:teuthology.orchestra.run.trial063.stdout:ceph packages for x86_64 168 kB/s | 94 kB 00:00 2026-02-20T12:07:41.992 INFO:teuthology.orchestra.run.trial063.stdout:ceph noarch packages 58 kB/s | 24 kB 00:00 2026-02-20T12:07:42.377 INFO:teuthology.orchestra.run.trial063.stdout:ceph source packages 5.7 kB/s | 2.1 kB 00:00 2026-02-20T12:07:43.142 INFO:teuthology.orchestra.run.trial063.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-20T12:07:47.041 INFO:teuthology.orchestra.run.trial063.stdout:CentOS Stream 9 - AppStream 7.9 MB/s | 27 MB 00:03 2026-02-20T12:07:51.215 INFO:teuthology.orchestra.run.trial063.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 7.8 MB 00:01 2026-02-20T12:07:52.734 INFO:teuthology.orchestra.run.trial063.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 20 kB 00:00 2026-02-20T12:07:53.140 INFO:teuthology.orchestra.run.trial063.stdout:Extra Packages for Enterprise Linux 59 MB/s | 20 MB 00:00 2026-02-20T12:07:56.531 INFO:teuthology.orchestra.run.trial063.stdout:lab-extras 481 kB/s | 50 kB 00:00 2026-02-20T12:07:57.698 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-radosgw-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:07:57.717 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:07:57.718 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:07:57.718 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:07:57.741 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-test 2026-02-20T12:07:58.053 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:07:58.117 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-test-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:07:58.136 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:07:58.136 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:07:58.137 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:07:58.158 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph 2026-02-20T12:07:58.470 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:07:58.535 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:07:58.554 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:07:58.554 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:07:58.555 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:07:58.576 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-base 2026-02-20T12:07:58.887 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:07:58.952 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:07:58.971 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:07:58.972 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:07:58.972 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:07:58.993 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install cephadm 2026-02-20T12:07:59.307 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:07:59.372 INFO:teuthology.orchestra.run.trial063.stdout:Package cephadm-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T12:07:59.391 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:07:59.391 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:07:59.392 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:07:59.413 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T12:07:59.727 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:07:59.790 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-immutable-object-cache-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:07:59.809 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:07:59.809 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:07:59.809 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:07:59.830 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-mgr 2026-02-20T12:08:00.138 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:00.202 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:08:00.221 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:00.222 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:00.222 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:00.243 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T12:08:00.557 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:00.622 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T12:08:00.640 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:00.641 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:00.641 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:00.663 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T12:08:00.972 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:01.035 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T12:08:01.054 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:01.054 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:01.054 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:01.075 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-mgr-rook 2026-02-20T12:08:01.376 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:01.441 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T12:08:01.460 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:01.460 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:01.460 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:01.480 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T12:08:01.787 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:01.852 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T12:08:01.870 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:01.871 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:01.871 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:01.891 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-osd 2026-02-20T12:08:02.201 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:02.265 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:08:02.284 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:02.284 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:02.284 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:02.307 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-osd-classic 2026-02-20T12:08:02.616 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:02.681 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:08:02.700 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:02.701 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:02.701 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:02.721 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-fuse 2026-02-20T12:08:03.028 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:03.093 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:08:03.111 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:03.112 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:03.112 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:03.133 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install ceph-volume 2026-02-20T12:08:03.436 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:03.501 INFO:teuthology.orchestra.run.trial063.stdout:Package ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T12:08:03.520 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:03.520 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:03.521 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:03.540 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install librados-devel 2026-02-20T12:08:03.851 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:03.917 INFO:teuthology.orchestra.run.trial063.stdout:Package librados-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:08:03.935 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:03.936 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:03.936 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:03.956 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install libcephfs2 2026-02-20T12:08:04.263 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:04.327 INFO:teuthology.orchestra.run.trial063.stdout:Package libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:08:04.346 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:04.347 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:04.347 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:04.368 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install libcephfs-devel 2026-02-20T12:08:04.681 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:04.745 INFO:teuthology.orchestra.run.trial063.stdout:Package libcephfs-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:08:04.764 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:04.765 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:04.765 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:04.786 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install librados2 2026-02-20T12:08:05.096 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:05.161 INFO:teuthology.orchestra.run.trial063.stdout:Package librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:08:05.179 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:05.180 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:05.180 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:05.202 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install librbd1 2026-02-20T12:08:05.511 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:05.575 INFO:teuthology.orchestra.run.trial063.stdout:Package librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:08:05.594 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:05.594 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:05.595 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:05.616 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install python3-rados 2026-02-20T12:08:05.926 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:05.991 INFO:teuthology.orchestra.run.trial063.stdout:Package python3-rados-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:08:06.009 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:06.010 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:06.010 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:06.033 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install python3-rgw 2026-02-20T12:08:06.342 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:06.407 INFO:teuthology.orchestra.run.trial063.stdout:Package python3-rgw-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:08:06.425 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:06.426 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:06.426 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:06.447 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install python3-cephfs 2026-02-20T12:08:06.763 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:06.827 INFO:teuthology.orchestra.run.trial063.stdout:Package python3-cephfs-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:08:06.846 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:06.847 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:06.847 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:06.868 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install python3-rbd 2026-02-20T12:08:07.179 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:07.244 INFO:teuthology.orchestra.run.trial063.stdout:Package python3-rbd-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:08:07.262 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:07.263 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:07.263 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:07.285 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install rbd-fuse 2026-02-20T12:08:07.599 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:07.663 INFO:teuthology.orchestra.run.trial063.stdout:Package rbd-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:08:07.682 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:07.683 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:07.683 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:07.704 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install rbd-mirror 2026-02-20T12:08:08.013 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:08.078 INFO:teuthology.orchestra.run.trial063.stdout:Package rbd-mirror-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:08:08.097 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:08.097 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:08.098 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:08.118 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install rbd-nbd 2026-02-20T12:08:08.426 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:08.491 INFO:teuthology.orchestra.run.trial063.stdout:Package rbd-nbd-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T12:08:08.509 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:08.510 INFO:teuthology.orchestra.run.trial063.stdout:Nothing to do. 2026-02-20T12:08:08.510 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:08:08.534 DEBUG:teuthology.parallel:result is None 2026-02-20T12:08:08.535 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=26bc97655ae0056b78c14ab91d1307332bd6dfca 2026-02-20T12:08:08.708 DEBUG:teuthology.orchestra.run.trial063:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T12:08:08.730 INFO:teuthology.orchestra.run.trial063.stdout:20.3.0-5312.g26bc9765.el9 2026-02-20T12:08:08.730 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5312.g26bc9765.el9 2026-02-20T12:08:08.730 INFO:teuthology.task.install:The correct ceph version 20.3.0-5312.g26bc9765 is installed. 2026-02-20T12:08:08.733 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-20T12:08:08.733 INFO:teuthology.run_tasks:Running task ceph... 2026-02-20T12:08:08.837 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-20T12:08:08.837 DEBUG:teuthology.orchestra.run.trial063:> sudo chmod 777 /var/log/ceph 2026-02-20T12:08:08.861 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-20T12:08:08.861 DEBUG:teuthology.orchestra.run.trial063:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-20T12:08:08.925 INFO:tasks.ceph:Creating extra log directories... 2026-02-20T12:08:08.926 DEBUG:teuthology.orchestra.run.trial063:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-20T12:08:09.002 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-20T12:08:09.002 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug alienstore': 20, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-20T12:08:09.003 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60620', 'branch': 'wip-perezjos-crimson-only-12-02-2026-PR66245', 'description': 'crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/crimson_bluestore perf_ignorelist settings/optimized workloads/fio_4K_rand_read}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '60620', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-perezjos-crimson-only-12-02-2026-PR66245'}, 'ceph': {'conf': {'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug alienstore': 20, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'}}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '445d5c9ba18a4040e70e25303230c36c77773acb'}}, 'owner': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'priority': 101, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 5547, 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '445d5c9ba18a4040e70e25303230c36c77773acb', 'targets': {'trial063.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIJYZjnqibUMeAHNxdxh2feQgult/r76XoZj2DgOZv1SKIrU5BJE4E79KXi+jFx5RgDMSOWc9Fqaxl4Gp9Cw8x0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug alienstore': 20, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}}, 'wait-for-scrub': False, 'crimson_compat': True, 'flavor': 'debug', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca', 'cluster': 'ceph'}}, {'ssh_keys': None}, {'cbt': {'benchmarks': {'librbdfio': {'iodepth': [32], 'log_avg_msec': 100, 'mode': ['randread'], 'norandommap': True, 'op_size': [4096], 'osd_ra': [4096], 'pool_profile': 'rbd', 'procs_per_volume': [1], 'time': 60, 'vol_size': 4096, 'volumes_per_client': [2]}}, 'cluster': {'iterations': 1, 'osds_per_node': 3, 'pool_profiles': {'rbd': {'pg_size': 128, 'pgp_size': 128, 'replication': 3}}, 'user': 'ubuntu'}, 'monitoring_profiles': {'perf': {'args': 'stat -p {pid} -o {perf_dir}/perf_stat.{pid}', 'nodes': ['osds'], 'perf_cmd': 'perf', 'pid_glob': 'crimson-osd.*.pid'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'reimage-ssh-down', 'teuthology_sha1': 'e6d9099ce03dc21193fda653159ec82465c3a94a', 'timestamp': '2026-02-20_10:29:19', 'tube': 'trial', 'user': 'jjperez', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699'} 2026-02-20T12:08:09.004 DEBUG:teuthology.orchestra.run.trial063:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-20T12:08:09.048 DEBUG:teuthology.orchestra.run.trial063:> sudo install -d -m0777 -- /var/run/ceph 2026-02-20T12:08:09.113 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:09.114 DEBUG:teuthology.orchestra.run.trial063:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T12:08:09.170 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T12:08:09.170 DEBUG:teuthology.orchestra.run.trial063:> stat /dev/vg_nvme/lv_1 2026-02-20T12:08:09.228 INFO:teuthology.orchestra.run.trial063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T12:08:09.228 INFO:teuthology.orchestra.run.trial063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T12:08:09.228 INFO:teuthology.orchestra.run.trial063.stdout:Device: 6h/6d Inode: 1287 Links: 1 2026-02-20T12:08:09.228 INFO:teuthology.orchestra.run.trial063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T12:08:09.228 INFO:teuthology.orchestra.run.trial063.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T12:08:09.228 INFO:teuthology.orchestra.run.trial063.stdout:Access: 2026-02-20 12:06:54.778287352 +0000 2026-02-20T12:08:09.228 INFO:teuthology.orchestra.run.trial063.stdout:Modify: 2026-02-20 12:05:59.606524519 +0000 2026-02-20T12:08:09.229 INFO:teuthology.orchestra.run.trial063.stdout:Change: 2026-02-20 12:05:59.606524519 +0000 2026-02-20T12:08:09.229 INFO:teuthology.orchestra.run.trial063.stdout: Birth: 2026-02-20 12:05:59.606524519 +0000 2026-02-20T12:08:09.229 DEBUG:teuthology.orchestra.run.trial063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T12:08:09.292 INFO:teuthology.orchestra.run.trial063.stderr:1+0 records in 2026-02-20T12:08:09.292 INFO:teuthology.orchestra.run.trial063.stderr:1+0 records out 2026-02-20T12:08:09.293 INFO:teuthology.orchestra.run.trial063.stderr:512 bytes copied, 0.000156994 s, 3.3 MB/s 2026-02-20T12:08:09.294 DEBUG:teuthology.orchestra.run.trial063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T12:08:09.351 DEBUG:teuthology.orchestra.run.trial063:> stat /dev/vg_nvme/lv_2 2026-02-20T12:08:09.409 INFO:teuthology.orchestra.run.trial063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T12:08:09.410 INFO:teuthology.orchestra.run.trial063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T12:08:09.410 INFO:teuthology.orchestra.run.trial063.stdout:Device: 6h/6d Inode: 1307 Links: 1 2026-02-20T12:08:09.410 INFO:teuthology.orchestra.run.trial063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T12:08:09.410 INFO:teuthology.orchestra.run.trial063.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T12:08:09.410 INFO:teuthology.orchestra.run.trial063.stdout:Access: 2026-02-20 12:06:54.778287352 +0000 2026-02-20T12:08:09.410 INFO:teuthology.orchestra.run.trial063.stdout:Modify: 2026-02-20 12:05:59.607524510 +0000 2026-02-20T12:08:09.410 INFO:teuthology.orchestra.run.trial063.stdout:Change: 2026-02-20 12:05:59.607524510 +0000 2026-02-20T12:08:09.410 INFO:teuthology.orchestra.run.trial063.stdout: Birth: 2026-02-20 12:05:59.607524510 +0000 2026-02-20T12:08:09.411 DEBUG:teuthology.orchestra.run.trial063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T12:08:09.474 INFO:teuthology.orchestra.run.trial063.stderr:1+0 records in 2026-02-20T12:08:09.474 INFO:teuthology.orchestra.run.trial063.stderr:1+0 records out 2026-02-20T12:08:09.474 INFO:teuthology.orchestra.run.trial063.stderr:512 bytes copied, 0.000135844 s, 3.8 MB/s 2026-02-20T12:08:09.476 DEBUG:teuthology.orchestra.run.trial063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T12:08:09.534 DEBUG:teuthology.orchestra.run.trial063:> stat /dev/vg_nvme/lv_3 2026-02-20T12:08:09.590 INFO:teuthology.orchestra.run.trial063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T12:08:09.591 INFO:teuthology.orchestra.run.trial063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T12:08:09.591 INFO:teuthology.orchestra.run.trial063.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-20T12:08:09.591 INFO:teuthology.orchestra.run.trial063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T12:08:09.591 INFO:teuthology.orchestra.run.trial063.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T12:08:09.591 INFO:teuthology.orchestra.run.trial063.stdout:Access: 2026-02-20 12:06:54.778287352 +0000 2026-02-20T12:08:09.591 INFO:teuthology.orchestra.run.trial063.stdout:Modify: 2026-02-20 12:05:59.606524519 +0000 2026-02-20T12:08:09.591 INFO:teuthology.orchestra.run.trial063.stdout:Change: 2026-02-20 12:05:59.606524519 +0000 2026-02-20T12:08:09.591 INFO:teuthology.orchestra.run.trial063.stdout: Birth: 2026-02-20 12:05:59.606524519 +0000 2026-02-20T12:08:09.592 DEBUG:teuthology.orchestra.run.trial063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T12:08:09.655 INFO:teuthology.orchestra.run.trial063.stderr:1+0 records in 2026-02-20T12:08:09.655 INFO:teuthology.orchestra.run.trial063.stderr:1+0 records out 2026-02-20T12:08:09.655 INFO:teuthology.orchestra.run.trial063.stderr:512 bytes copied, 0.0001546 s, 3.3 MB/s 2026-02-20T12:08:09.657 DEBUG:teuthology.orchestra.run.trial063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T12:08:09.715 DEBUG:teuthology.orchestra.run.trial063:> stat /dev/vg_nvme/lv_4 2026-02-20T12:08:09.771 INFO:teuthology.orchestra.run.trial063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T12:08:09.772 INFO:teuthology.orchestra.run.trial063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T12:08:09.772 INFO:teuthology.orchestra.run.trial063.stdout:Device: 6h/6d Inode: 1308 Links: 1 2026-02-20T12:08:09.772 INFO:teuthology.orchestra.run.trial063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T12:08:09.772 INFO:teuthology.orchestra.run.trial063.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T12:08:09.772 INFO:teuthology.orchestra.run.trial063.stdout:Access: 2026-02-20 12:06:54.779287375 +0000 2026-02-20T12:08:09.772 INFO:teuthology.orchestra.run.trial063.stdout:Modify: 2026-02-20 12:05:59.607524510 +0000 2026-02-20T12:08:09.772 INFO:teuthology.orchestra.run.trial063.stdout:Change: 2026-02-20 12:05:59.607524510 +0000 2026-02-20T12:08:09.772 INFO:teuthology.orchestra.run.trial063.stdout: Birth: 2026-02-20 12:05:59.607524510 +0000 2026-02-20T12:08:09.773 DEBUG:teuthology.orchestra.run.trial063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T12:08:09.835 INFO:teuthology.orchestra.run.trial063.stderr:1+0 records in 2026-02-20T12:08:09.835 INFO:teuthology.orchestra.run.trial063.stderr:1+0 records out 2026-02-20T12:08:09.835 INFO:teuthology.orchestra.run.trial063.stderr:512 bytes copied, 0.000132017 s, 3.9 MB/s 2026-02-20T12:08:09.836 DEBUG:teuthology.orchestra.run.trial063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T12:08:09.894 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-20T12:08:09.894 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-20T12:08:09.894 INFO:tasks.ceph:Generating config... 2026-02-20T12:08:09.896 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-20T12:08:09.897 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-20T12:08:09.897 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2026-02-20T12:08:09.897 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-20T12:08:09.897 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-20T12:08:09.897 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2026-02-20T12:08:09.897 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-20T12:08:09.897 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-20T12:08:09.897 INFO:tasks.ceph:[osd] debug alienstore = 20 2026-02-20T12:08:09.898 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-20T12:08:09.898 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-20T12:08:09.898 INFO:tasks.ceph:[osd] debug filestore = 0/0 2026-02-20T12:08:09.898 INFO:tasks.ceph:[osd] debug journal = 0/0 2026-02-20T12:08:09.898 INFO:tasks.ceph:[osd] debug ms = 0/0 2026-02-20T12:08:09.898 INFO:tasks.ceph:[osd] debug osd = 0/0 2026-02-20T12:08:09.898 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-20T12:08:09.898 INFO:tasks.ceph:[osd] err to stderr = True 2026-02-20T12:08:09.898 INFO:tasks.ceph:[osd] log flush on exit = True 2026-02-20T12:08:09.898 INFO:tasks.ceph:[osd] log to file = False 2026-02-20T12:08:09.898 INFO:tasks.ceph:[osd] log to stderr = True 2026-02-20T12:08:09.898 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-20T12:08:09.899 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-20T12:08:09.899 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-20T12:08:09.899 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-20T12:08:09.899 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-20T12:08:09.899 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-20T12:08:09.899 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-20T12:08:09.899 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-20T12:08:09.899 INFO:tasks.ceph:[global] auth client required = none 2026-02-20T12:08:09.899 INFO:tasks.ceph:[global] auth cluster required = none 2026-02-20T12:08:09.899 INFO:tasks.ceph:[global] auth service required = none 2026-02-20T12:08:09.900 INFO:tasks.ceph:[global] auth supported = none 2026-02-20T12:08:09.900 INFO:tasks.ceph:[global] debug asok = 0/0 2026-02-20T12:08:09.900 INFO:tasks.ceph:[global] debug auth = 0/0 2026-02-20T12:08:09.900 INFO:tasks.ceph:[global] debug bdev = 0/0 2026-02-20T12:08:09.900 INFO:tasks.ceph:[global] debug bluefs = 0/0 2026-02-20T12:08:09.900 INFO:tasks.ceph:[global] debug bluestore = 0/0 2026-02-20T12:08:09.900 INFO:tasks.ceph:[global] debug buffer = 0/0 2026-02-20T12:08:09.900 INFO:tasks.ceph:[global] debug civetweb = 0/0 2026-02-20T12:08:09.900 INFO:tasks.ceph:[global] debug client = 0/0 2026-02-20T12:08:09.900 INFO:tasks.ceph:[global] debug compressor = 0/0 2026-02-20T12:08:09.900 INFO:tasks.ceph:[global] debug context = 0/0 2026-02-20T12:08:09.901 INFO:tasks.ceph:[global] debug crush = 0/0 2026-02-20T12:08:09.901 INFO:tasks.ceph:[global] debug crypto = 0/0 2026-02-20T12:08:09.901 INFO:tasks.ceph:[global] debug dpdk = 0/0 2026-02-20T12:08:09.901 INFO:tasks.ceph:[global] debug eventtrace = 0/0 2026-02-20T12:08:09.901 INFO:tasks.ceph:[global] debug filer = 0/0 2026-02-20T12:08:09.901 INFO:tasks.ceph:[global] debug filestore = 0/0 2026-02-20T12:08:09.901 INFO:tasks.ceph:[global] debug finisher = 0/0 2026-02-20T12:08:09.901 INFO:tasks.ceph:[global] debug fuse = 0/0 2026-02-20T12:08:09.901 INFO:tasks.ceph:[global] debug heartbeatmap = 0/0 2026-02-20T12:08:09.901 INFO:tasks.ceph:[global] debug javaclient = 0/0 2026-02-20T12:08:09.901 INFO:tasks.ceph:[global] debug journal = 0/0 2026-02-20T12:08:09.901 INFO:tasks.ceph:[global] debug journaler = 0/0 2026-02-20T12:08:09.902 INFO:tasks.ceph:[global] debug kstore = 0/0 2026-02-20T12:08:09.902 INFO:tasks.ceph:[global] debug leveldb = 0/0 2026-02-20T12:08:09.902 INFO:tasks.ceph:[global] debug lockdep = 0/0 2026-02-20T12:08:09.902 INFO:tasks.ceph:[global] debug mds = 0/0 2026-02-20T12:08:09.902 INFO:tasks.ceph:[global] debug mds balancer = 0/0 2026-02-20T12:08:09.902 INFO:tasks.ceph:[global] debug mds locker = 0/0 2026-02-20T12:08:09.902 INFO:tasks.ceph:[global] debug mds log = 0/0 2026-02-20T12:08:09.902 INFO:tasks.ceph:[global] debug mds log expire = 0/0 2026-02-20T12:08:09.902 INFO:tasks.ceph:[global] debug mds migrator = 0/0 2026-02-20T12:08:09.902 INFO:tasks.ceph:[global] debug memdb = 0/0 2026-02-20T12:08:09.902 INFO:tasks.ceph:[global] debug mgr = 0/0 2026-02-20T12:08:09.902 INFO:tasks.ceph:[global] debug mgrc = 0/0 2026-02-20T12:08:09.903 INFO:tasks.ceph:[global] debug mon = 0/0 2026-02-20T12:08:09.903 INFO:tasks.ceph:[global] debug monc = 0/0 2026-02-20T12:08:09.903 INFO:tasks.ceph:[global] debug ms = 0/0 2026-02-20T12:08:09.903 INFO:tasks.ceph:[global] debug objclass = 0/0 2026-02-20T12:08:09.903 INFO:tasks.ceph:[global] debug objectcacher = 0/0 2026-02-20T12:08:09.903 INFO:tasks.ceph:[global] debug objecter = 0/0 2026-02-20T12:08:09.903 INFO:tasks.ceph:[global] debug optracker = 0/0 2026-02-20T12:08:09.903 INFO:tasks.ceph:[global] debug osd = 0/0 2026-02-20T12:08:09.903 INFO:tasks.ceph:[global] debug paxos = 0/0 2026-02-20T12:08:09.903 INFO:tasks.ceph:[global] debug perfcounter = 0/0 2026-02-20T12:08:09.903 INFO:tasks.ceph:[global] debug rados = 0/0 2026-02-20T12:08:09.903 INFO:tasks.ceph:[global] debug rbd = 0/0 2026-02-20T12:08:09.904 INFO:tasks.ceph:[global] debug rbd mirror = 0/0 2026-02-20T12:08:09.904 INFO:tasks.ceph:[global] debug rbd replay = 0/0 2026-02-20T12:08:09.904 INFO:tasks.ceph:[global] debug refs = 0/0 2026-02-20T12:08:09.904 INFO:tasks.ceph:[global] debug rgw = 0/0 2026-02-20T12:08:09.904 INFO:tasks.ceph:[global] debug rgw lifecycle = 0/0 2026-02-20T12:08:09.904 INFO:tasks.ceph:[global] debug rgw notification = 0/0 2026-02-20T12:08:09.904 INFO:tasks.ceph:[global] debug rgw sync = 0/0 2026-02-20T12:08:09.904 INFO:tasks.ceph:[global] debug rocksdb = 0/0 2026-02-20T12:08:09.904 INFO:tasks.ceph:[global] debug striper = 0/0 2026-02-20T12:08:09.904 INFO:tasks.ceph:[global] debug throttle = 0/0 2026-02-20T12:08:09.904 INFO:tasks.ceph:[global] debug timer = 0/0 2026-02-20T12:08:09.904 INFO:tasks.ceph:[global] debug tp = 0/0 2026-02-20T12:08:09.904 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-20T12:08:09.905 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-20T12:08:09.905 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-20T12:08:09.905 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-20T12:08:09.905 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-20T12:08:09.905 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-20T12:08:09.905 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-20T12:08:09.905 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-20T12:08:09.905 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-20T12:08:09.905 INFO:tasks.ceph:[mon] debug mon = 0/0 2026-02-20T12:08:09.905 INFO:tasks.ceph:[mon] debug ms = 0/0 2026-02-20T12:08:09.905 INFO:tasks.ceph:[mon] debug paxos = 0/0 2026-02-20T12:08:09.906 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-20T12:08:09.906 INFO:tasks.ceph:Setting up mon.a... 2026-02-20T12:08:09.906 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-20T12:08:09.977 INFO:teuthology.orchestra.run.trial063.stdout:creating /etc/ceph/ceph.keyring 2026-02-20T12:08:09.980 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-20T12:08:10.066 DEBUG:teuthology.orchestra.run.trial063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T12:08:10.090 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.63')] 2026-02-20T12:08:10.091 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'none', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.63', 'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug alienstore': 20, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': '0/0', 'debug mon': '0/0', 'debug paxos': '0/0', 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-20T12:08:10.094 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:10.094 DEBUG:teuthology.orchestra.run.trial063:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T12:08:10.147 DEBUG:teuthology.orchestra.run.trial063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.63 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-20T12:08:10.228 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:10.225+0000 7f2a07268f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:10.228 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:10.226+0000 7f2a07268f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:10.228 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:10.226+0000 7f2a07268f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:10.230 INFO:teuthology.orchestra.run.trial063.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-20T12:08:10.230 INFO:teuthology.orchestra.run.trial063.stdout:monmaptool: generated fsid 3c4dd169-be64-479a-88be-0d39b58c9853 2026-02-20T12:08:10.230 INFO:teuthology.orchestra.run.trial063.stdout:setting min_mon_release = tentacle 2026-02-20T12:08:10.230 INFO:teuthology.orchestra.run.trial063.stdout:epoch 0 2026-02-20T12:08:10.230 INFO:teuthology.orchestra.run.trial063.stdout:fsid 3c4dd169-be64-479a-88be-0d39b58c9853 2026-02-20T12:08:10.230 INFO:teuthology.orchestra.run.trial063.stdout:last_changed 2026-02-20T12:08:10.227172+0000 2026-02-20T12:08:10.230 INFO:teuthology.orchestra.run.trial063.stdout:created 2026-02-20T12:08:10.227172+0000 2026-02-20T12:08:10.231 INFO:teuthology.orchestra.run.trial063.stdout:min_mon_release 20 (tentacle) 2026-02-20T12:08:10.231 INFO:teuthology.orchestra.run.trial063.stdout:election_strategy: 1 2026-02-20T12:08:10.231 INFO:teuthology.orchestra.run.trial063.stdout:0: [v2:10.20.193.63:3300/0,v1:10.20.193.63:6789/0] mon.a 2026-02-20T12:08:10.231 INFO:teuthology.orchestra.run.trial063.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-20T12:08:10.232 DEBUG:teuthology.orchestra.run.trial063:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T12:08:10.288 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3c4dd169-be64-479a-88be-0d39b58c9853... 2026-02-20T12:08:10.290 DEBUG:teuthology.orchestra.run.trial063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout:[global] 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: chdir = "" 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: auth supported = none 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: filestore xattr use omap = true 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: mon clock drift allowed = 1.000 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: osd crush chooseleaf type = 0 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: auth debug = true 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: ms die on old message = true 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: ms die on bug = true 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: mon pg warn max object skew = 0 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: # disable pg_autoscaler by default for new pools 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: osd pool default size = 2 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: mon osd allow primary affinity = true 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: mon osd allow pg remap = true 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: mon warn on legacy crush tunables = false 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: mon warn on crush straw calc version zero = false 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: mon warn on no sortbitwise = false 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: mon warn on osd down out interval zero = false 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: mon warn on too few osds = false 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-20T12:08:10.369 INFO:teuthology.orchestra.run.trial063.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: mon_allow_pool_size_one = true 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: osd default data pool replay window = 5 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: mon allow pool delete = true 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: mon cluster log file level = debug 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug asserts on shutdown = true 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: mon health detail to clog = false 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: mon host = 10.20.193.63 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: auth client required = none 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: auth cluster required = none 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: auth service required = none 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug asok = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug auth = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug bdev = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug bluefs = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug bluestore = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug buffer = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug civetweb = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug client = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug compressor = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug context = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug crush = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug crypto = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug dpdk = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug eventtrace = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug filer = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug filestore = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug finisher = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug fuse = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug heartbeatmap = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug javaclient = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug journal = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug journaler = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug kstore = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug leveldb = 0/0 2026-02-20T12:08:10.370 INFO:teuthology.orchestra.run.trial063.stdout: debug lockdep = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug mds = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug mds balancer = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug mds locker = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug mds log = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug mds log expire = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug mds migrator = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug memdb = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug mgr = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug mgrc = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug mon = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug monc = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug ms = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug objclass = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug objectcacher = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug objecter = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug optracker = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug osd = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug paxos = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug perfcounter = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug rados = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug rbd = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug rbd mirror = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug rbd replay = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug refs = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug rgw = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug rgw lifecycle = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug rgw notification = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug rgw sync = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug rocksdb = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug striper = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug throttle = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug timer = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: debug tp = 0/0 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: ms client mode = crc 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: ms cluster mode = crc 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: ms mon client mode = crc 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: ms mon cluster mode = crc 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: ms mon service mode = crc 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: ms service mode = crc 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: fsid = 3c4dd169-be64-479a-88be-0d39b58c9853 2026-02-20T12:08:10.371 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout:[osd] 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: osd journal size = 100 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: osd scrub load threshold = 5.0 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: osd scrub max interval = 600 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: osd mclock profile = high_recovery_ops 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: osd mclock skip benchmark = true 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: osd recover clone overlap = true 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: osd recovery max chunk = 1048576 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: osd debug shutdown = true 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: osd debug op order = true 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: osd debug verify stray on activate = true 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: osd debug trim objects = true 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: osd open classes on start = true 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: osd debug pg log writeout = true 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: osd deep scrub update digest min age = 30 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: osd map max advance = 10 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: journal zero on create = true 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: filestore ondisk finisher threads = 3 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: filestore apply finisher threads = 3 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: bdev debug aio = true 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: osd debug misdirected ops = true 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: debug monc = 20 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: bluestore block size = 96636764160 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: bluestore compression algorithm = snappy 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: bluestore compression mode = aggressive 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: bluestore fsck on mount = True 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: bluestore rocksdb cf = False 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: crimson cpu num = 4 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: crimson osd obc lru size = 10 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: debug alienstore = 20 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: debug bluefs = 20 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: debug bluestore = 20 2026-02-20T12:08:10.372 INFO:teuthology.orchestra.run.trial063.stdout: debug filestore = 0/0 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: debug journal = 0/0 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: debug ms = 0/0 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: debug osd = 0/0 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: debug rocksdb = 10 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: err to stderr = True 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: log flush on exit = True 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: log to file = False 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: log to stderr = True 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: mon osd backfillfull_ratio = 0.85 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: mon osd full ratio = 0.9 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: mon osd nearfull ratio = 0.8 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: osd failsafe full ratio = 0.95 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: osd objectstore = bluestore 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: osd shutdown pgref assert = True 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: seastore cachepin size pershard = 64M 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: seastore max concurrent transactions = 8 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout:[mgr] 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: debug ms = 1 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: debug mgr = 20 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: debug mon = 20 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: debug auth = 20 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: mon reweight min pgs per osd = 4 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: mon reweight min bytes per osd = 10 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: mgr/telemetry/nag = false 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout:[mon] 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: debug ms = 0/0 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: debug mon = 0/0 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: debug paxos = 0/0 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: debug auth = 20 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: mon data avail warn = 5 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: mon mgr mkfs grace = 240 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: mon reweight min pgs per osd = 4 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: mon osd reporter subtree level = osd 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: mon osd prime pg temp = true 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: mon reweight min bytes per osd = 10 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: auth mon ticket ttl = 660 # 11m 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: auth service ticket ttl = 240 # 4m 2026-02-20T12:08:10.373 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.374 INFO:teuthology.orchestra.run.trial063.stdout: # don't complain about insecure global_id in the test suite 2026-02-20T12:08:10.374 INFO:teuthology.orchestra.run.trial063.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-20T12:08:10.374 INFO:teuthology.orchestra.run.trial063.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-20T12:08:10.374 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.374 INFO:teuthology.orchestra.run.trial063.stdout: # 1m isn't quite enough 2026-02-20T12:08:10.374 INFO:teuthology.orchestra.run.trial063.stdout: mon_down_mkfs_grace = 2m 2026-02-20T12:08:10.374 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.374 INFO:teuthology.orchestra.run.trial063.stdout: mon_warn_on_filestore_osds = false 2026-02-20T12:08:10.374 INFO:teuthology.orchestra.run.trial063.stdout: osd pool default crimson = True 2026-02-20T12:08:10.374 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:10.374 INFO:teuthology.orchestra.run.trial063.stdout:[client] 2026-02-20T12:08:10.374 INFO:teuthology.orchestra.run.trial063.stdout: rgw cache enabled = true 2026-02-20T12:08:10.374 INFO:teuthology.orchestra.run.trial063.stdout: rgw enable ops log = true 2026-02-20T12:08:10.374 INFO:teuthology.orchestra.run.trial063.stdout: rgw enable usage log = true 2026-02-20T12:08:10.374 INFO:teuthology.orchestra.run.trial063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-20T12:08:10.374 INFO:teuthology.orchestra.run.trial063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-20T12:08:10.374 INFO:teuthology.orchestra.run.trial063.stdout:[mon.a] 2026-02-20T12:08:10.378 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-20T12:08:10.378 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-20T12:08:10.468 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-20T12:08:10.468 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:10.469 DEBUG:teuthology.orchestra.run.trial063:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-20T12:08:10.486 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:10.486 DEBUG:teuthology.orchestra.run.trial063:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-20T12:08:10.542 INFO:tasks.ceph:Sending monmap to node ubuntu@trial063.front.sepia.ceph.com 2026-02-20T12:08:10.543 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:10.543 DEBUG:teuthology.orchestra.run.trial063:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-20T12:08:10.543 DEBUG:teuthology.orchestra.run.trial063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T12:08:10.616 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:10.617 DEBUG:teuthology.orchestra.run.trial063:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-20T12:08:10.674 INFO:tasks.ceph:Setting up mon nodes... 2026-02-20T12:08:10.674 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-20T12:08:10.675 DEBUG:teuthology.orchestra.run.trial063:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T12:08:10.765 INFO:teuthology.orchestra.run.trial063.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T12:08:10.768 INFO:tasks.ceph:Setting up mds nodes... 2026-02-20T12:08:10.768 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-20T12:08:10.768 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-20T12:08:10.809 INFO:teuthology.orchestra.run.trial063.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-20T12:08:10.821 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-20T12:08:10.821 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-20T12:08:10.821 DEBUG:teuthology.orchestra.run.trial063:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-20T12:08:10.888 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-20T12:08:10.888 INFO:tasks.ceph:role: osd.0 2026-02-20T12:08:10.889 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial063.front.sepia.ceph.com 2026-02-20T12:08:10.889 DEBUG:teuthology.orchestra.run.trial063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-20T12:08:10.953 INFO:teuthology.orchestra.run.trial063.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T12:08:10.953 INFO:teuthology.orchestra.run.trial063.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T12:08:10.953 INFO:teuthology.orchestra.run.trial063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T12:08:10.953 INFO:teuthology.orchestra.run.trial063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T12:08:10.954 INFO:teuthology.orchestra.run.trial063.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T12:08:10.954 INFO:teuthology.orchestra.run.trial063.stdout: = sunit=0 swidth=0 blks 2026-02-20T12:08:10.954 INFO:teuthology.orchestra.run.trial063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T12:08:10.954 INFO:teuthology.orchestra.run.trial063.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T12:08:10.954 INFO:teuthology.orchestra.run.trial063.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T12:08:10.954 INFO:teuthology.orchestra.run.trial063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T12:08:11.523 INFO:teuthology.orchestra.run.trial063.stdout:Discarding blocks...Done. 2026-02-20T12:08:11.525 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial063.front.sepia.ceph.com -o noatime 2026-02-20T12:08:11.525 DEBUG:teuthology.orchestra.run.trial063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-20T12:08:11.594 DEBUG:teuthology.orchestra.run.trial063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-20T12:08:11.661 DEBUG:teuthology.orchestra.run.trial063:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-20T12:08:11.725 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-20T12:08:11.725 INFO:tasks.ceph:role: osd.1 2026-02-20T12:08:11.725 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial063.front.sepia.ceph.com 2026-02-20T12:08:11.725 DEBUG:teuthology.orchestra.run.trial063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-20T12:08:11.790 INFO:teuthology.orchestra.run.trial063.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T12:08:11.790 INFO:teuthology.orchestra.run.trial063.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T12:08:11.790 INFO:teuthology.orchestra.run.trial063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T12:08:11.790 INFO:teuthology.orchestra.run.trial063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T12:08:11.790 INFO:teuthology.orchestra.run.trial063.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T12:08:11.790 INFO:teuthology.orchestra.run.trial063.stdout: = sunit=0 swidth=0 blks 2026-02-20T12:08:11.790 INFO:teuthology.orchestra.run.trial063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T12:08:11.790 INFO:teuthology.orchestra.run.trial063.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T12:08:11.790 INFO:teuthology.orchestra.run.trial063.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T12:08:11.790 INFO:teuthology.orchestra.run.trial063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T12:08:12.350 INFO:teuthology.orchestra.run.trial063.stdout:Discarding blocks...Done. 2026-02-20T12:08:12.352 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial063.front.sepia.ceph.com -o noatime 2026-02-20T12:08:12.352 DEBUG:teuthology.orchestra.run.trial063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-20T12:08:12.421 DEBUG:teuthology.orchestra.run.trial063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-20T12:08:12.489 DEBUG:teuthology.orchestra.run.trial063:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-20T12:08:12.556 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-20T12:08:12.556 INFO:tasks.ceph:role: osd.2 2026-02-20T12:08:12.556 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial063.front.sepia.ceph.com 2026-02-20T12:08:12.556 DEBUG:teuthology.orchestra.run.trial063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-20T12:08:12.623 INFO:teuthology.orchestra.run.trial063.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T12:08:12.623 INFO:teuthology.orchestra.run.trial063.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T12:08:12.623 INFO:teuthology.orchestra.run.trial063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T12:08:12.623 INFO:teuthology.orchestra.run.trial063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T12:08:12.623 INFO:teuthology.orchestra.run.trial063.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T12:08:12.623 INFO:teuthology.orchestra.run.trial063.stdout: = sunit=0 swidth=0 blks 2026-02-20T12:08:12.624 INFO:teuthology.orchestra.run.trial063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T12:08:12.624 INFO:teuthology.orchestra.run.trial063.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T12:08:12.624 INFO:teuthology.orchestra.run.trial063.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T12:08:12.624 INFO:teuthology.orchestra.run.trial063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T12:08:13.236 INFO:teuthology.orchestra.run.trial063.stdout:Discarding blocks...Done. 2026-02-20T12:08:13.238 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial063.front.sepia.ceph.com -o noatime 2026-02-20T12:08:13.238 DEBUG:teuthology.orchestra.run.trial063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-20T12:08:13.305 DEBUG:teuthology.orchestra.run.trial063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-20T12:08:13.372 DEBUG:teuthology.orchestra.run.trial063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T12:08:13.520 INFO:teuthology.orchestra.run.trial063.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T12:08:13.576 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:13,575 seastar - Reactor backend: linux-aio 2026-02-20T12:08:13.585 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:13,584 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:08:13.585 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:13,584 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:08:13.587 INFO:teuthology.orchestra.run.trial063.stderr:==39443==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T12:08:13.647 INFO:teuthology.orchestra.run.trial063.stderr:DEBUG 2026-02-20 12:08:13,645 [shard 0:main] seastar - reactor::drain 2026-02-20T12:08:15.686 INFO:teuthology.orchestra.run.trial063.stderr:----------------------------------------------------- 2026-02-20T12:08:15.686 INFO:teuthology.orchestra.run.trial063.stderr:Suppressions used: 2026-02-20T12:08:15.686 INFO:teuthology.orchestra.run.trial063.stderr: count bytes template 2026-02-20T12:08:15.687 INFO:teuthology.orchestra.run.trial063.stderr: 1 8 MallocExtension::Register 2026-02-20T12:08:15.687 INFO:teuthology.orchestra.run.trial063.stderr:----------------------------------------------------- 2026-02-20T12:08:15.687 INFO:teuthology.orchestra.run.trial063.stderr: 2026-02-20T12:08:15.706 INFO:teuthology.orchestra.run.trial063.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T12:08:15.706 INFO:teuthology.orchestra.run.trial063.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T12:08:15.748 INFO:teuthology.orchestra.run.trial063.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T12:08:15.749 INFO:teuthology.orchestra.run.trial063.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T12:08:15.755 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:15,754 seastar - Reactor backend: linux-aio 2026-02-20T12:08:15.766 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:15,765 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:08:15.767 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:15,765 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:08:15.771 INFO:teuthology.orchestra.run.trial063.stderr:==39441==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T12:08:15.771 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:15,770 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T12:08:18.972 INFO:teuthology.orchestra.run.trial063.stderr:----------------------------------------------------- 2026-02-20T12:08:18.972 INFO:teuthology.orchestra.run.trial063.stderr:Suppressions used: 2026-02-20T12:08:18.972 INFO:teuthology.orchestra.run.trial063.stderr: count bytes template 2026-02-20T12:08:18.973 INFO:teuthology.orchestra.run.trial063.stderr: 1 8 MallocExtension::Register 2026-02-20T12:08:18.973 INFO:teuthology.orchestra.run.trial063.stderr:----------------------------------------------------- 2026-02-20T12:08:18.973 INFO:teuthology.orchestra.run.trial063.stderr: 2026-02-20T12:08:19.006 DEBUG:teuthology.orchestra.run.trial063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-20T12:08:19.031 DEBUG:teuthology.orchestra.run.trial063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T12:08:19.184 INFO:teuthology.orchestra.run.trial063.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T12:08:19.235 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:19,233 seastar - Reactor backend: linux-aio 2026-02-20T12:08:19.253 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:19,251 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:08:19.253 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:19,251 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:08:19.255 INFO:teuthology.orchestra.run.trial063.stderr:==39646==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T12:08:19.288 INFO:teuthology.orchestra.run.trial063.stderr:Reactor stalled for 32 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x354e3ae 0x354e6b9 0x354e93a 0x354eafc 0x354ec1b 0x35477bc 0x3547b68 0x3547dae 0x3547e83 0x354aee0 0x3559517 0x3559859 0x3559a8b 0x3559d0e 0x355a08d 0x355a39d 0x355a45b 0x355a5da 0x355ae61 0x355b29e 0x355b5c4 0x355b6e6 0x355b8bc 0x355d755 0x355da0c 0x355ea9d 0x355eb5b 0x355ebfd 0x355ed26 0x355f04b 0x355f24d 0x355f5cf 0x359356a 0x3593e14 0x3594374 0x35946ec 0x3594b8a 0x3594fc9 0x355ff1e 0x3560f55 0x356120c 0x35616ab 0x35617c7 0x3561a7b 0x3561e0d 0x3562140 0x356249d 0x35626d5 0x3562d10 0x3563040 0x35633a6 0x3563853 0x3563c92 0x360e1aa 0x34ac321 0x34ac5d8 0x34ac729 0x359a892 0x359ac1d 0x359af50 0x359b443 0x359b825 0x359b9b1 0x359bde9 0x359c155 0x359c4ba 0x359c7dd 0x359c8bf 0x359cb4d 0x359cd24 0x359cf8b 0x359d241 0x359d991 0x359de7d 0x359e1f7 0x359e476 0x359e52b 0x3546648 0x3546fab 0x35475e5 0x3546648 0x3546a57 0x3546d0e 0x354806f 0x3585e47 0x33f83b5 0x4630936 0x4684821 0x4685ce7 0x4685d6c 0x4685e6e 2026-02-20T12:08:19.315 INFO:teuthology.orchestra.run.trial063.stderr:DEBUG 2026-02-20 12:08:19,314 [shard 0:main] seastar - reactor::drain 2026-02-20T12:08:21.356 INFO:teuthology.orchestra.run.trial063.stderr:----------------------------------------------------- 2026-02-20T12:08:21.356 INFO:teuthology.orchestra.run.trial063.stderr:Suppressions used: 2026-02-20T12:08:21.356 INFO:teuthology.orchestra.run.trial063.stderr: count bytes template 2026-02-20T12:08:21.356 INFO:teuthology.orchestra.run.trial063.stderr: 1 8 MallocExtension::Register 2026-02-20T12:08:21.356 INFO:teuthology.orchestra.run.trial063.stderr:----------------------------------------------------- 2026-02-20T12:08:21.357 INFO:teuthology.orchestra.run.trial063.stderr: 2026-02-20T12:08:21.377 INFO:teuthology.orchestra.run.trial063.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T12:08:21.378 INFO:teuthology.orchestra.run.trial063.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T12:08:21.418 INFO:teuthology.orchestra.run.trial063.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T12:08:21.418 INFO:teuthology.orchestra.run.trial063.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T12:08:21.425 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:21,424 seastar - Reactor backend: linux-aio 2026-02-20T12:08:21.434 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:21,432 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:08:21.434 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:21,432 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:08:21.439 INFO:teuthology.orchestra.run.trial063.stderr:==39644==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T12:08:21.439 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:21,438 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T12:08:24.672 INFO:teuthology.orchestra.run.trial063.stderr:----------------------------------------------------- 2026-02-20T12:08:24.672 INFO:teuthology.orchestra.run.trial063.stderr:Suppressions used: 2026-02-20T12:08:24.672 INFO:teuthology.orchestra.run.trial063.stderr: count bytes template 2026-02-20T12:08:24.672 INFO:teuthology.orchestra.run.trial063.stderr: 1 8 MallocExtension::Register 2026-02-20T12:08:24.672 INFO:teuthology.orchestra.run.trial063.stderr:----------------------------------------------------- 2026-02-20T12:08:24.672 INFO:teuthology.orchestra.run.trial063.stderr: 2026-02-20T12:08:24.704 DEBUG:teuthology.orchestra.run.trial063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-20T12:08:24.730 DEBUG:teuthology.orchestra.run.trial063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T12:08:24.883 INFO:teuthology.orchestra.run.trial063.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T12:08:24.936 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:24,935 seastar - Reactor backend: linux-aio 2026-02-20T12:08:24.946 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:24,944 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:08:24.946 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:24,944 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:08:24.948 INFO:teuthology.orchestra.run.trial063.stderr:==39849==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T12:08:25.008 INFO:teuthology.orchestra.run.trial063.stderr:DEBUG 2026-02-20 12:08:25,007 [shard 0:main] seastar - reactor::drain 2026-02-20T12:08:27.079 INFO:teuthology.orchestra.run.trial063.stderr:----------------------------------------------------- 2026-02-20T12:08:27.080 INFO:teuthology.orchestra.run.trial063.stderr:Suppressions used: 2026-02-20T12:08:27.080 INFO:teuthology.orchestra.run.trial063.stderr: count bytes template 2026-02-20T12:08:27.080 INFO:teuthology.orchestra.run.trial063.stderr: 1 8 MallocExtension::Register 2026-02-20T12:08:27.080 INFO:teuthology.orchestra.run.trial063.stderr:----------------------------------------------------- 2026-02-20T12:08:27.080 INFO:teuthology.orchestra.run.trial063.stderr: 2026-02-20T12:08:27.101 INFO:teuthology.orchestra.run.trial063.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T12:08:27.101 INFO:teuthology.orchestra.run.trial063.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T12:08:27.143 INFO:teuthology.orchestra.run.trial063.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T12:08:27.144 INFO:teuthology.orchestra.run.trial063.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T12:08:27.150 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:27,149 seastar - Reactor backend: linux-aio 2026-02-20T12:08:27.162 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:27,161 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:08:27.162 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:27,161 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:08:27.167 INFO:teuthology.orchestra.run.trial063.stderr:==39847==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T12:08:27.167 INFO:teuthology.orchestra.run.trial063.stderr:INFO 2026-02-20 12:08:27,166 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T12:08:30.512 INFO:teuthology.orchestra.run.trial063.stderr:----------------------------------------------------- 2026-02-20T12:08:30.513 INFO:teuthology.orchestra.run.trial063.stderr:Suppressions used: 2026-02-20T12:08:30.513 INFO:teuthology.orchestra.run.trial063.stderr: count bytes template 2026-02-20T12:08:30.513 INFO:teuthology.orchestra.run.trial063.stderr: 1 8 MallocExtension::Register 2026-02-20T12:08:30.513 INFO:teuthology.orchestra.run.trial063.stderr:----------------------------------------------------- 2026-02-20T12:08:30.513 INFO:teuthology.orchestra.run.trial063.stderr: 2026-02-20T12:08:30.545 DEBUG:teuthology.orchestra.run.trial063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-20T12:08:30.571 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-20T12:08:30.571 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:30.572 DEBUG:teuthology.orchestra.run.trial063:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-20T12:08:30.635 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:30.635 DEBUG:teuthology.orchestra.run.trial063:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-20T12:08:30.701 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:30.701 DEBUG:teuthology.orchestra.run.trial063:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-20T12:08:30.766 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:30.766 DEBUG:teuthology.orchestra.run.trial063:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-20T12:08:30.830 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:30.830 DEBUG:teuthology.orchestra.run.trial063:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-20T12:08:30.888 INFO:tasks.ceph:Adding keys to all mons... 2026-02-20T12:08:30.888 DEBUG:teuthology.orchestra.run.trial063:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-20T12:08:30.950 INFO:teuthology.orchestra.run.trial063.stdout:[mgr.x] 2026-02-20T12:08:30.950 INFO:teuthology.orchestra.run.trial063.stdout: key = AQCqTphpjGiOLRAAoq4yqkUmUtww1LA8/86tTQ== 2026-02-20T12:08:30.951 INFO:teuthology.orchestra.run.trial063.stdout:[osd.0] 2026-02-20T12:08:30.951 INFO:teuthology.orchestra.run.trial063.stdout: key = AQCvTphp3y/4MRAAalOX8uvVJPPJh3ShyAS9Cg== 2026-02-20T12:08:30.951 INFO:teuthology.orchestra.run.trial063.stdout:[osd.1] 2026-02-20T12:08:30.951 INFO:teuthology.orchestra.run.trial063.stdout: key = AQC1TphpSwIfHhAAQKTm9YmO0glBNpw1+tidjg== 2026-02-20T12:08:30.951 INFO:teuthology.orchestra.run.trial063.stdout:[osd.2] 2026-02-20T12:08:30.951 INFO:teuthology.orchestra.run.trial063.stdout: key = AQC7TphpGnDMDRAAMuHnz/TPzNKbjaqvyw1qfw== 2026-02-20T12:08:30.951 INFO:teuthology.orchestra.run.trial063.stdout:[client.0] 2026-02-20T12:08:30.951 INFO:teuthology.orchestra.run.trial063.stdout: key = AQCqTphp1mAvMBAAioMCFLSU6oY0DHYo3t8G/g== 2026-02-20T12:08:30.952 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-20T12:08:31.041 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T12:08:31.090 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T12:08:31.138 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T12:08:31.186 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-20T12:08:31.236 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-20T12:08:31.237 DEBUG:teuthology.orchestra.run.trial063:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-20T12:08:31.260 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-20T12:08:31.347 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:31.345+0000 7f2cd9a35c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:31.347 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:31.345+0000 7f2cd9a35c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:31.354 DEBUG:teuthology.orchestra.run.trial063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-20T12:08:31.379 DEBUG:teuthology.orchestra.run.trial063:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-20T12:08:31.435 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-20T12:08:31.435 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-20T12:08:31.436 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-20T12:08:31.477 INFO:tasks.ceph.mon.a:Started 2026-02-20T12:08:31.478 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-20T12:08:31.478 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-20T12:08:31.478 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-20T12:08:31.481 INFO:tasks.ceph.mgr.x:Started 2026-02-20T12:08:31.481 DEBUG:tasks.ceph:set 0 configs 2026-02-20T12:08:31.481 DEBUG:teuthology.orchestra.run.trial063:> sudo ceph --cluster ceph config dump 2026-02-20T12:08:31.542 INFO:tasks.ceph.mon.a.trial063.stderr:2026-02-20T12:08:31.540+0000 7f8b9e53dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:31.542 INFO:tasks.ceph.mon.a.trial063.stderr:2026-02-20T12:08:31.540+0000 7f8b9e53dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:31.543 INFO:tasks.ceph.mon.a.trial063.stderr:2026-02-20T12:08:31.540+0000 7f8b9e53dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:31.544 INFO:tasks.ceph.mgr.x.trial063.stderr:2026-02-20T12:08:31.542+0000 7fc04a7f3fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:31.557 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:31.553+0000 7f835b6b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:31.558 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:31.556+0000 7f835b6b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:31.591 INFO:teuthology.orchestra.run.trial063.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-20T12:08:31.600 INFO:tasks.ceph:Setting crush tunables to default 2026-02-20T12:08:31.600 DEBUG:teuthology.orchestra.run.trial063:> sudo ceph --cluster ceph osd crush tunables default 2026-02-20T12:08:31.673 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:31.668+0000 7f15c5f9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:31.674 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:31.673+0000 7f15c5f9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:31.708 INFO:teuthology.orchestra.run.trial063.stderr:adjusted tunables profile to default 2026-02-20T12:08:31.716 INFO:tasks.ceph:check_enable_crimson: True 2026-02-20T12:08:31.716 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-20T12:08:31.717 DEBUG:teuthology.orchestra.run.trial063:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-20T12:08:31.747 INFO:tasks.ceph.mgr.x.trial063.stderr:2026-02-20T12:08:31.745+0000 7fc04a7f3fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:31.748 INFO:tasks.ceph.mgr.x.trial063.stderr:2026-02-20T12:08:31.746+0000 7fc04a7f3fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:31.790 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:31.785+0000 7fc4f0806640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:31.791 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:31.789+0000 7fc4f0806640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:31.828 INFO:tasks.ceph.mon.a.trial063.stderr:2026-02-20T12:08:31.826+0000 7f8b967f1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-20T12:08:31.828 INFO:tasks.ceph.mon.a.trial063.stderr:Please be aware that this feature is experimental, untested, 2026-02-20T12:08:31.828 INFO:tasks.ceph.mon.a.trial063.stderr:unsupported, and may result in data corruption, data loss, 2026-02-20T12:08:31.829 INFO:tasks.ceph.mon.a.trial063.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-20T12:08:31.829 INFO:tasks.ceph.mon.a.trial063.stderr:feature with important data. 2026-02-20T12:08:31.829 INFO:tasks.ceph.mon.a.trial063.stderr: 2026-02-20T12:08:32.586 INFO:tasks.ceph.mgr.x.trial063.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T12:08:32.586 INFO:tasks.ceph.mgr.x.trial063.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T12:08:32.586 INFO:tasks.ceph.mgr.x.trial063.stderr: from numpy import show_config as show_numpy_config 2026-02-20T12:08:32.718 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-20T12:08:32.719 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:32.719 DEBUG:teuthology.orchestra.run.trial063:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-20T12:08:32.783 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:32.783 DEBUG:teuthology.orchestra.run.trial063:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-20T12:08:32.851 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:32.852 DEBUG:teuthology.orchestra.run.trial063:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-20T12:08:32.912 DEBUG:teuthology.orchestra.run.trial063:> sudo ceph --cluster ceph osd new c46d8053-55b5-4faf-982a-5aa5a16a56cb 0 2026-02-20T12:08:33.025 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:33.020+0000 7ff9a921a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:33.026 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:33.025+0000 7ff9a921a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:33.063 INFO:teuthology.orchestra.run.trial063.stdout:0 2026-02-20T12:08:33.072 DEBUG:teuthology.orchestra.run.trial063:> sudo ceph --cluster ceph osd new 1fe83bf7-6fad-4770-88f7-d31784d0be8d 1 2026-02-20T12:08:33.146 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:33.141+0000 7fb4be10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:33.148 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:33.146+0000 7fb4be10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:33.188 INFO:teuthology.orchestra.run.trial063.stdout:1 2026-02-20T12:08:33.197 DEBUG:teuthology.orchestra.run.trial063:> sudo ceph --cluster ceph osd new 4a6c1124-a9ba-47c2-a269-bb6126b0ef49 2 2026-02-20T12:08:33.273 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:33.268+0000 7fd6be90b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:33.274 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:33.272+0000 7fd6be90b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:33.311 INFO:teuthology.orchestra.run.trial063.stdout:2 2026-02-20T12:08:33.320 DEBUG:teuthology.orchestra.run.trial063:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-20T12:08:33.348 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-20T12:08:33.349 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-20T12:08:33.390 INFO:tasks.ceph.osd.0:Started 2026-02-20T12:08:33.390 DEBUG:teuthology.orchestra.run.trial063:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-20T12:08:33.419 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-20T12:08:33.419 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-20T12:08:33.461 INFO:tasks.ceph.osd.1:Started 2026-02-20T12:08:33.461 DEBUG:teuthology.orchestra.run.trial063:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-20T12:08:33.491 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-20T12:08:33.492 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-20T12:08:33.534 INFO:tasks.ceph.osd.2:Started 2026-02-20T12:08:33.536 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T12:08:33.614 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:33.610+0000 7fbce5ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:33.615 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:33.613+0000 7fbce5ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:33.647 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:33.647 INFO:teuthology.orchestra.run.trial063.stdout:{"epoch":6,"fsid":"3c4dd169-be64-479a-88be-0d39b58c9853","created":"2026-02-20T12:08:31.551428+0000","modified":"2026-02-20T12:08:33.309803+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T12:08:33.309803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"c46d8053-55b5-4faf-982a-5aa5a16a56cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1fe83bf7-6fad-4770-88f7-d31784d0be8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4a6c1124-a9ba-47c2-a269-bb6126b0ef49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T12:08:33.655 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-20T12:08:33.655 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-20T12:08:33.957 DEBUG:teuthology.orchestra.run.trial063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T12:08:34.028 INFO:teuthology.misc.health.trial063.stderr:2026-02-20T12:08:34.024+0000 7f17095b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:34.029 INFO:teuthology.misc.health.trial063.stderr:2026-02-20T12:08:34.027+0000 7f17095b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:34.061 INFO:teuthology.misc.health.trial063.stdout: 2026-02-20T12:08:34.061 INFO:teuthology.misc.health.trial063.stdout:{"epoch":6,"fsid":"3c4dd169-be64-479a-88be-0d39b58c9853","created":"2026-02-20T12:08:31.551428+0000","modified":"2026-02-20T12:08:33.309803+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T12:08:33.309803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"c46d8053-55b5-4faf-982a-5aa5a16a56cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1fe83bf7-6fad-4770-88f7-d31784d0be8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4a6c1124-a9ba-47c2-a269-bb6126b0ef49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T12:08:34.069 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-20T12:08:34.973 INFO:tasks.ceph.mgr.x.trial063.stderr:2026-02-20T12:08:34.971+0000 7fbf657ab640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-20T12:08:40.371 DEBUG:teuthology.orchestra.run.trial063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T12:08:40.440 INFO:teuthology.misc.health.trial063.stderr:2026-02-20T12:08:40.435+0000 7f2ae8c51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:40.441 INFO:teuthology.misc.health.trial063.stderr:2026-02-20T12:08:40.439+0000 7f2ae8c51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:40.553 INFO:teuthology.misc.health.trial063.stdout: 2026-02-20T12:08:40.553 INFO:teuthology.misc.health.trial063.stdout:{"epoch":7,"fsid":"3c4dd169-be64-479a-88be-0d39b58c9853","created":"2026-02-20T12:08:31.551428+0000","modified":"2026-02-20T12:08:40.361523+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T12:08:33.309803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"c46d8053-55b5-4faf-982a-5aa5a16a56cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1fe83bf7-6fad-4770-88f7-d31784d0be8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4a6c1124-a9ba-47c2-a269-bb6126b0ef49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T12:08:40.563 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-20T12:08:46.866 DEBUG:teuthology.orchestra.run.trial063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T12:08:46.937 INFO:teuthology.misc.health.trial063.stderr:2026-02-20T12:08:46.933+0000 7f489970b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:46.938 INFO:teuthology.misc.health.trial063.stderr:2026-02-20T12:08:46.936+0000 7f489970b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:47.048 INFO:teuthology.misc.health.trial063.stdout: 2026-02-20T12:08:47.048 INFO:teuthology.misc.health.trial063.stdout:{"epoch":13,"fsid":"3c4dd169-be64-479a-88be-0d39b58c9853","created":"2026-02-20T12:08:31.551428+0000","modified":"2026-02-20T12:08:46.387253+0000","last_up_change":"2026-02-20T12:08:43.374432+0000","last_in_change":"2026-02-20T12:08:33.309803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T12:08:43.984921+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c46d8053-55b5-4faf-982a-5aa5a16a56cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6803","nonce":4065914647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6804","nonce":4065914647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6811","nonce":4065914647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6810","nonce":4065914647}]},"public_addr":"10.20.193.63:6803/4065914647","cluster_addr":"10.20.193.63:6804/4065914647","heartbeat_back_addr":"10.20.193.63:6811/4065914647","heartbeat_front_addr":"10.20.193.63:6810/4065914647","state":["exists","up"]},{"osd":1,"uuid":"1fe83bf7-6fad-4770-88f7-d31784d0be8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6809","nonce":815096211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6808","nonce":815096211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6813","nonce":815096211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6812","nonce":815096211}]},"public_addr":"10.20.193.63:6809/815096211","cluster_addr":"10.20.193.63:6808/815096211","heartbeat_back_addr":"10.20.193.63:6813/815096211","heartbeat_front_addr":"10.20.193.63:6812/815096211","state":["exists","up"]},{"osd":2,"uuid":"4a6c1124-a9ba-47c2-a269-bb6126b0ef49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6802","nonce":3885900828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6805","nonce":3885900828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6815","nonce":3885900828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6816","nonce":3885900828}]},"public_addr":"10.20.193.63:6802/3885900828","cluster_addr":"10.20.193.63:6805/3885900828","heartbeat_back_addr":"10.20.193.63:6815/3885900828","heartbeat_front_addr":"10.20.193.63:6816/3885900828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T12:08:47.057 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-20T12:08:47.057 INFO:tasks.ceph:Creating RBD pool 2026-02-20T12:08:47.057 DEBUG:teuthology.orchestra.run.trial063:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-20T12:08:47.133 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:47.127+0000 7f7d9ac1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:47.134 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:47.132+0000 7f7d9ac1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:47.545 INFO:teuthology.orchestra.run.trial063.stderr:pool 'rbd' created 2026-02-20T12:08:47.561 DEBUG:teuthology.orchestra.run.trial063:> rbd --cluster ceph pool init rbd 2026-02-20T12:08:47.602 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:47.599+0000 7f38b68f1240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:47.602 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:47.599+0000 7f38b68f1240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:47.603 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:47.601+0000 7f38b68f1240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:50.570 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-20T12:08:50.571 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-20T12:08:50.571 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-20T12:08:50.687 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:50.682+0000 7fac80fa4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:50.688 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:50.686+0000 7fac80fa4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:50.798 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:50.807 INFO:teuthology.orchestra.run.trial063.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-20T12:08:50.807 INFO:tasks.ceph_manager:config epoch is 1 2026-02-20T12:08:50.808 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-20T12:08:50.808 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-20T12:08:50.808 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-20T12:08:50.884 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:50.880+0000 7fc364acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:50.885 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:50.883+0000 7fc364acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:51.028 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:51.037 INFO:teuthology.orchestra.run.trial063.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6800","nonce":386193208},{"type":"v1","addr":"10.20.193.63:6801","nonce":386193208}]},"active_addr":"10.20.193.63:6801/386193208","active_change":"2026-02-20T12:08:33.966491+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.63:0","nonce":1852088437}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.63:0","nonce":3475664231}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.63:0","nonce":2063263454}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.63:0","nonce":3806214638}]}]} 2026-02-20T12:08:51.041 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-20T12:08:51.042 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T12:08:51.042 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T12:08:51.120 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:51.116+0000 7f62c2a46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:51.122 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:51.120+0000 7f62c2a46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:51.232 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:51.232 INFO:teuthology.orchestra.run.trial063.stdout:{"epoch":17,"fsid":"3c4dd169-be64-479a-88be-0d39b58c9853","created":"2026-02-20T12:08:31.551428+0000","modified":"2026-02-20T12:08:50.553618+0000","last_up_change":"2026-02-20T12:08:43.374432+0000","last_in_change":"2026-02-20T12:08:33.309803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T12:08:43.984921+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T12:08:47.245740+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c46d8053-55b5-4faf-982a-5aa5a16a56cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6803","nonce":4065914647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6804","nonce":4065914647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6811","nonce":4065914647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6810","nonce":4065914647}]},"public_addr":"10.20.193.63:6803/4065914647","cluster_addr":"10.20.193.63:6804/4065914647","heartbeat_back_addr":"10.20.193.63:6811/4065914647","heartbeat_front_addr":"10.20.193.63:6810/4065914647","state":["exists","up"]},{"osd":1,"uuid":"1fe83bf7-6fad-4770-88f7-d31784d0be8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6809","nonce":815096211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6808","nonce":815096211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6813","nonce":815096211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6812","nonce":815096211}]},"public_addr":"10.20.193.63:6809/815096211","cluster_addr":"10.20.193.63:6808/815096211","heartbeat_back_addr":"10.20.193.63:6813/815096211","heartbeat_front_addr":"10.20.193.63:6812/815096211","state":["exists","up"]},{"osd":2,"uuid":"4a6c1124-a9ba-47c2-a269-bb6126b0ef49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6802","nonce":3885900828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6805","nonce":3885900828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6815","nonce":3885900828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6816","nonce":3885900828}]},"public_addr":"10.20.193.63:6802/3885900828","cluster_addr":"10.20.193.63:6805/3885900828","heartbeat_back_addr":"10.20.193.63:6815/3885900828","heartbeat_front_addr":"10.20.193.63:6816/3885900828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T12:08:51.242 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-20T12:08:51.242 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T12:08:51.319 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:51.315+0000 7f9dcf70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:51.320 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:51.318+0000 7f9dcf70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:51.430 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:51.430 INFO:teuthology.orchestra.run.trial063.stdout:{"epoch":17,"fsid":"3c4dd169-be64-479a-88be-0d39b58c9853","created":"2026-02-20T12:08:31.551428+0000","modified":"2026-02-20T12:08:50.553618+0000","last_up_change":"2026-02-20T12:08:43.374432+0000","last_in_change":"2026-02-20T12:08:33.309803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T12:08:43.984921+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T12:08:47.245740+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c46d8053-55b5-4faf-982a-5aa5a16a56cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6803","nonce":4065914647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6804","nonce":4065914647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6811","nonce":4065914647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6810","nonce":4065914647}]},"public_addr":"10.20.193.63:6803/4065914647","cluster_addr":"10.20.193.63:6804/4065914647","heartbeat_back_addr":"10.20.193.63:6811/4065914647","heartbeat_front_addr":"10.20.193.63:6810/4065914647","state":["exists","up"]},{"osd":1,"uuid":"1fe83bf7-6fad-4770-88f7-d31784d0be8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6809","nonce":815096211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6808","nonce":815096211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6813","nonce":815096211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6812","nonce":815096211}]},"public_addr":"10.20.193.63:6809/815096211","cluster_addr":"10.20.193.63:6808/815096211","heartbeat_back_addr":"10.20.193.63:6813/815096211","heartbeat_front_addr":"10.20.193.63:6812/815096211","state":["exists","up"]},{"osd":2,"uuid":"4a6c1124-a9ba-47c2-a269-bb6126b0ef49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6802","nonce":3885900828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6805","nonce":3885900828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6815","nonce":3885900828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.63:6816","nonce":3885900828}]},"public_addr":"10.20.193.63:6802/3885900828","cluster_addr":"10.20.193.63:6805/3885900828","heartbeat_back_addr":"10.20.193.63:6815/3885900828","heartbeat_front_addr":"10.20.193.63:6816/3885900828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T12:08:51.439 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-20T12:08:51.440 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-20T12:08:51.440 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-20T12:08:51.521 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:51.516+0000 7f57a19b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:51.521 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:51.516+0000 7f1227ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:51.522 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:51.517+0000 7fa9d44cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:51.522 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:51.520+0000 7f57a19b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:51.522 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:51.520+0000 7f1227ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:51.523 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:51.520+0000 7fa9d44cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:51.536 INFO:teuthology.orchestra.run.trial063.stdout:38654705673 2026-02-20T12:08:51.537 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T12:08:51.538 INFO:teuthology.orchestra.run.trial063.stdout:42949672968 2026-02-20T12:08:51.538 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T12:08:51.539 INFO:teuthology.orchestra.run.trial063.stdout:42949672968 2026-02-20T12:08:51.540 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T12:08:51.659 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:51.654+0000 7f6a0205a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:51.660 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:51.654+0000 7f9798c11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:51.660 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:51.655+0000 7f370eb8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:51.660 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:51.658+0000 7f6a0205a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:51.661 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:51.659+0000 7f9798c11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:51.661 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:51.659+0000 7f370d903640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:51.772 INFO:teuthology.orchestra.run.trial063.stdout:42949672964 2026-02-20T12:08:51.775 INFO:teuthology.orchestra.run.trial063.stdout:38654705673 2026-02-20T12:08:51.775 INFO:teuthology.orchestra.run.trial063.stdout:42949672964 2026-02-20T12:08:51.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672964 for osd.1 2026-02-20T12:08:51.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672964 for osd.2 2026-02-20T12:08:51.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705673 got 38654705673 for osd.0 2026-02-20T12:08:51.788 DEBUG:teuthology.parallel:result is None 2026-02-20T12:08:52.784 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T12:08:52.788 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T12:08:52.864 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:52.858+0000 7fcc615c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:52.865 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:52.863+0000 7fcc615c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:52.908 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:52.904+0000 7fa341451640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:52.909 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:52.907+0000 7fa33bfff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:52.978 INFO:teuthology.orchestra.run.trial063.stdout:42949672968 2026-02-20T12:08:52.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.1 2026-02-20T12:08:52.989 DEBUG:teuthology.parallel:result is None 2026-02-20T12:08:53.018 INFO:teuthology.orchestra.run.trial063.stdout:42949672968 2026-02-20T12:08:53.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.2 2026-02-20T12:08:53.028 DEBUG:teuthology.parallel:result is None 2026-02-20T12:08:53.029 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T12:08:53.029 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T12:08:53.146 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:53.142+0000 7f9f3b50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:53.147 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:53.145+0000 7f9f3b50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:53.254 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:53.255 INFO:teuthology.orchestra.run.trial063.stderr:dumped all 2026-02-20T12:08:53.264 INFO:teuthology.orchestra.run.trial063.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-20T12:08:51.970661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":80852,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":80256,"kb_avail":283034668,"statfs":{"total":289910292480,"available":289827500032,"internally_reserved":0,"allocated":561152,"data_stored":1293892,"data_compressed":61182,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82182144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.424960"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.558635+0000","last_change":"2026-02-20T12:08:50.564610+0000","last_active":"2026-02-20T12:08:50.558635+0000","last_peered":"2026-02-20T12:08:50.558635+0000","last_clean":"2026-02-20T12:08:50.558635+0000","last_became_active":"2026-02-20T12:08:48.563069+0000","last_became_peered":"2026-02-20T12:08:48.563069+0000","last_unstale":"2026-02-20T12:08:50.558635+0000","last_undegraded":"2026-02-20T12:08:50.558635+0000","last_fullsized":"2026-02-20T12:08:50.558635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_clean_scrub_stamp":"2026-02-20T12:08:47.543972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.559592+0000","last_change":"2026-02-20T12:08:50.561225+0000","last_active":"2026-02-20T12:08:50.559592+0000","last_peered":"2026-02-20T12:08:50.559592+0000","last_clean":"2026-02-20T12:08:50.559592+0000","last_became_active":"2026-02-20T12:08:48.578300+0000","last_became_peered":"2026-02-20T12:08:48.578300+0000","last_unstale":"2026-02-20T12:08:50.559592+0000","last_undegraded":"2026-02-20T12:08:50.559592+0000","last_fullsized":"2026-02-20T12:08:50.559592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_clean_scrub_stamp":"2026-02-20T12:08:47.543972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.563202+0000","last_change":"2026-02-20T12:08:50.563798+0000","last_active":"2026-02-20T12:08:50.563202+0000","last_peered":"2026-02-20T12:08:50.563202+0000","last_clean":"2026-02-20T12:08:50.563202+0000","last_became_active":"2026-02-20T12:08:48.573366+0000","last_became_peered":"2026-02-20T12:08:48.573366+0000","last_unstale":"2026-02-20T12:08:50.563202+0000","last_undegraded":"2026-02-20T12:08:50.563202+0000","last_fullsized":"2026-02-20T12:08:50.563202+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_clean_scrub_stamp":"2026-02-20T12:08:47.543972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.559717+0000","last_change":"2026-02-20T12:08:50.560945+0000","last_active":"2026-02-20T12:08:50.559717+0000","last_peered":"2026-02-20T12:08:50.559717+0000","last_clean":"2026-02-20T12:08:50.559717+0000","last_became_active":"2026-02-20T12:08:48.574174+0000","last_became_peered":"2026-02-20T12:08:48.574174+0000","last_unstale":"2026-02-20T12:08:50.559717+0000","last_undegraded":"2026-02-20T12:08:50.559717+0000","last_fullsized":"2026-02-20T12:08:50.559717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_clean_scrub_stamp":"2026-02-20T12:08:47.543972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.560667+0000","last_change":"2026-02-20T12:08:50.560667+0000","last_active":"2026-02-20T12:08:50.560667+0000","last_peered":"2026-02-20T12:08:50.560667+0000","last_clean":"2026-02-20T12:08:50.560667+0000","last_became_active":"2026-02-20T12:08:48.570997+0000","last_became_peered":"2026-02-20T12:08:48.570997+0000","last_unstale":"2026-02-20T12:08:50.560667+0000","last_undegraded":"2026-02-20T12:08:50.560667+0000","last_fullsized":"2026-02-20T12:08:50.560667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_clean_scrub_stamp":"2026-02-20T12:08:47.543972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.560640+0000","last_change":"2026-02-20T12:08:50.561408+0000","last_active":"2026-02-20T12:08:50.560640+0000","last_peered":"2026-02-20T12:08:50.560640+0000","last_clean":"2026-02-20T12:08:50.560640+0000","last_became_active":"2026-02-20T12:08:48.579580+0000","last_became_peered":"2026-02-20T12:08:48.579580+0000","last_unstale":"2026-02-20T12:08:50.560640+0000","last_undegraded":"2026-02-20T12:08:50.560640+0000","last_fullsized":"2026-02-20T12:08:50.560640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_clean_scrub_stamp":"2026-02-20T12:08:47.543972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.559074+0000","last_change":"2026-02-20T12:08:50.560695+0000","last_active":"2026-02-20T12:08:50.559074+0000","last_peered":"2026-02-20T12:08:50.559074+0000","last_clean":"2026-02-20T12:08:50.559074+0000","last_became_active":"2026-02-20T12:08:48.575426+0000","last_became_peered":"2026-02-20T12:08:48.575426+0000","last_unstale":"2026-02-20T12:08:50.559074+0000","last_undegraded":"2026-02-20T12:08:50.559074+0000","last_fullsized":"2026-02-20T12:08:50.559074+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_clean_scrub_stamp":"2026-02-20T12:08:47.543972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.562113+0000","last_change":"2026-02-20T12:08:50.562757+0000","last_active":"2026-02-20T12:08:50.562113+0000","last_peered":"2026-02-20T12:08:50.562113+0000","last_clean":"2026-02-20T12:08:50.562113+0000","last_became_active":"2026-02-20T12:08:48.570692+0000","last_became_peered":"2026-02-20T12:08:48.570692+0000","last_unstale":"2026-02-20T12:08:50.562113+0000","last_undegraded":"2026-02-20T12:08:50.562113+0000","last_fullsized":"2026-02-20T12:08:50.562113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_clean_scrub_stamp":"2026-02-20T12:08:47.543972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":90,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.558271+0000","last_change":"2026-02-20T12:08:45.395801+0000","last_active":"2026-02-20T12:08:50.558271+0000","last_peered":"2026-02-20T12:08:50.558271+0000","last_clean":"2026-02-20T12:08:50.558271+0000","last_became_active":"2026-02-20T12:08:45.394046+0000","last_became_peered":"2026-02-20T12:08:45.394046+0000","last_unstale":"2026-02-20T12:08:50.558271+0000","last_undegraded":"2026-02-20T12:08:50.558271+0000","last_fullsized":"2026-02-20T12:08:50.558271+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:44.379214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:44.379214+0000","last_clean_scrub_stamp":"2026-02-20T12:08:44.379214+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30591,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26972,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344868,"statfs":{"total":96636764160,"available":96609144832,"internally_reserved":0,"allocated":208896,"data_stored":628093,"data_compressed":30591,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26908,"kb_used_data":140,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344932,"statfs":{"total":96636764160,"available":96609210368,"internally_reserved":0,"allocated":143360,"data_stored":37706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26972,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344868,"statfs":{"total":96636764160,"available":96609144832,"internally_reserved":0,"allocated":208896,"data_stored":628093,"data_compressed":30591,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30591,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T12:08:53.265 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T12:08:53.341 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:53.337+0000 7f5db2e11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:53.342 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:53.340+0000 7f5db2e11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:53.453 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:53.453 INFO:teuthology.orchestra.run.trial063.stderr:dumped all 2026-02-20T12:08:53.463 INFO:teuthology.orchestra.run.trial063.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-20T12:08:51.970661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":80852,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":80256,"kb_avail":283034668,"statfs":{"total":289910292480,"available":289827500032,"internally_reserved":0,"allocated":561152,"data_stored":1293892,"data_compressed":61182,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82182144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.424960"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.558635+0000","last_change":"2026-02-20T12:08:50.564610+0000","last_active":"2026-02-20T12:08:50.558635+0000","last_peered":"2026-02-20T12:08:50.558635+0000","last_clean":"2026-02-20T12:08:50.558635+0000","last_became_active":"2026-02-20T12:08:48.563069+0000","last_became_peered":"2026-02-20T12:08:48.563069+0000","last_unstale":"2026-02-20T12:08:50.558635+0000","last_undegraded":"2026-02-20T12:08:50.558635+0000","last_fullsized":"2026-02-20T12:08:50.558635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_clean_scrub_stamp":"2026-02-20T12:08:47.543972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.559592+0000","last_change":"2026-02-20T12:08:50.561225+0000","last_active":"2026-02-20T12:08:50.559592+0000","last_peered":"2026-02-20T12:08:50.559592+0000","last_clean":"2026-02-20T12:08:50.559592+0000","last_became_active":"2026-02-20T12:08:48.578300+0000","last_became_peered":"2026-02-20T12:08:48.578300+0000","last_unstale":"2026-02-20T12:08:50.559592+0000","last_undegraded":"2026-02-20T12:08:50.559592+0000","last_fullsized":"2026-02-20T12:08:50.559592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_clean_scrub_stamp":"2026-02-20T12:08:47.543972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.563202+0000","last_change":"2026-02-20T12:08:50.563798+0000","last_active":"2026-02-20T12:08:50.563202+0000","last_peered":"2026-02-20T12:08:50.563202+0000","last_clean":"2026-02-20T12:08:50.563202+0000","last_became_active":"2026-02-20T12:08:48.573366+0000","last_became_peered":"2026-02-20T12:08:48.573366+0000","last_unstale":"2026-02-20T12:08:50.563202+0000","last_undegraded":"2026-02-20T12:08:50.563202+0000","last_fullsized":"2026-02-20T12:08:50.563202+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_clean_scrub_stamp":"2026-02-20T12:08:47.543972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.559717+0000","last_change":"2026-02-20T12:08:50.560945+0000","last_active":"2026-02-20T12:08:50.559717+0000","last_peered":"2026-02-20T12:08:50.559717+0000","last_clean":"2026-02-20T12:08:50.559717+0000","last_became_active":"2026-02-20T12:08:48.574174+0000","last_became_peered":"2026-02-20T12:08:48.574174+0000","last_unstale":"2026-02-20T12:08:50.559717+0000","last_undegraded":"2026-02-20T12:08:50.559717+0000","last_fullsized":"2026-02-20T12:08:50.559717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_clean_scrub_stamp":"2026-02-20T12:08:47.543972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.560667+0000","last_change":"2026-02-20T12:08:50.560667+0000","last_active":"2026-02-20T12:08:50.560667+0000","last_peered":"2026-02-20T12:08:50.560667+0000","last_clean":"2026-02-20T12:08:50.560667+0000","last_became_active":"2026-02-20T12:08:48.570997+0000","last_became_peered":"2026-02-20T12:08:48.570997+0000","last_unstale":"2026-02-20T12:08:50.560667+0000","last_undegraded":"2026-02-20T12:08:50.560667+0000","last_fullsized":"2026-02-20T12:08:50.560667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_clean_scrub_stamp":"2026-02-20T12:08:47.543972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.560640+0000","last_change":"2026-02-20T12:08:50.561408+0000","last_active":"2026-02-20T12:08:50.560640+0000","last_peered":"2026-02-20T12:08:50.560640+0000","last_clean":"2026-02-20T12:08:50.560640+0000","last_became_active":"2026-02-20T12:08:48.579580+0000","last_became_peered":"2026-02-20T12:08:48.579580+0000","last_unstale":"2026-02-20T12:08:50.560640+0000","last_undegraded":"2026-02-20T12:08:50.560640+0000","last_fullsized":"2026-02-20T12:08:50.560640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_clean_scrub_stamp":"2026-02-20T12:08:47.543972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.559074+0000","last_change":"2026-02-20T12:08:50.560695+0000","last_active":"2026-02-20T12:08:50.559074+0000","last_peered":"2026-02-20T12:08:50.559074+0000","last_clean":"2026-02-20T12:08:50.559074+0000","last_became_active":"2026-02-20T12:08:48.575426+0000","last_became_peered":"2026-02-20T12:08:48.575426+0000","last_unstale":"2026-02-20T12:08:50.559074+0000","last_undegraded":"2026-02-20T12:08:50.559074+0000","last_fullsized":"2026-02-20T12:08:50.559074+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_clean_scrub_stamp":"2026-02-20T12:08:47.543972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.562113+0000","last_change":"2026-02-20T12:08:50.562757+0000","last_active":"2026-02-20T12:08:50.562113+0000","last_peered":"2026-02-20T12:08:50.562113+0000","last_clean":"2026-02-20T12:08:50.562113+0000","last_became_active":"2026-02-20T12:08:48.570692+0000","last_became_peered":"2026-02-20T12:08:48.570692+0000","last_unstale":"2026-02-20T12:08:50.562113+0000","last_undegraded":"2026-02-20T12:08:50.562113+0000","last_fullsized":"2026-02-20T12:08:50.562113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:47.543972+0000","last_clean_scrub_stamp":"2026-02-20T12:08:47.543972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":90,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:08:50.558271+0000","last_change":"2026-02-20T12:08:45.395801+0000","last_active":"2026-02-20T12:08:50.558271+0000","last_peered":"2026-02-20T12:08:50.558271+0000","last_clean":"2026-02-20T12:08:50.558271+0000","last_became_active":"2026-02-20T12:08:45.394046+0000","last_became_peered":"2026-02-20T12:08:45.394046+0000","last_unstale":"2026-02-20T12:08:50.558271+0000","last_undegraded":"2026-02-20T12:08:50.558271+0000","last_fullsized":"2026-02-20T12:08:50.558271+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:08:44.379214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:08:44.379214+0000","last_clean_scrub_stamp":"2026-02-20T12:08:44.379214+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30591,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26972,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344868,"statfs":{"total":96636764160,"available":96609144832,"internally_reserved":0,"allocated":208896,"data_stored":628093,"data_compressed":30591,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26908,"kb_used_data":140,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344932,"statfs":{"total":96636764160,"available":96609210368,"internally_reserved":0,"allocated":143360,"data_stored":37706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26972,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344868,"statfs":{"total":96636764160,"available":96609144832,"internally_reserved":0,"allocated":208896,"data_stored":628093,"data_compressed":30591,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30591,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T12:08:53.463 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T12:08:53.463 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-20T12:08:53.463 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-20T12:08:53.464 DEBUG:teuthology.orchestra.run.trial063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-20T12:08:53.543 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:53.539+0000 7f1021562640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:53.544 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:08:53.542+0000 7f1021562640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:08:53.683 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:53.683 INFO:teuthology.orchestra.run.trial063.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-20T12:08:53.692 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-20T12:08:53.693 INFO:teuthology.run_tasks:Running task ssh_keys... 2026-02-20T12:08:53.815 DEBUG:teuthology.orchestra.run.trial063:> echo 'StrictHostKeyChecking no 2026-02-20T12:08:53.815 DEBUG:teuthology.orchestra.run.trial063:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2026-02-20T12:08:53.831 INFO:teuthology.task.ssh_keys:generated public key AAAAB3NzaC1yc2EAAAADAQABAAABAQC/5zvuBl7v2lW7ZWo3WPvKBZx9fXAbta/2eDNzc8dXOCB+xfi70n4alNbDjaZlDwxUx/JuB1FS5xGaY7saff07BdmhyGCLrNyYqJ8kldHFpmEA76SXE11MEIoOvJxJb9yiRRNcyV5e2Yx6JiqzSrbLsZH6G+49lSdOWMY5stwzITVldQ4flNvxBYsoJRTCvZTPpDmo70FEWfwZXWndcEYKNMkAi/sG2pVc5o4mTinE+cic5w4O6WnWMUHNprMdWAx1iRV9Pzp2c5MJ3Ad97p82Sp2ie2nn/k9VISW7hDz3nW91RsgCG4DJ0ZBtycuKpfqgQmejehNlPqOKYIc2BraZ 2026-02-20T12:08:53.831 INFO:teuthology.task.ssh_keys:pushing keys to trial063.front.sepia.ceph.com for ubuntu 2026-02-20T12:08:53.831 DEBUG:teuthology.orchestra.run.trial063:> rm -f -- /home/ubuntu/.ssh/id_rsa 2026-02-20T12:08:53.887 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:53.887 DEBUG:teuthology.orchestra.run.trial063:> dd of=/home/ubuntu/.ssh/id_rsa 2026-02-20T12:08:53.887 DEBUG:teuthology.orchestra.run.trial063:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2026-02-20T12:08:53.944 DEBUG:teuthology.orchestra.run.trial063:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2026-02-20T12:08:54.000 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:54.001 DEBUG:teuthology.orchestra.run.trial063:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2026-02-20T12:08:54.055 DEBUG:teuthology.orchestra.run.trial063:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2026-02-20_12:08:54:055792 2026-02-20T12:08:54.112 INFO:teuthology.orchestra.run.trial063.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2026-02-20_12:08:54:055792' 2026-02-20T12:08:54.113 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:54.113 DEBUG:teuthology.orchestra.run.trial063:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2026-02-20T12:08:54.169 INFO:teuthology.run_tasks:Running task cbt... 2026-02-20T12:08:54.197 INFO:tasks.cbt:cbt configuration is {'cluster': {'user': 'ubuntu', 'head': 'ubuntu@trial063.front.sepia.ceph.com', 'osds': ['ubuntu@trial063.front.sepia.ceph.com'], 'mons': ['ubuntu@trial063.front.sepia.ceph.com'], 'clients': ['ubuntu@trial063.front.sepia.ceph.com'], 'rgws': {'ubuntu@trial063.front.sepia.ceph.com': None}, 'osds_per_node': 3, 'rebuild_every_test': False, 'use_existing': True, 'is_teuthology': True, 'iterations': 1, 'tmp_dir': '/tmp/cbt', 'pool_profiles': {'rbd': {'pg_size': 128, 'pgp_size': 128, 'replication': 3}}, 'pid_dir': '/var/run/ceph'}, 'benchmarks': {'librbdfio': {'iodepth': [32], 'log_avg_msec': 100, 'mode': ['randread'], 'norandommap': True, 'op_size': [4096], 'osd_ra': [4096], 'pool_profile': 'rbd', 'procs_per_volume': [1], 'time': 60, 'vol_size': 4096, 'volumes_per_client': [2], 'cmd_path': '/home/ubuntu/cephtest/fio/fio'}}, 'client_endpoints': None, 'monitoring_profiles': {'perf': {'args': 'stat -p {pid} -o {perf_dir}/perf_stat.{pid}', 'nodes': ['osds'], 'perf_cmd': 'perf', 'pid_glob': 'crimson-osd.*.pid'}}} 2026-02-20T12:08:54.198 DEBUG:teuthology.orchestra.run.trial063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/cbt 2026-02-20T12:08:54.229 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:08:54.229 DEBUG:teuthology.orchestra.run.trial063:> dd of=/home/ubuntu/cephtest/archive/cbt/cbt_config.yaml 2026-02-20T12:08:54.281 DEBUG:teuthology.orchestra.run.trial063:> git clone --depth 1 -b master https://github.com/ceph/cbt.git /home/ubuntu/cephtest/cbt 2026-02-20T12:08:54.344 INFO:teuthology.orchestra.run.trial063.stderr:Cloning into '/home/ubuntu/cephtest/cbt'... 2026-02-20T12:08:55.367 INFO:tasks.cbt:Installing collectl 2026-02-20T12:08:55.367 DEBUG:teuthology.orchestra.run.trial063:> sudo mkdir collectl && cd collectl && sudo wget https://sourceforge.net/projects/collectl/files/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz/download -O collectl.tar.gz && sudo tar -xvf collectl.tar.gz && cd collectl-4.3.1 && sudo ./INSTALL 2026-02-20T12:08:55.442 INFO:teuthology.orchestra.run.trial063.stderr:--2026-02-20 12:08:55-- https://sourceforge.net/projects/collectl/files/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz/download 2026-02-20T12:08:55.576 INFO:teuthology.orchestra.run.trial063.stderr:Resolving sourceforge.net (sourceforge.net)... 104.18.13.149, 104.18.12.149, 2606:4700::6812:c95, ... 2026-02-20T12:08:55.657 INFO:teuthology.orchestra.run.trial063.stderr:Connecting to sourceforge.net (sourceforge.net)|104.18.13.149|:443... connected. 2026-02-20T12:08:56.013 INFO:teuthology.orchestra.run.trial063.stderr:HTTP request sent, awaiting response... 302 Found 2026-02-20T12:08:56.014 INFO:teuthology.orchestra.run.trial063.stderr:Location: https://downloads.sourceforge.net/project/collectl/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz?ts=gAAAAABpmE7XaBiYUjXmENxfWZBbztWdu3K5P3wegYocgm_uBTm2DlcUFeSMyfsYFatoMAQ86Q1yLGBprirlLjC7IqciLx2WkQ%3D%3D&use_mirror=psychz&r= [following] 2026-02-20T12:08:56.015 INFO:teuthology.orchestra.run.trial063.stderr:--2026-02-20 12:08:56-- https://downloads.sourceforge.net/project/collectl/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz?ts=gAAAAABpmE7XaBiYUjXmENxfWZBbztWdu3K5P3wegYocgm_uBTm2DlcUFeSMyfsYFatoMAQ86Q1yLGBprirlLjC7IqciLx2WkQ%3D%3D&use_mirror=psychz&r= 2026-02-20T12:08:56.171 INFO:teuthology.orchestra.run.trial063.stderr:Resolving downloads.sourceforge.net (downloads.sourceforge.net)... 104.18.12.149, 104.18.13.149, 2606:4700::6812:c95, ... 2026-02-20T12:08:56.262 INFO:teuthology.orchestra.run.trial063.stderr:Connecting to downloads.sourceforge.net (downloads.sourceforge.net)|104.18.12.149|:443... connected. 2026-02-20T12:08:56.609 INFO:teuthology.orchestra.run.trial063.stderr:HTTP request sent, awaiting response... 302 Found 2026-02-20T12:08:56.610 INFO:teuthology.orchestra.run.trial063.stderr:Location: https://psychz.dl.sourceforge.net/project/collectl/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz?viasf=1 [following] 2026-02-20T12:08:56.610 INFO:teuthology.orchestra.run.trial063.stderr:--2026-02-20 12:08:56-- https://psychz.dl.sourceforge.net/project/collectl/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz?viasf=1 2026-02-20T12:08:56.688 INFO:teuthology.orchestra.run.trial063.stderr:Resolving psychz.dl.sourceforge.net (psychz.dl.sourceforge.net)... 208.87.241.191 2026-02-20T12:08:56.753 INFO:teuthology.orchestra.run.trial063.stderr:Connecting to psychz.dl.sourceforge.net (psychz.dl.sourceforge.net)|208.87.241.191|:443... connected. 2026-02-20T12:08:57.062 INFO:teuthology.orchestra.run.trial063.stderr:HTTP request sent, awaiting response... 200 OK 2026-02-20T12:08:57.062 INFO:teuthology.orchestra.run.trial063.stderr:Length: 620693 (606K) [application/x-gzip] 2026-02-20T12:08:57.062 INFO:teuthology.orchestra.run.trial063.stderr:Saving to: ‘collectl.tar.gz’ 2026-02-20T12:08:57.062 INFO:teuthology.orchestra.run.trial063.stderr: 2026-02-20T12:08:57.126 INFO:teuthology.orchestra.run.trial063.stderr: 0K .......... .......... .......... .......... .......... 8% 773K 1s 2026-02-20T12:08:57.191 INFO:teuthology.orchestra.run.trial063.stderr: 50K .......... .......... .......... .......... .......... 16% 790K 1s 2026-02-20T12:08:57.191 INFO:teuthology.orchestra.run.trial063.stderr: 100K .......... .......... .......... .......... .......... 24% 57.3M 0s 2026-02-20T12:08:57.191 INFO:teuthology.orchestra.run.trial063.stderr: 150K .......... .......... .......... .......... .......... 32% 47.3M 0s 2026-02-20T12:08:57.256 INFO:teuthology.orchestra.run.trial063.stderr: 200K .......... .......... .......... .......... .......... 41% 801K 0s 2026-02-20T12:08:57.257 INFO:teuthology.orchestra.run.trial063.stderr: 250K .......... .......... .......... .......... .......... 49% 51.7M 0s 2026-02-20T12:08:57.257 INFO:teuthology.orchestra.run.trial063.stderr: 300K .......... .......... .......... .......... .......... 57% 175M 0s 2026-02-20T12:08:57.257 INFO:teuthology.orchestra.run.trial063.stderr: 350K .......... .......... .......... .......... .......... 65% 59.9M 0s 2026-02-20T12:08:57.318 INFO:teuthology.orchestra.run.trial063.stderr: 400K .......... .......... .......... .......... .......... 74% 808K 0s 2026-02-20T12:08:57.318 INFO:teuthology.orchestra.run.trial063.stderr: 450K .......... .......... .......... .......... .......... 82% 206M 0s 2026-02-20T12:08:57.318 INFO:teuthology.orchestra.run.trial063.stderr: 500K .......... .......... .......... .......... .......... 90% 323M 0s 2026-02-20T12:08:57.318 INFO:teuthology.orchestra.run.trial063.stderr: 550K .......... .......... .......... .......... .......... 98% 72.2M 0s 2026-02-20T12:08:57.318 INFO:teuthology.orchestra.run.trial063.stderr: 600K ...... 100% 11.4T=0.3s 2026-02-20T12:08:57.318 INFO:teuthology.orchestra.run.trial063.stderr: 2026-02-20T12:08:57.318 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20 12:08:57 (2.30 MB/s) - ‘collectl.tar.gz’ saved [620693/620693] 2026-02-20T12:08:57.318 INFO:teuthology.orchestra.run.trial063.stderr: 2026-02-20T12:08:57.335 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/ 2026-02-20T12:08:57.335 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/collectl.conf 2026-02-20T12:08:57.335 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/ 2026-02-20T12:08:57.335 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/SlowProc.html 2026-02-20T12:08:57.335 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/BuddyInfo.html 2026-02-20T12:08:57.335 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/WhySummary.html 2026-02-20T12:08:57.335 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Socket.html 2026-02-20T12:08:57.335 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/colmux.html 2026-02-20T12:08:57.335 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Tutorial.html 2026-02-20T12:08:57.335 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Gexpr.html 2026-02-20T12:08:57.335 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Import.html 2026-02-20T12:08:57.335 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/style.css 2026-02-20T12:08:57.335 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Ganglia3.jpg 2026-02-20T12:08:57.335 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Ganglia2.jpg 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/FileNaming.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/TheMath.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Environmental.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Process.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/OutputFiles.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/HiResTime.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/OutputFormats.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/slub.jpg 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Lustre.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Documentation.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Inodes.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Graphite.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/InputFiles.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Export.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Interrupts.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Startup.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Performance.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Messages.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Logging.html 2026-02-20T12:08:57.336 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Data-detail.html 2026-02-20T12:08:57.337 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/CPUs.html 2026-02-20T12:08:57.337 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Matrix.html 2026-02-20T12:08:57.337 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Data-brief.html 2026-02-20T12:08:57.337 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/SlabInfo.html 2026-02-20T12:08:57.337 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Misc.html 2026-02-20T12:08:57.337 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Examples.html 2026-02-20T12:08:57.337 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/OpenStack.html 2026-02-20T12:08:57.337 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Plotfiles.html 2026-02-20T12:08:57.337 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/ColmuxCPU.jpg 2026-02-20T12:08:57.337 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Tutorial-Lustre.html 2026-02-20T12:08:57.337 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Data-verbose.html 2026-02-20T12:08:57.337 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Data.html 2026-02-20T12:08:57.337 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Exceptions.html 2026-02-20T12:08:57.337 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/RunningAsAService.html 2026-02-20T12:08:57.337 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/FAQ-collectl.html 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Ganglia.jpg 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/OperationalModes.html 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Playback.html 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Hello.html 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Sockets.html 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Network.html 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Infiniband.html 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Memory.html 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/ColmuxLustre.jpg 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/Disks.html 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/docs/NfsInfo.html 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/service/ 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/service/collectl.service 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/initd/ 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/initd/collectl-suse 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/initd/collectl-debian 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/initd/collectl-generic 2026-02-20T12:08:57.338 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/initd/collectl 2026-02-20T12:08:57.339 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/misc.ph 2026-02-20T12:08:57.339 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/gexpr.ph 2026-02-20T12:08:57.339 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/statsd.ph 2026-02-20T12:08:57.339 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/envrules.std 2026-02-20T12:08:57.339 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/hello.ph 2026-02-20T12:08:57.339 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/vmsum.ph 2026-02-20T12:08:57.339 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/proctree.ph 2026-02-20T12:08:57.339 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/README-WINDOWS 2026-02-20T12:08:57.339 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/formatit.ph 2026-02-20T12:08:57.339 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/colmux 2026-02-20T12:08:57.340 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/INSTALL 2026-02-20T12:08:57.340 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/graphite.ph 2026-02-20T12:08:57.340 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/RELEASE-collectl 2026-02-20T12:08:57.340 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/vmstat.ph 2026-02-20T12:08:57.340 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/README 2026-02-20T12:08:57.340 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/man1/ 2026-02-20T12:08:57.340 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/man1/collectl.1 2026-02-20T12:08:57.340 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/man1/colmux.1 2026-02-20T12:08:57.340 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/lexpr.ph 2026-02-20T12:08:57.341 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/client.pl 2026-02-20T12:08:57.341 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/collectl 2026-02-20T12:08:57.341 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/COPYING 2026-02-20T12:08:57.342 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/vnet.ph 2026-02-20T12:08:57.342 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/GPL 2026-02-20T12:08:57.342 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/UNINSTALL 2026-02-20T12:08:57.342 INFO:teuthology.orchestra.run.trial063.stdout:collectl-4.3.1/ARTISTIC 2026-02-20T12:08:57.384 INFO:teuthology.orchestra.run.trial063.stderr:./INSTALL: line 90: chkconfig: command not found 2026-02-20T12:08:57.385 DEBUG:teuthology.orchestra.run.trial063:> sudo yum -y install librbd-devel pdsh pdsh-rcmd-ssh perf 2026-02-20T12:08:57.740 INFO:teuthology.orchestra.run.trial063.stdout:Last metadata expiration check: 0:01:01 ago on Fri 20 Feb 2026 12:07:56 PM UTC. 2026-02-20T12:08:57.828 INFO:teuthology.orchestra.run.trial063.stdout:Dependencies resolved. 2026-02-20T12:08:57.829 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:08:57.829 INFO:teuthology.orchestra.run.trial063.stdout: Package Arch Version Repository Size 2026-02-20T12:08:57.829 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:08:57.829 INFO:teuthology.orchestra.run.trial063.stdout:Installing: 2026-02-20T12:08:57.829 INFO:teuthology.orchestra.run.trial063.stdout: librbd-devel x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 24 k 2026-02-20T12:08:57.829 INFO:teuthology.orchestra.run.trial063.stdout: pdsh x86_64 2.34-7.el9 epel 118 k 2026-02-20T12:08:57.829 INFO:teuthology.orchestra.run.trial063.stdout: pdsh-rcmd-ssh x86_64 2.34-7.el9 epel 13 k 2026-02-20T12:08:57.829 INFO:teuthology.orchestra.run.trial063.stdout: perf x86_64 5.14.0-681.el9 appstream 3.2 M 2026-02-20T12:08:57.829 INFO:teuthology.orchestra.run.trial063.stdout:Installing dependencies: 2026-02-20T12:08:57.829 INFO:teuthology.orchestra.run.trial063.stdout: libradospp-devel x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 31 k 2026-02-20T12:08:57.830 INFO:teuthology.orchestra.run.trial063.stdout: libtraceevent x86_64 1.8.4-2.el9 baseos 290 k 2026-02-20T12:08:57.830 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:57.830 INFO:teuthology.orchestra.run.trial063.stdout:Transaction Summary 2026-02-20T12:08:57.830 INFO:teuthology.orchestra.run.trial063.stdout:================================================================================ 2026-02-20T12:08:57.830 INFO:teuthology.orchestra.run.trial063.stdout:Install 6 Packages 2026-02-20T12:08:57.830 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:08:57.830 INFO:teuthology.orchestra.run.trial063.stdout:Total download size: 3.7 M 2026-02-20T12:08:57.830 INFO:teuthology.orchestra.run.trial063.stdout:Installed size: 14 M 2026-02-20T12:08:57.830 INFO:teuthology.orchestra.run.trial063.stdout:Downloading Packages: 2026-02-20T12:08:58.585 INFO:teuthology.orchestra.run.trial063.stdout:(1/6): librbd-devel-20.3.0-5312.g26bc9765.el9.x 69 kB/s | 24 kB 00:00 2026-02-20T12:08:58.632 INFO:teuthology.orchestra.run.trial063.stdout:(2/6): libradospp-devel-20.3.0-5312.g26bc9765.e 80 kB/s | 31 kB 00:00 2026-02-20T12:08:58.864 INFO:teuthology.orchestra.run.trial063.stdout:(3/6): pdsh-2.34-7.el9.x86_64.rpm 512 kB/s | 118 kB 00:00 2026-02-20T12:08:58.888 INFO:teuthology.orchestra.run.trial063.stdout:(4/6): pdsh-rcmd-ssh-2.34-7.el9.x86_64.rpm 548 kB/s | 13 kB 00:00 2026-02-20T12:08:59.188 INFO:teuthology.orchestra.run.trial063.stdout:(5/6): libtraceevent-1.8.4-2.el9.x86_64.rpm 306 kB/s | 290 kB 00:00 2026-02-20T12:09:01.253 INFO:teuthology.orchestra.run.trial063.stdout:(6/6): perf-5.14.0-681.el9.x86_64.rpm 1.2 MB/s | 3.2 MB 00:02 2026-02-20T12:09:01.255 INFO:teuthology.orchestra.run.trial063.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:09:01.255 INFO:teuthology.orchestra.run.trial063.stdout:Total 1.1 MB/s | 3.7 MB 00:03 2026-02-20T12:09:01.280 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction check 2026-02-20T12:09:01.290 INFO:teuthology.orchestra.run.trial063.stdout:Transaction check succeeded. 2026-02-20T12:09:01.290 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction test 2026-02-20T12:09:01.348 INFO:teuthology.orchestra.run.trial063.stdout:Transaction test succeeded. 2026-02-20T12:09:01.348 INFO:teuthology.orchestra.run.trial063.stdout:Running transaction 2026-02-20T12:09:01.422 INFO:teuthology.orchestra.run.trial063.stdout: Preparing : 1/1 2026-02-20T12:09:01.427 INFO:teuthology.orchestra.run.trial063.stdout: Installing : pdsh-rcmd-ssh-2.34-7.el9.x86_64 1/6 2026-02-20T12:09:01.467 INFO:teuthology.orchestra.run.trial063.stdout: Installing : pdsh-2.34-7.el9.x86_64 2/6 2026-02-20T12:09:01.472 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libtraceevent-1.8.4-2.el9.x86_64 3/6 2026-02-20T12:09:01.475 INFO:teuthology.orchestra.run.trial063.stdout: Installing : libradospp-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 4/6 2026-02-20T12:09:01.642 INFO:teuthology.orchestra.run.trial063.stdout: Installing : librbd-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 5/6 2026-02-20T12:09:01.663 INFO:teuthology.orchestra.run.trial063.stdout: Installing : perf-5.14.0-681.el9.x86_64 6/6 2026-02-20T12:09:01.768 INFO:teuthology.orchestra.run.trial063.stdout: Running scriptlet: perf-5.14.0-681.el9.x86_64 6/6 2026-02-20T12:09:01.768 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libradospp-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/6 2026-02-20T12:09:01.768 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : librbd-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 2/6 2026-02-20T12:09:01.768 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : libtraceevent-1.8.4-2.el9.x86_64 3/6 2026-02-20T12:09:01.768 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : perf-5.14.0-681.el9.x86_64 4/6 2026-02-20T12:09:01.768 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : pdsh-2.34-7.el9.x86_64 5/6 2026-02-20T12:09:01.830 INFO:teuthology.orchestra.run.trial063.stdout: Verifying : pdsh-rcmd-ssh-2.34-7.el9.x86_64 6/6 2026-02-20T12:09:01.830 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:09:01.830 INFO:teuthology.orchestra.run.trial063.stdout:Installed: 2026-02-20T12:09:01.830 INFO:teuthology.orchestra.run.trial063.stdout: libradospp-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:09:01.830 INFO:teuthology.orchestra.run.trial063.stdout: librbd-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:09:01.831 INFO:teuthology.orchestra.run.trial063.stdout: libtraceevent-1.8.4-2.el9.x86_64 2026-02-20T12:09:01.831 INFO:teuthology.orchestra.run.trial063.stdout: pdsh-2.34-7.el9.x86_64 2026-02-20T12:09:01.831 INFO:teuthology.orchestra.run.trial063.stdout: pdsh-rcmd-ssh-2.34-7.el9.x86_64 2026-02-20T12:09:01.831 INFO:teuthology.orchestra.run.trial063.stdout: perf-5.14.0-681.el9.x86_64 2026-02-20T12:09:01.831 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:09:01.831 INFO:teuthology.orchestra.run.trial063.stdout:Complete! 2026-02-20T12:09:01.862 DEBUG:teuthology.orchestra.run.trial063:> python3 -m pip install -r /home/ubuntu/cephtest/cbt/requirements.txt 2026-02-20T12:09:02.000 INFO:teuthology.orchestra.run.trial063.stdout:Defaulting to user installation because normal site-packages is not writeable 2026-02-20T12:09:02.011 INFO:teuthology.orchestra.run.trial063.stdout:Requirement already satisfied: pyyaml in /usr/lib64/python3.9/site-packages (from -r /home/ubuntu/cephtest/cbt/requirements.txt (line 1)) (5.4.1) 2026-02-20T12:09:02.011 INFO:teuthology.orchestra.run.trial063.stdout:Requirement already satisfied: lxml in /usr/lib64/python3.9/site-packages (from -r /home/ubuntu/cephtest/cbt/requirements.txt (line 2)) (4.6.5) 2026-02-20T12:09:02.775 INFO:teuthology.orchestra.run.trial063.stdout:Collecting matplotlib 2026-02-20T12:09:03.107 INFO:teuthology.orchestra.run.trial063.stdout: Downloading matplotlib-3.9.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.3 MB) 2026-02-20T12:09:03.760 INFO:teuthology.orchestra.run.trial063.stdout:Requirement already satisfied: python-dateutil>=2.7 in /usr/lib/python3.9/site-packages (from matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (2.9.0.post0) 2026-02-20T12:09:04.200 INFO:teuthology.orchestra.run.trial063.stdout:Collecting fonttools>=4.22.0 2026-02-20T12:09:04.286 INFO:teuthology.orchestra.run.trial063.stdout: Downloading fonttools-4.60.2-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (4.8 MB) 2026-02-20T12:09:04.630 INFO:teuthology.orchestra.run.trial063.stdout:Collecting kiwisolver>=1.3.1 2026-02-20T12:09:04.717 INFO:teuthology.orchestra.run.trial063.stdout: Downloading kiwisolver-1.4.7-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.6 MB) 2026-02-20T12:09:04.838 INFO:teuthology.orchestra.run.trial063.stdout:Collecting cycler>=0.10 2026-02-20T12:09:04.925 INFO:teuthology.orchestra.run.trial063.stdout: Downloading cycler-0.12.1-py3-none-any.whl (8.3 kB) 2026-02-20T12:09:04.926 INFO:teuthology.orchestra.run.trial063.stdout:Requirement already satisfied: pyparsing>=2.3.1 in /usr/lib/python3.9/site-packages (from matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (2.4.7) 2026-02-20T12:09:05.042 INFO:teuthology.orchestra.run.trial063.stdout:Collecting importlib-resources>=3.2.0 2026-02-20T12:09:05.134 INFO:teuthology.orchestra.run.trial063.stdout: Downloading importlib_resources-6.5.2-py3-none-any.whl (37 kB) 2026-02-20T12:09:05.136 INFO:teuthology.orchestra.run.trial063.stdout:Requirement already satisfied: numpy>=1.23 in /usr/lib64/python3.9/site-packages (from matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (1.23.5) 2026-02-20T12:09:05.136 INFO:teuthology.orchestra.run.trial063.stdout:Requirement already satisfied: packaging>=20.0 in /usr/lib/python3.9/site-packages (from matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (20.9) 2026-02-20T12:09:05.634 INFO:teuthology.orchestra.run.trial063.stdout:Collecting pillow>=8 2026-02-20T12:09:05.718 INFO:teuthology.orchestra.run.trial063.stdout: Downloading pillow-11.3.0-cp39-cp39-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (6.6 MB) 2026-02-20T12:09:06.096 INFO:teuthology.orchestra.run.trial063.stdout:Collecting contourpy>=1.0.1 2026-02-20T12:09:06.181 INFO:teuthology.orchestra.run.trial063.stdout: Downloading contourpy-1.3.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (321 kB) 2026-02-20T12:09:06.314 INFO:teuthology.orchestra.run.trial063.stdout:Collecting zipp>=3.1.0 2026-02-20T12:09:06.405 INFO:teuthology.orchestra.run.trial063.stdout: Downloading zipp-3.23.0-py3-none-any.whl (10 kB) 2026-02-20T12:09:06.416 INFO:teuthology.orchestra.run.trial063.stdout:Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil>=2.7->matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (1.15.0) 2026-02-20T12:09:06.532 INFO:teuthology.orchestra.run.trial063.stdout:Installing collected packages: zipp, pillow, kiwisolver, importlib-resources, fonttools, cycler, contourpy, matplotlib 2026-02-20T12:09:07.604 INFO:teuthology.orchestra.run.trial063.stdout:Successfully installed contourpy-1.3.0 cycler-0.12.1 fonttools-4.60.2 importlib-resources-6.5.2 kiwisolver-1.4.7 matplotlib-3.9.4 pillow-11.3.0 zipp-3.23.0 2026-02-20T12:09:07.962 INFO:tasks.cbt:benchmark: librbdfio 2026-02-20T12:09:07.962 DEBUG:teuthology.orchestra.run.trial063:> git clone -b master https://github.com/axboe/fio.git /home/ubuntu/cephtest/fio 2026-02-20T12:09:07.979 INFO:teuthology.orchestra.run.trial063.stderr:Cloning into '/home/ubuntu/cephtest/fio'... 2026-02-20T12:09:08.794 DEBUG:teuthology.orchestra.run.trial063:> cd /home/ubuntu/cephtest/fio && ./configure && make 2026-02-20T12:09:08.968 INFO:teuthology.orchestra.run.trial063.stdout:Operating system Linux 2026-02-20T12:09:08.968 INFO:teuthology.orchestra.run.trial063.stdout:CPU x86_64 2026-02-20T12:09:08.968 INFO:teuthology.orchestra.run.trial063.stdout:Big endian no 2026-02-20T12:09:08.968 INFO:teuthology.orchestra.run.trial063.stdout:Compiler gcc 2026-02-20T12:09:08.969 INFO:teuthology.orchestra.run.trial063.stdout:Cross compile no 2026-02-20T12:09:08.969 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:09:08.969 INFO:teuthology.orchestra.run.trial063.stdout:Static build no 2026-02-20T12:09:09.018 INFO:teuthology.orchestra.run.trial063.stdout:Wordsize 64 2026-02-20T12:09:09.023 INFO:teuthology.orchestra.run.trial063.stdout:zlib no 2026-02-20T12:09:09.035 INFO:teuthology.orchestra.run.trial063.stdout:fcntl(F_FULLFSYNC) no 2026-02-20T12:09:09.047 INFO:teuthology.orchestra.run.trial063.stdout:Linux AIO support no 2026-02-20T12:09:09.047 INFO:teuthology.orchestra.run.trial063.stdout:Linux AIO support rw flags no 2026-02-20T12:09:09.073 INFO:teuthology.orchestra.run.trial063.stdout:POSIX AIO support yes 2026-02-20T12:09:09.073 INFO:teuthology.orchestra.run.trial063.stdout:POSIX AIO support needs -lrt no 2026-02-20T12:09:09.095 INFO:teuthology.orchestra.run.trial063.stdout:POSIX AIO fsync yes 2026-02-20T12:09:09.116 INFO:teuthology.orchestra.run.trial063.stdout:POSIX pshared support yes 2026-02-20T12:09:09.143 INFO:teuthology.orchestra.run.trial063.stdout:pthread_condattr_setclock() yes 2026-02-20T12:09:09.167 INFO:teuthology.orchestra.run.trial063.stdout:pthread_sigmask() yes 2026-02-20T12:09:09.191 INFO:teuthology.orchestra.run.trial063.stdout:pthread_getaffinity_np() yes 2026-02-20T12:09:09.198 INFO:teuthology.orchestra.run.trial063.stdout:Solaris AIO support no 2026-02-20T12:09:09.218 INFO:teuthology.orchestra.run.trial063.stdout:__sync_fetch_and_add yes 2026-02-20T12:09:09.240 INFO:teuthology.orchestra.run.trial063.stdout:__sync_synchronize yes 2026-02-20T12:09:09.259 INFO:teuthology.orchestra.run.trial063.stdout:__sync_val_compare_and_swap yes 2026-02-20T12:09:09.264 INFO:teuthology.orchestra.run.trial063.stdout:libverbs no 2026-02-20T12:09:09.273 INFO:teuthology.orchestra.run.trial063.stdout:rdmacm no 2026-02-20T12:09:09.294 INFO:teuthology.orchestra.run.trial063.stdout:asprintf() yes 2026-02-20T12:09:09.313 INFO:teuthology.orchestra.run.trial063.stdout:vasprintf() yes 2026-02-20T12:09:09.335 INFO:teuthology.orchestra.run.trial063.stdout:Linux fallocate yes 2026-02-20T12:09:09.356 INFO:teuthology.orchestra.run.trial063.stdout:POSIX fadvise yes 2026-02-20T12:09:09.376 INFO:teuthology.orchestra.run.trial063.stdout:POSIX fallocate yes 2026-02-20T12:09:09.397 INFO:teuthology.orchestra.run.trial063.stdout:sched_setaffinity(3 arg) yes 2026-02-20T12:09:09.398 INFO:teuthology.orchestra.run.trial063.stdout:sched_setaffinity(2 arg) no 2026-02-20T12:09:09.419 INFO:teuthology.orchestra.run.trial063.stdout:clock_gettime yes 2026-02-20T12:09:09.440 INFO:teuthology.orchestra.run.trial063.stdout:CLOCK_MONOTONIC yes 2026-02-20T12:09:09.462 INFO:teuthology.orchestra.run.trial063.stdout:gettimeofday yes 2026-02-20T12:09:09.484 INFO:teuthology.orchestra.run.trial063.stdout:fdatasync yes 2026-02-20T12:09:09.505 INFO:teuthology.orchestra.run.trial063.stdout:pipe() yes 2026-02-20T12:09:09.525 INFO:teuthology.orchestra.run.trial063.stdout:pipe2() yes 2026-02-20T12:09:09.545 INFO:teuthology.orchestra.run.trial063.stdout:pread() yes 2026-02-20T12:09:09.569 INFO:teuthology.orchestra.run.trial063.stdout:sync_file_range yes 2026-02-20T12:09:09.575 INFO:teuthology.orchestra.run.trial063.stdout:ASharedMemory_create no 2026-02-20T12:09:09.583 INFO:teuthology.orchestra.run.trial063.stdout:EXT4 move extent yes 2026-02-20T12:09:09.604 INFO:teuthology.orchestra.run.trial063.stdout:Linux splice(2) yes 2026-02-20T12:09:09.609 INFO:teuthology.orchestra.run.trial063.stdout:libnuma no 2026-02-20T12:09:09.629 INFO:teuthology.orchestra.run.trial063.stdout:strsep yes 2026-02-20T12:09:09.650 INFO:teuthology.orchestra.run.trial063.stdout:strcasestr yes 2026-02-20T12:09:09.658 INFO:teuthology.orchestra.run.trial063.stdout:strlcat no 2026-02-20T12:09:09.680 INFO:teuthology.orchestra.run.trial063.stdout:getopt_long_only() yes 2026-02-20T12:09:09.703 INFO:teuthology.orchestra.run.trial063.stdout:inet_aton yes 2026-02-20T12:09:09.725 INFO:teuthology.orchestra.run.trial063.stdout:socklen_t yes 2026-02-20T12:09:09.748 INFO:teuthology.orchestra.run.trial063.stdout:__thread yes 2026-02-20T12:09:09.768 INFO:teuthology.orchestra.run.trial063.stdout:RUSAGE_THREAD yes 2026-02-20T12:09:09.789 INFO:teuthology.orchestra.run.trial063.stdout:SCHED_IDLE yes 2026-02-20T12:09:09.813 INFO:teuthology.orchestra.run.trial063.stdout:TCP_NODELAY yes 2026-02-20T12:09:09.834 INFO:teuthology.orchestra.run.trial063.stdout:vsock yes 2026-02-20T12:09:09.856 INFO:teuthology.orchestra.run.trial063.stdout:Net engine window_size yes 2026-02-20T12:09:09.879 INFO:teuthology.orchestra.run.trial063.stdout:TCP_MAXSEG yes 2026-02-20T12:09:09.899 INFO:teuthology.orchestra.run.trial063.stdout:RLIMIT_MEMLOCK yes 2026-02-20T12:09:09.922 INFO:teuthology.orchestra.run.trial063.stdout:pwritev/preadv yes 2026-02-20T12:09:09.943 INFO:teuthology.orchestra.run.trial063.stdout:pwritev2/preadv2 yes 2026-02-20T12:09:09.966 INFO:teuthology.orchestra.run.trial063.stdout:IPv6 helpers yes 2026-02-20T12:09:09.978 INFO:teuthology.orchestra.run.trial063.stdout:http engine no 2026-02-20T12:09:10.034 INFO:teuthology.orchestra.run.trial063.stdout:Rados engine yes 2026-02-20T12:09:10.098 INFO:teuthology.orchestra.run.trial063.stdout:Rados Block Device engine yes 2026-02-20T12:09:10.163 INFO:teuthology.orchestra.run.trial063.stdout:rbd_poll yes 2026-02-20T12:09:10.227 INFO:teuthology.orchestra.run.trial063.stdout:rbd_invalidate_cache yes 2026-02-20T12:09:10.295 INFO:teuthology.orchestra.run.trial063.stdout:rbd_encryption_load yes 2026-02-20T12:09:10.316 INFO:teuthology.orchestra.run.trial063.stdout:setvbuf yes 2026-02-20T12:09:10.321 INFO:teuthology.orchestra.run.trial063.stdout:Gluster API engine no 2026-02-20T12:09:10.334 INFO:teuthology.orchestra.run.trial063.stdout:s390_z196_facilities no 2026-02-20T12:09:10.334 INFO:teuthology.orchestra.run.trial063.stdout:HDFS engine no 2026-02-20T12:09:10.355 INFO:teuthology.orchestra.run.trial063.stdout:MTD yes 2026-02-20T12:09:10.361 INFO:teuthology.orchestra.run.trial063.stdout:libpmem no 2026-02-20T12:09:10.361 INFO:teuthology.orchestra.run.trial063.stdout:libpmem1_5 no 2026-02-20T12:09:10.366 INFO:teuthology.orchestra.run.trial063.stdout:libpmem2 no 2026-02-20T12:09:10.366 INFO:teuthology.orchestra.run.trial063.stdout:PMDK dev-dax engine no 2026-02-20T12:09:10.366 INFO:teuthology.orchestra.run.trial063.stdout:PMDK libpmem engine no 2026-02-20T12:09:10.372 INFO:teuthology.orchestra.run.trial063.stdout:DDN's Infinite Memory Engine no 2026-02-20T12:09:10.372 INFO:teuthology.orchestra.run.trial063.stdout:iscsi engine no 2026-02-20T12:09:10.372 INFO:teuthology.orchestra.run.trial063.stdout:NBD engine no 2026-02-20T12:09:10.378 INFO:teuthology.orchestra.run.trial063.stdout:DAOS File System (dfs) Engine no 2026-02-20T12:09:10.385 INFO:teuthology.orchestra.run.trial063.stdout:NFS engine no 2026-02-20T12:09:10.385 INFO:teuthology.orchestra.run.trial063.stdout:lex/yacc for arithmetic no 2026-02-20T12:09:10.407 INFO:teuthology.orchestra.run.trial063.stdout:getmntent yes 2026-02-20T12:09:10.419 INFO:teuthology.orchestra.run.trial063.stdout:getmntinfo no 2026-02-20T12:09:10.449 INFO:teuthology.orchestra.run.trial063.stdout:Static Assert yes 2026-02-20T12:09:10.469 INFO:teuthology.orchestra.run.trial063.stdout:bool yes 2026-02-20T12:09:10.490 INFO:teuthology.orchestra.run.trial063.stdout:strndup yes 2026-02-20T12:09:10.496 INFO:teuthology.orchestra.run.trial063.stdout:Valgrind headers no 2026-02-20T12:09:10.515 INFO:teuthology.orchestra.run.trial063.stdout:Zoned block device support yes 2026-02-20T12:09:10.534 INFO:teuthology.orchestra.run.trial063.stdout:Zoned block device capacity yes 2026-02-20T12:09:10.539 INFO:teuthology.orchestra.run.trial063.stdout:libzbc engine no 2026-02-20T12:09:10.560 INFO:teuthology.orchestra.run.trial063.stdout:NVMe uring command support yes 2026-02-20T12:09:10.571 INFO:teuthology.orchestra.run.trial063.stdout:xnvme engine no 2026-02-20T12:09:10.577 INFO:teuthology.orchestra.run.trial063.stdout:isal no 2026-02-20T12:09:10.578 INFO:teuthology.orchestra.run.trial063.stdout:isal CRC64 no 2026-02-20T12:09:10.590 INFO:teuthology.orchestra.run.trial063.stdout:libblkio engine no 2026-02-20T12:09:10.590 INFO:teuthology.orchestra.run.trial063.stdout:march_armv8_a_crc_crypto no 2026-02-20T12:09:10.590 INFO:teuthology.orchestra.run.trial063.stdout:cuda no 2026-02-20T12:09:10.590 INFO:teuthology.orchestra.run.trial063.stdout:libcufile no 2026-02-20T12:09:10.610 INFO:teuthology.orchestra.run.trial063.stdout:Build march=native yes 2026-02-20T12:09:10.615 INFO:teuthology.orchestra.run.trial063.stdout:CUnit no 2026-02-20T12:09:10.635 INFO:teuthology.orchestra.run.trial063.stdout:__kernel_rwf_t yes 2026-02-20T12:09:10.655 INFO:teuthology.orchestra.run.trial063.stdout:-Wimplicit-fallthrough=2 yes 2026-02-20T12:09:10.676 INFO:teuthology.orchestra.run.trial063.stdout:-Wno-stringop-truncation yes 2026-02-20T12:09:10.696 INFO:teuthology.orchestra.run.trial063.stdout:MADV_HUGEPAGE yes 2026-02-20T12:09:10.716 INFO:teuthology.orchestra.run.trial063.stdout:gettid yes 2026-02-20T12:09:10.738 INFO:teuthology.orchestra.run.trial063.stdout:statx(2)/libc yes 2026-02-20T12:09:10.760 INFO:teuthology.orchestra.run.trial063.stdout:statx(2)/syscall yes 2026-02-20T12:09:10.762 INFO:teuthology.orchestra.run.trial063.stdout:Windows PDB generation no 2026-02-20T12:09:10.783 INFO:teuthology.orchestra.run.trial063.stdout:timerfd_create yes 2026-02-20T12:09:10.784 INFO:teuthology.orchestra.run.trial063.stdout:Consider installing zlib1g-dev (zlib-devel) as some fio features depend on it. 2026-02-20T12:09:10.784 INFO:teuthology.orchestra.run.trial063.stdout:Lib-based ioengines dynamic no 2026-02-20T12:09:10.827 INFO:teuthology.orchestra.run.trial063.stdout:TCMalloc support yes 2026-02-20T12:09:10.828 INFO:teuthology.orchestra.run.trial063.stdout:seed_buckets 4 2026-02-20T12:09:10.873 INFO:teuthology.orchestra.run.trial063.stderr:FIO_VERSION = fio-3.41-110-g1a04e5 2026-02-20T12:09:10.896 INFO:teuthology.orchestra.run.trial063.stdout: CC crc/crc16.o 2026-02-20T12:09:10.932 INFO:teuthology.orchestra.run.trial063.stdout: CC crc/crc32.o 2026-02-20T12:09:10.960 INFO:teuthology.orchestra.run.trial063.stdout: CC crc/crc32c-arm64.o 2026-02-20T12:09:11.006 INFO:teuthology.orchestra.run.trial063.stdout: CC crc/crc32c-intel.o 2026-02-20T12:09:11.039 INFO:teuthology.orchestra.run.trial063.stdout: CC crc/crc32c.o 2026-02-20T12:09:11.072 INFO:teuthology.orchestra.run.trial063.stdout: CC crc/crc64.o 2026-02-20T12:09:11.099 INFO:teuthology.orchestra.run.trial063.stdout: CC crc/crc7.o 2026-02-20T12:09:11.125 INFO:teuthology.orchestra.run.trial063.stdout: CC crc/crct10dif_common.o 2026-02-20T12:09:11.151 INFO:teuthology.orchestra.run.trial063.stdout: CC crc/fnv.o 2026-02-20T12:09:11.180 INFO:teuthology.orchestra.run.trial063.stdout: CC crc/md5.o 2026-02-20T12:09:11.239 INFO:teuthology.orchestra.run.trial063.stdout: CC crc/murmur3.o 2026-02-20T12:09:11.270 INFO:teuthology.orchestra.run.trial063.stdout: CC crc/sha1.o 2026-02-20T12:09:11.368 INFO:teuthology.orchestra.run.trial063.stdout: CC crc/sha256.o 2026-02-20T12:09:11.507 INFO:teuthology.orchestra.run.trial063.stdout: CC crc/sha3.o 2026-02-20T12:09:11.590 INFO:teuthology.orchestra.run.trial063.stdout: CC crc/sha512.o 2026-02-20T12:09:11.658 INFO:teuthology.orchestra.run.trial063.stdout: CC crc/test.o 2026-02-20T12:09:11.751 INFO:teuthology.orchestra.run.trial063.stdout: CC crc/xxhash.o 2026-02-20T12:09:11.808 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/axmap.o 2026-02-20T12:09:11.882 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/bloom.o 2026-02-20T12:09:11.932 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/flist_sort.o 2026-02-20T12:09:11.977 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/gauss.o 2026-02-20T12:09:12.030 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/getrusage.o 2026-02-20T12:09:12.058 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/hweight.o 2026-02-20T12:09:12.085 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/ieee754.o 2026-02-20T12:09:12.118 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/lfsr.o 2026-02-20T12:09:12.175 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/memalign.o 2026-02-20T12:09:12.207 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/memcpy.o 2026-02-20T12:09:12.290 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/mountcheck.o 2026-02-20T12:09:12.320 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/num2str.o 2026-02-20T12:09:12.366 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/output_buffer.o 2026-02-20T12:09:12.400 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/pattern.o 2026-02-20T12:09:12.481 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/prio_tree.o 2026-02-20T12:09:12.551 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/rand.o 2026-02-20T12:09:12.632 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/rbtree.o 2026-02-20T12:09:12.703 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/strntol.o 2026-02-20T12:09:12.737 INFO:teuthology.orchestra.run.trial063.stdout: CC lib/zipf.o 2026-02-20T12:09:12.802 INFO:teuthology.orchestra.run.trial063.stdout: CC gettime.o 2026-02-20T12:09:12.955 INFO:teuthology.orchestra.run.trial063.stdout: CC ioengines.o 2026-02-20T12:09:13.095 INFO:teuthology.orchestra.run.trial063.stdout: CC init.o 2026-02-20T12:09:13.470 INFO:teuthology.orchestra.run.trial063.stdout: CC stat.o 2026-02-20T12:09:14.177 INFO:teuthology.orchestra.run.trial063.stdout: CC log.o 2026-02-20T12:09:14.248 INFO:teuthology.orchestra.run.trial063.stdout: CC time.o 2026-02-20T12:09:14.338 INFO:teuthology.orchestra.run.trial063.stdout: CC filesetup.o 2026-02-20T12:09:14.676 INFO:teuthology.orchestra.run.trial063.stdout: CC eta.o 2026-02-20T12:09:14.840 INFO:teuthology.orchestra.run.trial063.stdout: CC verify.o 2026-02-20T12:09:15.183 INFO:teuthology.orchestra.run.trial063.stdout: CC memory.o 2026-02-20T12:09:15.279 INFO:teuthology.orchestra.run.trial063.stdout: CC io_u.o 2026-02-20T12:09:15.662 INFO:teuthology.orchestra.run.trial063.stdout: CC parse.o 2026-02-20T12:09:15.884 INFO:teuthology.orchestra.run.trial063.stdout: CC fio_sem.o 2026-02-20T12:09:15.948 INFO:teuthology.orchestra.run.trial063.stdout: CC rwlock.o 2026-02-20T12:09:16.001 INFO:teuthology.orchestra.run.trial063.stdout: CC pshared.o 2026-02-20T12:09:16.043 INFO:teuthology.orchestra.run.trial063.stdout: CC options.o 2026-02-20T12:09:16.449 INFO:teuthology.orchestra.run.trial063.stdout: CC fio_shared_sem.o 2026-02-20T12:09:16.482 INFO:teuthology.orchestra.run.trial063.stdout: CC smalloc.o 2026-02-20T12:09:16.584 INFO:teuthology.orchestra.run.trial063.stdout: CC filehash.o 2026-02-20T12:09:16.670 INFO:teuthology.orchestra.run.trial063.stdout: CC profile.o 2026-02-20T12:09:16.739 INFO:teuthology.orchestra.run.trial063.stdout: CC debug.o 2026-02-20T12:09:16.769 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/cpu.o 2026-02-20T12:09:16.847 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/mmap.o 2026-02-20T12:09:16.938 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/sync.o 2026-02-20T12:09:17.062 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/null.o 2026-02-20T12:09:17.133 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/net.o 2026-02-20T12:09:17.344 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/ftruncate.o 2026-02-20T12:09:17.406 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/fileoperations.o 2026-02-20T12:09:17.496 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/exec.o 2026-02-20T12:09:17.582 INFO:teuthology.orchestra.run.trial063.stdout: CC server.o 2026-02-20T12:09:17.941 INFO:teuthology.orchestra.run.trial063.stdout: CC client.o 2026-02-20T12:09:18.225 INFO:teuthology.orchestra.run.trial063.stdout: CC iolog.o 2026-02-20T12:09:18.457 INFO:teuthology.orchestra.run.trial063.stdout: CC backend.o 2026-02-20T12:09:18.877 INFO:teuthology.orchestra.run.trial063.stdout: CC libfio.o 2026-02-20T12:09:18.977 INFO:teuthology.orchestra.run.trial063.stdout: CC flow.o 2026-02-20T12:09:19.046 INFO:teuthology.orchestra.run.trial063.stdout: CC cconv.o 2026-02-20T12:09:19.268 INFO:teuthology.orchestra.run.trial063.stdout: CC gettime-thread.o 2026-02-20T12:09:19.331 INFO:teuthology.orchestra.run.trial063.stdout: CC helpers.o 2026-02-20T12:09:19.375 INFO:teuthology.orchestra.run.trial063.stdout: CC json.o 2026-02-20T12:09:19.474 INFO:teuthology.orchestra.run.trial063.stdout: CC idletime.o 2026-02-20T12:09:19.596 INFO:teuthology.orchestra.run.trial063.stdout: CC td_error.o 2026-02-20T12:09:19.660 INFO:teuthology.orchestra.run.trial063.stdout: CC profiles/tiobench.o 2026-02-20T12:09:19.720 INFO:teuthology.orchestra.run.trial063.stdout: CC profiles/act.o 2026-02-20T12:09:19.808 INFO:teuthology.orchestra.run.trial063.stdout: CC io_u_queue.o 2026-02-20T12:09:19.841 INFO:teuthology.orchestra.run.trial063.stdout: CC filelock.o 2026-02-20T12:09:19.915 INFO:teuthology.orchestra.run.trial063.stdout: CC workqueue.o 2026-02-20T12:09:20.014 INFO:teuthology.orchestra.run.trial063.stdout: CC rate-submit.o 2026-02-20T12:09:20.099 INFO:teuthology.orchestra.run.trial063.stdout: CC optgroup.o 2026-02-20T12:09:20.130 INFO:teuthology.orchestra.run.trial063.stdout: CC helper_thread.o 2026-02-20T12:09:20.233 INFO:teuthology.orchestra.run.trial063.stdout: CC steadystate.o 2026-02-20T12:09:20.379 INFO:teuthology.orchestra.run.trial063.stdout: CC zone-dist.o 2026-02-20T12:09:20.460 INFO:teuthology.orchestra.run.trial063.stdout: CC zbd.o 2026-02-20T12:09:20.831 INFO:teuthology.orchestra.run.trial063.stdout: CC dedupe.o 2026-02-20T12:09:20.915 INFO:teuthology.orchestra.run.trial063.stdout: CC dataplacement.o 2026-02-20T12:09:21.012 INFO:teuthology.orchestra.run.trial063.stdout: CC sprandom.o 2026-02-20T12:09:21.173 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/posixaio.o 2026-02-20T12:09:21.251 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/falloc.o 2026-02-20T12:09:21.321 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/e4defrag.o 2026-02-20T12:09:21.397 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/splice.o 2026-02-20T12:09:21.497 INFO:teuthology.orchestra.run.trial063.stdout: CC oslib/asprintf.o 2026-02-20T12:09:21.524 INFO:teuthology.orchestra.run.trial063.stdout: CC oslib/strlcat.o 2026-02-20T12:09:21.557 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/mtd.o 2026-02-20T12:09:21.646 INFO:teuthology.orchestra.run.trial063.stdout: CC oslib/libmtd.o 2026-02-20T12:09:21.842 INFO:teuthology.orchestra.run.trial063.stdout: CC oslib/libmtd_legacy.o 2026-02-20T12:09:21.918 INFO:teuthology.orchestra.run.trial063.stdout: CC diskutil.o 2026-02-20T12:09:22.035 INFO:teuthology.orchestra.run.trial063.stdout: CC fifo.o 2026-02-20T12:09:22.073 INFO:teuthology.orchestra.run.trial063.stdout: CC blktrace.o 2026-02-20T12:09:22.241 INFO:teuthology.orchestra.run.trial063.stdout: CC cgroup.o 2026-02-20T12:09:22.327 INFO:teuthology.orchestra.run.trial063.stdout: CC trim.o 2026-02-20T12:09:22.396 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/sg.o 2026-02-20T12:09:22.593 INFO:teuthology.orchestra.run.trial063.stdout: CC oslib/linux-dev-lookup.o 2026-02-20T12:09:22.633 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/io_uring.o 2026-02-20T12:09:22.869 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/nvme.o 2026-02-20T12:09:23.031 INFO:teuthology.orchestra.run.trial063.stdout: CC oslib/linux-blkzoned.o 2026-02-20T12:09:23.125 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/cmdprio.o 2026-02-20T12:09:23.254 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/rados.o 2026-02-20T12:09:23.355 INFO:teuthology.orchestra.run.trial063.stdout: CC engines/rbd.o 2026-02-20T12:09:23.461 INFO:teuthology.orchestra.run.trial063.stdout: CC fio.o 2026-02-20T12:09:23.519 INFO:teuthology.orchestra.run.trial063.stdout: LINK fio 2026-02-20T12:09:23.642 INFO:teuthology.orchestra.run.trial063.stdout: CC t/log.o 2026-02-20T12:09:23.672 INFO:teuthology.orchestra.run.trial063.stdout: CC t/genzipf.o 2026-02-20T12:09:23.749 INFO:teuthology.orchestra.run.trial063.stdout: CC oslib/strcasestr.o 2026-02-20T12:09:23.771 INFO:teuthology.orchestra.run.trial063.stdout: CC oslib/strndup.o 2026-02-20T12:09:23.790 INFO:teuthology.orchestra.run.trial063.stdout: LINK t/fio-genzipf 2026-02-20T12:09:23.847 INFO:teuthology.orchestra.run.trial063.stdout: CC t/btrace2fio.o 2026-02-20T12:09:24.048 INFO:teuthology.orchestra.run.trial063.stdout: LINK t/fio-btrace2fio 2026-02-20T12:09:24.103 INFO:teuthology.orchestra.run.trial063.stdout: CC t/verify-state.o 2026-02-20T12:09:24.164 INFO:teuthology.orchestra.run.trial063.stdout: CC t/debug.o 2026-02-20T12:09:24.190 INFO:teuthology.orchestra.run.trial063.stdout: LINK t/fio-verify-state 2026-02-20T12:09:24.243 INFO:teuthology.orchestra.run.trial063.stdout: CC t/stest.o 2026-02-20T12:09:24.291 INFO:teuthology.orchestra.run.trial063.stdout: CC t/arch.o 2026-02-20T12:09:24.315 INFO:teuthology.orchestra.run.trial063.stdout: LINK t/stest 2026-02-20T12:09:24.369 INFO:teuthology.orchestra.run.trial063.stdout: CC t/ieee754.o 2026-02-20T12:09:24.399 INFO:teuthology.orchestra.run.trial063.stdout: LINK t/ieee754 2026-02-20T12:09:24.453 INFO:teuthology.orchestra.run.trial063.stdout: CC t/axmap.o 2026-02-20T12:09:24.511 INFO:teuthology.orchestra.run.trial063.stdout: LINK t/axmap 2026-02-20T12:09:24.563 INFO:teuthology.orchestra.run.trial063.stdout: CC t/lfsr-test.o 2026-02-20T12:09:24.620 INFO:teuthology.orchestra.run.trial063.stdout: LINK t/lfsr-test 2026-02-20T12:09:24.675 INFO:teuthology.orchestra.run.trial063.stdout: CC t/gen-rand.o 2026-02-20T12:09:24.730 INFO:teuthology.orchestra.run.trial063.stdout: LINK t/gen-rand 2026-02-20T12:09:24.786 INFO:teuthology.orchestra.run.trial063.stdout: CC t/memlock.o 2026-02-20T12:09:24.826 INFO:teuthology.orchestra.run.trial063.stdout: LINK t/memlock 2026-02-20T12:09:24.878 INFO:teuthology.orchestra.run.trial063.stdout: CC t/read-to-pipe-async.o 2026-02-20T12:09:24.981 INFO:teuthology.orchestra.run.trial063.stdout: LINK t/read-to-pipe-async 2026-02-20T12:09:25.037 INFO:teuthology.orchestra.run.trial063.stdout: CC t/io_uring.o 2026-02-20T12:09:25.308 INFO:teuthology.orchestra.run.trial063.stdout: LINK t/io_uring 2026-02-20T12:09:25.365 DEBUG:teuthology.orchestra.run.trial063:> sudo /sbin/sysctl -q -w kernel.perf_event_paranoid=0 2026-02-20T12:09:25.391 DEBUG:teuthology.orchestra.run.trial063:> /home/ubuntu/cephtest/cbt/cbt.py -a /home/ubuntu/cephtest/archive/cbt /home/ubuntu/cephtest/archive/cbt/cbt_config.yaml 2026-02-20T12:09:25.505 INFO:teuthology.orchestra.run.trial063.stderr:12:09:25 - DEBUG - cbt - Settings.cluster: 2026-02-20T12:09:25.505 INFO:teuthology.orchestra.run.trial063.stderr: {'archive_dir': '/home/ubuntu/cephtest/archive/cbt', 2026-02-20T12:09:25.505 INFO:teuthology.orchestra.run.trial063.stderr: 'clients': ['ubuntu@trial063.front.sepia.ceph.com'], 2026-02-20T12:09:25.505 INFO:teuthology.orchestra.run.trial063.stderr: 'conf_file': '/etc/ceph/ceph.conf', 2026-02-20T12:09:25.505 INFO:teuthology.orchestra.run.trial063.stderr: 'head': 'ubuntu@trial063.front.sepia.ceph.com', 2026-02-20T12:09:25.505 INFO:teuthology.orchestra.run.trial063.stderr: 'is_teuthology': True, 2026-02-20T12:09:25.505 INFO:teuthology.orchestra.run.trial063.stderr: 'iterations': 1, 2026-02-20T12:09:25.505 INFO:teuthology.orchestra.run.trial063.stderr: 'mons': ['ubuntu@trial063.front.sepia.ceph.com'], 2026-02-20T12:09:25.506 INFO:teuthology.orchestra.run.trial063.stderr: 'osds': ['ubuntu@trial063.front.sepia.ceph.com'], 2026-02-20T12:09:25.506 INFO:teuthology.orchestra.run.trial063.stderr: 'osds_per_node': 3, 2026-02-20T12:09:25.506 INFO:teuthology.orchestra.run.trial063.stderr: 'pid_dir': '/var/run/ceph', 2026-02-20T12:09:25.506 INFO:teuthology.orchestra.run.trial063.stderr: 'pool_profiles': {'rbd': {'pg_size': 128, 'pgp_size': 128, 'replication': 3}}, 2026-02-20T12:09:25.506 INFO:teuthology.orchestra.run.trial063.stderr: 'rebuild_every_test': False, 2026-02-20T12:09:25.506 INFO:teuthology.orchestra.run.trial063.stderr: 'rgws': {'ubuntu@trial063.front.sepia.ceph.com': None}, 2026-02-20T12:09:25.506 INFO:teuthology.orchestra.run.trial063.stderr: 'tmp_dir': '/tmp/cbt', 2026-02-20T12:09:25.506 INFO:teuthology.orchestra.run.trial063.stderr: 'use_existing': True, 2026-02-20T12:09:25.506 INFO:teuthology.orchestra.run.trial063.stderr: 'user': 'ubuntu'} 2026-02-20T12:09:25.506 INFO:teuthology.orchestra.run.trial063.stderr:12:09:25 - INFO - cbt - Results dir: /home/ubuntu/cephtest/archive/cbt/results/00000000/id-c9606d7c 2026-02-20T12:09:25.507 INFO:teuthology.orchestra.run.trial063.stderr:12:09:25 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com if [ -d "/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread" ]; then rm -rf /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread; fi 2026-02-20T12:09:25.676 INFO:teuthology.orchestra.run.trial063.stderr:12:09:25 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread 2026-02-20T12:09:25.839 INFO:teuthology.orchestra.run.trial063.stderr:12:09:25 - INFO - cbt - Pausing for 60s for idle monitoring. 2026-02-20T12:09:25.839 INFO:teuthology.orchestra.run.trial063.stderr:12:09:25 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/idle_monitoring/collectl 2026-02-20T12:09:25.997 INFO:teuthology.orchestra.run.trial063.stderr:12:09:25 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com collectl -s+mYZ -i 1:10 -F0 -f /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/idle_monitoring/collectl --rawdskfilt \"+cciss/c\d+d\d+ |hd[ab] | sd[a-z]+ |dm-\d+ |xvd[a-z] |fio[a-z]+ | vd[a-z]+ |emcpower[a-z]+ |psv\d+ |nvme[0-9]n[0-9]+p[0-9]+ \" 2026-02-20T12:09:25.999 INFO:teuthology.orchestra.run.trial063.stderr:12:09:25 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/idle_monitoring/perf 2026-02-20T12:09:26.165 INFO:teuthology.orchestra.run.trial063.stderr:12:09:26 - DEBUG - cbt - PerfMonitoring: remote_node 2026-02-20T12:09:26.166 INFO:teuthology.orchestra.run.trial063.stderr:12:09:26 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com for pid in `cat /var/run/ceph/crimson-osd.*.pid`; do perf stat -p ${pid} -o /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/idle_monitoring/perf/perf_stat.${pid} & done 2026-02-20T12:10:26.228 INFO:teuthology.orchestra.run.trial063.stderr:12:10:26 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com pkill -SIGINT -f collectl 2026-02-20T12:10:26.411 INFO:teuthology.orchestra.run.trial063.stderr:12:10:26 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo pkill -SIGINT -f perf\ 2026-02-20T12:10:26.591 INFO:teuthology.orchestra.run.trial063.stderr:12:10:26 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo chown -R ubuntu.ubuntu /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/* 2026-02-20T12:10:26.762 INFO:teuthology.orchestra.run.trial063.stderr:12:10:26 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=rpdcp -f 10 -R ssh -w ubuntu@trial063.front.sepia.ceph.com -r /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/* /home/ubuntu/cephtest/archive/cbt/results/00000000/id-c9606d7c 2026-02-20T12:10:26.926 INFO:teuthology.orchestra.run.trial063.stderr:12:10:26 - INFO - cbt - Creating fio images... 2026-02-20T12:10:26.927 INFO:teuthology.orchestra.run.trial063.stderr:12:10:26 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/pool_monitoring/collectl 2026-02-20T12:10:27.082 INFO:teuthology.orchestra.run.trial063.stderr:12:10:27 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com collectl -s+mYZ -i 1:10 -F0 -f /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/pool_monitoring/collectl --rawdskfilt \"+cciss/c\d+d\d+ |hd[ab] | sd[a-z]+ |dm-\d+ |xvd[a-z] |fio[a-z]+ | vd[a-z]+ |emcpower[a-z]+ |psv\d+ |nvme[0-9]n[0-9]+p[0-9]+ \" 2026-02-20T12:10:27.084 INFO:teuthology.orchestra.run.trial063.stderr:12:10:27 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/pool_monitoring/perf 2026-02-20T12:10:27.241 INFO:teuthology.orchestra.run.trial063.stderr:12:10:27 - DEBUG - cbt - PerfMonitoring: remote_node 2026-02-20T12:10:27.242 INFO:teuthology.orchestra.run.trial063.stderr:12:10:27 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com for pid in `cat /var/run/ceph/crimson-osd.*.pid`; do perf stat -p ${pid} -o /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/pool_monitoring/perf/perf_stat.${pid} & done 2026-02-20T12:10:27.243 INFO:teuthology.orchestra.run.trial063.stderr:12:10:27 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool delete cbt-librbdfio cbt-librbdfio --yes-i-really-really-mean-it 2026-02-20T12:10:27.590 INFO:teuthology.orchestra.run.trial063.stderr:12:10:27 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool create cbt-librbdfio 128 128 2026-02-20T12:10:28.633 INFO:teuthology.orchestra.run.trial063.stderr:12:10:28 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool application enable cbt-librbdfio rbd 2026-02-20T12:10:29.633 INFO:teuthology.orchestra.run.trial063.stderr:12:10:29 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool set cbt-librbdfio size 3 2026-02-20T12:10:30.639 INFO:teuthology.orchestra.run.trial063.stderr:12:10:30 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool set cbt-librbdfio min_size 2 2026-02-20T12:10:31.644 INFO:teuthology.orchestra.run.trial063.stderr:12:10:31 - INFO - cbt - Checking Health after pool creation. 2026-02-20T12:10:36.648 INFO:teuthology.orchestra.run.trial063.stderr:12:10:36 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com /usr/bin/ceph -c /etc/ceph/ceph.conf health 2026-02-20T12:10:37.005 INFO:teuthology.orchestra.run.trial063.stderr:12:10:37 - INFO - cbt - Final Pool Health Check. 2026-02-20T12:10:42.009 INFO:teuthology.orchestra.run.trial063.stderr:12:10:42 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com /usr/bin/ceph -c /etc/ceph/ceph.conf health 2026-02-20T12:10:42.363 INFO:teuthology.orchestra.run.trial063.stderr:12:10:42 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com hostname -f 2026-02-20T12:10:42.521 INFO:teuthology.orchestra.run.trial063.stderr:12:10:42 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com /usr/bin/rbd -c /etc/ceph/ceph.conf create cbt-librbdfio-trial063-0 --size 4096 --pool cbt-librbdfio --order 22 2026-02-20T12:10:44.715 INFO:teuthology.orchestra.run.trial063.stderr:12:10:44 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com /usr/bin/rbd -c /etc/ceph/ceph.conf create cbt-librbdfio-trial063-1 --size 4096 --pool cbt-librbdfio --order 22 2026-02-20T12:10:44.936 INFO:teuthology.orchestra.run.trial063.stderr:12:10:44 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com pkill -SIGINT -f collectl 2026-02-20T12:10:45.122 INFO:teuthology.orchestra.run.trial063.stderr:12:10:45 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo pkill -SIGINT -f perf\ 2026-02-20T12:10:45.306 INFO:teuthology.orchestra.run.trial063.stderr:12:10:45 - INFO - cbt - Attempting to prefill fio images... 2026-02-20T12:10:45.306 INFO:teuthology.orchestra.run.trial063.stderr:12:10:45 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-0 --invalidate=0 --rw=write --numjobs=1 --bs=4M --size 4096M --name=cbt-librbdfio-`hostname -f`-file-0 --output-format=json,normal > /dev/null 2026-02-20T12:10:45.307 INFO:teuthology.orchestra.run.trial063.stderr:12:10:45 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-1 --invalidate=0 --rw=write --numjobs=1 --bs=4M --size 4096M --name=cbt-librbdfio-`hostname -f`-file-0 --output-format=json,normal > /dev/null 2026-02-20T12:11:26.890 INFO:teuthology.orchestra.run.trial063.stderr:12:11:26 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-0 --invalidate=0 --rw=write --numjobs=1 --bs=4M --size 4096M --name=cbt-librbdfio-`hostname -f`-file-0 --output-format=json,normal > /dev/null 2026-02-20T12:11:26.891 INFO:teuthology.orchestra.run.trial063.stderr:12:11:26 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-1 --invalidate=0 --rw=write --numjobs=1 --bs=4M --size 4096M --name=cbt-librbdfio-`hostname -f`-file-0 --output-format=json,normal > /dev/null 2026-02-20T12:12:04.224 INFO:teuthology.orchestra.run.trial063.stderr:12:12:04 - INFO - cbt - Results dir: /home/ubuntu/cephtest/archive/cbt/results/00000000/id-c9606d7c 2026-02-20T12:12:04.224 INFO:teuthology.orchestra.run.trial063.stderr:12:12:04 - INFO - cbt - Skipping existing test in /home/ubuntu/cephtest/archive/cbt/results/00000000/id-c9606d7c. 2026-02-20T12:12:04.224 INFO:teuthology.orchestra.run.trial063.stderr:12:12:04 - INFO - cbt - Running benchmark /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread 2026-02-20T12:12:04.224 INFO:teuthology.orchestra.run.trial063.stderr:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-c9606d7c 2026-02-20T12:12:04.224 INFO:teuthology.orchestra.run.trial063.stderr:{'cmd_path': '/home/ubuntu/cephtest/fio/fio', 'log_avg_msec': 100, 'norandommap': True, 'pool_profile': 'rbd', 'time': 60, 'vol_size': 4096, 'iodepth': 32, 'mode': 'randread', 'op_size': 4096, 'osd_ra': 4096, 'procs_per_volume': 1, 'volumes_per_client': 2, 'benchmark': 'librbdfio', 'iteration': 0} == iteration 0 == 2026-02-20T12:12:04.225 INFO:teuthology.orchestra.run.trial063.stderr:12:12:04 - INFO - cbt - Setting OSD Read Ahead to: 4096 2026-02-20T12:12:04.225 INFO:teuthology.orchestra.run.trial063.stderr:12:12:04 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com find /dev/disk/by-partlabel/osd-device-*data -exec readlink {} \; | cut -d"/" -f 3 | sed "s/[0-9]$//" | xargs -I{} sudo sh -c "echo 4096 > /sys/block/'{}'/queue/read_ahead_kb" 2026-02-20T12:12:04.225 INFO:teuthology.orchestra.run.trial063.stderr:12:12:04 - DEBUG - cbt - Cleaning existing temporary run directory: /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread 2026-02-20T12:12:04.226 INFO:teuthology.orchestra.run.trial063.stderr:12:12:04 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo rm -rf /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread 2026-02-20T12:12:04.398 INFO:teuthology.orchestra.run.trial063.stderr:12:12:04 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sync 2026-02-20T12:12:04.639 INFO:teuthology.orchestra.run.trial063.stderr:12:12:04 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com echo 3 | sudo tee /proc/sys/vm/drop_caches 2026-02-20T12:12:06.075 INFO:teuthology.orchestra.run.trial063.stderr:12:12:06 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread 2026-02-20T12:12:06.266 INFO:teuthology.orchestra.run.trial063.stderr:12:12:06 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf daemon osd.0 config show > /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/ceph_settings.out 2026-02-20T12:12:31.576 INFO:teuthology.orchestra.run.trial063.stderr:12:12:31 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com echo "[`date`] ceph progress" >> /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/pgautoscaler.log;/usr/bin/ceph -c /etc/ceph/ceph.conf progress | tee -a /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/pgautoscaler.log 2026-02-20T12:12:31.941 INFO:teuthology.orchestra.run.trial063.stderr:12:12:31 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/collectl 2026-02-20T12:12:32.124 INFO:teuthology.orchestra.run.trial063.stderr:12:12:32 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com collectl -s+mYZ -i 1:10 -F0 -f /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/collectl --rawdskfilt \"+cciss/c\d+d\d+ |hd[ab] | sd[a-z]+ |dm-\d+ |xvd[a-z] |fio[a-z]+ | vd[a-z]+ |emcpower[a-z]+ |psv\d+ |nvme[0-9]n[0-9]+p[0-9]+ \" 2026-02-20T12:12:32.126 INFO:teuthology.orchestra.run.trial063.stderr:12:12:32 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/perf 2026-02-20T12:12:32.290 INFO:teuthology.orchestra.run.trial063.stderr:12:12:32 - DEBUG - cbt - PerfMonitoring: remote_node 2026-02-20T12:12:32.290 INFO:teuthology.orchestra.run.trial063.stderr:12:12:32 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com for pid in `cat /var/run/ceph/crimson-osd.*.pid`; do perf stat -p ${pid} -o /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/perf/perf_stat.${pid} & done 2026-02-20T12:12:32.292 INFO:teuthology.orchestra.run.trial063.stderr:12:12:32 - INFO - cbt - Running rbd fio randread test. 2026-02-20T12:12:32.292 INFO:teuthology.orchestra.run.trial063.stderr:12:12:32 - DEBUG - cbt - Using rbdname cbt-librbdfio-`hostname -f`-0 2026-02-20T12:12:32.292 INFO:teuthology.orchestra.run.trial063.stderr:12:12:32 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-0 --invalidate=0 --rw=randread --output-format=json,normal --runtime=60 --numjobs=1 --direct=1 --bs=4096B --iodepth=32 --end_fsync=0 --norandommap --write_iops_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/output.0 --write_bw_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/output.0 --write_lat_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/output.0 --log_avg_msec=100 --name=cbt-librbdfio-`hostname -f`-file-0 > /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/output.0 2026-02-20T12:12:32.293 INFO:teuthology.orchestra.run.trial063.stderr:12:12:32 - DEBUG - cbt - Using rbdname cbt-librbdfio-`hostname -f`-1 2026-02-20T12:12:32.294 INFO:teuthology.orchestra.run.trial063.stderr:12:12:32 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-1 --invalidate=0 --rw=randread --output-format=json,normal --runtime=60 --numjobs=1 --direct=1 --bs=4096B --iodepth=32 --end_fsync=0 --norandommap --write_iops_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/output.1 --write_bw_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/output.1 --write_lat_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/output.1 --log_avg_msec=100 --name=cbt-librbdfio-`hostname -f`-file-0 > /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/output.1 2026-02-20T12:13:32.889 INFO:teuthology.orchestra.run.trial063.stderr:12:13:32 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com pkill -SIGINT -f collectl 2026-02-20T12:13:33.067 INFO:teuthology.orchestra.run.trial063.stderr:12:13:33 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo pkill -SIGINT -f perf\ 2026-02-20T12:13:33.246 INFO:teuthology.orchestra.run.trial063.stderr:12:13:33 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/perf/perf.data 2026-02-20T12:13:33.247 INFO:teuthology.orchestra.run.trial063.stderr:12:13:33 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/perf/perf_stat.* 2026-02-20T12:13:33.249 INFO:teuthology.orchestra.run.trial063.stderr:12:13:33 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com find /var/run/ceph/ceph-osd*.asok -maxdepth 1 -exec sudo /usr/bin/ceph --admin-daemon {} dump_historic_ops \; > /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/historic_ops.out 2026-02-20T12:13:33.613 INFO:teuthology.orchestra.run.trial063.stderr:12:13:33 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial063.front.sepia.ceph.com sudo chown -R ubuntu.ubuntu /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/* 2026-02-20T12:13:33.785 INFO:teuthology.orchestra.run.trial063.stderr:12:13:33 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=rpdcp -f 10 -R ssh -w ubuntu@trial063.front.sepia.ceph.com -r /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread/* /home/ubuntu/cephtest/archive/cbt/results/00000000/id-c9606d7c 2026-02-20T12:13:33.953 INFO:teuthology.orchestra.run.trial063.stderr:12:13:33 - INFO - cbt - Convert results to json format. 2026-02-20T12:13:33.954 INFO:teuthology.orchestra.run.trial063.stdout:cleaning remote dir /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-00004096/concurrent_procs-002/iodepth-032/randread 2026-02-20T12:13:33.955 INFO:teuthology.orchestra.run.trial063.stdout:trial063: trial063 2026-02-20T12:13:33.955 INFO:teuthology.orchestra.run.trial063.stdout: 2026-02-20T12:13:33.955 INFO:teuthology.orchestra.run.trial063.stdout:['trial063'] 2026-02-20T12:13:33.966 DEBUG:teuthology.run_tasks:Unwinding manager cbt 2026-02-20T12:13:33.983 DEBUG:teuthology.orchestra.run.trial063:> rm --one-file-system -rf -- /home/ubuntu/cephtest/cbt 2026-02-20T12:13:34.009 DEBUG:teuthology.orchestra.run.trial063:> rm --one-file-system -rf -- /home/ubuntu/cephtest/fio 2026-02-20T12:13:34.088 INFO:tasks.cbt_performance:Collecting CBT performance data config 2026-02-20T12:13:34.089 INFO:tasks.cbt_performance:reading cbt preferences 2026-02-20T12:13:34.089 DEBUG:teuthology.orchestra.run.trial063:> find /home/ubuntu/cephtest -name 'json_output.*' 2026-02-20T12:13:34.146 INFO:teuthology.orchestra.run.trial063.stdout:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-c9606d7c/json_output.0.trial063.front.sepia.ceph.com 2026-02-20T12:13:34.146 INFO:teuthology.orchestra.run.trial063.stdout:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-c9606d7c/json_output.1.trial063.front.sepia.ceph.com 2026-02-20T12:13:34.148 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:13:34.148 DEBUG:teuthology.orchestra.run.trial063:> dd if=/home/ubuntu/cephtest/archive/cbt/results/00000000/id-c9606d7c/json_output.0.trial063.front.sepia.ceph.com of=/dev/stdout 2026-02-20T12:13:34.205 INFO:tasks.cbt_performance:reading total cpu cycles 2026-02-20T12:13:34.206 DEBUG:teuthology.orchestra.run.trial063:> find /home/ubuntu/cephtest/archive/cbt/results/00000000/id-c9606d7c -name 'perf_stat.*' 2026-02-20T12:13:34.262 INFO:tasks.cbt_performance:cpu_cycles_paths: [''] 2026-02-20T12:13:34.262 INFO:tasks.cbt_performance:total cpu cycles: 0 2026-02-20T12:13:34.263 DEBUG:teuthology.orchestra.run.trial063:> set -ex 2026-02-20T12:13:34.263 DEBUG:teuthology.orchestra.run.trial063:> dd if=/home/ubuntu/cephtest/archive/cbt/results/00000000/id-c9606d7c/json_output.1.trial063.front.sepia.ceph.com of=/dev/stdout 2026-02-20T12:13:34.320 INFO:tasks.cbt_performance:reading total cpu cycles 2026-02-20T12:13:34.321 DEBUG:teuthology.orchestra.run.trial063:> find /home/ubuntu/cephtest/archive/cbt/results/00000000/id-c9606d7c -name 'perf_stat.*' 2026-02-20T12:13:34.377 INFO:tasks.cbt_performance:cpu_cycles_paths: [''] 2026-02-20T12:13:34.377 INFO:tasks.cbt_performance:total cpu cycles: 0 2026-02-20T12:13:34.386 WARNING:tasks.cbt_performance:Could not send performance data to http://mira118.front.sepia.ceph.com:4000/cbt_performance: HTTPConnectionPool(host='mira118.front.sepia.ceph.com', port=4000): Max retries exceeded with url: /cbt_performance (Caused by NewConnectionError(': Failed to establish a new connection: [Errno -2] Name or service not known')) 2026-02-20T12:13:34.386 WARNING:tasks.cbt_performance:Continuing without performance data collection 2026-02-20T12:13:34.387 DEBUG:teuthology.run_tasks:Unwinding manager ssh_keys 2026-02-20T12:13:34.403 INFO:teuthology.task.ssh_keys:Cleaning up SSH keys 2026-02-20T12:13:34.403 INFO:teuthology.task.ssh_keys:cleaning up keys added for testing 2026-02-20T12:13:34.404 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on trial063.front.sepia.ceph.com 2026-02-20T12:13:34.404 DEBUG:teuthology.orchestra.run.trial063:> rm -- /home/ubuntu/.ssh/id_rsa 2026-02-20T12:13:34.433 DEBUG:teuthology.orchestra.run.trial063:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2026-02-20T12:13:34.489 DEBUG:teuthology.orchestra.run.trial063:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2026-02-20T12:13:34.546 INFO:teuthology.orchestra.run.trial063.stdout:"600" 2026-02-20T12:13:34.547 DEBUG:teuthology.orchestra.run.trial063:> mv -- /home/ubuntu/.ssh/authorized_keys_2026-02-20_12:08:54:055792 /home/ubuntu/.ssh/authorized_keys 2026-02-20T12:13:34.604 DEBUG:teuthology.orchestra.run.trial063:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2026-02-20T12:13:34.662 DEBUG:teuthology.orchestra.run.trial063:> rm /home/ubuntu/.ssh/config 2026-02-20T12:13:34.718 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-20T12:13:34.733 DEBUG:teuthology.orchestra.run.trial063:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-20T12:13:34.834 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:13:34.828+0000 7f8f2ba5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:13:34.835 INFO:teuthology.orchestra.run.trial063.stderr:2026-02-20T12:13:34.832+0000 7f8f2ba5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:13:34.959 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-20T12:13:34.959 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-20T12:13:34.959 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-20T12:13:34.960 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:13:37.135 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2026-02-20T12:13:41.061 INFO:tasks.ceph.osd.0:Stopped 2026-02-20T12:13:41.062 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-20T12:13:41.062 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:13:42.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2026-02-20T12:13:42.439 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2026-02-20T12:13:47.164 INFO:tasks.ceph.osd.1:Stopped 2026-02-20T12:13:47.164 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-20T12:13:47.164 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:13:47.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-20T12:13:47.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2026-02-20T12:13:52.844 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~5s 2026-02-20T12:13:53.266 INFO:tasks.ceph.osd.2:Stopped 2026-02-20T12:13:53.266 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-20T12:13:53.266 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-20T12:13:53.267 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:13:53.307 INFO:tasks.ceph.mgr.x:Stopped 2026-02-20T12:13:53.307 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-20T12:13:53.307 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-20T12:13:53.308 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:13:53.357 INFO:tasks.ceph.mon.a:Stopped 2026-02-20T12:13:53.357 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-20T12:13:53.358 DEBUG:teuthology.orchestra.run.trial063:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v '\(PG_' | grep -E -v '\(OSD_' | grep -E -v '\(OBJECT_' | grep -E -v 'overall HEALTH' | head -n 1 2026-02-20T12:13:53.424 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial063.front.sepia.ceph.com 2026-02-20T12:13:53.424 DEBUG:teuthology.orchestra.run.trial063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-20T12:13:53.494 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial063.front.sepia.ceph.com 2026-02-20T12:13:53.494 DEBUG:teuthology.orchestra.run.trial063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-20T12:13:53.565 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial063.front.sepia.ceph.com 2026-02-20T12:13:53.565 DEBUG:teuthology.orchestra.run.trial063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-20T12:13:53.634 INFO:tasks.ceph:Archiving mon data... 2026-02-20T12:13:53.636 DEBUG:teuthology.misc:Transferring archived files from trial063:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60620/data/mon.a.tgz 2026-02-20T12:13:53.636 DEBUG:teuthology.orchestra.run.trial063:> mktemp 2026-02-20T12:13:53.690 INFO:teuthology.orchestra.run.trial063.stdout:/tmp/tmp.VVwX2QRPmA 2026-02-20T12:13:53.691 DEBUG:teuthology.orchestra.run.trial063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.VVwX2QRPmA 2026-02-20T12:13:53.782 DEBUG:teuthology.orchestra.run.trial063:> sudo chmod 0666 /tmp/tmp.VVwX2QRPmA 2026-02-20T12:13:53.865 DEBUG:teuthology.orchestra.remote:trial063:/tmp/tmp.VVwX2QRPmA is 210KB 2026-02-20T12:13:53.957 DEBUG:teuthology.orchestra.run.trial063:> rm -fr /tmp/tmp.VVwX2QRPmA 2026-02-20T12:13:53.974 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-20T12:13:53.975 DEBUG:teuthology.orchestra.run.trial063:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-20T12:13:54.097 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-20T12:13:54.097 INFO:tasks.ceph:Archiving crash dumps... 2026-02-20T12:13:54.099 DEBUG:teuthology.misc:Transferring archived files from trial063:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60620/remote/trial063/crash 2026-02-20T12:13:54.100 DEBUG:teuthology.orchestra.run.trial063:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-20T12:13:54.162 INFO:tasks.ceph:Compressing logs... 2026-02-20T12:13:54.162 DEBUG:teuthology.orchestra.run.trial063:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T12:13:54.244 INFO:teuthology.orchestra.run.trial063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47699.log 2026-02-20T12:13:54.244 INFO:teuthology.orchestra.run.trial063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-20T12:13:54.244 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.47699.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-20T12:13:54.244 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-osd.2.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47699.log.gz 2026-02-20T12:13:54.244 INFO:teuthology.orchestra.run.trial063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-20T12:13:54.244 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42158.log 2026-02-20T12:13:54.245 INFO:teuthology.orchestra.run.trial063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49183.log 2026-02-20T12:13:54.245 INFO:teuthology.orchestra.run.trial063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41698.log 2026-02-20T12:13:54.245 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.42158.log: /var/log/ceph/ceph-client.admin.49183.log: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-20T12:13:54.245 INFO:teuthology.orchestra.run.trial063.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42158.log.gz 2026-02-20T12:13:54.245 INFO:teuthology.orchestra.run.trial063.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.49183.log.gz 2026-02-20T12:13:54.245 INFO:teuthology.orchestra.run.trial063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42253.log 2026-02-20T12:13:54.245 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.41698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48032.log 2026-02-20T12:13:54.245 INFO:teuthology.orchestra.run.trial063.stderr: 66.1% -- replaced with /var/log/ceph/ceph-client.admin.41698.log.gz 2026-02-20T12:13:54.245 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.42253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42400.log 2026-02-20T12:13:54.245 INFO:teuthology.orchestra.run.trial063.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42253.log.gz 2026-02-20T12:13:54.245 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.48032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41910.log 2026-02-20T12:13:54.245 INFO:teuthology.orchestra.run.trial063.stderr: 66.9% -- replaced with /var/log/ceph/ceph-client.admin.48032.log.gz 2026-02-20T12:13:54.246 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.42400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48616.log 2026-02-20T12:13:54.246 INFO:teuthology.orchestra.run.trial063.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42400.log.gz 2026-02-20T12:13:54.246 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.41910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47641.log 2026-02-20T12:13:54.246 INFO:teuthology.orchestra.run.trial063.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41910.log.gz 2026-02-20T12:13:54.246 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.48616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48210.log 2026-02-20T12:13:54.246 INFO:teuthology.orchestra.run.trial063.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48616.log.gz 2026-02-20T12:13:54.246 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.47641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48211.log 2026-02-20T12:13:54.246 INFO:teuthology.orchestra.run.trial063.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47641.log.gz 2026-02-20T12:13:54.246 INFO:teuthology.orchestra.run.trial063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41673.log 2026-02-20T12:13:54.246 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.48210.log: /var/log/ceph/ceph-client.admin.48211.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48210.log.gz 2026-02-20T12:13:54.246 INFO:teuthology.orchestra.run.trial063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41603.log 2026-02-20T12:13:54.247 INFO:teuthology.orchestra.run.trial063.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48211.log.gz 2026-02-20T12:13:54.247 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.41673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47811.log 2026-02-20T12:13:54.247 INFO:teuthology.orchestra.run.trial063.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41673.log.gz 2026-02-20T12:13:54.247 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.41603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47843.log 2026-02-20T12:13:54.247 INFO:teuthology.orchestra.run.trial063.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41603.log.gz 2026-02-20T12:13:54.247 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.47811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47755.log 2026-02-20T12:13:54.247 INFO:teuthology.orchestra.run.trial063.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47811.log.gz 2026-02-20T12:13:54.247 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.47843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41458.log 2026-02-20T12:13:54.247 INFO:teuthology.orchestra.run.trial063.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47843.log.gz 2026-02-20T12:13:54.247 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.47755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41131.log 2026-02-20T12:13:54.247 INFO:teuthology.orchestra.run.trial063.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47755.log.gz 2026-02-20T12:13:54.247 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.41458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40604.log 2026-02-20T12:13:54.248 INFO:teuthology.orchestra.run.trial063.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41458.log.gz 2026-02-20T12:13:54.248 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.41131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41812.log 2026-02-20T12:13:54.248 INFO:teuthology.orchestra.run.trial063.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41131.log.gz 2026-02-20T12:13:54.248 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.40604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40651.log 2026-02-20T12:13:54.248 INFO:teuthology.orchestra.run.trial063.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40604.log.gz 2026-02-20T12:13:54.248 INFO:teuthology.orchestra.run.trial063.stderr:gzip/var/log/ceph/ceph-client.admin.41812.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42160.log 2026-02-20T12:13:54.248 INFO:teuthology.orchestra.run.trial063.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41812.log.gz 2026-02-20T12:13:54.248 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.40651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41861.log 2026-02-20T12:13:54.248 INFO:teuthology.orchestra.run.trial063.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40651.log.gz 2026-02-20T12:13:54.248 INFO:teuthology.orchestra.run.trial063.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42160.log: -- /var/log/ceph/ceph-client.admin.42449.log 2026-02-20T12:13:54.248 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.41861.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.42160.log.gz 2026-02-20T12:13:54.249 INFO:teuthology.orchestra.run.trial063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48948.log 2026-02-20T12:13:54.249 INFO:teuthology.orchestra.run.trial063.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41861.log.gz 2026-02-20T12:13:54.249 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.42449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49184.log 2026-02-20T12:13:54.249 INFO:teuthology.orchestra.run.trial063.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42449.log.gz 2026-02-20T12:13:54.249 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.48948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47897.log 2026-02-20T12:13:54.249 INFO:teuthology.orchestra.run.trial063.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.48948.log.gz 2026-02-20T12:13:54.249 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.49184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41763.log 2026-02-20T12:13:54.249 INFO:teuthology.orchestra.run.trial063.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.49184.log.gz 2026-02-20T12:13:54.249 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.47897.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-20T12:13:54.249 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.41763.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47897.log.gz 2026-02-20T12:13:54.249 INFO:teuthology.orchestra.run.trial063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42159.log 2026-02-20T12:13:54.249 INFO:teuthology.orchestra.run.trial063.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41763.log.gz 2026-02-20T12:13:54.249 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47983.log 2026-02-20T12:13:54.250 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.42159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40882.log 2026-02-20T12:13:54.250 INFO:teuthology.orchestra.run.trial063.stderr: 86.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-20T12:13:54.250 INFO:teuthology.orchestra.run.trial063.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42159.log.gz 2026-02-20T12:13:54.250 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.47983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40835.log 2026-02-20T12:13:54.250 INFO:teuthology.orchestra.run.trial063.stderr: 67.7% -- replaced with /var/log/ceph/ceph-client.admin.47983.log.gz 2026-02-20T12:13:54.250 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.40882.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-20T12:13:54.250 INFO:teuthology.orchestra.run.trial063.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40882.log.gz 2026-02-20T12:13:54.250 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.40835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48615.log 2026-02-20T12:13:54.250 INFO:teuthology.orchestra.run.trial063.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40835.log.gz 2026-02-20T12:13:54.250 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42012.log 2026-02-20T12:13:54.250 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.48615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42011.log 2026-02-20T12:13:54.250 INFO:teuthology.orchestra.run.trial063.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.48615.log.gz 2026-02-20T12:13:54.251 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.42012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42013.log 2026-02-20T12:13:54.251 INFO:teuthology.orchestra.run.trial063.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42012.log.gz 2026-02-20T12:13:54.251 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.42011.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-20T12:13:54.251 INFO:teuthology.orchestra.run.trial063.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42011.log.gz 2026-02-20T12:13:54.251 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.42013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40788.log 2026-02-20T12:13:54.251 INFO:teuthology.orchestra.run.trial063.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42013.log.gz 2026-02-20T12:13:54.251 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47585.log 2026-02-20T12:13:54.251 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.40788.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.38808.log 2026-02-20T12:13:54.251 INFO:teuthology.orchestra.run.trial063.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40788.log.gz 2026-02-20T12:13:54.251 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.47585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42280.log 2026-02-20T12:13:54.251 INFO:teuthology.orchestra.run.trial063.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47585.log.gz 2026-02-20T12:13:54.251 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph.tmp-client.admin.38808.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-20T12:13:54.252 INFO:teuthology.orchestra.run.trial063.stderr: 66.9% -- replaced with /var/log/ceph/ceph.tmp-client.admin.38808.log.gz 2026-02-20T12:13:54.252 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.42280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40509.log 2026-02-20T12:13:54.252 INFO:teuthology.orchestra.run.trial063.stderr: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.42280.log.gz 2026-02-20T12:13:54.252 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49840.log 2026-02-20T12:13:54.252 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.40509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41101.log 2026-02-20T12:13:54.252 INFO:teuthology.orchestra.run.trial063.stderr: 87.2% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-20T12:13:54.252 INFO:teuthology.orchestra.run.trial063.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40509.log.gz 2026-02-20T12:13:54.252 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.49840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42351.log 2026-02-20T12:13:54.252 INFO:teuthology.orchestra.run.trial063.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49840.log.gz 2026-02-20T12:13:54.252 INFO:teuthology.orchestra.run.trial063.stderr:/var/log/ceph/ceph-client.admin.41101.log: /var/log/ceph/ceph-client.admin.42351.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41101.log.gz 2026-02-20T12:13:54.252 INFO:teuthology.orchestra.run.trial063.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42351.log.gz 2026-02-20T12:13:54.253 INFO:teuthology.orchestra.run.trial063.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-20T12:13:57.845 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2026-02-20T12:14:00.231 INFO:teuthology.orchestra.run.trial063.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-20T12:14:00.384 INFO:teuthology.orchestra.run.trial063.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-20T12:14:01.280 INFO:teuthology.orchestra.run.trial063.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-20T12:14:01.281 INFO:teuthology.orchestra.run.trial063.stderr: 2026-02-20T12:14:01.281 INFO:teuthology.orchestra.run.trial063.stderr:real 0m7.062s 2026-02-20T12:14:01.281 INFO:teuthology.orchestra.run.trial063.stderr:user 0m17.679s 2026-02-20T12:14:01.282 INFO:teuthology.orchestra.run.trial063.stderr:sys 0m1.489s 2026-02-20T12:14:01.282 INFO:tasks.ceph:Archiving logs... 2026-02-20T12:14:01.283 DEBUG:teuthology.misc:Transferring archived files from trial063:/var/log/ceph to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60620/remote/trial063/log 2026-02-20T12:14:01.284 DEBUG:teuthology.orchestra.run.trial063:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T12:14:02.693 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T12:14:02.767 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T12:14:02.779 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-20T12:14:02.779 DEBUG:teuthology.orchestra.run.trial063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T12:14:02.805 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-20T12:14:02.816 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-20T12:14:02.816 DEBUG:teuthology.orchestra.run.trial063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T12:14:02.859 INFO:teuthology.orchestra.run.trial063.stderr:bash: line 1: ntpq: command not found 2026-02-20T12:14:03.224 INFO:teuthology.orchestra.run.trial063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T12:14:03.224 INFO:teuthology.orchestra.run.trial063.stdout:=============================================================================== 2026-02-20T12:14:03.225 INFO:teuthology.orchestra.run.trial063.stdout:^- ip216-250-115-174.pbiaas> 2 6 377 48 -1378us[-1378us] +/- 115ms 2026-02-20T12:14:03.225 INFO:teuthology.orchestra.run.trial063.stdout:^* 50.205.57.38 1 6 377 48 +296us[ +304us] +/- 5160us 2026-02-20T12:14:03.225 INFO:teuthology.orchestra.run.trial063.stdout:^- 144.202.62.209.vultruser> 3 6 377 48 -1349us[-1349us] +/- 19ms 2026-02-20T12:14:03.225 INFO:teuthology.orchestra.run.trial063.stdout:^- 155.248.202.205 2 6 377 47 +232us[ +232us] +/- 70ms 2026-02-20T12:14:03.225 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-20T12:14:03.245 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-20T12:14:03.246 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-20T12:14:03.259 DEBUG:teuthology.orchestra.run.trial063:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T12:14:03.327 DEBUG:teuthology.orchestra.run.trial063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T12:14:03.354 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:14:03.355 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-20T12:14:03.371 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-20T12:14:03.386 INFO:teuthology.task.internal:Duration was 695.031285 seconds 2026-02-20T12:14:03.387 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-20T12:14:03.403 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-20T12:14:03.403 DEBUG:teuthology.orchestra.run.trial063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T12:14:03.443 INFO:teuthology.orchestra.run.trial063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T12:14:03.838 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-20T12:14:03.838 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial063.front.sepia.ceph.com 2026-02-20T12:14:03.838 DEBUG:teuthology.orchestra.run.trial063:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T12:14:03.896 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-20T12:14:03.896 DEBUG:teuthology.orchestra.run.trial063:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T12:14:04.002 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-20T12:14:04.002 DEBUG:teuthology.orchestra.run.trial063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T12:14:04.025 INFO:teuthology.orchestra.run.trial063.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T12:14:04.026 INFO:teuthology.orchestra.run.trial063.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T12:14:04.027 INFO:teuthology.orchestra.run.trial063.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T12:14:04.027 INFO:teuthology.orchestra.run.trial063.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T12:14:04.027 INFO:teuthology.orchestra.run.trial063.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T12:14:04.036 INFO:teuthology.orchestra.run.trial063.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T12:14:04.039 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-20T12:14:04.056 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-20T12:14:04.057 DEBUG:teuthology.orchestra.run.trial063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T12:14:04.104 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-20T12:14:04.131 DEBUG:teuthology.orchestra.run.trial063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T12:14:04.169 INFO:teuthology.orchestra.run.trial063.stdout:kernel.core_pattern = core 2026-02-20T12:14:04.186 DEBUG:teuthology.orchestra.run.trial063:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T12:14:04.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:14:04.243 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-20T12:14:04.261 INFO:teuthology.task.internal:Transferring archived files... 2026-02-20T12:14:04.262 DEBUG:teuthology.misc:Transferring archived files from trial063:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60620/remote/trial063 2026-02-20T12:14:04.262 DEBUG:teuthology.orchestra.run.trial063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T12:14:04.349 INFO:teuthology.task.internal:Removing archive directory... 2026-02-20T12:14:04.350 DEBUG:teuthology.orchestra.run.trial063:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T12:14:04.377 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-20T12:14:04.398 INFO:teuthology.task.internal:Not uploading archives. 2026-02-20T12:14:04.398 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-20T12:14:04.416 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-20T12:14:04.416 DEBUG:teuthology.orchestra.run.trial063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T12:14:04.433 INFO:teuthology.orchestra.run.trial063.stdout: 917576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 12:14 /home/ubuntu/cephtest 2026-02-20T12:14:04.435 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-20T12:14:04.463 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-20T12:14:04.500 INFO:teuthology.run:Summary data: description: crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/crimson_bluestore perf_ignorelist settings/optimized workloads/fio_4K_rand_read} duration: 695.0312852859497 flavor: debug owner: scheduled_jjperez@soko04.front.sepia.ceph.com success: true 2026-02-20T12:14:04.500 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T12:14:04.613 INFO:teuthology.run:pass