2026-02-20T11:24:55.335 INFO:root:teuthology version: 1.2.4.dev11+ge6d9099ce 2026-02-20T11:24:55.355 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T11:24:55.438 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60529 branch: wip-perezjos-crimson-only-19-02-2026-PR64439 description: crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/crimson_bluestore perf_ignorelist settings/optimized workloads/fio_4M_rand_read} email: null first_in_suite: false flavor: debug job_id: '60529' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-perezjos-crimson-only-19-02-2026-PR64439 ceph: conf: global: auth client required: none auth cluster required: none auth service required: none auth supported: none debug asok: 0/0 debug auth: 0/0 debug bdev: 0/0 debug bluefs: 0/0 debug bluestore: 0/0 debug buffer: 0/0 debug civetweb: 0/0 debug client: 0/0 debug compressor: 0/0 debug context: 0/0 debug crush: 0/0 debug crypto: 0/0 debug dpdk: 0/0 debug eventtrace: 0/0 debug filer: 0/0 debug filestore: 0/0 debug finisher: 0/0 debug fuse: 0/0 debug heartbeatmap: 0/0 debug javaclient: 0/0 debug journal: 0/0 debug journaler: 0/0 debug kstore: 0/0 debug leveldb: 0/0 debug lockdep: 0/0 debug mds: 0/0 debug mds balancer: 0/0 debug mds locker: 0/0 debug mds log: 0/0 debug mds log expire: 0/0 debug mds migrator: 0/0 debug memdb: 0/0 debug mgr: 0/0 debug mgrc: 0/0 debug mon: 0/0 debug monc: 0/0 debug ms: 0/0 debug objclass: 0/0 debug objectcacher: 0/0 debug objecter: 0/0 debug optracker: 0/0 debug osd: 0/0 debug paxos: 0/0 debug perfcounter: 0/0 debug rados: 0/0 debug rbd: 0/0 debug rbd mirror: 0/0 debug rbd replay: 0/0 debug refs: 0/0 debug rgw: 0/0 debug rgw lifecycle: 0/0 debug rgw notification: 0/0 debug rgw sync: 0/0 debug rocksdb: 0/0 debug striper: 0/0 debug throttle: 0/0 debug timer: 0/0 debug tp: 0/0 enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 0/0 debug ms: 0/0 debug paxos: 0/0 osd pool default crimson: true osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson cpu num: 4 crimson osd obc lru size: 10 debug alienstore: 20 debug bluefs: 20 debug bluestore: 20 debug filestore: 0/0 debug journal: 0/0 debug ms: 0/0 debug osd: 0/0 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true seastore cachepin size pershard: 64M seastore max concurrent transactions: 8 crimson_compat: true flavor: debug fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - \(PG_ - \(OSD_ - \(OBJECT_ - overall HEALTH sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} install: ceph: flavor: debug sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 445d5c9ba18a4040e70e25303230c36c77773acb owner: scheduled_jjperez@soko04.front.sepia.ceph.com priority: 101 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 1736 sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 445d5c9ba18a4040e70e25303230c36c77773acb targets: trial051.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBVMf4Mm/q/oyHB11iR/yYJdtkUQQQnAi6xXPBiSg+cWLd8G0DyKWc+GelYWN4ufSJQBsMjPEoAfDWVkyi64qd0= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: osd: debug monc: 20 wait-for-scrub: false - ssh_keys: null - cbt: benchmarks: librbdfio: iodepth: - 32 log_avg_msec: 100 mode: - randread norandommap: true op_size: - 4194304 osd_ra: - 4096 pool_profile: rbd procs_per_volume: - 1 time: 60 vol_size: 4096 volumes_per_client: - 2 cluster: iterations: 1 osds_per_node: 3 pool_profiles: rbd: pg_size: 128 pgp_size: 128 replication: 3 user: ubuntu monitoring_profiles: perf: args: stat -p {pid} -o {perf_dir}/perf_stat.{pid} nodes: - osds perf_cmd: perf pid_glob: crimson-osd.*.pid teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: reimage-ssh-down teuthology_sha1: e6d9099ce03dc21193fda653159ec82465c3a94a timestamp: 2026-02-20_10:21:31 tube: trial user: jjperez verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-20T11:24:55.438 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa; will attempt to use it 2026-02-20T11:24:55.439 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks 2026-02-20T11:24:55.439 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-20T11:24:55.440 INFO:teuthology.task.internal:Checking packages... 2026-02-20T11:24:55.441 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4' 2026-02-20T11:24:55.441 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T11:24:55.441 INFO:teuthology.packaging:ref: None 2026-02-20T11:24:55.441 INFO:teuthology.packaging:tag: None 2026-02-20T11:24:55.441 INFO:teuthology.packaging:branch: wip-perezjos-crimson-only-19-02-2026-PR64439 2026-02-20T11:24:55.441 INFO:teuthology.packaging:sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:24:55.441 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=wip-perezjos-crimson-only-19-02-2026-PR64439 2026-02-20T11:24:55.568 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5357.g0c3148ca 2026-02-20T11:24:55.569 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-20T11:24:55.581 INFO:teuthology.task.internal:no buildpackages task found 2026-02-20T11:24:55.581 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-20T11:24:55.593 INFO:teuthology.task.internal:Saving configuration 2026-02-20T11:24:55.611 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-20T11:24:55.624 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-20T11:24:55.704 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial051.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60529', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 11:21:31.038455', 'locked_by': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBVMf4Mm/q/oyHB11iR/yYJdtkUQQQnAi6xXPBiSg+cWLd8G0DyKWc+GelYWN4ufSJQBsMjPEoAfDWVkyi64qd0='} 2026-02-20T11:24:55.704 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-20T11:24:55.715 INFO:teuthology.task.internal:roles: ubuntu@trial051.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-20T11:24:55.715 INFO:teuthology.run_tasks:Running task console_log... 2026-02-20T11:24:55.800 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7a46eb050f40>, signals=[15]) 2026-02-20T11:24:55.800 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-20T11:24:55.812 INFO:teuthology.task.internal:Opening connections... 2026-02-20T11:24:55.812 DEBUG:teuthology.task.internal:connecting to ubuntu@trial051.front.sepia.ceph.com 2026-02-20T11:24:55.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:24:55.874 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-20T11:24:55.886 DEBUG:teuthology.orchestra.run.trial051:> uname -m 2026-02-20T11:24:55.944 INFO:teuthology.orchestra.run.trial051.stdout:x86_64 2026-02-20T11:24:55.944 DEBUG:teuthology.orchestra.run.trial051:> cat /etc/os-release 2026-02-20T11:24:56.000 INFO:teuthology.orchestra.run.trial051.stdout:NAME="CentOS Stream" 2026-02-20T11:24:56.001 INFO:teuthology.orchestra.run.trial051.stdout:VERSION="9" 2026-02-20T11:24:56.001 INFO:teuthology.orchestra.run.trial051.stdout:ID="centos" 2026-02-20T11:24:56.001 INFO:teuthology.orchestra.run.trial051.stdout:ID_LIKE="rhel fedora" 2026-02-20T11:24:56.001 INFO:teuthology.orchestra.run.trial051.stdout:VERSION_ID="9" 2026-02-20T11:24:56.001 INFO:teuthology.orchestra.run.trial051.stdout:PLATFORM_ID="platform:el9" 2026-02-20T11:24:56.001 INFO:teuthology.orchestra.run.trial051.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T11:24:56.001 INFO:teuthology.orchestra.run.trial051.stdout:ANSI_COLOR="0;31" 2026-02-20T11:24:56.001 INFO:teuthology.orchestra.run.trial051.stdout:LOGO="fedora-logo-icon" 2026-02-20T11:24:56.001 INFO:teuthology.orchestra.run.trial051.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T11:24:56.001 INFO:teuthology.orchestra.run.trial051.stdout:HOME_URL="https://centos.org/" 2026-02-20T11:24:56.002 INFO:teuthology.orchestra.run.trial051.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T11:24:56.002 INFO:teuthology.orchestra.run.trial051.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T11:24:56.002 INFO:teuthology.orchestra.run.trial051.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T11:24:56.002 INFO:teuthology.lock.ops:Updating trial051.front.sepia.ceph.com on lock server 2026-02-20T11:24:56.096 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-20T11:24:56.111 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-20T11:24:56.123 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-20T11:24:56.123 DEBUG:teuthology.orchestra.run.trial051:> test '!' -e /home/ubuntu/cephtest 2026-02-20T11:24:56.139 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-20T11:24:56.150 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-20T11:24:56.150 DEBUG:teuthology.orchestra.run.trial051:> test -z $(ls -A /var/lib/ceph) 2026-02-20T11:24:56.195 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-20T11:24:56.307 INFO:teuthology.run_tasks:Running task kernel... 2026-02-20T11:24:56.326 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-20T11:24:56.327 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-20T11:24:56.327 DEBUG:teuthology.orchestra.run.trial051:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T11:24:56.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:24:56.342 DEBUG:teuthology.orchestra.run.trial051:> uname -r 2026-02-20T11:24:56.398 INFO:teuthology.orchestra.run.trial051.stdout:5.14.0-681.el9.x86_64 2026-02-20T11:24:56.398 INFO:teuthology.task.kernel:Running kernel on trial051: 5.14.0-681.el9.x86_64 2026-02-20T11:24:56.398 DEBUG:teuthology.orchestra.run.trial051:> sudo yum install -y kernel 2026-02-20T11:24:57.651 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-20T11:25:00.786 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-20T11:25:04.883 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 7.8 MB 00:01 2026-02-20T11:25:05.720 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - Extras packages 160 kB/s | 20 kB 00:00 2026-02-20T11:25:06.788 INFO:teuthology.orchestra.run.trial051.stdout:Extra Packages for Enterprise Linux 20 MB/s | 20 MB 00:01 2026-02-20T11:25:10.018 INFO:teuthology.orchestra.run.trial051.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-20T11:25:11.025 INFO:teuthology.orchestra.run.trial051.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T11:25:11.025 INFO:teuthology.orchestra.run.trial051.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T11:25:11.045 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:25:11.045 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:25:11.045 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:25:11.073 DEBUG:teuthology.orchestra.run.trial051:> echo no | sudo yum reinstall kernel || true 2026-02-20T11:25:11.372 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 11:25:10 AM UTC. 2026-02-20T11:25:11.452 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:25:11.454 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:25:11.454 INFO:teuthology.orchestra.run.trial051.stdout: Package Architecture Version Repository Size 2026-02-20T11:25:11.454 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:25:11.454 INFO:teuthology.orchestra.run.trial051.stdout:Reinstalling: 2026-02-20T11:25:11.454 INFO:teuthology.orchestra.run.trial051.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:25:11.454 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:25:11.454 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-20T11:25:11.454 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:25:11.454 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:25:11.455 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 803 k 2026-02-20T11:25:11.455 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 0 2026-02-20T11:25:11.455 INFO:teuthology.orchestra.run.trial051.stderr:Operation aborted. 2026-02-20T11:25:11.474 INFO:teuthology.orchestra.run.trial051.stdout:Is this ok [y/N]: 2026-02-20T11:25:11.474 DEBUG:teuthology.orchestra.run.trial051:> sudo yum reinstall -y kernel || true 2026-02-20T11:25:11.778 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 11:25:10 AM UTC. 2026-02-20T11:25:11.858 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:25:11.859 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:25:11.859 INFO:teuthology.orchestra.run.trial051.stdout: Package Architecture Version Repository Size 2026-02-20T11:25:11.859 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:25:11.859 INFO:teuthology.orchestra.run.trial051.stdout:Reinstalling: 2026-02-20T11:25:11.859 INFO:teuthology.orchestra.run.trial051.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:25:11.859 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:25:11.859 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-20T11:25:11.859 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:25:11.859 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:25:11.859 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 803 k 2026-02-20T11:25:11.859 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 0 2026-02-20T11:25:11.859 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-20T11:25:12.634 INFO:teuthology.orchestra.run.trial051.stdout:kernel-5.14.0-681.el9.x86_64.rpm 1.1 MB/s | 803 kB 00:00 2026-02-20T11:25:12.634 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:25:12.634 INFO:teuthology.orchestra.run.trial051.stdout:Total 1.0 MB/s | 803 kB 00:00 2026-02-20T11:25:12.644 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-20T11:25:12.678 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-20T11:25:12.678 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-20T11:25:12.683 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-20T11:25:12.683 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-20T11:25:12.707 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-20T11:25:12.711 INFO:teuthology.orchestra.run.trial051.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:25:12.711 INFO:teuthology.orchestra.run.trial051.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:25:12.820 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:25:12.820 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:25:12.875 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:25:12.875 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:25:12.875 INFO:teuthology.orchestra.run.trial051.stdout:Reinstalled: 2026-02-20T11:25:12.875 INFO:teuthology.orchestra.run.trial051.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T11:25:12.875 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:25:12.875 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:25:12.903 DEBUG:teuthology.orchestra.run.trial051:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T11:25:12.928 INFO:teuthology.orchestra.run.trial051.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T11:25:12.929 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T11:25:12.929 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T11:25:12.929 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-20T11:25:12.929 DEBUG:teuthology.orchestra.run.trial051:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T11:25:12.992 INFO:teuthology.orchestra.run.trial051.stdout:ttyS1 2026-02-20T11:25:13.020 DEBUG:teuthology.parallel:result is None 2026-02-20T11:25:13.020 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-20T11:25:13.033 INFO:teuthology.task.internal:Creating test directory... 2026-02-20T11:25:13.033 DEBUG:teuthology.orchestra.run.trial051:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T11:25:13.077 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-20T11:25:13.091 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-20T11:25:13.102 INFO:teuthology.task.internal:Creating archive directory... 2026-02-20T11:25:13.102 DEBUG:teuthology.orchestra.run.trial051:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T11:25:13.137 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-20T11:25:13.148 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-20T11:25:13.148 DEBUG:teuthology.orchestra.run.trial051:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T11:25:13.197 INFO:teuthology.orchestra.run.trial051.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:25:13.206 INFO:teuthology.orchestra.run.trial051.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:25:13.208 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-20T11:25:13.218 INFO:teuthology.task.internal:Configuring sudo... 2026-02-20T11:25:13.218 DEBUG:teuthology.orchestra.run.trial051:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T11:25:13.271 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-20T11:25:13.283 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-20T11:25:13.283 DEBUG:teuthology.orchestra.run.trial051:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T11:25:13.327 DEBUG:teuthology.orchestra.run.trial051:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:25:14.932 DEBUG:teuthology.orchestra.run.trial051:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:25:14.956 DEBUG:teuthology.orchestra.run.trial051:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:25:15.119 DEBUG:teuthology.orchestra.run.trial051:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:25:15.143 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:25:15.143 DEBUG:teuthology.orchestra.run.trial051:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T11:25:15.207 DEBUG:teuthology.orchestra.run.trial051:> sudo service rsyslog restart 2026-02-20T11:25:15.275 INFO:teuthology.orchestra.run.trial051.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T11:25:15.738 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-20T11:25:15.750 INFO:teuthology.task.internal:Starting timer... 2026-02-20T11:25:15.750 INFO:teuthology.run_tasks:Running task pcp... 2026-02-20T11:25:15.772 INFO:teuthology.run_tasks:Running task selinux... 2026-02-20T11:25:15.791 DEBUG:teuthology.orchestra.run.trial051:> sudo service auditd rotate 2026-02-20T11:25:15.819 INFO:teuthology.orchestra.run.trial051.stdout:Rotating logs: 2026-02-20T11:25:15.821 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-20T11:25:15.821 DEBUG:teuthology.orchestra.run.trial051:> /usr/sbin/getenforce 2026-02-20T11:25:15.879 INFO:teuthology.orchestra.run.trial051.stdout:Permissive 2026-02-20T11:25:15.879 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial051.front.sepia.ceph.com': 'permissive'} 2026-02-20T11:25:15.880 DEBUG:teuthology.orchestra.run.trial051:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T11:25:15.945 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:25:15.945 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-20T11:25:15.946 DEBUG:teuthology.orchestra.run.trial051:> sudo /usr/sbin/setenforce permissive 2026-02-20T11:25:16.009 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-20T11:25:16.025 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-20T11:25:16.027 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-20T11:25:16.224 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-20T11:25:16.238 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-20T11:25:16.239 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial051.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-20T11:28:00.899 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial051.front.sepia.ceph.com')] 2026-02-20T11:28:00.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial051.front.sepia.ceph.com' 2026-02-20T11:28:00.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:28:01.015 DEBUG:teuthology.orchestra.run.trial051:> true 2026-02-20T11:28:01.088 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial051.front.sepia.ceph.com' 2026-02-20T11:28:01.088 INFO:teuthology.run_tasks:Running task clock... 2026-02-20T11:28:01.100 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-20T11:28:01.101 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T11:28:01.101 DEBUG:teuthology.orchestra.run.trial051:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T11:28:01.155 INFO:teuthology.orchestra.run.trial051.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T11:28:01.167 INFO:teuthology.orchestra.run.trial051.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T11:28:01.188 INFO:teuthology.orchestra.run.trial051.stderr:sudo: ntpd: command not found 2026-02-20T11:28:01.198 INFO:teuthology.orchestra.run.trial051.stdout:506 Cannot talk to daemon 2026-02-20T11:28:01.210 INFO:teuthology.orchestra.run.trial051.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T11:28:01.221 INFO:teuthology.orchestra.run.trial051.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T11:28:01.273 INFO:teuthology.orchestra.run.trial051.stderr:bash: line 1: ntpq: command not found 2026-02-20T11:28:01.581 INFO:teuthology.orchestra.run.trial051.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T11:28:01.581 INFO:teuthology.orchestra.run.trial051.stdout:=============================================================================== 2026-02-20T11:28:01.582 INFO:teuthology.orchestra.run.trial051.stdout:^? ntp1.glypnod.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:28:01.582 INFO:teuthology.orchestra.run.trial051.stdout:^? wsip-24-249-17-253.dc.dc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:28:01.582 INFO:teuthology.orchestra.run.trial051.stdout:^? ntp.sfo.icanbwell.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:28:01.582 INFO:teuthology.orchestra.run.trial051.stdout:^? ntp0.alb1.inoc.net 2 6 1 0 -181us[ -181us] +/- 4038us 2026-02-20T11:28:01.583 INFO:teuthology.run_tasks:Running task install... 2026-02-20T11:28:01.597 DEBUG:teuthology.task.install:project ceph 2026-02-20T11:28:01.597 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}} 2026-02-20T11:28:01.598 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'} 2026-02-20T11:28:01.598 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T11:28:01.606 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T11:28:01.606 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-20T11:28:01.607 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:28:01.608 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:28:01.872 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:28:01.873 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:28:02.228 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:28:02.228 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:28:02.229 DEBUG:teuthology.orchestra.run.trial051:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:28:02.255 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-20T11:28:02.255 DEBUG:teuthology.orchestra.run.trial051:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:28:02.321 DEBUG:teuthology.orchestra.run.trial051:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:28:02.394 DEBUG:teuthology.orchestra.run.trial051:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:28:02.458 INFO:teuthology.orchestra.run.trial051.stdout:check_obsoletes = 1 2026-02-20T11:28:02.459 DEBUG:teuthology.orchestra.run.trial051:> sudo yum clean all 2026-02-20T11:28:02.619 INFO:teuthology.orchestra.run.trial051.stdout:41 files removed 2026-02-20T11:28:02.635 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-radosgw 2026-02-20T11:28:03.483 INFO:teuthology.orchestra.run.trial051.stdout:ceph packages for x86_64 132 kB/s | 94 kB 00:00 2026-02-20T11:28:04.133 INFO:teuthology.orchestra.run.trial051.stdout:ceph noarch packages 39 kB/s | 24 kB 00:00 2026-02-20T11:28:04.724 INFO:teuthology.orchestra.run.trial051.stdout:ceph source packages 3.6 kB/s | 2.1 kB 00:00 2026-02-20T11:28:06.031 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - BaseOS 6.9 MB/s | 8.9 MB 00:01 2026-02-20T11:28:09.435 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 27 MB 00:02 2026-02-20T11:28:13.088 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 7.8 MB 00:01 2026-02-20T11:28:14.268 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 20 kB 00:00 2026-02-20T11:28:15.822 INFO:teuthology.orchestra.run.trial051.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2026-02-20T11:28:19.017 INFO:teuthology.orchestra.run.trial051.stdout:lab-extras 2.9 MB/s | 50 kB 00:00 2026-02-20T11:28:20.211 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:28:20.212 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:28:20.212 INFO:teuthology.orchestra.run.trial051.stdout: Package Arch Version Repository Size 2026-02-20T11:28:20.213 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:28:20.213 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-20T11:28:20.213 INFO:teuthology.orchestra.run.trial051.stdout: ceph-radosgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 11 M 2026-02-20T11:28:20.213 INFO:teuthology.orchestra.run.trial051.stdout:Upgrading: 2026-02-20T11:28:20.213 INFO:teuthology.orchestra.run.trial051.stdout: librados2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 3.3 M 2026-02-20T11:28:20.213 INFO:teuthology.orchestra.run.trial051.stdout: librbd1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.7 M 2026-02-20T11:28:20.213 INFO:teuthology.orchestra.run.trial051.stdout:Installing dependencies: 2026-02-20T11:28:20.213 INFO:teuthology.orchestra.run.trial051.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T11:28:20.213 INFO:teuthology.orchestra.run.trial051.stdout: ceph-base x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.1 M 2026-02-20T11:28:20.213 INFO:teuthology.orchestra.run.trial051.stdout: ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 21 M 2026-02-20T11:28:20.214 INFO:teuthology.orchestra.run.trial051.stdout: ceph-selinux x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 25 k 2026-02-20T11:28:20.214 INFO:teuthology.orchestra.run.trial051.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T11:28:20.214 INFO:teuthology.orchestra.run.trial051.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T11:28:20.214 INFO:teuthology.orchestra.run.trial051.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T11:28:20.214 INFO:teuthology.orchestra.run.trial051.stdout: libcephfs2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 860 k 2026-02-20T11:28:20.214 INFO:teuthology.orchestra.run.trial051.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T11:28:20.214 INFO:teuthology.orchestra.run.trial051.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T11:28:20.214 INFO:teuthology.orchestra.run.trial051.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T11:28:20.214 INFO:teuthology.orchestra.run.trial051.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T11:28:20.214 INFO:teuthology.orchestra.run.trial051.stdout: libradosstriper1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 263 k 2026-02-20T11:28:20.214 INFO:teuthology.orchestra.run.trial051.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T11:28:20.214 INFO:teuthology.orchestra.run.trial051.stdout: librgw2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.6 M 2026-02-20T11:28:20.215 INFO:teuthology.orchestra.run.trial051.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T11:28:20.215 INFO:teuthology.orchestra.run.trial051.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T11:28:20.215 INFO:teuthology.orchestra.run.trial051.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T11:28:20.215 INFO:teuthology.orchestra.run.trial051.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T11:28:20.215 INFO:teuthology.orchestra.run.trial051.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T11:28:20.215 INFO:teuthology.orchestra.run.trial051.stdout: python3-ceph-argparse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 45 k 2026-02-20T11:28:20.215 INFO:teuthology.orchestra.run.trial051.stdout: python3-ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 185 k 2026-02-20T11:28:20.215 INFO:teuthology.orchestra.run.trial051.stdout: python3-cephfs x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 204 k 2026-02-20T11:28:20.215 INFO:teuthology.orchestra.run.trial051.stdout: python3-rados x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 324 k 2026-02-20T11:28:20.215 INFO:teuthology.orchestra.run.trial051.stdout: python3-rbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 305 k 2026-02-20T11:28:20.215 INFO:teuthology.orchestra.run.trial051.stdout: python3-rgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 100 k 2026-02-20T11:28:20.215 INFO:teuthology.orchestra.run.trial051.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T11:28:20.216 INFO:teuthology.orchestra.run.trial051.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T11:28:20.216 INFO:teuthology.orchestra.run.trial051.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T11:28:20.216 INFO:teuthology.orchestra.run.trial051.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T11:28:20.216 INFO:teuthology.orchestra.run.trial051.stdout:Installing weak dependencies: 2026-02-20T11:28:20.216 INFO:teuthology.orchestra.run.trial051.stdout: libcephfs-daemon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:28:20.216 INFO:teuthology.orchestra.run.trial051.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 26 k 2026-02-20T11:28:20.216 INFO:teuthology.orchestra.run.trial051.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T11:28:20.216 INFO:teuthology.orchestra.run.trial051.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T11:28:20.216 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:28:20.216 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-20T11:28:20.216 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:28:20.216 INFO:teuthology.orchestra.run.trial051.stdout:Install 35 Packages 2026-02-20T11:28:20.217 INFO:teuthology.orchestra.run.trial051.stdout:Upgrade 2 Packages 2026-02-20T11:28:20.217 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:28:20.217 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 61 M 2026-02-20T11:28:20.217 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-20T11:28:26.980 INFO:teuthology.orchestra.run.trial051.stdout:(1/37): ceph-common-20.3.0-5357.g0c3148ca.el9.x 3.4 MB/s | 21 MB 00:06 2026-02-20T11:28:27.045 INFO:teuthology.orchestra.run.trial051.stdout:(2/37): ceph-selinux-20.3.0-5357.g0c3148ca.el9. 383 kB/s | 25 kB 00:00 2026-02-20T11:28:27.111 INFO:teuthology.orchestra.run.trial051.stdout:(3/37): libcephfs-daemon-20.3.0-5357.g0c3148ca. 563 kB/s | 37 kB 00:00 2026-02-20T11:28:27.176 INFO:teuthology.orchestra.run.trial051.stdout:(4/37): libcephfs-proxy2-20.3.0-5357.g0c3148ca. 393 kB/s | 26 kB 00:00 2026-02-20T11:28:27.445 INFO:teuthology.orchestra.run.trial051.stdout:(5/37): libcephfs2-20.3.0-5357.g0c3148ca.el9.x8 3.1 MB/s | 860 kB 00:00 2026-02-20T11:28:27.512 INFO:teuthology.orchestra.run.trial051.stdout:(6/37): libradosstriper1-20.3.0-5357.g0c3148ca. 3.8 MB/s | 263 kB 00:00 2026-02-20T11:28:29.000 INFO:teuthology.orchestra.run.trial051.stdout:(7/37): librgw2-20.3.0-5357.g0c3148ca.el9.x86_6 3.8 MB/s | 5.6 MB 00:01 2026-02-20T11:28:29.063 INFO:teuthology.orchestra.run.trial051.stdout:(8/37): python3-ceph-argparse-20.3.0-5357.g0c31 708 kB/s | 45 kB 00:00 2026-02-20T11:28:29.129 INFO:teuthology.orchestra.run.trial051.stdout:(9/37): python3-ceph-common-20.3.0-5357.g0c3148 2.8 MB/s | 185 kB 00:00 2026-02-20T11:28:29.195 INFO:teuthology.orchestra.run.trial051.stdout:(10/37): python3-cephfs-20.3.0-5357.g0c3148ca.e 3.0 MB/s | 204 kB 00:00 2026-02-20T11:28:29.330 INFO:teuthology.orchestra.run.trial051.stdout:(11/37): python3-rados-20.3.0-5357.g0c3148ca.el 2.3 MB/s | 324 kB 00:00 2026-02-20T11:28:29.533 INFO:teuthology.orchestra.run.trial051.stdout:(12/37): python3-rbd-20.3.0-5357.g0c3148ca.el9. 1.5 MB/s | 305 kB 00:00 2026-02-20T11:28:29.596 INFO:teuthology.orchestra.run.trial051.stdout:(13/37): python3-rgw-20.3.0-5357.g0c3148ca.el9. 1.6 MB/s | 100 kB 00:00 2026-02-20T11:28:29.607 INFO:teuthology.orchestra.run.trial051.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 3.1 MB/s | 33 kB 00:00 2026-02-20T11:28:29.627 INFO:teuthology.orchestra.run.trial051.stdout:(15/37): nvme-cli-2.16-1.el9.x86_64.rpm 57 MB/s | 1.2 MB 00:00 2026-02-20T11:28:29.632 INFO:teuthology.orchestra.run.trial051.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 18 MB/s | 93 kB 00:00 2026-02-20T11:28:29.637 INFO:teuthology.orchestra.run.trial051.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 23 MB/s | 104 kB 00:00 2026-02-20T11:28:29.643 INFO:teuthology.orchestra.run.trial051.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 27 MB/s | 164 kB 00:00 2026-02-20T11:28:29.649 INFO:teuthology.orchestra.run.trial051.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 25 MB/s | 160 kB 00:00 2026-02-20T11:28:29.654 INFO:teuthology.orchestra.run.trial051.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 9.9 MB/s | 45 kB 00:00 2026-02-20T11:28:29.661 INFO:teuthology.orchestra.run.trial051.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 90 MB/s | 662 kB 00:00 2026-02-20T11:28:29.668 INFO:teuthology.orchestra.run.trial051.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 43 MB/s | 292 kB 00:00 2026-02-20T11:28:29.674 INFO:teuthology.orchestra.run.trial051.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 38 MB/s | 240 kB 00:00 2026-02-20T11:28:29.678 INFO:teuthology.orchestra.run.trial051.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 8.5 MB/s | 37 kB 00:00 2026-02-20T11:28:29.683 INFO:teuthology.orchestra.run.trial051.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 14 MB/s | 66 kB 00:00 2026-02-20T11:28:29.865 INFO:teuthology.orchestra.run.trial051.stdout:(26/37): ceph-base-20.3.0-5357.g0c3148ca.el9.x8 576 kB/s | 5.1 MB 00:09 2026-02-20T11:28:29.973 INFO:teuthology.orchestra.run.trial051.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.0 MB/s | 308 kB 00:00 2026-02-20T11:28:29.998 INFO:teuthology.orchestra.run.trial051.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 991 kB/s | 25 kB 00:00 2026-02-20T11:28:30.008 INFO:teuthology.orchestra.run.trial051.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 5.0 MB/s | 49 kB 00:00 2026-02-20T11:28:30.026 INFO:teuthology.orchestra.run.trial051.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 3.7 MB/s | 67 kB 00:00 2026-02-20T11:28:30.068 INFO:teuthology.orchestra.run.trial051.stdout:(31/37): libarrow-9.0.0-15.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2026-02-20T11:28:30.079 INFO:teuthology.orchestra.run.trial051.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 15 MB/s | 838 kB 00:00 2026-02-20T11:28:30.090 INFO:teuthology.orchestra.run.trial051.stdout:(33/37): re2-20211101-20.el9.x86_64.rpm 8.6 MB/s | 191 kB 00:00 2026-02-20T11:28:30.202 INFO:teuthology.orchestra.run.trial051.stdout:(34/37): thrift-0.15.0-4.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2026-02-20T11:28:31.413 INFO:teuthology.orchestra.run.trial051.stdout:(35/37): librbd1-20.3.0-5357.g0c3148ca.el9.x86_ 2.2 MB/s | 2.7 MB 00:01 2026-02-20T11:28:32.624 INFO:teuthology.orchestra.run.trial051.stdout:(36/37): ceph-radosgw-20.3.0-5357.g0c3148ca.el9 968 kB/s | 11 MB 00:11 2026-02-20T11:28:32.904 INFO:teuthology.orchestra.run.trial051.stdout:(37/37): librados2-20.3.0-5357.g0c3148ca.el9.x8 1.2 MB/s | 3.3 MB 00:02 2026-02-20T11:28:32.907 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:32.908 INFO:teuthology.orchestra.run.trial051.stdout:Total 4.8 MB/s | 61 MB 00:12 2026-02-20T11:28:33.010 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-20T11:28:33.028 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-20T11:28:33.028 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-20T11:28:33.279 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-20T11:28:33.280 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-20T11:28:33.572 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-20T11:28:33.713 INFO:teuthology.orchestra.run.trial051.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-20T11:28:33.718 INFO:teuthology.orchestra.run.trial051.stdout: Upgrading : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:28:33.769 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:28:33.770 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:28:33.783 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:28:33.785 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 4/39 2026-02-20T11:28:33.786 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:28:33.813 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:28:33.815 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 6/39 2026-02-20T11:28:33.823 INFO:teuthology.orchestra.run.trial051.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-20T11:28:33.826 INFO:teuthology.orchestra.run.trial051.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-20T11:28:33.831 INFO:teuthology.orchestra.run.trial051.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-20T11:28:33.835 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-20T11:28:33.846 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 11/39 2026-02-20T11:28:33.859 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:28:33.860 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:28:33.881 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:28:33.885 INFO:teuthology.orchestra.run.trial051.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-20T11:28:33.915 INFO:teuthology.orchestra.run.trial051.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-20T11:28:33.918 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-20T11:28:33.925 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-20T11:28:33.927 INFO:teuthology.orchestra.run.trial051.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-20T11:28:33.932 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-20T11:28:34.046 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:28:34.047 INFO:teuthology.orchestra.run.trial051.stdout: Upgrading : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:28:34.072 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:28:34.075 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 22/39 2026-02-20T11:28:34.081 INFO:teuthology.orchestra.run.trial051.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-20T11:28:34.329 INFO:teuthology.orchestra.run.trial051.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-20T11:28:34.330 INFO:teuthology.orchestra.run.trial051.stdout: Installing : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:28:34.347 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:28:34.351 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 26/39 2026-02-20T11:28:34.355 INFO:teuthology.orchestra.run.trial051.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-20T11:28:34.358 INFO:teuthology.orchestra.run.trial051.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-20T11:28:34.359 INFO:teuthology.orchestra.run.trial051.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:28:34.377 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:28:34.492 INFO:teuthology.orchestra.run.trial051.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-20T11:28:34.494 INFO:teuthology.orchestra.run.trial051.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:28:34.779 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:28:34.779 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T11:28:34.779 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:28:34.822 INFO:teuthology.orchestra.run.trial051.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-20T11:28:34.825 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 33/39 2026-02-20T11:28:35.773 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:28:35.776 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:28:36.043 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:28:36.047 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:28:36.088 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:28:36.088 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T11:28:36.088 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T11:28:36.088 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:28:36.090 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:28:40.635 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:28:40.635 INFO:teuthology.orchestra.run.trial051.stdout:skipping the directory /sys 2026-02-20T11:28:40.635 INFO:teuthology.orchestra.run.trial051.stdout:skipping the directory /proc 2026-02-20T11:28:40.635 INFO:teuthology.orchestra.run.trial051.stdout:skipping the directory /mnt 2026-02-20T11:28:40.635 INFO:teuthology.orchestra.run.trial051.stdout:skipping the directory /var/tmp 2026-02-20T11:28:40.635 INFO:teuthology.orchestra.run.trial051.stdout:skipping the directory /home 2026-02-20T11:28:40.636 INFO:teuthology.orchestra.run.trial051.stdout:skipping the directory /root 2026-02-20T11:28:40.636 INFO:teuthology.orchestra.run.trial051.stdout:skipping the directory /tmp 2026-02-20T11:28:40.636 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:28:41.127 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:28:41.151 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:28:41.151 INFO:teuthology.orchestra.run.trial051.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:28:41.151 INFO:teuthology.orchestra.run.trial051.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T11:28:41.151 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:28:41.151 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:28:41.151 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:28:41.153 INFO:teuthology.orchestra.run.trial051.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:28:41.166 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:28:41.166 INFO:teuthology.orchestra.run.trial051.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:28:41.223 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:28:41.223 INFO:teuthology.orchestra.run.trial051.stdout:Creating group 'qat' with GID 992. 2026-02-20T11:28:41.223 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:28:41.522 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/39 2026-02-20T11:28:41.522 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:28:41.522 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:28:41.522 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/39 2026-02-20T11:28:41.522 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:28:41.522 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/39 2026-02-20T11:28:41.522 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 7/39 2026-02-20T11:28:41.522 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 8/39 2026-02-20T11:28:41.523 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 9/39 2026-02-20T11:28:41.523 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 10/39 2026-02-20T11:28:41.523 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 11/39 2026-02-20T11:28:41.523 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:28:41.523 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 13/39 2026-02-20T11:28:41.523 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 14/39 2026-02-20T11:28:41.523 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 15/39 2026-02-20T11:28:41.523 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-20T11:28:41.523 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-20T11:28:41.523 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-20T11:28:41.523 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-20T11:28:41.523 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:28:41.523 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-20T11:28:41.524 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-20T11:28:41.524 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-20T11:28:41.524 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-20T11:28:41.524 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-20T11:28:41.524 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-20T11:28:41.524 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-20T11:28:41.524 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-20T11:28:41.524 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-20T11:28:41.524 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-20T11:28:41.524 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-20T11:28:41.524 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-20T11:28:41.524 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-20T11:28:41.524 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-20T11:28:41.525 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-20T11:28:41.525 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:28:41.525 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-20T11:28:41.525 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 38/39 2026-02-20T11:28:41.582 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:28:41.583 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:28:41.583 INFO:teuthology.orchestra.run.trial051.stdout:Upgraded: 2026-02-20T11:28:41.583 INFO:teuthology.orchestra.run.trial051.stdout: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.583 INFO:teuthology.orchestra.run.trial051.stdout: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.583 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-20T11:28:41.583 INFO:teuthology.orchestra.run.trial051.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T11:28:41.583 INFO:teuthology.orchestra.run.trial051.stdout: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.583 INFO:teuthology.orchestra.run.trial051.stdout: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.583 INFO:teuthology.orchestra.run.trial051.stdout: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.583 INFO:teuthology.orchestra.run.trial051.stdout: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.583 INFO:teuthology.orchestra.run.trial051.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T11:28:41.584 INFO:teuthology.orchestra.run.trial051.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T11:28:41.584 INFO:teuthology.orchestra.run.trial051.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T11:28:41.584 INFO:teuthology.orchestra.run.trial051.stdout: libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.584 INFO:teuthology.orchestra.run.trial051.stdout: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.584 INFO:teuthology.orchestra.run.trial051.stdout: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.584 INFO:teuthology.orchestra.run.trial051.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T11:28:41.584 INFO:teuthology.orchestra.run.trial051.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T11:28:41.584 INFO:teuthology.orchestra.run.trial051.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T11:28:41.584 INFO:teuthology.orchestra.run.trial051.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T11:28:41.584 INFO:teuthology.orchestra.run.trial051.stdout: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.584 INFO:teuthology.orchestra.run.trial051.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T11:28:41.585 INFO:teuthology.orchestra.run.trial051.stdout: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.585 INFO:teuthology.orchestra.run.trial051.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T11:28:41.585 INFO:teuthology.orchestra.run.trial051.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T11:28:41.585 INFO:teuthology.orchestra.run.trial051.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T11:28:41.585 INFO:teuthology.orchestra.run.trial051.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T11:28:41.585 INFO:teuthology.orchestra.run.trial051.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T11:28:41.585 INFO:teuthology.orchestra.run.trial051.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T11:28:41.585 INFO:teuthology.orchestra.run.trial051.stdout: python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.585 INFO:teuthology.orchestra.run.trial051.stdout: python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.585 INFO:teuthology.orchestra.run.trial051.stdout: python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.585 INFO:teuthology.orchestra.run.trial051.stdout: python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.586 INFO:teuthology.orchestra.run.trial051.stdout: python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.586 INFO:teuthology.orchestra.run.trial051.stdout: python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.586 INFO:teuthology.orchestra.run.trial051.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T11:28:41.586 INFO:teuthology.orchestra.run.trial051.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T11:28:41.586 INFO:teuthology.orchestra.run.trial051.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T11:28:41.586 INFO:teuthology.orchestra.run.trial051.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T11:28:41.586 INFO:teuthology.orchestra.run.trial051.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T11:28:41.586 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:28:41.586 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:28:41.626 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-test 2026-02-20T11:28:41.935 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:22 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:28:42.018 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout: Package Arch Version Repository Size 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout: ceph-test x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 127 M 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout:Installing dependencies: 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout: libcephsqlite x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 153 k 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout:Install 12 Packages 2026-02-20T11:28:42.019 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:28:42.020 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 132 M 2026-02-20T11:28:42.020 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 989 M 2026-02-20T11:28:42.020 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-20T11:28:42.933 INFO:teuthology.orchestra.run.trial051.stdout:(1/12): libcephsqlite-20.3.0-5357.g0c3148ca.el9 345 kB/s | 153 kB 00:00 2026-02-20T11:28:43.476 INFO:teuthology.orchestra.run.trial051.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 42 kB/s | 23 kB 00:00 2026-02-20T11:28:43.489 INFO:teuthology.orchestra.run.trial051.stdout:(3/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 2.1 MB/s | 2.1 MB 00:01 2026-02-20T11:28:44.133 INFO:teuthology.orchestra.run.trial051.stdout:(4/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 143 kB/s | 94 kB 00:00 2026-02-20T11:28:44.632 INFO:teuthology.orchestra.run.trial051.stdout:(5/12): libasan8-15.2.1-7.el9.x86_64.rpm 459 kB/s | 525 kB 00:01 2026-02-20T11:28:44.840 INFO:teuthology.orchestra.run.trial051.stdout:(6/12): libubsan-11.5.0-14.el9.x86_64.rpm 249 kB/s | 176 kB 00:00 2026-02-20T11:28:44.984 INFO:teuthology.orchestra.run.trial051.stdout:(7/12): libxslt-1.1.34-12.el9.x86_64.rpm 663 kB/s | 233 kB 00:00 2026-02-20T11:28:45.422 INFO:teuthology.orchestra.run.trial051.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 692 kB/s | 303 kB 00:00 2026-02-20T11:28:45.514 INFO:teuthology.orchestra.run.trial051.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 692 kB/s | 64 kB 00:00 2026-02-20T11:28:45.761 INFO:teuthology.orchestra.run.trial051.stdout:(10/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 494 kB/s | 122 kB 00:00 2026-02-20T11:28:46.152 INFO:teuthology.orchestra.run.trial051.stdout:(11/12): protobuf-3.14.0-17.el9.x86_64.rpm 784 kB/s | 1.0 MB 00:01 2026-02-20T11:29:44.502 INFO:teuthology.orchestra.run.trial051.stdout:(12/12): ceph-test-20.3.0-5357.g0c3148ca.el9.x8 2.0 MB/s | 127 MB 01:02 2026-02-20T11:29:44.505 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:29:44.505 INFO:teuthology.orchestra.run.trial051.stdout:Total 2.1 MB/s | 132 MB 01:02 2026-02-20T11:29:44.575 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-20T11:29:44.586 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-20T11:29:44.586 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-20T11:29:45.017 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-20T11:29:45.017 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-20T11:29:45.473 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-20T11:29:45.482 INFO:teuthology.orchestra.run.trial051.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-20T11:29:45.491 INFO:teuthology.orchestra.run.trial051.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-20T11:29:45.496 INFO:teuthology.orchestra.run.trial051.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-20T11:29:45.500 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-20T11:29:45.503 INFO:teuthology.orchestra.run.trial051.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-20T11:29:45.507 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-20T11:29:45.508 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:29:45.525 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:29:45.528 INFO:teuthology.orchestra.run.trial051.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-20T11:29:45.538 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-20T11:29:45.546 INFO:teuthology.orchestra.run.trial051.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-20T11:29:45.547 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:29:52.519 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:29:52.537 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:29:53.321 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:29:53.321 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/12 2026-02-20T11:29:53.321 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/12 2026-02-20T11:29:53.322 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-20T11:29:53.322 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-20T11:29:53.322 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-20T11:29:53.322 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-20T11:29:53.322 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-20T11:29:53.322 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-20T11:29:53.322 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-20T11:29:53.322 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-20T11:29:53.322 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-20T11:29:53.374 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-20T11:29:53.375 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:29:53.375 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-20T11:29:53.375 INFO:teuthology.orchestra.run.trial051.stdout: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:29:53.375 INFO:teuthology.orchestra.run.trial051.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-20T11:29:53.375 INFO:teuthology.orchestra.run.trial051.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-20T11:29:53.375 INFO:teuthology.orchestra.run.trial051.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-20T11:29:53.375 INFO:teuthology.orchestra.run.trial051.stdout: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:29:53.375 INFO:teuthology.orchestra.run.trial051.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-20T11:29:53.375 INFO:teuthology.orchestra.run.trial051.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T11:29:53.375 INFO:teuthology.orchestra.run.trial051.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-20T11:29:53.376 INFO:teuthology.orchestra.run.trial051.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T11:29:53.376 INFO:teuthology.orchestra.run.trial051.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T11:29:53.376 INFO:teuthology.orchestra.run.trial051.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T11:29:53.376 INFO:teuthology.orchestra.run.trial051.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-20T11:29:53.376 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:29:53.376 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:29:53.415 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph 2026-02-20T11:29:53.725 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:01:34 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:29:53.812 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:29:53.815 INFO:teuthology.orchestra.run.trial051.stdout:======================================================================================= 2026-02-20T11:29:53.815 INFO:teuthology.orchestra.run.trial051.stdout: Package Arch Version Repository Size 2026-02-20T11:29:53.815 INFO:teuthology.orchestra.run.trial051.stdout:======================================================================================= 2026-02-20T11:29:53.815 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-20T11:29:53.815 INFO:teuthology.orchestra.run.trial051.stdout: ceph x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 6.5 k 2026-02-20T11:29:53.815 INFO:teuthology.orchestra.run.trial051.stdout:Installing dependencies: 2026-02-20T11:29:53.815 INFO:teuthology.orchestra.run.trial051.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T11:29:53.815 INFO:teuthology.orchestra.run.trial051.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 57 k 2026-02-20T11:29:53.815 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mds x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.0 M 2026-02-20T11:29:53.815 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 937 k 2026-02-20T11:29:53.816 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 297 k 2026-02-20T11:29:53.816 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 4.9 M 2026-02-20T11:29:53.816 INFO:teuthology.orchestra.run.trial051.stdout: ceph-osd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 163 k 2026-02-20T11:29:53.816 INFO:teuthology.orchestra.run.trial051.stdout: ceph-osd-classic x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 15 M 2026-02-20T11:29:53.816 INFO:teuthology.orchestra.run.trial051.stdout: ceph-osd-crimson x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 88 M 2026-02-20T11:29:53.816 INFO:teuthology.orchestra.run.trial051.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 17 k 2026-02-20T11:29:53.816 INFO:teuthology.orchestra.run.trial051.stdout: cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 1.0 M 2026-02-20T11:29:53.816 INFO:teuthology.orchestra.run.trial051.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T11:29:53.816 INFO:teuthology.orchestra.run.trial051.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T11:29:53.816 INFO:teuthology.orchestra.run.trial051.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T11:29:53.816 INFO:teuthology.orchestra.run.trial051.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T11:29:53.816 INFO:teuthology.orchestra.run.trial051.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T11:29:53.817 INFO:teuthology.orchestra.run.trial051.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T11:29:53.817 INFO:teuthology.orchestra.run.trial051.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T11:29:53.817 INFO:teuthology.orchestra.run.trial051.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T11:29:53.817 INFO:teuthology.orchestra.run.trial051.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T11:29:53.817 INFO:teuthology.orchestra.run.trial051.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T11:29:53.817 INFO:teuthology.orchestra.run.trial051.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T11:29:53.817 INFO:teuthology.orchestra.run.trial051.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T11:29:53.817 INFO:teuthology.orchestra.run.trial051.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T11:29:53.817 INFO:teuthology.orchestra.run.trial051.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T11:29:53.817 INFO:teuthology.orchestra.run.trial051.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T11:29:53.817 INFO:teuthology.orchestra.run.trial051.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T11:29:53.817 INFO:teuthology.orchestra.run.trial051.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T11:29:53.817 INFO:teuthology.orchestra.run.trial051.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T11:29:53.818 INFO:teuthology.orchestra.run.trial051.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T11:29:53.818 INFO:teuthology.orchestra.run.trial051.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T11:29:53.818 INFO:teuthology.orchestra.run.trial051.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T11:29:53.818 INFO:teuthology.orchestra.run.trial051.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T11:29:53.818 INFO:teuthology.orchestra.run.trial051.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T11:29:53.818 INFO:teuthology.orchestra.run.trial051.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T11:29:53.818 INFO:teuthology.orchestra.run.trial051.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T11:29:53.818 INFO:teuthology.orchestra.run.trial051.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T11:29:53.818 INFO:teuthology.orchestra.run.trial051.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T11:29:53.818 INFO:teuthology.orchestra.run.trial051.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T11:29:53.818 INFO:teuthology.orchestra.run.trial051.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T11:29:53.818 INFO:teuthology.orchestra.run.trial051.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T11:29:53.818 INFO:teuthology.orchestra.run.trial051.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T11:29:53.819 INFO:teuthology.orchestra.run.trial051.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T11:29:53.819 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T11:29:53.819 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T11:29:53.819 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T11:29:53.819 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T11:29:53.819 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T11:29:53.819 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T11:29:53.819 INFO:teuthology.orchestra.run.trial051.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T11:29:53.819 INFO:teuthology.orchestra.run.trial051.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T11:29:53.819 INFO:teuthology.orchestra.run.trial051.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T11:29:53.819 INFO:teuthology.orchestra.run.trial051.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T11:29:53.819 INFO:teuthology.orchestra.run.trial051.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T11:29:53.819 INFO:teuthology.orchestra.run.trial051.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T11:29:53.820 INFO:teuthology.orchestra.run.trial051.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T11:29:53.820 INFO:teuthology.orchestra.run.trial051.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T11:29:53.820 INFO:teuthology.orchestra.run.trial051.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T11:29:53.820 INFO:teuthology.orchestra.run.trial051.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T11:29:53.820 INFO:teuthology.orchestra.run.trial051.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T11:29:53.820 INFO:teuthology.orchestra.run.trial051.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T11:29:53.820 INFO:teuthology.orchestra.run.trial051.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T11:29:53.820 INFO:teuthology.orchestra.run.trial051.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T11:29:53.820 INFO:teuthology.orchestra.run.trial051.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T11:29:53.820 INFO:teuthology.orchestra.run.trial051.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T11:29:53.820 INFO:teuthology.orchestra.run.trial051.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T11:29:53.821 INFO:teuthology.orchestra.run.trial051.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T11:29:53.821 INFO:teuthology.orchestra.run.trial051.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T11:29:53.821 INFO:teuthology.orchestra.run.trial051.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T11:29:53.821 INFO:teuthology.orchestra.run.trial051.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T11:29:53.821 INFO:teuthology.orchestra.run.trial051.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T11:29:53.821 INFO:teuthology.orchestra.run.trial051.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T11:29:53.821 INFO:teuthology.orchestra.run.trial051.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T11:29:53.821 INFO:teuthology.orchestra.run.trial051.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T11:29:53.821 INFO:teuthology.orchestra.run.trial051.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T11:29:53.821 INFO:teuthology.orchestra.run.trial051.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T11:29:53.821 INFO:teuthology.orchestra.run.trial051.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T11:29:53.821 INFO:teuthology.orchestra.run.trial051.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T11:29:53.822 INFO:teuthology.orchestra.run.trial051.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T11:29:53.822 INFO:teuthology.orchestra.run.trial051.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T11:29:53.822 INFO:teuthology.orchestra.run.trial051.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T11:29:53.822 INFO:teuthology.orchestra.run.trial051.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T11:29:53.822 INFO:teuthology.orchestra.run.trial051.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T11:29:53.822 INFO:teuthology.orchestra.run.trial051.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T11:29:53.822 INFO:teuthology.orchestra.run.trial051.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T11:29:53.822 INFO:teuthology.orchestra.run.trial051.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T11:29:53.822 INFO:teuthology.orchestra.run.trial051.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T11:29:53.822 INFO:teuthology.orchestra.run.trial051.stdout:Installing weak dependencies: 2026-02-20T11:29:53.822 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 184 k 2026-02-20T11:29:53.822 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 51 M 2026-02-20T11:29:53.823 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 7.4 M 2026-02-20T11:29:53.823 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 22 k 2026-02-20T11:29:53.823 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-rook noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 50 k 2026-02-20T11:29:53.823 INFO:teuthology.orchestra.run.trial051.stdout: ceph-volume noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 301 k 2026-02-20T11:29:53.823 INFO:teuthology.orchestra.run.trial051.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T11:29:53.823 INFO:teuthology.orchestra.run.trial051.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T11:29:53.823 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:29:53.823 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-20T11:29:53.823 INFO:teuthology.orchestra.run.trial051.stdout:======================================================================================= 2026-02-20T11:29:53.823 INFO:teuthology.orchestra.run.trial051.stdout:Install 96 Packages 2026-02-20T11:29:53.823 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:29:53.824 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 226 M 2026-02-20T11:29:53.824 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 1.5 G 2026-02-20T11:29:53.824 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-20T11:29:54.357 INFO:teuthology.orchestra.run.trial051.stdout:(1/96): ceph-20.3.0-5357.g0c3148ca.el9.x86_64.r 25 kB/s | 6.5 kB 00:00 2026-02-20T11:29:54.805 INFO:teuthology.orchestra.run.trial051.stdout:(2/96): ceph-mgr-20.3.0-5357.g0c3148ca.el9.x86_ 1.3 MB/s | 937 kB 00:00 2026-02-20T11:29:54.866 INFO:teuthology.orchestra.run.trial051.stdout:(3/96): ceph-osd-20.3.0-5357.g0c3148ca.el9.x86_ 2.6 MB/s | 163 kB 00:00 2026-02-20T11:29:55.267 INFO:teuthology.orchestra.run.trial051.stdout:(4/96): ceph-mds-20.3.0-5357.g0c3148ca.el9.x86_ 1.7 MB/s | 2.0 MB 00:01 2026-02-20T11:29:55.893 INFO:teuthology.orchestra.run.trial051.stdout:(5/96): ceph-mon-20.3.0-5357.g0c3148ca.el9.x86_ 3.2 MB/s | 4.9 MB 00:01 2026-02-20T11:29:55.952 INFO:teuthology.orchestra.run.trial051.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5357.g0c 975 kB/s | 57 kB 00:00 2026-02-20T11:29:56.012 INFO:teuthology.orchestra.run.trial051.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5357.g0c3148ca. 3.0 MB/s | 184 kB 00:00 2026-02-20T11:30:00.739 INFO:teuthology.orchestra.run.trial051.stdout:(8/96): ceph-osd-classic-20.3.0-5357.g0c3148ca. 2.5 MB/s | 15 MB 00:05 2026-02-20T11:30:03.813 INFO:teuthology.orchestra.run.trial051.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-53 2.4 MB/s | 7.4 MB 00:03 2026-02-20T11:30:03.882 INFO:teuthology.orchestra.run.trial051.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5357.g0c3148 325 kB/s | 22 kB 00:00 2026-02-20T11:30:04.090 INFO:teuthology.orchestra.run.trial051.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5357.g0c3 1.4 MB/s | 297 kB 00:00 2026-02-20T11:30:04.156 INFO:teuthology.orchestra.run.trial051.stdout:(12/96): ceph-mgr-rook-20.3.0-5357.g0c3148ca.el 762 kB/s | 50 kB 00:00 2026-02-20T11:30:04.220 INFO:teuthology.orchestra.run.trial051.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5357.g0c 271 kB/s | 17 kB 00:00 2026-02-20T11:30:04.418 INFO:teuthology.orchestra.run.trial051.stdout:(14/96): ceph-volume-20.3.0-5357.g0c3148ca.el9. 1.5 MB/s | 301 kB 00:00 2026-02-20T11:30:04.959 INFO:teuthology.orchestra.run.trial051.stdout:(15/96): cephadm-20.3.0-5357.g0c3148ca.el9.noar 1.9 MB/s | 1.0 MB 00:00 2026-02-20T11:30:04.983 INFO:teuthology.orchestra.run.trial051.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 14 MB/s | 351 kB 00:00 2026-02-20T11:30:04.988 INFO:teuthology.orchestra.run.trial051.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 9.2 MB/s | 40 kB 00:00 2026-02-20T11:30:04.992 INFO:teuthology.orchestra.run.trial051.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 15 MB/s | 72 kB 00:00 2026-02-20T11:30:05.013 INFO:teuthology.orchestra.run.trial051.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 38 MB/s | 794 kB 00:00 2026-02-20T11:30:05.047 INFO:teuthology.orchestra.run.trial051.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 5.3 MB/s | 184 kB 00:00 2026-02-20T11:30:05.057 INFO:teuthology.orchestra.run.trial051.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 26 MB/s | 253 kB 00:00 2026-02-20T11:30:05.096 INFO:teuthology.orchestra.run.trial051.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 32 MB/s | 1.2 MB 00:00 2026-02-20T11:30:05.102 INFO:teuthology.orchestra.run.trial051.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 18 MB/s | 106 kB 00:00 2026-02-20T11:30:05.108 INFO:teuthology.orchestra.run.trial051.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 22 MB/s | 135 kB 00:00 2026-02-20T11:30:05.114 INFO:teuthology.orchestra.run.trial051.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 24 MB/s | 150 kB 00:00 2026-02-20T11:30:05.121 INFO:teuthology.orchestra.run.trial051.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 19 MB/s | 126 kB 00:00 2026-02-20T11:30:05.128 INFO:teuthology.orchestra.run.trial051.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 32 MB/s | 218 kB 00:00 2026-02-20T11:30:05.135 INFO:teuthology.orchestra.run.trial051.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 25 MB/s | 182 kB 00:00 2026-02-20T11:30:05.144 INFO:teuthology.orchestra.run.trial051.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 29 MB/s | 266 kB 00:00 2026-02-20T11:30:05.759 INFO:teuthology.orchestra.run.trial051.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 48 kB/s | 30 kB 00:00 2026-02-20T11:30:09.664 INFO:teuthology.orchestra.run.trial051.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 784 kB/s | 3.0 MB 00:03 2026-02-20T11:30:09.839 INFO:teuthology.orchestra.run.trial051.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 85 kB/s | 15 kB 00:00 2026-02-20T11:30:10.274 INFO:teuthology.orchestra.run.trial051.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 566 kB/s | 246 kB 00:00 2026-02-20T11:30:10.624 INFO:teuthology.orchestra.run.trial051.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 539 kB/s | 188 kB 00:00 2026-02-20T11:30:10.800 INFO:teuthology.orchestra.run.trial051.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 240 kB/s | 42 kB 00:00 2026-02-20T11:30:12.458 INFO:teuthology.orchestra.run.trial051.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 3.2 MB/s | 5.3 MB 00:01 2026-02-20T11:30:13.080 INFO:teuthology.orchestra.run.trial051.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 9.6 MB/s | 6.0 MB 00:00 2026-02-20T11:30:13.256 INFO:teuthology.orchestra.run.trial051.stdout:(38/96): python3-devel-3.9.25-3.el9.x86_64.rpm 1.4 MB/s | 244 kB 00:00 2026-02-20T11:30:13.433 INFO:teuthology.orchestra.run.trial051.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.4 MB/s | 249 kB 00:00 2026-02-20T11:30:13.608 INFO:teuthology.orchestra.run.trial051.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 271 kB/s | 48 kB 00:00 2026-02-20T11:30:13.785 INFO:teuthology.orchestra.run.trial051.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 1.0 MB/s | 177 kB 00:00 2026-02-20T11:30:14.050 INFO:teuthology.orchestra.run.trial051.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 4.6 MB/s | 1.2 MB 00:00 2026-02-20T11:30:14.226 INFO:teuthology.orchestra.run.trial051.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 198 kB/s | 35 kB 00:00 2026-02-20T11:30:14.848 INFO:teuthology.orchestra.run.trial051.stdout:(44/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 9.9 MB/s | 6.1 MB 00:00 2026-02-20T11:30:15.029 INFO:teuthology.orchestra.run.trial051.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 2.4 MB/s | 442 kB 00:00 2026-02-20T11:30:15.206 INFO:teuthology.orchestra.run.trial051.stdout:(46/96): python3-packaging-20.9-5.el9.noarch.rp 437 kB/s | 77 kB 00:00 2026-02-20T11:30:15.391 INFO:teuthology.orchestra.run.trial051.stdout:(47/96): python3-protobuf-3.14.0-17.el9.noarch. 1.4 MB/s | 267 kB 00:00 2026-02-20T11:30:15.571 INFO:teuthology.orchestra.run.trial051.stdout:(48/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 885 kB/s | 159 kB 00:00 2026-02-20T11:30:15.748 INFO:teuthology.orchestra.run.trial051.stdout:(49/96): python3-pyasn1-modules-0.4.8-6.el9.noa 1.5 MB/s | 279 kB 00:00 2026-02-20T11:30:15.923 INFO:teuthology.orchestra.run.trial051.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 306 kB/s | 54 kB 00:00 2026-02-20T11:30:17.527 INFO:teuthology.orchestra.run.trial051.stdout:(51/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 12 MB/s | 19 MB 00:01 2026-02-20T11:30:17.702 INFO:teuthology.orchestra.run.trial051.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 237 kB/s | 42 kB 00:00 2026-02-20T11:30:17.878 INFO:teuthology.orchestra.run.trial051.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 1.0 MB/s | 189 kB 00:00 2026-02-20T11:30:18.054 INFO:teuthology.orchestra.run.trial051.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 515 kB/s | 90 kB 00:00 2026-02-20T11:30:18.078 INFO:teuthology.orchestra.run.trial051.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 927 kB/s | 22 kB 00:00 2026-02-20T11:30:18.119 INFO:teuthology.orchestra.run.trial051.stdout:(56/96): protobuf-compiler-3.14.0-17.el9.x86_64 21 MB/s | 862 kB 00:00 2026-02-20T11:30:23.242 INFO:teuthology.orchestra.run.trial051.stdout:(57/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 108 kB/s | 551 kB 00:05 2026-02-20T11:30:23.246 INFO:teuthology.orchestra.run.trial051.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 5.8 MB/s | 19 kB 00:00 2026-02-20T11:30:23.250 INFO:teuthology.orchestra.run.trial051.stdout:(59/96): luarocks-3.9.2-5.el9.noarch.rpm 39 MB/s | 151 kB 00:00 2026-02-20T11:30:23.256 INFO:teuthology.orchestra.run.trial051.stdout:(60/96): python3-asyncssh-2.13.2-5.el9.noarch.r 95 MB/s | 548 kB 00:00 2026-02-20T11:30:23.259 INFO:teuthology.orchestra.run.trial051.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 9.1 MB/s | 29 kB 00:00 2026-02-20T11:30:23.263 INFO:teuthology.orchestra.run.trial051.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 18 MB/s | 60 kB 00:00 2026-02-20T11:30:23.266 INFO:teuthology.orchestra.run.trial051.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 13 MB/s | 43 kB 00:00 2026-02-20T11:30:23.269 INFO:teuthology.orchestra.run.trial051.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 9.9 MB/s | 32 kB 00:00 2026-02-20T11:30:23.273 INFO:teuthology.orchestra.run.trial051.stdout:(65/96): python3-certifi-2023.05.07-4.el9.noarc 4.4 MB/s | 14 kB 00:00 2026-02-20T11:30:23.277 INFO:teuthology.orchestra.run.trial051.stdout:(66/96): python3-cheroot-10.0.1-4.el9.noarch.rp 45 MB/s | 173 kB 00:00 2026-02-20T11:30:23.281 INFO:teuthology.orchestra.run.trial051.stdout:(67/96): python3-cherrypy-18.6.1-2.el9.noarch.r 78 MB/s | 358 kB 00:00 2026-02-20T11:30:23.286 INFO:teuthology.orchestra.run.trial051.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 62 MB/s | 254 kB 00:00 2026-02-20T11:30:23.296 INFO:teuthology.orchestra.run.trial051.stdout:(69/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 189 MB/s | 2.0 MB 00:00 2026-02-20T11:30:23.300 INFO:teuthology.orchestra.run.trial051.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 41 MB/s | 144 kB 00:00 2026-02-20T11:30:23.304 INFO:teuthology.orchestra.run.trial051.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 37 MB/s | 139 kB 00:00 2026-02-20T11:30:23.307 INFO:teuthology.orchestra.run.trial051.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 16 MB/s | 56 kB 00:00 2026-02-20T11:30:23.310 INFO:teuthology.orchestra.run.trial051.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 3.3 MB/s | 11 kB 00:00 2026-02-20T11:30:23.314 INFO:teuthology.orchestra.run.trial051.stdout:(74/96): python3-jaraco-classes-3.2.1-5.el9.noa 5.3 MB/s | 18 kB 00:00 2026-02-20T11:30:23.317 INFO:teuthology.orchestra.run.trial051.stdout:(75/96): python3-jaraco-collections-3.0.0-8.el9 6.9 MB/s | 23 kB 00:00 2026-02-20T11:30:23.321 INFO:teuthology.orchestra.run.trial051.stdout:(76/96): python3-jaraco-context-6.0.1-3.el9.noa 5.8 MB/s | 20 kB 00:00 2026-02-20T11:30:23.324 INFO:teuthology.orchestra.run.trial051.stdout:(77/96): python3-jaraco-functools-3.5.0-2.el9.n 5.8 MB/s | 19 kB 00:00 2026-02-20T11:30:23.327 INFO:teuthology.orchestra.run.trial051.stdout:(78/96): python3-jaraco-text-4.0.0-2.el9.noarch 7.9 MB/s | 26 kB 00:00 2026-02-20T11:30:23.334 INFO:teuthology.orchestra.run.trial051.stdout:(79/96): python3-kubernetes-26.1.0-3.el9.noarch 165 MB/s | 1.0 MB 00:00 2026-02-20T11:30:23.337 INFO:teuthology.orchestra.run.trial051.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 23 MB/s | 79 kB 00:00 2026-02-20T11:30:23.341 INFO:teuthology.orchestra.run.trial051.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 26 MB/s | 86 kB 00:00 2026-02-20T11:30:23.344 INFO:teuthology.orchestra.run.trial051.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 17 MB/s | 58 kB 00:00 2026-02-20T11:30:23.347 INFO:teuthology.orchestra.run.trial051.stdout:(83/96): python3-portend-3.1.0-2.el9.noarch.rpm 5.2 MB/s | 16 kB 00:00 2026-02-20T11:30:23.351 INFO:teuthology.orchestra.run.trial051.stdout:(84/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 27 MB/s | 90 kB 00:00 2026-02-20T11:30:23.354 INFO:teuthology.orchestra.run.trial051.stdout:(85/96): python3-repoze-lru-0.7-16.el9.noarch.r 9.2 MB/s | 31 kB 00:00 2026-02-20T11:30:23.358 INFO:teuthology.orchestra.run.trial051.stdout:(86/96): python3-routes-2.5.1-5.el9.noarch.rpm 51 MB/s | 188 kB 00:00 2026-02-20T11:30:23.361 INFO:teuthology.orchestra.run.trial051.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 18 MB/s | 59 kB 00:00 2026-02-20T11:30:23.365 INFO:teuthology.orchestra.run.trial051.stdout:(88/96): python3-saml-1.16.0-1.el9.noarch.rpm 36 MB/s | 125 kB 00:00 2026-02-20T11:30:23.368 INFO:teuthology.orchestra.run.trial051.stdout:(89/96): python3-tempora-5.0.0-2.el9.noarch.rpm 11 MB/s | 36 kB 00:00 2026-02-20T11:30:23.371 INFO:teuthology.orchestra.run.trial051.stdout:(90/96): python3-typing-extensions-4.15.0-1.el9 25 MB/s | 86 kB 00:00 2026-02-20T11:30:23.375 INFO:teuthology.orchestra.run.trial051.stdout:(91/96): python3-websocket-client-1.2.3-2.el9.n 26 MB/s | 90 kB 00:00 2026-02-20T11:30:23.378 INFO:teuthology.orchestra.run.trial051.stdout:(92/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 15 MB/s | 48 kB 00:00 2026-02-20T11:30:23.382 INFO:teuthology.orchestra.run.trial051.stdout:(93/96): python3-xmltodict-0.12.0-15.el9.noarch 6.8 MB/s | 22 kB 00:00 2026-02-20T11:30:23.385 INFO:teuthology.orchestra.run.trial051.stdout:(94/96): python3-zc-lockfile-2.0-10.el9.noarch. 6.3 MB/s | 20 kB 00:00 2026-02-20T11:30:24.722 INFO:teuthology.orchestra.run.trial051.stdout:(95/96): ceph-mgr-dashboard-20.3.0-5357.g0c3148 1.8 MB/s | 51 MB 00:28 2026-02-20T11:31:01.614 INFO:teuthology.orchestra.run.trial051.stdout:(96/96): ceph-osd-crimson-20.3.0-5357.g0c3148ca 1.3 MB/s | 88 MB 01:06 2026-02-20T11:31:01.616 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:01.616 INFO:teuthology.orchestra.run.trial051.stdout:Total 3.3 MB/s | 226 MB 01:07 2026-02-20T11:31:01.989 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-20T11:31:02.028 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-20T11:31:02.028 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-20T11:31:02.830 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-20T11:31:02.830 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-20T11:31:03.669 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-20T11:31:03.671 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-20T11:31:03.674 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-20T11:31:03.696 INFO:teuthology.orchestra.run.trial051.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-20T11:31:03.729 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-20T11:31:03.736 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-20T11:31:03.739 INFO:teuthology.orchestra.run.trial051.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-20T11:31:03.743 INFO:teuthology.orchestra.run.trial051.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-20T11:31:03.766 INFO:teuthology.orchestra.run.trial051.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-20T11:31:03.779 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-20T11:31:03.782 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-20T11:31:03.788 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-20T11:31:03.790 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-20T11:31:03.801 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-20T11:31:03.807 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-20T11:31:03.831 INFO:teuthology.orchestra.run.trial051.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-20T11:31:03.835 INFO:teuthology.orchestra.run.trial051.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-20T11:31:03.885 INFO:teuthology.orchestra.run.trial051.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-20T11:31:03.898 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-20T11:31:03.900 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-20T11:31:03.904 INFO:teuthology.orchestra.run.trial051.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-20T11:31:03.910 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-20T11:31:03.914 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-20T11:31:03.918 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-20T11:31:03.932 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-20T11:31:03.937 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-20T11:31:03.942 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-20T11:31:03.953 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-20T11:31:03.962 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-20T11:31:03.968 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-20T11:31:03.988 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-20T11:31:03.999 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-20T11:31:04.014 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-20T11:31:04.019 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-20T11:31:04.027 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-20T11:31:04.067 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-20T11:31:04.391 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-20T11:31:04.401 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-20T11:31:04.405 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-20T11:31:04.411 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-20T11:31:04.413 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-20T11:31:04.441 INFO:teuthology.orchestra.run.trial051.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-20T11:31:04.485 INFO:teuthology.orchestra.run.trial051.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-20T11:31:04.493 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-20T11:31:04.498 INFO:teuthology.orchestra.run.trial051.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-20T11:31:04.502 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-20T11:31:04.508 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-20T11:31:04.511 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-20T11:31:04.518 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-20T11:31:04.522 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-20T11:31:04.549 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-20T11:31:04.559 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-20T11:31:04.565 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-20T11:31:04.572 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-20T11:31:04.606 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-20T11:31:04.830 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-20T11:31:04.854 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-20T11:31:04.858 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-20T11:31:04.918 INFO:teuthology.orchestra.run.trial051.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-20T11:31:04.920 INFO:teuthology.orchestra.run.trial051.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-20T11:31:04.942 INFO:teuthology.orchestra.run.trial051.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-20T11:31:05.269 INFO:teuthology.orchestra.run.trial051.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-20T11:31:05.341 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-20T11:31:06.013 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-20T11:31:06.029 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-20T11:31:06.039 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-20T11:31:06.046 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-20T11:31:06.059 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-20T11:31:06.075 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-20T11:31:06.151 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-20T11:31:06.159 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-20T11:31:06.183 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-20T11:31:06.213 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-20T11:31:06.263 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-20T11:31:06.269 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-20T11:31:06.272 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-20T11:31:06.274 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-20T11:31:06.291 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:31:06.291 INFO:teuthology.orchestra.run.trial051.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T11:31:06.291 INFO:teuthology.orchestra.run.trial051.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T11:31:06.292 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:06.298 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:31:06.323 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:31:06.323 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T11:31:06.323 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:06.359 INFO:teuthology.orchestra.run.trial051.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-20T11:31:06.975 INFO:teuthology.orchestra.run.trial051.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-20T11:31:12.497 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 80/96 2026-02-20T11:31:12.561 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 81/96 2026-02-20T11:31:12.563 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:31:12.577 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:31:12.577 INFO:teuthology.orchestra.run.trial051.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:31:12.577 INFO:teuthology.orchestra.run.trial051.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T11:31:12.577 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:12.588 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:31:12.611 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:31:12.611 INFO:teuthology.orchestra.run.trial051.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:31:12.611 INFO:teuthology.orchestra.run.trial051.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T11:31:12.611 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:31:12.611 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:31:12.611 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:12.670 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:31:12.672 INFO:teuthology.orchestra.run.trial051.stdout: Installing : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:31:12.681 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 85/96 2026-02-20T11:31:12.705 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 86/96 2026-02-20T11:31:12.706 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:31:15.644 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:31:15.651 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:31:16.119 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:31:16.120 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:31:16.132 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:31:16.133 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:31:16.193 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:31:16.236 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 91/96 2026-02-20T11:31:16.237 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:31:16.258 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:31:16.259 INFO:teuthology.orchestra.run.trial051.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:31:16.259 INFO:teuthology.orchestra.run.trial051.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T11:31:16.259 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:31:16.259 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:31:16.259 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:16.270 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:31:16.495 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:31:16.497 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:31:16.517 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:31:16.517 INFO:teuthology.orchestra.run.trial051.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:31:16.517 INFO:teuthology.orchestra.run.trial051.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T11:31:16.517 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:31:16.518 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:31:16.518 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:16.602 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:31:16.622 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:31:16.622 INFO:teuthology.orchestra.run.trial051.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:31:16.622 INFO:teuthology.orchestra.run.trial051.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T11:31:16.622 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:31:16.622 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:31:16.622 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:16.623 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:31:16.629 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:31:16.652 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:31:18.060 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:31:18.060 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/96 2026-02-20T11:31:18.060 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/96 2026-02-20T11:31:18.060 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/96 2026-02-20T11:31:18.060 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/96 2026-02-20T11:31:18.060 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 5/96 2026-02-20T11:31:18.060 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/96 2026-02-20T11:31:18.061 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 7/96 2026-02-20T11:31:18.061 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 8/96 2026-02-20T11:31:18.061 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 9/96 2026-02-20T11:31:18.061 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 10/96 2026-02-20T11:31:18.061 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 11/96 2026-02-20T11:31:18.061 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 12/96 2026-02-20T11:31:18.061 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 13/96 2026-02-20T11:31:18.061 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 14/96 2026-02-20T11:31:18.061 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 15/96 2026-02-20T11:31:18.061 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 16/96 2026-02-20T11:31:18.061 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 17/96 2026-02-20T11:31:18.062 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-20T11:31:18.062 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-20T11:31:18.062 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-20T11:31:18.062 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-20T11:31:18.062 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-20T11:31:18.062 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-20T11:31:18.062 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-20T11:31:18.062 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-20T11:31:18.062 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-20T11:31:18.062 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-20T11:31:18.062 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-20T11:31:18.063 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-20T11:31:18.063 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-20T11:31:18.063 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-20T11:31:18.063 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-20T11:31:18.063 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-20T11:31:18.063 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-20T11:31:18.063 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-20T11:31:18.063 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-20T11:31:18.063 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-20T11:31:18.063 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-20T11:31:18.063 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-20T11:31:18.064 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-20T11:31:18.064 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-20T11:31:18.064 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-20T11:31:18.064 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-20T11:31:18.064 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-20T11:31:18.064 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-20T11:31:18.064 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-20T11:31:18.064 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-20T11:31:18.064 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-20T11:31:18.064 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-20T11:31:18.064 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-20T11:31:18.065 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-20T11:31:18.065 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-20T11:31:18.065 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-20T11:31:18.065 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-20T11:31:18.065 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-20T11:31:18.065 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-20T11:31:18.065 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-20T11:31:18.065 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-20T11:31:18.065 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-20T11:31:18.065 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-20T11:31:18.065 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-20T11:31:18.066 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-20T11:31:18.066 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-20T11:31:18.066 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-20T11:31:18.066 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-20T11:31:18.066 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-20T11:31:18.066 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-20T11:31:18.066 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-20T11:31:18.066 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-20T11:31:18.066 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-20T11:31:18.066 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-20T11:31:18.067 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-20T11:31:18.067 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-20T11:31:18.067 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-20T11:31:18.067 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-20T11:31:18.067 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-20T11:31:18.067 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-20T11:31:18.067 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-20T11:31:18.067 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-20T11:31:18.067 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-20T11:31:18.067 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-20T11:31:18.067 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-20T11:31:18.068 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-20T11:31:18.068 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-20T11:31:18.068 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-20T11:31:18.068 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-20T11:31:18.068 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-20T11:31:18.068 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-20T11:31:18.068 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-20T11:31:18.068 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-20T11:31:18.068 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-20T11:31:18.068 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-20T11:31:18.068 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-20T11:31:18.068 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-20T11:31:18.069 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-20T11:31:18.120 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-20T11:31:18.120 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:18.121 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-20T11:31:18.121 INFO:teuthology.orchestra.run.trial051.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T11:31:18.121 INFO:teuthology.orchestra.run.trial051.stdout: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:18.121 INFO:teuthology.orchestra.run.trial051.stdout: ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:18.121 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:18.121 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:18.121 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:18.121 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:18.121 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:18.121 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:18.122 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:18.122 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:18.122 INFO:teuthology.orchestra.run.trial051.stdout: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:18.122 INFO:teuthology.orchestra.run.trial051.stdout: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:18.122 INFO:teuthology.orchestra.run.trial051.stdout: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:18.122 INFO:teuthology.orchestra.run.trial051.stdout: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:18.122 INFO:teuthology.orchestra.run.trial051.stdout: ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:18.122 INFO:teuthology.orchestra.run.trial051.stdout: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:18.122 INFO:teuthology.orchestra.run.trial051.stdout: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:18.122 INFO:teuthology.orchestra.run.trial051.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T11:31:18.122 INFO:teuthology.orchestra.run.trial051.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T11:31:18.122 INFO:teuthology.orchestra.run.trial051.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T11:31:18.122 INFO:teuthology.orchestra.run.trial051.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T11:31:18.123 INFO:teuthology.orchestra.run.trial051.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T11:31:18.123 INFO:teuthology.orchestra.run.trial051.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T11:31:18.123 INFO:teuthology.orchestra.run.trial051.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T11:31:18.123 INFO:teuthology.orchestra.run.trial051.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T11:31:18.123 INFO:teuthology.orchestra.run.trial051.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T11:31:18.123 INFO:teuthology.orchestra.run.trial051.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:31:18.123 INFO:teuthology.orchestra.run.trial051.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T11:31:18.123 INFO:teuthology.orchestra.run.trial051.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T11:31:18.123 INFO:teuthology.orchestra.run.trial051.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T11:31:18.123 INFO:teuthology.orchestra.run.trial051.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T11:31:18.123 INFO:teuthology.orchestra.run.trial051.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T11:31:18.123 INFO:teuthology.orchestra.run.trial051.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T11:31:18.124 INFO:teuthology.orchestra.run.trial051.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T11:31:18.124 INFO:teuthology.orchestra.run.trial051.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T11:31:18.124 INFO:teuthology.orchestra.run.trial051.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T11:31:18.124 INFO:teuthology.orchestra.run.trial051.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T11:31:18.124 INFO:teuthology.orchestra.run.trial051.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T11:31:18.124 INFO:teuthology.orchestra.run.trial051.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T11:31:18.124 INFO:teuthology.orchestra.run.trial051.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T11:31:18.124 INFO:teuthology.orchestra.run.trial051.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T11:31:18.124 INFO:teuthology.orchestra.run.trial051.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T11:31:18.124 INFO:teuthology.orchestra.run.trial051.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T11:31:18.124 INFO:teuthology.orchestra.run.trial051.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T11:31:18.124 INFO:teuthology.orchestra.run.trial051.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T11:31:18.124 INFO:teuthology.orchestra.run.trial051.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T11:31:18.125 INFO:teuthology.orchestra.run.trial051.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T11:31:18.125 INFO:teuthology.orchestra.run.trial051.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T11:31:18.125 INFO:teuthology.orchestra.run.trial051.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T11:31:18.125 INFO:teuthology.orchestra.run.trial051.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T11:31:18.125 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T11:31:18.125 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T11:31:18.125 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T11:31:18.125 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T11:31:18.125 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T11:31:18.125 INFO:teuthology.orchestra.run.trial051.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T11:31:18.125 INFO:teuthology.orchestra.run.trial051.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T11:31:18.125 INFO:teuthology.orchestra.run.trial051.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T11:31:18.125 INFO:teuthology.orchestra.run.trial051.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T11:31:18.126 INFO:teuthology.orchestra.run.trial051.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:31:18.126 INFO:teuthology.orchestra.run.trial051.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T11:31:18.126 INFO:teuthology.orchestra.run.trial051.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T11:31:18.126 INFO:teuthology.orchestra.run.trial051.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T11:31:18.126 INFO:teuthology.orchestra.run.trial051.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T11:31:18.126 INFO:teuthology.orchestra.run.trial051.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T11:31:18.126 INFO:teuthology.orchestra.run.trial051.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T11:31:18.126 INFO:teuthology.orchestra.run.trial051.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T11:31:18.126 INFO:teuthology.orchestra.run.trial051.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T11:31:18.126 INFO:teuthology.orchestra.run.trial051.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T11:31:18.126 INFO:teuthology.orchestra.run.trial051.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T11:31:18.126 INFO:teuthology.orchestra.run.trial051.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T11:31:18.127 INFO:teuthology.orchestra.run.trial051.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T11:31:18.127 INFO:teuthology.orchestra.run.trial051.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T11:31:18.127 INFO:teuthology.orchestra.run.trial051.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T11:31:18.127 INFO:teuthology.orchestra.run.trial051.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T11:31:18.127 INFO:teuthology.orchestra.run.trial051.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T11:31:18.127 INFO:teuthology.orchestra.run.trial051.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T11:31:18.127 INFO:teuthology.orchestra.run.trial051.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T11:31:18.127 INFO:teuthology.orchestra.run.trial051.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T11:31:18.127 INFO:teuthology.orchestra.run.trial051.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T11:31:18.127 INFO:teuthology.orchestra.run.trial051.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T11:31:18.127 INFO:teuthology.orchestra.run.trial051.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T11:31:18.127 INFO:teuthology.orchestra.run.trial051.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T11:31:18.127 INFO:teuthology.orchestra.run.trial051.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T11:31:18.128 INFO:teuthology.orchestra.run.trial051.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T11:31:18.128 INFO:teuthology.orchestra.run.trial051.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T11:31:18.128 INFO:teuthology.orchestra.run.trial051.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T11:31:18.128 INFO:teuthology.orchestra.run.trial051.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T11:31:18.128 INFO:teuthology.orchestra.run.trial051.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T11:31:18.128 INFO:teuthology.orchestra.run.trial051.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T11:31:18.128 INFO:teuthology.orchestra.run.trial051.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T11:31:18.128 INFO:teuthology.orchestra.run.trial051.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T11:31:18.128 INFO:teuthology.orchestra.run.trial051.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T11:31:18.128 INFO:teuthology.orchestra.run.trial051.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T11:31:18.128 INFO:teuthology.orchestra.run.trial051.stdout: zip-3.0-35.el9.x86_64 2026-02-20T11:31:18.128 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:18.129 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:18.190 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-base 2026-02-20T11:31:18.502 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:02:59 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:18.567 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:18.586 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:18.586 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:18.587 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:18.609 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install cephadm 2026-02-20T11:31:18.921 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:02:59 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:18.985 INFO:teuthology.orchestra.run.trial051.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:31:19.003 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:19.004 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:19.004 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:19.026 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:31:19.336 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:00 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:19.419 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:19.420 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:19.420 INFO:teuthology.orchestra.run.trial051.stdout: Package Arch Version Repo Size 2026-02-20T11:31:19.420 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:19.420 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-20T11:31:19.420 INFO:teuthology.orchestra.run.trial051.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 149 k 2026-02-20T11:31:19.420 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:19.420 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-20T11:31:19.420 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:19.420 INFO:teuthology.orchestra.run.trial051.stdout:Install 1 Package 2026-02-20T11:31:19.421 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:19.421 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 149 k 2026-02-20T11:31:19.421 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 455 k 2026-02-20T11:31:19.421 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-20T11:31:19.975 INFO:teuthology.orchestra.run.trial051.stdout:ceph-immutable-object-cache-20.3.0-5357.g0c3148 270 kB/s | 149 kB 00:00 2026-02-20T11:31:19.976 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:19.976 INFO:teuthology.orchestra.run.trial051.stdout:Total 269 kB/s | 149 kB 00:00 2026-02-20T11:31:19.976 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-20T11:31:19.980 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-20T11:31:19.981 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-20T11:31:20.012 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-20T11:31:20.012 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-20T11:31:20.067 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-20T11:31:20.068 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:31:20.091 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:31:20.091 INFO:teuthology.orchestra.run.trial051.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:31:20.091 INFO:teuthology.orchestra.run.trial051.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T11:31:20.091 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:20.378 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:31:20.378 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:20.378 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-20T11:31:20.378 INFO:teuthology.orchestra.run.trial051.stdout: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:20.378 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:20.378 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:20.405 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-mgr 2026-02-20T11:31:20.720 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:01 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:20.785 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:20.803 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:20.804 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:20.804 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:20.826 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:31:21.138 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:02 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:21.205 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:31:21.223 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:21.224 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:21.224 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:21.246 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:31:21.550 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:02 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:21.615 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:31:21.633 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:21.634 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:21.634 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:21.655 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:31:21.958 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:02 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:22.025 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:31:22.043 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:22.044 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:22.044 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:22.065 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:31:22.374 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:03 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:22.438 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:31:22.456 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:22.457 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:22.458 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:22.478 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-osd 2026-02-20T11:31:22.782 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:03 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:22.846 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:22.864 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:22.865 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:22.865 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:22.887 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-osd-classic 2026-02-20T11:31:23.198 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:04 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:23.264 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:23.282 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:23.282 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:23.283 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:23.305 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-fuse 2026-02-20T11:31:23.611 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:04 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:23.696 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:23.696 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:23.697 INFO:teuthology.orchestra.run.trial051.stdout: Package Arch Version Repo Size 2026-02-20T11:31:23.697 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:23.697 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-20T11:31:23.697 INFO:teuthology.orchestra.run.trial051.stdout: ceph-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 914 k 2026-02-20T11:31:23.697 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:23.697 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-20T11:31:23.697 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:23.697 INFO:teuthology.orchestra.run.trial051.stdout:Install 1 Package 2026-02-20T11:31:23.697 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:23.697 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 914 k 2026-02-20T11:31:23.698 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 2.9 M 2026-02-20T11:31:23.698 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-20T11:31:24.579 INFO:teuthology.orchestra.run.trial051.stdout:ceph-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 1.0 MB/s | 914 kB 00:00 2026-02-20T11:31:24.579 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:24.579 INFO:teuthology.orchestra.run.trial051.stdout:Total 1.0 MB/s | 914 kB 00:00 2026-02-20T11:31:24.579 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-20T11:31:24.584 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-20T11:31:24.585 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-20T11:31:24.618 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-20T11:31:24.618 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-20T11:31:24.708 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-20T11:31:24.725 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:24.951 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:25.008 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:25.008 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:25.008 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-20T11:31:25.008 INFO:teuthology.orchestra.run.trial051.stdout: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:25.009 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:25.009 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:25.035 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-volume 2026-02-20T11:31:25.351 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:06 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:25.420 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:31:25.439 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:25.439 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:25.439 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:25.463 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install librados-devel 2026-02-20T11:31:25.774 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:06 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:25.857 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:25.858 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:25.858 INFO:teuthology.orchestra.run.trial051.stdout: Package Arch Version Repo Size 2026-02-20T11:31:25.858 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:25.858 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-20T11:31:25.859 INFO:teuthology.orchestra.run.trial051.stdout: librados-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 124 k 2026-02-20T11:31:25.859 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:25.859 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-20T11:31:25.859 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:25.859 INFO:teuthology.orchestra.run.trial051.stdout:Install 1 Package 2026-02-20T11:31:25.859 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:25.859 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 124 k 2026-02-20T11:31:25.859 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 434 k 2026-02-20T11:31:25.859 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-20T11:31:26.339 INFO:teuthology.orchestra.run.trial051.stdout:librados-devel-20.3.0-5357.g0c3148ca.el9.x86_64 257 kB/s | 124 kB 00:00 2026-02-20T11:31:26.339 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:26.340 INFO:teuthology.orchestra.run.trial051.stdout:Total 257 kB/s | 124 kB 00:00 2026-02-20T11:31:26.340 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-20T11:31:26.343 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-20T11:31:26.343 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-20T11:31:26.377 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-20T11:31:26.378 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-20T11:31:26.433 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-20T11:31:26.449 INFO:teuthology.orchestra.run.trial051.stdout: Installing : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:26.531 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:26.589 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:26.589 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:26.589 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-20T11:31:26.589 INFO:teuthology.orchestra.run.trial051.stdout: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:26.589 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:26.589 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:26.618 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install libcephfs2 2026-02-20T11:31:26.929 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:07 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:26.994 INFO:teuthology.orchestra.run.trial051.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:27.012 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:27.013 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:27.013 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:27.035 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install libcephfs-devel 2026-02-20T11:31:27.344 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:08 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:27.426 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:27.427 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:27.427 INFO:teuthology.orchestra.run.trial051.stdout: Package Arch Version Repo Size 2026-02-20T11:31:27.427 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:27.427 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-20T11:31:27.427 INFO:teuthology.orchestra.run.trial051.stdout: libcephfs-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:31:27.427 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:27.427 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-20T11:31:27.427 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:27.427 INFO:teuthology.orchestra.run.trial051.stdout:Install 1 Package 2026-02-20T11:31:27.427 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:27.427 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 37 k 2026-02-20T11:31:27.427 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 171 k 2026-02-20T11:31:27.427 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-20T11:31:27.849 INFO:teuthology.orchestra.run.trial051.stdout:libcephfs-devel-20.3.0-5357.g0c3148ca.el9.x86_6 89 kB/s | 37 kB 00:00 2026-02-20T11:31:27.850 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:27.850 INFO:teuthology.orchestra.run.trial051.stdout:Total 88 kB/s | 37 kB 00:00 2026-02-20T11:31:27.850 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-20T11:31:27.852 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-20T11:31:27.852 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-20T11:31:27.855 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-20T11:31:27.855 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-20T11:31:27.876 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-20T11:31:27.892 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:27.951 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:28.008 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:28.009 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:28.009 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-20T11:31:28.009 INFO:teuthology.orchestra.run.trial051.stdout: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:28.009 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:28.009 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:28.037 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install librados2 2026-02-20T11:31:28.345 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:09 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:28.411 INFO:teuthology.orchestra.run.trial051.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:28.429 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:28.430 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:28.430 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:28.451 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install librbd1 2026-02-20T11:31:28.761 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:09 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:28.826 INFO:teuthology.orchestra.run.trial051.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:28.845 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:28.846 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:28.846 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:28.867 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install python3-rados 2026-02-20T11:31:29.173 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:10 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:29.238 INFO:teuthology.orchestra.run.trial051.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:29.256 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:29.257 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:29.257 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:29.279 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install python3-rgw 2026-02-20T11:31:29.595 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:10 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:29.660 INFO:teuthology.orchestra.run.trial051.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:29.678 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:29.679 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:29.679 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:29.701 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install python3-cephfs 2026-02-20T11:31:30.011 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:11 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:30.075 INFO:teuthology.orchestra.run.trial051.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:30.093 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:30.094 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:30.094 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:30.116 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install python3-rbd 2026-02-20T11:31:30.425 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:11 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:30.492 INFO:teuthology.orchestra.run.trial051.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:30.510 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:30.511 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:30.511 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:30.533 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install rbd-fuse 2026-02-20T11:31:30.846 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:11 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:30.929 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:30.930 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:30.930 INFO:teuthology.orchestra.run.trial051.stdout: Package Architecture Version Repository Size 2026-02-20T11:31:30.930 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:30.930 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-20T11:31:30.931 INFO:teuthology.orchestra.run.trial051.stdout: rbd-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 86 k 2026-02-20T11:31:30.931 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:30.931 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-20T11:31:30.931 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:30.931 INFO:teuthology.orchestra.run.trial051.stdout:Install 1 Package 2026-02-20T11:31:30.931 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:30.931 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 86 k 2026-02-20T11:31:30.931 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 236 k 2026-02-20T11:31:30.931 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-20T11:31:31.363 INFO:teuthology.orchestra.run.trial051.stdout:rbd-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 200 kB/s | 86 kB 00:00 2026-02-20T11:31:31.363 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:31.363 INFO:teuthology.orchestra.run.trial051.stdout:Total 200 kB/s | 86 kB 00:00 2026-02-20T11:31:31.363 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-20T11:31:31.368 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-20T11:31:31.368 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-20T11:31:31.399 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-20T11:31:31.399 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-20T11:31:31.450 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-20T11:31:31.466 INFO:teuthology.orchestra.run.trial051.stdout: Installing : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:31.548 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:31.606 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:31.606 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:31.606 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-20T11:31:31.606 INFO:teuthology.orchestra.run.trial051.stdout: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:31.606 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:31.606 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:31.635 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install rbd-mirror 2026-02-20T11:31:31.946 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:12 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:32.031 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:32.031 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:32.031 INFO:teuthology.orchestra.run.trial051.stdout: Package Arch Version Repo Size 2026-02-20T11:31:32.031 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:32.031 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-20T11:31:32.031 INFO:teuthology.orchestra.run.trial051.stdout: rbd-mirror x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.6 M 2026-02-20T11:31:32.032 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:32.032 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-20T11:31:32.032 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:32.032 INFO:teuthology.orchestra.run.trial051.stdout:Install 1 Package 2026-02-20T11:31:32.032 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:32.032 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 2.6 M 2026-02-20T11:31:32.032 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 11 M 2026-02-20T11:31:32.032 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-20T11:31:33.276 INFO:teuthology.orchestra.run.trial051.stdout:rbd-mirror-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 2.1 MB/s | 2.6 MB 00:01 2026-02-20T11:31:33.277 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:33.277 INFO:teuthology.orchestra.run.trial051.stdout:Total 2.1 MB/s | 2.6 MB 00:01 2026-02-20T11:31:33.277 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-20T11:31:33.282 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-20T11:31:33.282 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-20T11:31:33.321 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-20T11:31:33.322 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-20T11:31:33.492 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-20T11:31:33.493 INFO:teuthology.orchestra.run.trial051.stdout: Installing : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:33.515 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:33.516 INFO:teuthology.orchestra.run.trial051.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:31:33.516 INFO:teuthology.orchestra.run.trial051.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T11:31:33.516 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:31:33.516 INFO:teuthology.orchestra.run.trial051.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:31:33.516 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:33.814 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:33.814 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:33.814 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-20T11:31:33.814 INFO:teuthology.orchestra.run.trial051.stdout: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:33.814 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:33.814 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:33.843 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install rbd-nbd 2026-02-20T11:31:34.153 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:15 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:34.237 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:34.237 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:34.237 INFO:teuthology.orchestra.run.trial051.stdout: Package Architecture Version Repository Size 2026-02-20T11:31:34.237 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:34.238 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-20T11:31:34.238 INFO:teuthology.orchestra.run.trial051.stdout: rbd-nbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 167 k 2026-02-20T11:31:34.238 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:34.238 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-20T11:31:34.238 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:34.238 INFO:teuthology.orchestra.run.trial051.stdout:Install 1 Package 2026-02-20T11:31:34.238 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:34.238 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 167 k 2026-02-20T11:31:34.238 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 496 k 2026-02-20T11:31:34.238 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-20T11:31:34.863 INFO:teuthology.orchestra.run.trial051.stdout:rbd-nbd-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 267 kB/s | 167 kB 00:00 2026-02-20T11:31:34.863 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:34.863 INFO:teuthology.orchestra.run.trial051.stdout:Total 266 kB/s | 167 kB 00:00 2026-02-20T11:31:34.863 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-20T11:31:34.868 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-20T11:31:34.868 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-20T11:31:34.901 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-20T11:31:34.902 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-20T11:31:34.959 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-20T11:31:34.976 INFO:teuthology.orchestra.run.trial051.stdout: Installing : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:35.054 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:35.112 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:35.112 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:35.112 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-20T11:31:35.112 INFO:teuthology.orchestra.run.trial051.stdout: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:35.112 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:35.112 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:35.141 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-osd-crimson 2026-02-20T11:31:35.463 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:16 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:35.526 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:35.545 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:35.546 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:31:35.546 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:31:35.567 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-20T11:31:35.881 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:03:16 ago on Fri 20 Feb 2026 11:28:19 AM UTC. 2026-02-20T11:31:35.964 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:31:35.965 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:35.965 INFO:teuthology.orchestra.run.trial051.stdout: Package Arch Version Repo Size 2026-02-20T11:31:35.966 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:35.966 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-20T11:31:35.966 INFO:teuthology.orchestra.run.trial051.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 433 M 2026-02-20T11:31:35.966 INFO:teuthology.orchestra.run.trial051.stdout:Installing weak dependencies: 2026-02-20T11:31:35.966 INFO:teuthology.orchestra.run.trial051.stdout: ceph-debugsource x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 12 M 2026-02-20T11:31:35.966 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:35.966 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-20T11:31:35.966 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:31:35.966 INFO:teuthology.orchestra.run.trial051.stdout:Install 2 Packages 2026-02-20T11:31:35.966 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:31:35.966 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 445 M 2026-02-20T11:31:35.967 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 2.7 G 2026-02-20T11:31:35.967 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-20T11:31:40.946 INFO:teuthology.orchestra.run.trial051.stdout:(1/2): ceph-debugsource-20.3.0-5357.g0c3148ca.e 2.4 MB/s | 12 MB 00:04 2026-02-20T11:37:31.413 INFO:teuthology.orchestra.run.trial051.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5357.g 1.2 MB/s | 433 MB 05:55 2026-02-20T11:37:31.414 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:37:31.415 INFO:teuthology.orchestra.run.trial051.stdout:Total 1.3 MB/s | 445 MB 05:55 2026-02-20T11:37:31.415 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-20T11:37:31.420 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-20T11:37:31.420 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-20T11:37:32.797 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-20T11:37:32.797 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-20T11:37:36.388 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-20T11:37:59.893 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:37:59.910 INFO:teuthology.orchestra.run.trial051.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:38:01.912 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:38:01.912 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:38:01.970 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:38:01.971 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:01.971 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-20T11:38:01.971 INFO:teuthology.orchestra.run.trial051.stdout: ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:38:01.971 INFO:teuthology.orchestra.run.trial051.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:38:01.971 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:01.971 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:02.044 DEBUG:teuthology.parallel:result is None 2026-02-20T11:38:02.044 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:38:02.218 DEBUG:teuthology.orchestra.run.trial051:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:38:02.240 INFO:teuthology.orchestra.run.trial051.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:38:02.240 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:38:02.241 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:38:02.243 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-20T11:38:02.243 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:02.243 DEBUG:teuthology.orchestra.run.trial051:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T11:38:02.308 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-20T11:38:02.308 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:02.308 DEBUG:teuthology.orchestra.run.trial051:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T11:38:02.374 DEBUG:teuthology.orchestra.run.trial051:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T11:38:02.437 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-20T11:38:02.437 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:02.437 DEBUG:teuthology.orchestra.run.trial051:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T11:38:02.502 DEBUG:teuthology.orchestra.run.trial051:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T11:38:02.566 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-20T11:38:02.566 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:02.566 DEBUG:teuthology.orchestra.run.trial051:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T11:38:02.630 DEBUG:teuthology.orchestra.run.trial051:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T11:38:02.696 INFO:teuthology.run_tasks:Running task pexec... 2026-02-20T11:38:02.713 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-20T11:38:02.714 DEBUG:teuthology.orchestra.run.trial051:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-20T11:38:02.738 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial051.front.sepia.ceph.com 2026-02-20T11:38:02.738 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-20T11:38:02.789 DEBUG:teuthology.parallel:result is None 2026-02-20T11:38:02.789 INFO:teuthology.run_tasks:Running task install... 2026-02-20T11:38:02.802 DEBUG:teuthology.task.install:project ceph 2026-02-20T11:38:02.803 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}} 2026-02-20T11:38:02.803 DEBUG:teuthology.task.install:config {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'} 2026-02-20T11:38:02.803 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T11:38:02.811 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T11:38:02.811 INFO:teuthology.task.install:extra packages: [] 2026-02-20T11:38:02.812 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:38:02.812 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:38:02.974 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:38:02.974 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:38:03.342 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:38:03.343 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:03.343 DEBUG:teuthology.orchestra.run.trial051:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:38:03.368 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-20T11:38:03.368 DEBUG:teuthology.orchestra.run.trial051:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:38:03.432 DEBUG:teuthology.orchestra.run.trial051:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:38:03.499 DEBUG:teuthology.orchestra.run.trial051:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:38:03.554 INFO:teuthology.orchestra.run.trial051.stdout:check_obsoletes = 1 2026-02-20T11:38:03.563 DEBUG:teuthology.orchestra.run.trial051:> sudo yum clean all 2026-02-20T11:38:03.726 INFO:teuthology.orchestra.run.trial051.stdout:56 files removed 2026-02-20T11:38:03.740 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-radosgw 2026-02-20T11:38:04.661 INFO:teuthology.orchestra.run.trial051.stdout:ceph packages for x86_64 121 kB/s | 94 kB 00:00 2026-02-20T11:38:05.242 INFO:teuthology.orchestra.run.trial051.stdout:ceph noarch packages 44 kB/s | 24 kB 00:00 2026-02-20T11:38:05.783 INFO:teuthology.orchestra.run.trial051.stdout:ceph source packages 4.0 kB/s | 2.1 kB 00:00 2026-02-20T11:38:06.886 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - BaseOS 8.2 MB/s | 8.9 MB 00:01 2026-02-20T11:38:14.188 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - AppStream 4.0 MB/s | 27 MB 00:06 2026-02-20T11:38:18.268 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 7.8 MB 00:01 2026-02-20T11:38:19.173 INFO:teuthology.orchestra.run.trial051.stdout:CentOS Stream 9 - Extras packages 113 kB/s | 20 kB 00:00 2026-02-20T11:38:19.900 INFO:teuthology.orchestra.run.trial051.stdout:Extra Packages for Enterprise Linux 31 MB/s | 20 MB 00:00 2026-02-20T11:38:23.147 INFO:teuthology.orchestra.run.trial051.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-20T11:38:24.332 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:24.351 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:24.352 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:24.352 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:24.376 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-test 2026-02-20T11:38:24.686 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:24.752 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:24.771 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:24.771 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:24.771 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:24.792 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph 2026-02-20T11:38:25.103 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:25.167 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:25.187 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:25.188 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:25.188 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:25.210 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-base 2026-02-20T11:38:25.517 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:25.582 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:25.600 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:25.601 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:25.601 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:25.623 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install cephadm 2026-02-20T11:38:25.931 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:25.996 INFO:teuthology.orchestra.run.trial051.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:38:26.015 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:26.015 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:26.015 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:26.037 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:38:26.347 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:26.411 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:26.430 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:26.430 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:26.431 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:26.452 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-mgr 2026-02-20T11:38:26.759 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:26.825 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:26.843 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:26.844 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:26.844 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:26.866 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:38:27.174 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:27.238 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:38:27.257 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:27.257 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:27.258 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:27.279 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:38:27.596 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:27.662 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:38:27.681 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:27.682 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:27.682 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:27.703 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:38:28.019 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:28.085 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:38:28.104 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:28.104 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:28.105 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:28.126 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:38:28.441 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:28.506 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:38:28.525 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:28.525 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:28.525 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:28.548 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-osd 2026-02-20T11:38:28.854 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:28.918 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:28.937 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:28.937 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:28.937 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:28.959 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-osd-classic 2026-02-20T11:38:29.266 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:29.331 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:29.351 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:29.352 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:29.352 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:29.374 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-fuse 2026-02-20T11:38:29.679 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:29.744 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:29.762 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:29.763 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:29.763 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:29.785 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install ceph-volume 2026-02-20T11:38:30.092 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:30.156 INFO:teuthology.orchestra.run.trial051.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:38:30.175 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:30.176 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:30.176 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:30.198 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install librados-devel 2026-02-20T11:38:30.514 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:30.578 INFO:teuthology.orchestra.run.trial051.stdout:Package librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:30.597 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:30.597 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:30.597 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:30.620 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install libcephfs2 2026-02-20T11:38:30.925 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:30.991 INFO:teuthology.orchestra.run.trial051.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:31.009 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:31.010 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:31.010 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:31.033 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install libcephfs-devel 2026-02-20T11:38:31.345 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:31.410 INFO:teuthology.orchestra.run.trial051.stdout:Package libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:31.428 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:31.428 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:31.429 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:31.451 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install librados2 2026-02-20T11:38:31.756 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:31.821 INFO:teuthology.orchestra.run.trial051.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:31.839 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:31.840 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:31.840 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:31.862 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install librbd1 2026-02-20T11:38:32.173 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:32.239 INFO:teuthology.orchestra.run.trial051.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:32.259 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:32.259 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:32.259 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:32.283 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install python3-rados 2026-02-20T11:38:32.618 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:32.683 INFO:teuthology.orchestra.run.trial051.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:32.701 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:32.702 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:32.702 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:32.724 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install python3-rgw 2026-02-20T11:38:33.037 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:33.102 INFO:teuthology.orchestra.run.trial051.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:33.121 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:33.121 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:33.121 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:33.144 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install python3-cephfs 2026-02-20T11:38:33.457 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:33.523 INFO:teuthology.orchestra.run.trial051.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:33.541 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:33.542 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:33.542 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:33.563 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install python3-rbd 2026-02-20T11:38:33.874 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:33.939 INFO:teuthology.orchestra.run.trial051.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:33.958 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:33.959 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:33.959 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:33.981 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install rbd-fuse 2026-02-20T11:38:34.291 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:34.356 INFO:teuthology.orchestra.run.trial051.stdout:Package rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:34.374 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:34.375 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:34.375 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:34.397 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install rbd-mirror 2026-02-20T11:38:34.703 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:34.768 INFO:teuthology.orchestra.run.trial051.stdout:Package rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:34.787 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:34.788 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:34.788 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:34.809 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install rbd-nbd 2026-02-20T11:38:35.112 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:38:35.176 INFO:teuthology.orchestra.run.trial051.stdout:Package rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:38:35.195 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:38:35.195 INFO:teuthology.orchestra.run.trial051.stdout:Nothing to do. 2026-02-20T11:38:35.195 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:38:35.217 DEBUG:teuthology.parallel:result is None 2026-02-20T11:38:35.217 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:38:35.430 DEBUG:teuthology.orchestra.run.trial051:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:38:35.450 INFO:teuthology.orchestra.run.trial051.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:38:35.450 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:38:35.450 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:38:35.453 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-20T11:38:35.453 INFO:teuthology.run_tasks:Running task ceph... 2026-02-20T11:38:35.545 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-20T11:38:35.545 DEBUG:teuthology.orchestra.run.trial051:> sudo chmod 777 /var/log/ceph 2026-02-20T11:38:35.571 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-20T11:38:35.571 DEBUG:teuthology.orchestra.run.trial051:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-20T11:38:35.635 INFO:tasks.ceph:Creating extra log directories... 2026-02-20T11:38:35.635 DEBUG:teuthology.orchestra.run.trial051:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-20T11:38:35.709 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-20T11:38:35.709 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug alienstore': 20, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-20T11:38:35.709 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60529', 'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439', 'description': 'crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/crimson_bluestore perf_ignorelist settings/optimized workloads/fio_4M_rand_read}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '60529', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439'}, 'ceph': {'conf': {'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug alienstore': 20, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '445d5c9ba18a4040e70e25303230c36c77773acb'}}, 'owner': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'priority': 101, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 1736, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '445d5c9ba18a4040e70e25303230c36c77773acb', 'targets': {'trial051.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBVMf4Mm/q/oyHB11iR/yYJdtkUQQQnAi6xXPBiSg+cWLd8G0DyKWc+GelYWN4ufSJQBsMjPEoAfDWVkyi64qd0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug alienstore': 20, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0', 'osd pool default crimson': True}}, 'wait-for-scrub': False, 'crimson_compat': True, 'flavor': 'debug', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'cluster': 'ceph'}}, {'ssh_keys': None}, {'cbt': {'benchmarks': {'librbdfio': {'iodepth': [32], 'log_avg_msec': 100, 'mode': ['randread'], 'norandommap': True, 'op_size': [4194304], 'osd_ra': [4096], 'pool_profile': 'rbd', 'procs_per_volume': [1], 'time': 60, 'vol_size': 4096, 'volumes_per_client': [2]}}, 'cluster': {'iterations': 1, 'osds_per_node': 3, 'pool_profiles': {'rbd': {'pg_size': 128, 'pgp_size': 128, 'replication': 3}}, 'user': 'ubuntu'}, 'monitoring_profiles': {'perf': {'args': 'stat -p {pid} -o {perf_dir}/perf_stat.{pid}', 'nodes': ['osds'], 'perf_cmd': 'perf', 'pid_glob': 'crimson-osd.*.pid'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'reimage-ssh-down', 'teuthology_sha1': 'e6d9099ce03dc21193fda653159ec82465c3a94a', 'timestamp': '2026-02-20_10:21:31', 'tube': 'trial', 'user': 'jjperez', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699'} 2026-02-20T11:38:35.710 DEBUG:teuthology.orchestra.run.trial051:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-20T11:38:35.759 DEBUG:teuthology.orchestra.run.trial051:> sudo install -d -m0777 -- /var/run/ceph 2026-02-20T11:38:35.824 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:35.824 DEBUG:teuthology.orchestra.run.trial051:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T11:38:35.881 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T11:38:35.881 DEBUG:teuthology.orchestra.run.trial051:> stat /dev/vg_nvme/lv_1 2026-02-20T11:38:35.937 INFO:teuthology.orchestra.run.trial051.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T11:38:35.937 INFO:teuthology.orchestra.run.trial051.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:38:35.937 INFO:teuthology.orchestra.run.trial051.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-20T11:38:35.937 INFO:teuthology.orchestra.run.trial051.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:38:35.937 INFO:teuthology.orchestra.run.trial051.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:38:35.937 INFO:teuthology.orchestra.run.trial051.stdout:Access: 2026-02-20 11:31:33.660541143 +0000 2026-02-20T11:38:35.937 INFO:teuthology.orchestra.run.trial051.stdout:Modify: 2026-02-20 11:28:34.803952817 +0000 2026-02-20T11:38:35.937 INFO:teuthology.orchestra.run.trial051.stdout:Change: 2026-02-20 11:28:34.803952817 +0000 2026-02-20T11:38:35.937 INFO:teuthology.orchestra.run.trial051.stdout: Birth: 2026-02-20 11:28:34.803952817 +0000 2026-02-20T11:38:35.937 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T11:38:36.000 INFO:teuthology.orchestra.run.trial051.stderr:1+0 records in 2026-02-20T11:38:36.000 INFO:teuthology.orchestra.run.trial051.stderr:1+0 records out 2026-02-20T11:38:36.000 INFO:teuthology.orchestra.run.trial051.stderr:512 bytes copied, 0.000232362 s, 2.2 MB/s 2026-02-20T11:38:36.001 DEBUG:teuthology.orchestra.run.trial051:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T11:38:36.059 DEBUG:teuthology.orchestra.run.trial051:> stat /dev/vg_nvme/lv_2 2026-02-20T11:38:36.115 INFO:teuthology.orchestra.run.trial051.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T11:38:36.115 INFO:teuthology.orchestra.run.trial051.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:38:36.115 INFO:teuthology.orchestra.run.trial051.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-20T11:38:36.115 INFO:teuthology.orchestra.run.trial051.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:38:36.115 INFO:teuthology.orchestra.run.trial051.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:38:36.116 INFO:teuthology.orchestra.run.trial051.stdout:Access: 2026-02-20 11:31:33.660541143 +0000 2026-02-20T11:38:36.116 INFO:teuthology.orchestra.run.trial051.stdout:Modify: 2026-02-20 11:28:34.803952817 +0000 2026-02-20T11:38:36.116 INFO:teuthology.orchestra.run.trial051.stdout:Change: 2026-02-20 11:28:34.803952817 +0000 2026-02-20T11:38:36.116 INFO:teuthology.orchestra.run.trial051.stdout: Birth: 2026-02-20 11:28:34.803952817 +0000 2026-02-20T11:38:36.116 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T11:38:36.177 INFO:teuthology.orchestra.run.trial051.stderr:1+0 records in 2026-02-20T11:38:36.177 INFO:teuthology.orchestra.run.trial051.stderr:1+0 records out 2026-02-20T11:38:36.177 INFO:teuthology.orchestra.run.trial051.stderr:512 bytes copied, 0.000213396 s, 2.4 MB/s 2026-02-20T11:38:36.179 DEBUG:teuthology.orchestra.run.trial051:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T11:38:36.236 DEBUG:teuthology.orchestra.run.trial051:> stat /dev/vg_nvme/lv_3 2026-02-20T11:38:36.293 INFO:teuthology.orchestra.run.trial051.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T11:38:36.293 INFO:teuthology.orchestra.run.trial051.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:38:36.293 INFO:teuthology.orchestra.run.trial051.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-20T11:38:36.293 INFO:teuthology.orchestra.run.trial051.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:38:36.293 INFO:teuthology.orchestra.run.trial051.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:38:36.294 INFO:teuthology.orchestra.run.trial051.stdout:Access: 2026-02-20 11:31:33.661541107 +0000 2026-02-20T11:38:36.294 INFO:teuthology.orchestra.run.trial051.stdout:Modify: 2026-02-20 11:28:34.803952817 +0000 2026-02-20T11:38:36.294 INFO:teuthology.orchestra.run.trial051.stdout:Change: 2026-02-20 11:28:34.803952817 +0000 2026-02-20T11:38:36.294 INFO:teuthology.orchestra.run.trial051.stdout: Birth: 2026-02-20 11:28:34.803952817 +0000 2026-02-20T11:38:36.294 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T11:38:36.356 INFO:teuthology.orchestra.run.trial051.stderr:1+0 records in 2026-02-20T11:38:36.357 INFO:teuthology.orchestra.run.trial051.stderr:1+0 records out 2026-02-20T11:38:36.357 INFO:teuthology.orchestra.run.trial051.stderr:512 bytes copied, 0.000162352 s, 3.2 MB/s 2026-02-20T11:38:36.358 DEBUG:teuthology.orchestra.run.trial051:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T11:38:36.415 DEBUG:teuthology.orchestra.run.trial051:> stat /dev/vg_nvme/lv_4 2026-02-20T11:38:36.470 INFO:teuthology.orchestra.run.trial051.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T11:38:36.471 INFO:teuthology.orchestra.run.trial051.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:38:36.471 INFO:teuthology.orchestra.run.trial051.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-20T11:38:36.471 INFO:teuthology.orchestra.run.trial051.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:38:36.471 INFO:teuthology.orchestra.run.trial051.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:38:36.471 INFO:teuthology.orchestra.run.trial051.stdout:Access: 2026-02-20 11:31:33.661541107 +0000 2026-02-20T11:38:36.471 INFO:teuthology.orchestra.run.trial051.stdout:Modify: 2026-02-20 11:28:34.803952817 +0000 2026-02-20T11:38:36.471 INFO:teuthology.orchestra.run.trial051.stdout:Change: 2026-02-20 11:28:34.803952817 +0000 2026-02-20T11:38:36.471 INFO:teuthology.orchestra.run.trial051.stdout: Birth: 2026-02-20 11:28:34.803952817 +0000 2026-02-20T11:38:36.471 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T11:38:36.533 INFO:teuthology.orchestra.run.trial051.stderr:1+0 records in 2026-02-20T11:38:36.533 INFO:teuthology.orchestra.run.trial051.stderr:1+0 records out 2026-02-20T11:38:36.533 INFO:teuthology.orchestra.run.trial051.stderr:512 bytes copied, 0.000174233 s, 2.9 MB/s 2026-02-20T11:38:36.535 DEBUG:teuthology.orchestra.run.trial051:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T11:38:36.591 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-20T11:38:36.591 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial051.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-20T11:38:36.591 INFO:tasks.ceph:Generating config... 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] debug alienstore = 20 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] debug filestore = 0/0 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] debug journal = 0/0 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] debug ms = 0/0 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] debug osd = 0/0 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] err to stderr = True 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] log flush on exit = True 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] log to file = False 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] log to stderr = True 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-20T11:38:36.592 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-20T11:38:36.592 INFO:tasks.ceph:[global] auth client required = none 2026-02-20T11:38:36.592 INFO:tasks.ceph:[global] auth cluster required = none 2026-02-20T11:38:36.592 INFO:tasks.ceph:[global] auth service required = none 2026-02-20T11:38:36.592 INFO:tasks.ceph:[global] auth supported = none 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug asok = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug auth = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug bdev = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug bluefs = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug bluestore = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug buffer = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug civetweb = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug client = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug compressor = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug context = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug crush = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug crypto = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug dpdk = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug eventtrace = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug filer = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug filestore = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug finisher = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug fuse = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug heartbeatmap = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug javaclient = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug journal = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug journaler = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug kstore = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug leveldb = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug lockdep = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug mds = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug mds balancer = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug mds locker = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug mds log = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug mds log expire = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug mds migrator = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug memdb = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug mgr = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug mgrc = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug mon = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug monc = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug ms = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug objclass = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug objectcacher = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug objecter = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug optracker = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug osd = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug paxos = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug perfcounter = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug rados = 0/0 2026-02-20T11:38:36.593 INFO:tasks.ceph:[global] debug rbd = 0/0 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] debug rbd mirror = 0/0 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] debug rbd replay = 0/0 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] debug refs = 0/0 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] debug rgw = 0/0 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] debug rgw lifecycle = 0/0 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] debug rgw notification = 0/0 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] debug rgw sync = 0/0 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] debug rocksdb = 0/0 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] debug striper = 0/0 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] debug throttle = 0/0 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] debug timer = 0/0 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] debug tp = 0/0 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-20T11:38:36.594 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-20T11:38:36.594 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-20T11:38:36.594 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-20T11:38:36.594 INFO:tasks.ceph:[mon] debug mon = 0/0 2026-02-20T11:38:36.594 INFO:tasks.ceph:[mon] debug ms = 0/0 2026-02-20T11:38:36.594 INFO:tasks.ceph:[mon] debug paxos = 0/0 2026-02-20T11:38:36.594 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-20T11:38:36.594 INFO:tasks.ceph:Setting up mon.a... 2026-02-20T11:38:36.594 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-20T11:38:36.671 INFO:teuthology.orchestra.run.trial051.stdout:creating /etc/ceph/ceph.keyring 2026-02-20T11:38:36.674 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-20T11:38:36.759 DEBUG:teuthology.orchestra.run.trial051:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T11:38:36.784 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.51')] 2026-02-20T11:38:36.785 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'none', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.51', 'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug leveldb': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug alienstore': 20, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': '0/0', 'debug mon': '0/0', 'debug paxos': '0/0', 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-20T11:38:36.787 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:36.787 DEBUG:teuthology.orchestra.run.trial051:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T11:38:36.846 DEBUG:teuthology.orchestra.run.trial051:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.51 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:38:36.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:38:36.931+0000 7f9132c36f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:36.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:38:36.931+0000 7f9132c36f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:36.933 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:38:36.931+0000 7f9132c36f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:36.933 INFO:teuthology.orchestra.run.trial051.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:38:36.933 INFO:teuthology.orchestra.run.trial051.stdout:monmaptool: generated fsid c39f4f1d-77ea-40f8-83cf-4e936b01eae3 2026-02-20T11:38:36.933 INFO:teuthology.orchestra.run.trial051.stdout:setting min_mon_release = tentacle 2026-02-20T11:38:36.933 INFO:teuthology.orchestra.run.trial051.stdout:epoch 0 2026-02-20T11:38:36.933 INFO:teuthology.orchestra.run.trial051.stdout:fsid c39f4f1d-77ea-40f8-83cf-4e936b01eae3 2026-02-20T11:38:36.933 INFO:teuthology.orchestra.run.trial051.stdout:last_changed 2026-02-20T11:38:36.932119+0000 2026-02-20T11:38:36.933 INFO:teuthology.orchestra.run.trial051.stdout:created 2026-02-20T11:38:36.932119+0000 2026-02-20T11:38:36.933 INFO:teuthology.orchestra.run.trial051.stdout:min_mon_release 20 (tentacle) 2026-02-20T11:38:36.933 INFO:teuthology.orchestra.run.trial051.stdout:election_strategy: 1 2026-02-20T11:38:36.933 INFO:teuthology.orchestra.run.trial051.stdout:0: [v2:10.20.193.51:3300/0,v1:10.20.193.51:6789/0] mon.a 2026-02-20T11:38:36.933 INFO:teuthology.orchestra.run.trial051.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-20T11:38:36.934 DEBUG:teuthology.orchestra.run.trial051:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T11:38:37.004 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c39f4f1d-77ea-40f8-83cf-4e936b01eae3... 2026-02-20T11:38:37.005 DEBUG:teuthology.orchestra.run.trial051:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-20T11:38:37.090 INFO:teuthology.orchestra.run.trial051.stdout:[global] 2026-02-20T11:38:37.090 INFO:teuthology.orchestra.run.trial051.stdout: chdir = "" 2026-02-20T11:38:37.090 INFO:teuthology.orchestra.run.trial051.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-20T11:38:37.090 INFO:teuthology.orchestra.run.trial051.stdout: auth supported = none 2026-02-20T11:38:37.090 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.090 INFO:teuthology.orchestra.run.trial051.stdout: filestore xattr use omap = true 2026-02-20T11:38:37.091 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.091 INFO:teuthology.orchestra.run.trial051.stdout: mon clock drift allowed = 1.000 2026-02-20T11:38:37.091 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.091 INFO:teuthology.orchestra.run.trial051.stdout: osd crush chooseleaf type = 0 2026-02-20T11:38:37.091 INFO:teuthology.orchestra.run.trial051.stdout: auth debug = true 2026-02-20T11:38:37.091 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.091 INFO:teuthology.orchestra.run.trial051.stdout: ms die on old message = true 2026-02-20T11:38:37.091 INFO:teuthology.orchestra.run.trial051.stdout: ms die on bug = true 2026-02-20T11:38:37.091 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.091 INFO:teuthology.orchestra.run.trial051.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-20T11:38:37.091 INFO:teuthology.orchestra.run.trial051.stdout: mon pg warn max object skew = 0 2026-02-20T11:38:37.091 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.092 INFO:teuthology.orchestra.run.trial051.stdout: # disable pg_autoscaler by default for new pools 2026-02-20T11:38:37.092 INFO:teuthology.orchestra.run.trial051.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-20T11:38:37.092 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.092 INFO:teuthology.orchestra.run.trial051.stdout: osd pool default size = 2 2026-02-20T11:38:37.092 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.092 INFO:teuthology.orchestra.run.trial051.stdout: mon osd allow primary affinity = true 2026-02-20T11:38:37.092 INFO:teuthology.orchestra.run.trial051.stdout: mon osd allow pg remap = true 2026-02-20T11:38:37.092 INFO:teuthology.orchestra.run.trial051.stdout: mon warn on legacy crush tunables = false 2026-02-20T11:38:37.092 INFO:teuthology.orchestra.run.trial051.stdout: mon warn on crush straw calc version zero = false 2026-02-20T11:38:37.092 INFO:teuthology.orchestra.run.trial051.stdout: mon warn on no sortbitwise = false 2026-02-20T11:38:37.092 INFO:teuthology.orchestra.run.trial051.stdout: mon warn on osd down out interval zero = false 2026-02-20T11:38:37.092 INFO:teuthology.orchestra.run.trial051.stdout: mon warn on too few osds = false 2026-02-20T11:38:37.093 INFO:teuthology.orchestra.run.trial051.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-20T11:38:37.093 INFO:teuthology.orchestra.run.trial051.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-20T11:38:37.093 INFO:teuthology.orchestra.run.trial051.stdout: mon_allow_pool_size_one = true 2026-02-20T11:38:37.093 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.093 INFO:teuthology.orchestra.run.trial051.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-20T11:38:37.093 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.093 INFO:teuthology.orchestra.run.trial051.stdout: osd default data pool replay window = 5 2026-02-20T11:38:37.093 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.093 INFO:teuthology.orchestra.run.trial051.stdout: mon allow pool delete = true 2026-02-20T11:38:37.093 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.093 INFO:teuthology.orchestra.run.trial051.stdout: mon cluster log file level = debug 2026-02-20T11:38:37.093 INFO:teuthology.orchestra.run.trial051.stdout: debug asserts on shutdown = true 2026-02-20T11:38:37.093 INFO:teuthology.orchestra.run.trial051.stdout: mon health detail to clog = false 2026-02-20T11:38:37.094 INFO:teuthology.orchestra.run.trial051.stdout: mon host = 10.20.193.51 2026-02-20T11:38:37.094 INFO:teuthology.orchestra.run.trial051.stdout: auth client required = none 2026-02-20T11:38:37.094 INFO:teuthology.orchestra.run.trial051.stdout: auth cluster required = none 2026-02-20T11:38:37.094 INFO:teuthology.orchestra.run.trial051.stdout: auth service required = none 2026-02-20T11:38:37.094 INFO:teuthology.orchestra.run.trial051.stdout: debug asok = 0/0 2026-02-20T11:38:37.094 INFO:teuthology.orchestra.run.trial051.stdout: debug auth = 0/0 2026-02-20T11:38:37.094 INFO:teuthology.orchestra.run.trial051.stdout: debug bdev = 0/0 2026-02-20T11:38:37.094 INFO:teuthology.orchestra.run.trial051.stdout: debug bluefs = 0/0 2026-02-20T11:38:37.094 INFO:teuthology.orchestra.run.trial051.stdout: debug bluestore = 0/0 2026-02-20T11:38:37.094 INFO:teuthology.orchestra.run.trial051.stdout: debug buffer = 0/0 2026-02-20T11:38:37.094 INFO:teuthology.orchestra.run.trial051.stdout: debug civetweb = 0/0 2026-02-20T11:38:37.094 INFO:teuthology.orchestra.run.trial051.stdout: debug client = 0/0 2026-02-20T11:38:37.095 INFO:teuthology.orchestra.run.trial051.stdout: debug compressor = 0/0 2026-02-20T11:38:37.095 INFO:teuthology.orchestra.run.trial051.stdout: debug context = 0/0 2026-02-20T11:38:37.095 INFO:teuthology.orchestra.run.trial051.stdout: debug crush = 0/0 2026-02-20T11:38:37.095 INFO:teuthology.orchestra.run.trial051.stdout: debug crypto = 0/0 2026-02-20T11:38:37.095 INFO:teuthology.orchestra.run.trial051.stdout: debug dpdk = 0/0 2026-02-20T11:38:37.095 INFO:teuthology.orchestra.run.trial051.stdout: debug eventtrace = 0/0 2026-02-20T11:38:37.095 INFO:teuthology.orchestra.run.trial051.stdout: debug filer = 0/0 2026-02-20T11:38:37.095 INFO:teuthology.orchestra.run.trial051.stdout: debug filestore = 0/0 2026-02-20T11:38:37.095 INFO:teuthology.orchestra.run.trial051.stdout: debug finisher = 0/0 2026-02-20T11:38:37.095 INFO:teuthology.orchestra.run.trial051.stdout: debug fuse = 0/0 2026-02-20T11:38:37.095 INFO:teuthology.orchestra.run.trial051.stdout: debug heartbeatmap = 0/0 2026-02-20T11:38:37.095 INFO:teuthology.orchestra.run.trial051.stdout: debug javaclient = 0/0 2026-02-20T11:38:37.095 INFO:teuthology.orchestra.run.trial051.stdout: debug journal = 0/0 2026-02-20T11:38:37.096 INFO:teuthology.orchestra.run.trial051.stdout: debug journaler = 0/0 2026-02-20T11:38:37.096 INFO:teuthology.orchestra.run.trial051.stdout: debug kstore = 0/0 2026-02-20T11:38:37.096 INFO:teuthology.orchestra.run.trial051.stdout: debug leveldb = 0/0 2026-02-20T11:38:37.096 INFO:teuthology.orchestra.run.trial051.stdout: debug lockdep = 0/0 2026-02-20T11:38:37.096 INFO:teuthology.orchestra.run.trial051.stdout: debug mds = 0/0 2026-02-20T11:38:37.096 INFO:teuthology.orchestra.run.trial051.stdout: debug mds balancer = 0/0 2026-02-20T11:38:37.096 INFO:teuthology.orchestra.run.trial051.stdout: debug mds locker = 0/0 2026-02-20T11:38:37.096 INFO:teuthology.orchestra.run.trial051.stdout: debug mds log = 0/0 2026-02-20T11:38:37.096 INFO:teuthology.orchestra.run.trial051.stdout: debug mds log expire = 0/0 2026-02-20T11:38:37.096 INFO:teuthology.orchestra.run.trial051.stdout: debug mds migrator = 0/0 2026-02-20T11:38:37.096 INFO:teuthology.orchestra.run.trial051.stdout: debug memdb = 0/0 2026-02-20T11:38:37.096 INFO:teuthology.orchestra.run.trial051.stdout: debug mgr = 0/0 2026-02-20T11:38:37.097 INFO:teuthology.orchestra.run.trial051.stdout: debug mgrc = 0/0 2026-02-20T11:38:37.097 INFO:teuthology.orchestra.run.trial051.stdout: debug mon = 0/0 2026-02-20T11:38:37.097 INFO:teuthology.orchestra.run.trial051.stdout: debug monc = 0/0 2026-02-20T11:38:37.097 INFO:teuthology.orchestra.run.trial051.stdout: debug ms = 0/0 2026-02-20T11:38:37.097 INFO:teuthology.orchestra.run.trial051.stdout: debug objclass = 0/0 2026-02-20T11:38:37.097 INFO:teuthology.orchestra.run.trial051.stdout: debug objectcacher = 0/0 2026-02-20T11:38:37.097 INFO:teuthology.orchestra.run.trial051.stdout: debug objecter = 0/0 2026-02-20T11:38:37.097 INFO:teuthology.orchestra.run.trial051.stdout: debug optracker = 0/0 2026-02-20T11:38:37.097 INFO:teuthology.orchestra.run.trial051.stdout: debug osd = 0/0 2026-02-20T11:38:37.097 INFO:teuthology.orchestra.run.trial051.stdout: debug paxos = 0/0 2026-02-20T11:38:37.097 INFO:teuthology.orchestra.run.trial051.stdout: debug perfcounter = 0/0 2026-02-20T11:38:37.097 INFO:teuthology.orchestra.run.trial051.stdout: debug rados = 0/0 2026-02-20T11:38:37.097 INFO:teuthology.orchestra.run.trial051.stdout: debug rbd = 0/0 2026-02-20T11:38:37.098 INFO:teuthology.orchestra.run.trial051.stdout: debug rbd mirror = 0/0 2026-02-20T11:38:37.098 INFO:teuthology.orchestra.run.trial051.stdout: debug rbd replay = 0/0 2026-02-20T11:38:37.098 INFO:teuthology.orchestra.run.trial051.stdout: debug refs = 0/0 2026-02-20T11:38:37.098 INFO:teuthology.orchestra.run.trial051.stdout: debug rgw = 0/0 2026-02-20T11:38:37.098 INFO:teuthology.orchestra.run.trial051.stdout: debug rgw lifecycle = 0/0 2026-02-20T11:38:37.098 INFO:teuthology.orchestra.run.trial051.stdout: debug rgw notification = 0/0 2026-02-20T11:38:37.098 INFO:teuthology.orchestra.run.trial051.stdout: debug rgw sync = 0/0 2026-02-20T11:38:37.098 INFO:teuthology.orchestra.run.trial051.stdout: debug rocksdb = 0/0 2026-02-20T11:38:37.098 INFO:teuthology.orchestra.run.trial051.stdout: debug striper = 0/0 2026-02-20T11:38:37.098 INFO:teuthology.orchestra.run.trial051.stdout: debug throttle = 0/0 2026-02-20T11:38:37.098 INFO:teuthology.orchestra.run.trial051.stdout: debug timer = 0/0 2026-02-20T11:38:37.098 INFO:teuthology.orchestra.run.trial051.stdout: debug tp = 0/0 2026-02-20T11:38:37.098 INFO:teuthology.orchestra.run.trial051.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-20T11:38:37.099 INFO:teuthology.orchestra.run.trial051.stdout: ms client mode = crc 2026-02-20T11:38:37.099 INFO:teuthology.orchestra.run.trial051.stdout: ms cluster mode = crc 2026-02-20T11:38:37.099 INFO:teuthology.orchestra.run.trial051.stdout: ms mon client mode = crc 2026-02-20T11:38:37.099 INFO:teuthology.orchestra.run.trial051.stdout: ms mon cluster mode = crc 2026-02-20T11:38:37.099 INFO:teuthology.orchestra.run.trial051.stdout: ms mon service mode = crc 2026-02-20T11:38:37.099 INFO:teuthology.orchestra.run.trial051.stdout: ms service mode = crc 2026-02-20T11:38:37.099 INFO:teuthology.orchestra.run.trial051.stdout: fsid = c39f4f1d-77ea-40f8-83cf-4e936b01eae3 2026-02-20T11:38:37.099 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.099 INFO:teuthology.orchestra.run.trial051.stdout:[osd] 2026-02-20T11:38:37.099 INFO:teuthology.orchestra.run.trial051.stdout: osd journal size = 100 2026-02-20T11:38:37.099 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.099 INFO:teuthology.orchestra.run.trial051.stdout: osd scrub load threshold = 5.0 2026-02-20T11:38:37.099 INFO:teuthology.orchestra.run.trial051.stdout: osd scrub max interval = 600 2026-02-20T11:38:37.100 INFO:teuthology.orchestra.run.trial051.stdout: osd mclock profile = high_recovery_ops 2026-02-20T11:38:37.100 INFO:teuthology.orchestra.run.trial051.stdout: osd mclock skip benchmark = true 2026-02-20T11:38:37.100 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.100 INFO:teuthology.orchestra.run.trial051.stdout: osd recover clone overlap = true 2026-02-20T11:38:37.100 INFO:teuthology.orchestra.run.trial051.stdout: osd recovery max chunk = 1048576 2026-02-20T11:38:37.100 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.100 INFO:teuthology.orchestra.run.trial051.stdout: osd debug shutdown = true 2026-02-20T11:38:37.100 INFO:teuthology.orchestra.run.trial051.stdout: osd debug op order = true 2026-02-20T11:38:37.100 INFO:teuthology.orchestra.run.trial051.stdout: osd debug verify stray on activate = true 2026-02-20T11:38:37.100 INFO:teuthology.orchestra.run.trial051.stdout: osd debug trim objects = true 2026-02-20T11:38:37.100 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.100 INFO:teuthology.orchestra.run.trial051.stdout: osd open classes on start = true 2026-02-20T11:38:37.101 INFO:teuthology.orchestra.run.trial051.stdout: osd debug pg log writeout = true 2026-02-20T11:38:37.101 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.101 INFO:teuthology.orchestra.run.trial051.stdout: osd deep scrub update digest min age = 30 2026-02-20T11:38:37.101 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.101 INFO:teuthology.orchestra.run.trial051.stdout: osd map max advance = 10 2026-02-20T11:38:37.101 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.101 INFO:teuthology.orchestra.run.trial051.stdout: journal zero on create = true 2026-02-20T11:38:37.101 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.101 INFO:teuthology.orchestra.run.trial051.stdout: filestore ondisk finisher threads = 3 2026-02-20T11:38:37.101 INFO:teuthology.orchestra.run.trial051.stdout: filestore apply finisher threads = 3 2026-02-20T11:38:37.101 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.101 INFO:teuthology.orchestra.run.trial051.stdout: bdev debug aio = true 2026-02-20T11:38:37.101 INFO:teuthology.orchestra.run.trial051.stdout: osd debug misdirected ops = true 2026-02-20T11:38:37.102 INFO:teuthology.orchestra.run.trial051.stdout: debug monc = 20 2026-02-20T11:38:37.102 INFO:teuthology.orchestra.run.trial051.stdout: bluestore block size = 96636764160 2026-02-20T11:38:37.102 INFO:teuthology.orchestra.run.trial051.stdout: bluestore compression algorithm = snappy 2026-02-20T11:38:37.102 INFO:teuthology.orchestra.run.trial051.stdout: bluestore compression mode = aggressive 2026-02-20T11:38:37.102 INFO:teuthology.orchestra.run.trial051.stdout: bluestore fsck on mount = True 2026-02-20T11:38:37.102 INFO:teuthology.orchestra.run.trial051.stdout: bluestore rocksdb cf = False 2026-02-20T11:38:37.102 INFO:teuthology.orchestra.run.trial051.stdout: crimson cpu num = 4 2026-02-20T11:38:37.102 INFO:teuthology.orchestra.run.trial051.stdout: crimson osd obc lru size = 10 2026-02-20T11:38:37.102 INFO:teuthology.orchestra.run.trial051.stdout: debug alienstore = 20 2026-02-20T11:38:37.102 INFO:teuthology.orchestra.run.trial051.stdout: debug bluefs = 20 2026-02-20T11:38:37.102 INFO:teuthology.orchestra.run.trial051.stdout: debug bluestore = 20 2026-02-20T11:38:37.102 INFO:teuthology.orchestra.run.trial051.stdout: debug filestore = 0/0 2026-02-20T11:38:37.102 INFO:teuthology.orchestra.run.trial051.stdout: debug journal = 0/0 2026-02-20T11:38:37.102 INFO:teuthology.orchestra.run.trial051.stdout: debug ms = 0/0 2026-02-20T11:38:37.103 INFO:teuthology.orchestra.run.trial051.stdout: debug osd = 0/0 2026-02-20T11:38:37.103 INFO:teuthology.orchestra.run.trial051.stdout: debug rocksdb = 10 2026-02-20T11:38:37.103 INFO:teuthology.orchestra.run.trial051.stdout: err to stderr = True 2026-02-20T11:38:37.103 INFO:teuthology.orchestra.run.trial051.stdout: log flush on exit = True 2026-02-20T11:38:37.103 INFO:teuthology.orchestra.run.trial051.stdout: log to file = False 2026-02-20T11:38:37.103 INFO:teuthology.orchestra.run.trial051.stdout: log to stderr = True 2026-02-20T11:38:37.103 INFO:teuthology.orchestra.run.trial051.stdout: mon osd backfillfull_ratio = 0.85 2026-02-20T11:38:37.103 INFO:teuthology.orchestra.run.trial051.stdout: mon osd full ratio = 0.9 2026-02-20T11:38:37.103 INFO:teuthology.orchestra.run.trial051.stdout: mon osd nearfull ratio = 0.8 2026-02-20T11:38:37.103 INFO:teuthology.orchestra.run.trial051.stdout: osd failsafe full ratio = 0.95 2026-02-20T11:38:37.103 INFO:teuthology.orchestra.run.trial051.stdout: osd objectstore = bluestore 2026-02-20T11:38:37.103 INFO:teuthology.orchestra.run.trial051.stdout: osd shutdown pgref assert = True 2026-02-20T11:38:37.103 INFO:teuthology.orchestra.run.trial051.stdout: seastore cachepin size pershard = 64M 2026-02-20T11:38:37.104 INFO:teuthology.orchestra.run.trial051.stdout: seastore max concurrent transactions = 8 2026-02-20T11:38:37.104 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.104 INFO:teuthology.orchestra.run.trial051.stdout:[mgr] 2026-02-20T11:38:37.104 INFO:teuthology.orchestra.run.trial051.stdout: debug ms = 1 2026-02-20T11:38:37.104 INFO:teuthology.orchestra.run.trial051.stdout: debug mgr = 20 2026-02-20T11:38:37.104 INFO:teuthology.orchestra.run.trial051.stdout: debug mon = 20 2026-02-20T11:38:37.104 INFO:teuthology.orchestra.run.trial051.stdout: debug auth = 20 2026-02-20T11:38:37.104 INFO:teuthology.orchestra.run.trial051.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:38:37.104 INFO:teuthology.orchestra.run.trial051.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:38:37.104 INFO:teuthology.orchestra.run.trial051.stdout: mgr/telemetry/nag = false 2026-02-20T11:38:37.104 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.104 INFO:teuthology.orchestra.run.trial051.stdout:[mon] 2026-02-20T11:38:37.105 INFO:teuthology.orchestra.run.trial051.stdout: debug ms = 0/0 2026-02-20T11:38:37.105 INFO:teuthology.orchestra.run.trial051.stdout: debug mon = 0/0 2026-02-20T11:38:37.105 INFO:teuthology.orchestra.run.trial051.stdout: debug paxos = 0/0 2026-02-20T11:38:37.105 INFO:teuthology.orchestra.run.trial051.stdout: debug auth = 20 2026-02-20T11:38:37.105 INFO:teuthology.orchestra.run.trial051.stdout: mon data avail warn = 5 2026-02-20T11:38:37.105 INFO:teuthology.orchestra.run.trial051.stdout: mon mgr mkfs grace = 240 2026-02-20T11:38:37.105 INFO:teuthology.orchestra.run.trial051.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:38:37.105 INFO:teuthology.orchestra.run.trial051.stdout: mon osd reporter subtree level = osd 2026-02-20T11:38:37.105 INFO:teuthology.orchestra.run.trial051.stdout: mon osd prime pg temp = true 2026-02-20T11:38:37.105 INFO:teuthology.orchestra.run.trial051.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:38:37.105 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.105 INFO:teuthology.orchestra.run.trial051.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-20T11:38:37.105 INFO:teuthology.orchestra.run.trial051.stdout: auth mon ticket ttl = 660 # 11m 2026-02-20T11:38:37.106 INFO:teuthology.orchestra.run.trial051.stdout: auth service ticket ttl = 240 # 4m 2026-02-20T11:38:37.106 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.106 INFO:teuthology.orchestra.run.trial051.stdout: # don't complain about insecure global_id in the test suite 2026-02-20T11:38:37.106 INFO:teuthology.orchestra.run.trial051.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-20T11:38:37.106 INFO:teuthology.orchestra.run.trial051.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-20T11:38:37.106 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.106 INFO:teuthology.orchestra.run.trial051.stdout: # 1m isn't quite enough 2026-02-20T11:38:37.106 INFO:teuthology.orchestra.run.trial051.stdout: mon_down_mkfs_grace = 2m 2026-02-20T11:38:37.106 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.106 INFO:teuthology.orchestra.run.trial051.stdout: mon_warn_on_filestore_osds = false 2026-02-20T11:38:37.106 INFO:teuthology.orchestra.run.trial051.stdout: osd pool default crimson = True 2026-02-20T11:38:37.106 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:38:37.106 INFO:teuthology.orchestra.run.trial051.stdout:[client] 2026-02-20T11:38:37.107 INFO:teuthology.orchestra.run.trial051.stdout: rgw cache enabled = true 2026-02-20T11:38:37.107 INFO:teuthology.orchestra.run.trial051.stdout: rgw enable ops log = true 2026-02-20T11:38:37.107 INFO:teuthology.orchestra.run.trial051.stdout: rgw enable usage log = true 2026-02-20T11:38:37.107 INFO:teuthology.orchestra.run.trial051.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-20T11:38:37.107 INFO:teuthology.orchestra.run.trial051.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-20T11:38:37.107 INFO:teuthology.orchestra.run.trial051.stdout:[mon.a] 2026-02-20T11:38:37.108 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-20T11:38:37.108 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-20T11:38:37.198 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-20T11:38:37.198 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:37.199 DEBUG:teuthology.orchestra.run.trial051:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-20T11:38:37.215 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:37.215 DEBUG:teuthology.orchestra.run.trial051:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-20T11:38:37.272 INFO:tasks.ceph:Sending monmap to node ubuntu@trial051.front.sepia.ceph.com 2026-02-20T11:38:37.272 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:37.272 DEBUG:teuthology.orchestra.run.trial051:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-20T11:38:37.273 DEBUG:teuthology.orchestra.run.trial051:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T11:38:37.345 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:37.345 DEBUG:teuthology.orchestra.run.trial051:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:38:37.403 INFO:tasks.ceph:Setting up mon nodes... 2026-02-20T11:38:37.404 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-20T11:38:37.404 DEBUG:teuthology.orchestra.run.trial051:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T11:38:37.495 INFO:teuthology.orchestra.run.trial051.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T11:38:37.498 INFO:tasks.ceph:Setting up mds nodes... 2026-02-20T11:38:37.498 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-20T11:38:37.499 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-20T11:38:37.541 INFO:teuthology.orchestra.run.trial051.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-20T11:38:37.553 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-20T11:38:37.553 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial051.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-20T11:38:37.554 DEBUG:teuthology.orchestra.run.trial051:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-20T11:38:37.618 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-20T11:38:37.618 INFO:tasks.ceph:role: osd.0 2026-02-20T11:38:37.618 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial051.front.sepia.ceph.com 2026-02-20T11:38:37.619 DEBUG:teuthology.orchestra.run.trial051:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-20T11:38:37.685 INFO:teuthology.orchestra.run.trial051.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:38:37.685 INFO:teuthology.orchestra.run.trial051.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:38:37.685 INFO:teuthology.orchestra.run.trial051.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:38:37.685 INFO:teuthology.orchestra.run.trial051.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:38:37.685 INFO:teuthology.orchestra.run.trial051.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:38:37.686 INFO:teuthology.orchestra.run.trial051.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:38:37.686 INFO:teuthology.orchestra.run.trial051.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:38:37.686 INFO:teuthology.orchestra.run.trial051.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:38:37.686 INFO:teuthology.orchestra.run.trial051.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:38:37.686 INFO:teuthology.orchestra.run.trial051.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:38:38.304 INFO:teuthology.orchestra.run.trial051.stdout:Discarding blocks...Done. 2026-02-20T11:38:38.306 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial051.front.sepia.ceph.com -o noatime 2026-02-20T11:38:38.307 DEBUG:teuthology.orchestra.run.trial051:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-20T11:38:38.375 DEBUG:teuthology.orchestra.run.trial051:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-20T11:38:38.443 DEBUG:teuthology.orchestra.run.trial051:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-20T11:38:38.509 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-20T11:38:38.509 INFO:tasks.ceph:role: osd.1 2026-02-20T11:38:38.509 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial051.front.sepia.ceph.com 2026-02-20T11:38:38.509 DEBUG:teuthology.orchestra.run.trial051:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-20T11:38:38.575 INFO:teuthology.orchestra.run.trial051.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:38:38.575 INFO:teuthology.orchestra.run.trial051.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:38:38.576 INFO:teuthology.orchestra.run.trial051.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:38:38.576 INFO:teuthology.orchestra.run.trial051.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:38:38.576 INFO:teuthology.orchestra.run.trial051.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:38:38.576 INFO:teuthology.orchestra.run.trial051.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:38:38.576 INFO:teuthology.orchestra.run.trial051.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:38:38.576 INFO:teuthology.orchestra.run.trial051.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:38:38.576 INFO:teuthology.orchestra.run.trial051.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:38:38.576 INFO:teuthology.orchestra.run.trial051.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:38:39.188 INFO:teuthology.orchestra.run.trial051.stdout:Discarding blocks...Done. 2026-02-20T11:38:39.190 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial051.front.sepia.ceph.com -o noatime 2026-02-20T11:38:39.190 DEBUG:teuthology.orchestra.run.trial051:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-20T11:38:39.258 DEBUG:teuthology.orchestra.run.trial051:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-20T11:38:39.328 DEBUG:teuthology.orchestra.run.trial051:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-20T11:38:39.393 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-20T11:38:39.393 INFO:tasks.ceph:role: osd.2 2026-02-20T11:38:39.393 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial051.front.sepia.ceph.com 2026-02-20T11:38:39.393 DEBUG:teuthology.orchestra.run.trial051:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-20T11:38:39.458 INFO:teuthology.orchestra.run.trial051.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:38:39.458 INFO:teuthology.orchestra.run.trial051.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:38:39.458 INFO:teuthology.orchestra.run.trial051.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:38:39.458 INFO:teuthology.orchestra.run.trial051.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:38:39.458 INFO:teuthology.orchestra.run.trial051.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:38:39.458 INFO:teuthology.orchestra.run.trial051.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:38:39.458 INFO:teuthology.orchestra.run.trial051.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:38:39.458 INFO:teuthology.orchestra.run.trial051.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:38:39.459 INFO:teuthology.orchestra.run.trial051.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:38:39.459 INFO:teuthology.orchestra.run.trial051.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:38:40.065 INFO:teuthology.orchestra.run.trial051.stdout:Discarding blocks...Done. 2026-02-20T11:38:40.067 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial051.front.sepia.ceph.com -o noatime 2026-02-20T11:38:40.067 DEBUG:teuthology.orchestra.run.trial051:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-20T11:38:40.133 DEBUG:teuthology.orchestra.run.trial051:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-20T11:38:40.200 DEBUG:teuthology.orchestra.run.trial051:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:38:40.350 INFO:teuthology.orchestra.run.trial051.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:38:40.404 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:40,403 seastar - Reactor backend: linux-aio 2026-02-20T11:38:40.422 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:40,420 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:38:40.422 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:40,420 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:38:40.424 INFO:teuthology.orchestra.run.trial051.stderr:==39744==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:38:40.484 INFO:teuthology.orchestra.run.trial051.stderr:DEBUG 2026-02-20 11:38:40,483 [shard 0:main] seastar - reactor::drain 2026-02-20T11:38:42.552 INFO:teuthology.orchestra.run.trial051.stderr:----------------------------------------------------- 2026-02-20T11:38:42.552 INFO:teuthology.orchestra.run.trial051.stderr:Suppressions used: 2026-02-20T11:38:42.553 INFO:teuthology.orchestra.run.trial051.stderr: count bytes template 2026-02-20T11:38:42.553 INFO:teuthology.orchestra.run.trial051.stderr: 1 8 MallocExtension::Register 2026-02-20T11:38:42.553 INFO:teuthology.orchestra.run.trial051.stderr:----------------------------------------------------- 2026-02-20T11:38:42.553 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-20T11:38:42.572 INFO:teuthology.orchestra.run.trial051.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:38:42.572 INFO:teuthology.orchestra.run.trial051.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:38:42.618 INFO:teuthology.orchestra.run.trial051.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:38:42.618 INFO:teuthology.orchestra.run.trial051.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:38:42.625 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:42,624 seastar - Reactor backend: linux-aio 2026-02-20T11:38:42.640 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:42,639 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:38:42.640 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:42,639 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:38:42.644 INFO:teuthology.orchestra.run.trial051.stderr:==39742==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:38:42.644 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:42,643 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:38:45.856 INFO:teuthology.orchestra.run.trial051.stderr:----------------------------------------------------- 2026-02-20T11:38:45.857 INFO:teuthology.orchestra.run.trial051.stderr:Suppressions used: 2026-02-20T11:38:45.857 INFO:teuthology.orchestra.run.trial051.stderr: count bytes template 2026-02-20T11:38:45.857 INFO:teuthology.orchestra.run.trial051.stderr: 1 8 MallocExtension::Register 2026-02-20T11:38:45.857 INFO:teuthology.orchestra.run.trial051.stderr:----------------------------------------------------- 2026-02-20T11:38:45.857 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-20T11:38:45.889 DEBUG:teuthology.orchestra.run.trial051:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-20T11:38:45.916 DEBUG:teuthology.orchestra.run.trial051:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:38:46.066 INFO:teuthology.orchestra.run.trial051.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:38:46.120 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:46,118 seastar - Reactor backend: linux-aio 2026-02-20T11:38:46.129 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:46,128 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:38:46.129 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:46,128 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:38:46.131 INFO:teuthology.orchestra.run.trial051.stderr:==39947==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:38:46.192 INFO:teuthology.orchestra.run.trial051.stderr:DEBUG 2026-02-20 11:38:46,190 [shard 0:main] seastar - reactor::drain 2026-02-20T11:38:48.247 INFO:teuthology.orchestra.run.trial051.stderr:----------------------------------------------------- 2026-02-20T11:38:48.247 INFO:teuthology.orchestra.run.trial051.stderr:Suppressions used: 2026-02-20T11:38:48.247 INFO:teuthology.orchestra.run.trial051.stderr: count bytes template 2026-02-20T11:38:48.248 INFO:teuthology.orchestra.run.trial051.stderr: 1 8 MallocExtension::Register 2026-02-20T11:38:48.248 INFO:teuthology.orchestra.run.trial051.stderr:----------------------------------------------------- 2026-02-20T11:38:48.248 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-20T11:38:48.267 INFO:teuthology.orchestra.run.trial051.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:38:48.267 INFO:teuthology.orchestra.run.trial051.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:38:48.324 INFO:teuthology.orchestra.run.trial051.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:38:48.325 INFO:teuthology.orchestra.run.trial051.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:38:48.331 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:48,330 seastar - Reactor backend: linux-aio 2026-02-20T11:38:48.341 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:48,340 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:38:48.342 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:48,340 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:38:48.345 INFO:teuthology.orchestra.run.trial051.stderr:==39945==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:38:48.346 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:48,344 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:38:51.817 INFO:teuthology.orchestra.run.trial051.stderr:----------------------------------------------------- 2026-02-20T11:38:51.817 INFO:teuthology.orchestra.run.trial051.stderr:Suppressions used: 2026-02-20T11:38:51.817 INFO:teuthology.orchestra.run.trial051.stderr: count bytes template 2026-02-20T11:38:51.817 INFO:teuthology.orchestra.run.trial051.stderr: 1 8 MallocExtension::Register 2026-02-20T11:38:51.817 INFO:teuthology.orchestra.run.trial051.stderr:----------------------------------------------------- 2026-02-20T11:38:51.817 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-20T11:38:51.847 DEBUG:teuthology.orchestra.run.trial051:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-20T11:38:51.873 DEBUG:teuthology.orchestra.run.trial051:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:38:52.027 INFO:teuthology.orchestra.run.trial051.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:38:52.079 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:52,077 seastar - Reactor backend: linux-aio 2026-02-20T11:38:52.088 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:52,087 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:38:52.088 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:52,087 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:38:52.090 INFO:teuthology.orchestra.run.trial051.stderr:==40150==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:38:52.123 INFO:teuthology.orchestra.run.trial051.stderr:Reactor stalled for 32 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0xdc1f82 0x2b965f8 0x2b9694e 0x2b96a51 0x35f3836 0x35f3a05 0x35f3d38 0x35f40da 0x35f41e9 0x35fa172 0x35fa581 0x35fa838 0x35fa9a1 0x35fab15 0x35faf45 0x35fb184 0x35fb404 0x35fb5e4 0x35fb6f3 0x35fa172 0x35fc00b 0x35fc2c2 0x35fc52b 0x35fcd1d 0x35fd212 0x36159f1 0x3615d50 0x36160c8 0x3616566 0x36169a5 0x35fe7d4 0x35ff181 0x35ff438 0x35ff8d7 0x35ff9f3 0x361e13f 0x361e4d1 0x361e804 0x361eb61 0x361ed99 0x361f3d4 0x361f704 0x361fa6a 0x361ff17 0x3620356 0x35ffbf2 0x3600001 0x36002b8 0x3600409 0x3624bcc 0x3624f57 0x362528a 0x362577d 0x3625b5f 0x3625ceb 0x3626123 0x362648f 0x36267f4 0x3626b17 0x3626bf9 0x3626e87 0x362705e 0x36272c5 0x362757b 0x3627ccb 0x36281b7 0x3628531 0x36287b0 0x3628865 0x350a512 0x35e3799 0x35e3dd3 0x350a512 0x350a921 0x350abd8 0x350b6d9 0x3520d3b 0x33d614b 0x45f3998 0x467ed29 0x46801d1 0x4680256 0x4680358 0x4680450 0x468065b 0x4680841 0x46808bc 0x4680937 0x46809b2 0x468131f 0x46816c0 2026-02-20T11:38:52.150 INFO:teuthology.orchestra.run.trial051.stderr:DEBUG 2026-02-20 11:38:52,148 [shard 0:main] seastar - reactor::drain 2026-02-20T11:38:54.209 INFO:teuthology.orchestra.run.trial051.stderr:----------------------------------------------------- 2026-02-20T11:38:54.209 INFO:teuthology.orchestra.run.trial051.stderr:Suppressions used: 2026-02-20T11:38:54.209 INFO:teuthology.orchestra.run.trial051.stderr: count bytes template 2026-02-20T11:38:54.209 INFO:teuthology.orchestra.run.trial051.stderr: 1 8 MallocExtension::Register 2026-02-20T11:38:54.209 INFO:teuthology.orchestra.run.trial051.stderr:----------------------------------------------------- 2026-02-20T11:38:54.209 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-20T11:38:54.229 INFO:teuthology.orchestra.run.trial051.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:38:54.230 INFO:teuthology.orchestra.run.trial051.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:38:54.275 INFO:teuthology.orchestra.run.trial051.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:38:54.275 INFO:teuthology.orchestra.run.trial051.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:38:54.282 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:54,281 seastar - Reactor backend: linux-aio 2026-02-20T11:38:54.293 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:54,292 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:38:54.293 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:54,292 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:38:54.297 INFO:teuthology.orchestra.run.trial051.stderr:==40148==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:38:54.297 INFO:teuthology.orchestra.run.trial051.stderr:INFO 2026-02-20 11:38:54,296 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:38:57.511 INFO:teuthology.orchestra.run.trial051.stderr:----------------------------------------------------- 2026-02-20T11:38:57.511 INFO:teuthology.orchestra.run.trial051.stderr:Suppressions used: 2026-02-20T11:38:57.511 INFO:teuthology.orchestra.run.trial051.stderr: count bytes template 2026-02-20T11:38:57.512 INFO:teuthology.orchestra.run.trial051.stderr: 1 8 MallocExtension::Register 2026-02-20T11:38:57.512 INFO:teuthology.orchestra.run.trial051.stderr:----------------------------------------------------- 2026-02-20T11:38:57.512 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-20T11:38:57.544 DEBUG:teuthology.orchestra.run.trial051:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-20T11:38:57.569 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-20T11:38:57.569 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:57.569 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-20T11:38:57.632 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:57.632 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-20T11:38:57.695 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:57.696 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-20T11:38:57.759 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:57.760 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-20T11:38:57.824 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:57.824 DEBUG:teuthology.orchestra.run.trial051:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-20T11:38:57.880 INFO:tasks.ceph:Adding keys to all mons... 2026-02-20T11:38:57.880 DEBUG:teuthology.orchestra.run.trial051:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-20T11:38:57.943 INFO:teuthology.orchestra.run.trial051.stdout:[mgr.x] 2026-02-20T11:38:57.944 INFO:teuthology.orchestra.run.trial051.stdout: key = AQC9R5hpuyF0HRAAa1qYznTNDDkzl/eZDEgC0A== 2026-02-20T11:38:57.944 INFO:teuthology.orchestra.run.trial051.stdout:[osd.0] 2026-02-20T11:38:57.944 INFO:teuthology.orchestra.run.trial051.stdout: key = AQDCR5hpHW93KhAAA251i8I5eeHnAWtw1mXscA== 2026-02-20T11:38:57.944 INFO:teuthology.orchestra.run.trial051.stdout:[osd.1] 2026-02-20T11:38:57.944 INFO:teuthology.orchestra.run.trial051.stdout: key = AQDIR5hpQKFjGBAAkYenLLkHffmU+5ZSeYZDLQ== 2026-02-20T11:38:57.944 INFO:teuthology.orchestra.run.trial051.stdout:[osd.2] 2026-02-20T11:38:57.944 INFO:teuthology.orchestra.run.trial051.stdout: key = AQDOR5hpWQuKFRAARn8LGW4o+CwlRwea15seKw== 2026-02-20T11:38:57.944 INFO:teuthology.orchestra.run.trial051.stdout:[client.0] 2026-02-20T11:38:57.944 INFO:teuthology.orchestra.run.trial051.stdout: key = AQC9R5hp0U81IBAAgSCl+G2d3ggeIwNPl/nYqg== 2026-02-20T11:38:57.946 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-20T11:38:58.033 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:38:58.083 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:38:58.132 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:38:58.181 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-20T11:38:58.232 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-20T11:38:58.232 DEBUG:teuthology.orchestra.run.trial051:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-20T11:38:58.257 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-20T11:38:58.342 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:38:58.339+0000 7fa856c2ec00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:58.343 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:38:58.339+0000 7fa856c2ec00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:58.350 DEBUG:teuthology.orchestra.run.trial051:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-20T11:38:58.375 DEBUG:teuthology.orchestra.run.trial051:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:38:58.431 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-20T11:38:58.431 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-20T11:38:58.432 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-20T11:38:58.475 INFO:tasks.ceph.mon.a:Started 2026-02-20T11:38:58.475 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-20T11:38:58.475 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-20T11:38:58.476 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-20T11:38:58.478 INFO:tasks.ceph.mgr.x:Started 2026-02-20T11:38:58.479 DEBUG:tasks.ceph:set 0 configs 2026-02-20T11:38:58.479 DEBUG:teuthology.orchestra.run.trial051:> sudo ceph --cluster ceph config dump 2026-02-20T11:38:58.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-20T11:38:58.534+0000 7f754a64cc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:58.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-20T11:38:58.534+0000 7f754a64cc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:58.537 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-20T11:38:58.534+0000 7f754a64cc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:58.542 INFO:tasks.ceph.mgr.x.trial051.stderr:2026-02-20T11:38:58.539+0000 7f5840619fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:58.556 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:38:58.551+0000 7f894e61a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:58.558 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:38:58.555+0000 7f894e61a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:58.589 INFO:teuthology.orchestra.run.trial051.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-20T11:38:58.596 INFO:tasks.ceph:Setting crush tunables to default 2026-02-20T11:38:58.596 DEBUG:teuthology.orchestra.run.trial051:> sudo ceph --cluster ceph osd crush tunables default 2026-02-20T11:38:58.670 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:38:58.664+0000 7f76ecc5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:58.671 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:38:58.668+0000 7f76ecc5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:58.704 INFO:teuthology.orchestra.run.trial051.stderr:adjusted tunables profile to default 2026-02-20T11:38:58.712 INFO:tasks.ceph:check_enable_crimson: True 2026-02-20T11:38:58.712 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-20T11:38:58.712 DEBUG:teuthology.orchestra.run.trial051:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-20T11:38:58.745 INFO:tasks.ceph.mgr.x.trial051.stderr:2026-02-20T11:38:58.743+0000 7f5840619fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:58.745 INFO:tasks.ceph.mgr.x.trial051.stderr:2026-02-20T11:38:58.743+0000 7f5840619fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:58.786 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:38:58.781+0000 7f2a9205a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:58.788 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:38:58.785+0000 7f2a9205a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:58.825 INFO:tasks.ceph.mon.a.trial051.stderr:2026-02-20T11:38:58.822+0000 7f75419f1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-20T11:38:58.825 INFO:tasks.ceph.mon.a.trial051.stderr:Please be aware that this feature is experimental, untested, 2026-02-20T11:38:58.825 INFO:tasks.ceph.mon.a.trial051.stderr:unsupported, and may result in data corruption, data loss, 2026-02-20T11:38:58.825 INFO:tasks.ceph.mon.a.trial051.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-20T11:38:58.825 INFO:tasks.ceph.mon.a.trial051.stderr:feature with important data. 2026-02-20T11:38:58.825 INFO:tasks.ceph.mon.a.trial051.stderr: 2026-02-20T11:38:59.580 INFO:tasks.ceph.mgr.x.trial051.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T11:38:59.580 INFO:tasks.ceph.mgr.x.trial051.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T11:38:59.580 INFO:tasks.ceph.mgr.x.trial051.stderr: from numpy import show_config as show_numpy_config 2026-02-20T11:38:59.713 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-20T11:38:59.713 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:59.714 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-20T11:38:59.779 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:59.780 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-20T11:38:59.845 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:38:59.846 DEBUG:teuthology.orchestra.run.trial051:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-20T11:38:59.910 DEBUG:teuthology.orchestra.run.trial051:> sudo ceph --cluster ceph osd new 4be0d900-7fa7-419a-b4ba-a45412547a78 0 2026-02-20T11:39:00.026 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:00.020+0000 7f6863b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:00.027 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:00.024+0000 7f6863b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:00.065 INFO:teuthology.orchestra.run.trial051.stdout:0 2026-02-20T11:39:00.073 DEBUG:teuthology.orchestra.run.trial051:> sudo ceph --cluster ceph osd new b09bf23f-56bb-43b8-a15d-2c591c9e9561 1 2026-02-20T11:39:00.147 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:00.141+0000 7f9c7810b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:00.148 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:00.146+0000 7f9c7810b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:00.185 INFO:teuthology.orchestra.run.trial051.stdout:1 2026-02-20T11:39:00.193 DEBUG:teuthology.orchestra.run.trial051:> sudo ceph --cluster ceph osd new 1d4f8a09-300e-446a-9e0a-28ec6d30e68a 2 2026-02-20T11:39:00.268 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:00.262+0000 7fcaac30b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:00.269 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:00.266+0000 7fcaac30b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:00.305 INFO:teuthology.orchestra.run.trial051.stdout:2 2026-02-20T11:39:00.313 DEBUG:teuthology.orchestra.run.trial051:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-20T11:39:00.342 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-20T11:39:00.342 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-20T11:39:00.383 INFO:tasks.ceph.osd.0:Started 2026-02-20T11:39:00.384 DEBUG:teuthology.orchestra.run.trial051:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-20T11:39:00.412 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-20T11:39:00.412 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-20T11:39:00.454 INFO:tasks.ceph.osd.1:Started 2026-02-20T11:39:00.454 DEBUG:teuthology.orchestra.run.trial051:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-20T11:39:00.481 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-20T11:39:00.481 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-20T11:39:00.523 INFO:tasks.ceph.osd.2:Started 2026-02-20T11:39:00.523 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:39:00.602 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:00.598+0000 7eff866cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:00.603 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:00.601+0000 7eff866cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:00.639 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:39:00.640 INFO:teuthology.orchestra.run.trial051.stdout:{"epoch":6,"fsid":"c39f4f1d-77ea-40f8-83cf-4e936b01eae3","created":"2026-02-20T11:38:58.546529+0000","modified":"2026-02-20T11:39:00.303448+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T11:39:00.303448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"4be0d900-7fa7-419a-b4ba-a45412547a78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b09bf23f-56bb-43b8-a15d-2c591c9e9561","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1d4f8a09-300e-446a-9e0a-28ec6d30e68a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:39:00.649 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-20T11:39:00.649 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-20T11:39:00.951 DEBUG:teuthology.orchestra.run.trial051:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T11:39:01.018 INFO:teuthology.misc.health.trial051.stderr:2026-02-20T11:39:01.014+0000 7fb1c5ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:01.020 INFO:teuthology.misc.health.trial051.stderr:2026-02-20T11:39:01.018+0000 7fb1c5ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:01.051 INFO:teuthology.misc.health.trial051.stdout: 2026-02-20T11:39:01.051 INFO:teuthology.misc.health.trial051.stdout:{"epoch":6,"fsid":"c39f4f1d-77ea-40f8-83cf-4e936b01eae3","created":"2026-02-20T11:38:58.546529+0000","modified":"2026-02-20T11:39:00.303448+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T11:39:00.303448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"4be0d900-7fa7-419a-b4ba-a45412547a78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b09bf23f-56bb-43b8-a15d-2c591c9e9561","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1d4f8a09-300e-446a-9e0a-28ec6d30e68a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:39:01.058 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-20T11:39:01.972 INFO:tasks.ceph.mgr.x.trial051.stderr:2026-02-20T11:39:01.971+0000 7f575bad9640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-20T11:39:07.361 DEBUG:teuthology.orchestra.run.trial051:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T11:39:07.431 INFO:teuthology.misc.health.trial051.stderr:2026-02-20T11:39:07.428+0000 7f944a10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:07.433 INFO:teuthology.misc.health.trial051.stderr:2026-02-20T11:39:07.431+0000 7f944a10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:07.545 INFO:teuthology.misc.health.trial051.stdout: 2026-02-20T11:39:07.545 INFO:teuthology.misc.health.trial051.stdout:{"epoch":7,"fsid":"c39f4f1d-77ea-40f8-83cf-4e936b01eae3","created":"2026-02-20T11:38:58.546529+0000","modified":"2026-02-20T11:39:07.081876+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T11:39:00.303448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"4be0d900-7fa7-419a-b4ba-a45412547a78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b09bf23f-56bb-43b8-a15d-2c591c9e9561","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1d4f8a09-300e-446a-9e0a-28ec6d30e68a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:39:07.554 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-20T11:39:13.856 DEBUG:teuthology.orchestra.run.trial051:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T11:39:13.927 INFO:teuthology.misc.health.trial051.stderr:2026-02-20T11:39:13.924+0000 7ff3818cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:13.928 INFO:teuthology.misc.health.trial051.stderr:2026-02-20T11:39:13.927+0000 7ff3818cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:14.039 INFO:teuthology.misc.health.trial051.stdout: 2026-02-20T11:39:14.040 INFO:teuthology.misc.health.trial051.stdout:{"epoch":13,"fsid":"c39f4f1d-77ea-40f8-83cf-4e936b01eae3","created":"2026-02-20T11:38:58.546529+0000","modified":"2026-02-20T11:39:13.106035+0000","last_up_change":"2026-02-20T11:39:10.093567+0000","last_in_change":"2026-02-20T11:39:00.303448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T11:39:10.983459+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4be0d900-7fa7-419a-b4ba-a45412547a78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6802","nonce":571202022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6803","nonce":571202022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6816","nonce":571202022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6817","nonce":571202022}]},"public_addr":"10.20.193.51:6802/571202022","cluster_addr":"10.20.193.51:6803/571202022","heartbeat_back_addr":"10.20.193.51:6816/571202022","heartbeat_front_addr":"10.20.193.51:6817/571202022","state":["exists","up"]},{"osd":1,"uuid":"b09bf23f-56bb-43b8-a15d-2c591c9e9561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6808","nonce":2998744635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6809","nonce":2998744635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6807","nonce":2998744635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6812","nonce":2998744635}]},"public_addr":"10.20.193.51:6808/2998744635","cluster_addr":"10.20.193.51:6809/2998744635","heartbeat_back_addr":"10.20.193.51:6807/2998744635","heartbeat_front_addr":"10.20.193.51:6812/2998744635","state":["exists","up"]},{"osd":2,"uuid":"1d4f8a09-300e-446a-9e0a-28ec6d30e68a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6805","nonce":3482943900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6804","nonce":3482943900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6811","nonce":3482943900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6810","nonce":3482943900}]},"public_addr":"10.20.193.51:6805/3482943900","cluster_addr":"10.20.193.51:6804/3482943900","heartbeat_back_addr":"10.20.193.51:6811/3482943900","heartbeat_front_addr":"10.20.193.51:6810/3482943900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:39:14.048 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-20T11:39:14.049 INFO:tasks.ceph:Creating RBD pool 2026-02-20T11:39:14.049 DEBUG:teuthology.orchestra.run.trial051:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-20T11:39:14.128 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:14.122+0000 7fb43945a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:14.129 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:14.127+0000 7fb43945a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:15.112 INFO:teuthology.orchestra.run.trial051.stderr:pool 'rbd' created 2026-02-20T11:39:15.128 DEBUG:teuthology.orchestra.run.trial051:> rbd --cluster ceph pool init rbd 2026-02-20T11:39:15.167 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:15.165+0000 7f6e14aef240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:15.168 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:15.165+0000 7f6e14aef240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:15.169 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:15.166+0000 7f6e14aef240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:18.136 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-20T11:39:18.137 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-20T11:39:18.137 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-20T11:39:18.255 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:18.250+0000 7fbfb45dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:18.256 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:18.254+0000 7fbfb45dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:18.369 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:39:18.379 INFO:teuthology.orchestra.run.trial051.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-20T11:39:18.380 INFO:tasks.ceph_manager:config epoch is 1 2026-02-20T11:39:18.380 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-20T11:39:18.380 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-20T11:39:18.380 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-20T11:39:18.457 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:18.452+0000 7f14e463d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:18.458 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:18.455+0000 7f14e463d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:18.603 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:39:18.613 INFO:teuthology.orchestra.run.trial051.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6800","nonce":2615517404},{"type":"v1","addr":"10.20.193.51:6801","nonce":2615517404}]},"active_addr":"10.20.193.51:6801/2615517404","active_change":"2026-02-20T11:39:00.965442+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.51:0","nonce":177018558}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.51:0","nonce":2573218225}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.51:0","nonce":853181977}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.51:0","nonce":1754137532}]}]} 2026-02-20T11:39:18.617 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-20T11:39:18.617 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T11:39:18.618 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:39:18.694 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:18.690+0000 7f30464cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:18.695 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:18.693+0000 7f30464cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:18.806 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:39:18.806 INFO:teuthology.orchestra.run.trial051.stdout:{"epoch":17,"fsid":"c39f4f1d-77ea-40f8-83cf-4e936b01eae3","created":"2026-02-20T11:38:58.546529+0000","modified":"2026-02-20T11:39:18.119204+0000","last_up_change":"2026-02-20T11:39:10.093567+0000","last_in_change":"2026-02-20T11:39:00.303448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T11:39:10.983459+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T11:39:14.240893+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4be0d900-7fa7-419a-b4ba-a45412547a78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6802","nonce":571202022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6803","nonce":571202022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6816","nonce":571202022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6817","nonce":571202022}]},"public_addr":"10.20.193.51:6802/571202022","cluster_addr":"10.20.193.51:6803/571202022","heartbeat_back_addr":"10.20.193.51:6816/571202022","heartbeat_front_addr":"10.20.193.51:6817/571202022","state":["exists","up"]},{"osd":1,"uuid":"b09bf23f-56bb-43b8-a15d-2c591c9e9561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6808","nonce":2998744635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6809","nonce":2998744635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6807","nonce":2998744635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6812","nonce":2998744635}]},"public_addr":"10.20.193.51:6808/2998744635","cluster_addr":"10.20.193.51:6809/2998744635","heartbeat_back_addr":"10.20.193.51:6807/2998744635","heartbeat_front_addr":"10.20.193.51:6812/2998744635","state":["exists","up"]},{"osd":2,"uuid":"1d4f8a09-300e-446a-9e0a-28ec6d30e68a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6805","nonce":3482943900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6804","nonce":3482943900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6811","nonce":3482943900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6810","nonce":3482943900}]},"public_addr":"10.20.193.51:6805/3482943900","cluster_addr":"10.20.193.51:6804/3482943900","heartbeat_back_addr":"10.20.193.51:6811/3482943900","heartbeat_front_addr":"10.20.193.51:6810/3482943900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:39:18.815 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-20T11:39:18.816 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:39:18.892 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:18.888+0000 7ffb63c8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:18.893 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:18.891+0000 7ffb63c8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:19.004 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:39:19.004 INFO:teuthology.orchestra.run.trial051.stdout:{"epoch":17,"fsid":"c39f4f1d-77ea-40f8-83cf-4e936b01eae3","created":"2026-02-20T11:38:58.546529+0000","modified":"2026-02-20T11:39:18.119204+0000","last_up_change":"2026-02-20T11:39:10.093567+0000","last_in_change":"2026-02-20T11:39:00.303448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T11:39:10.983459+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T11:39:14.240893+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4be0d900-7fa7-419a-b4ba-a45412547a78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6802","nonce":571202022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6803","nonce":571202022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6816","nonce":571202022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6817","nonce":571202022}]},"public_addr":"10.20.193.51:6802/571202022","cluster_addr":"10.20.193.51:6803/571202022","heartbeat_back_addr":"10.20.193.51:6816/571202022","heartbeat_front_addr":"10.20.193.51:6817/571202022","state":["exists","up"]},{"osd":1,"uuid":"b09bf23f-56bb-43b8-a15d-2c591c9e9561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6808","nonce":2998744635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6809","nonce":2998744635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6807","nonce":2998744635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6812","nonce":2998744635}]},"public_addr":"10.20.193.51:6808/2998744635","cluster_addr":"10.20.193.51:6809/2998744635","heartbeat_back_addr":"10.20.193.51:6807/2998744635","heartbeat_front_addr":"10.20.193.51:6812/2998744635","state":["exists","up"]},{"osd":2,"uuid":"1d4f8a09-300e-446a-9e0a-28ec6d30e68a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6805","nonce":3482943900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6804","nonce":3482943900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6811","nonce":3482943900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.51:6810","nonce":3482943900}]},"public_addr":"10.20.193.51:6805/3482943900","cluster_addr":"10.20.193.51:6804/3482943900","heartbeat_back_addr":"10.20.193.51:6811/3482943900","heartbeat_front_addr":"10.20.193.51:6810/3482943900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:39:19.014 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-20T11:39:19.015 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-20T11:39:19.015 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-20T11:39:19.096 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:19.091+0000 7f8aa12cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:19.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:19.092+0000 7fc84d7dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:19.097 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:19.092+0000 7f16b7611640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:19.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:19.095+0000 7f8aa12cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:19.098 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:19.096+0000 7fc84d7dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:19.099 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:19.096+0000 7f16b7611640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:19.113 INFO:teuthology.orchestra.run.trial051.stdout:42949672969 2026-02-20T11:39:19.113 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T11:39:19.114 INFO:teuthology.orchestra.run.trial051.stdout:38654705674 2026-02-20T11:39:19.115 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T11:39:19.116 INFO:teuthology.orchestra.run.trial051.stdout:42949672969 2026-02-20T11:39:19.116 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T11:39:19.236 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:19.231+0000 7fd2c681a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:19.237 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:19.232+0000 7f4bb12c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:19.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:19.235+0000 7fd2c681a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:19.238 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:19.236+0000 7f4bb12c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:19.239 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:19.233+0000 7f3f30564640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:19.247 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:19.244+0000 7f3f30564640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:19.349 INFO:teuthology.orchestra.run.trial051.stdout:42949672965 2026-02-20T11:39:19.355 INFO:teuthology.orchestra.run.trial051.stdout:42949672965 2026-02-20T11:39:19.357 INFO:teuthology.orchestra.run.trial051.stdout:38654705674 2026-02-20T11:39:19.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672969 got 42949672965 for osd.2 2026-02-20T11:39:19.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672969 got 42949672965 for osd.1 2026-02-20T11:39:19.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705674 got 38654705674 for osd.0 2026-02-20T11:39:19.368 DEBUG:teuthology.parallel:result is None 2026-02-20T11:39:20.361 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T11:39:20.366 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T11:39:20.442 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:20.436+0000 7f645b783640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:20.443 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:20.440+0000 7f645b783640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:20.487 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:20.481+0000 7f6ad748b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:20.488 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:20.485+0000 7f6ad748b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:20.555 INFO:teuthology.orchestra.run.trial051.stdout:42949672965 2026-02-20T11:39:20.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672969 got 42949672965 for osd.2 2026-02-20T11:39:20.599 INFO:teuthology.orchestra.run.trial051.stdout:42949672965 2026-02-20T11:39:20.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672969 got 42949672965 for osd.1 2026-02-20T11:39:21.566 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T11:39:21.611 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T11:39:21.646 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:21.640+0000 7f8a0ec8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:21.647 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:21.645+0000 7f8a0ec8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:21.690 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:21.685+0000 7f0ea6193640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:21.692 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:21.689+0000 7f0ea6193640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:21.758 INFO:teuthology.orchestra.run.trial051.stdout:42949672970 2026-02-20T11:39:21.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672969 got 42949672970 for osd.2 2026-02-20T11:39:21.769 DEBUG:teuthology.parallel:result is None 2026-02-20T11:39:21.802 INFO:teuthology.orchestra.run.trial051.stdout:42949672970 2026-02-20T11:39:21.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672969 got 42949672970 for osd.1 2026-02-20T11:39:21.812 DEBUG:teuthology.parallel:result is None 2026-02-20T11:39:21.812 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T11:39:21.812 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:39:21.928 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:21.924+0000 7faf07db8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:21.930 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:21.927+0000 7faf07db8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:22.036 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:39:22.036 INFO:teuthology.orchestra.run.trial051.stderr:dumped all 2026-02-20T11:39:22.046 INFO:teuthology.orchestra.run.trial051.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-20T11:39:20.969666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":80852,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":80256,"kb_avail":283034668,"statfs":{"total":289910292480,"available":289827500032,"internally_reserved":0,"allocated":561152,"data_stored":1293892,"data_compressed":61162,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82182144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.857001"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.125210+0000","last_change":"2026-02-20T11:39:18.129817+0000","last_active":"2026-02-20T11:39:18.125210+0000","last_peered":"2026-02-20T11:39:18.125210+0000","last_clean":"2026-02-20T11:39:18.125210+0000","last_became_active":"2026-02-20T11:39:16.135476+0000","last_became_peered":"2026-02-20T11:39:16.135476+0000","last_unstale":"2026-02-20T11:39:18.125210+0000","last_undegraded":"2026-02-20T11:39:18.125210+0000","last_fullsized":"2026-02-20T11:39:18.125210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_clean_scrub_stamp":"2026-02-20T11:39:15.109020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.126725+0000","last_change":"2026-02-20T11:39:18.127773+0000","last_active":"2026-02-20T11:39:18.126725+0000","last_peered":"2026-02-20T11:39:18.126725+0000","last_clean":"2026-02-20T11:39:18.126725+0000","last_became_active":"2026-02-20T11:39:16.145355+0000","last_became_peered":"2026-02-20T11:39:16.145355+0000","last_unstale":"2026-02-20T11:39:18.126725+0000","last_undegraded":"2026-02-20T11:39:18.126725+0000","last_fullsized":"2026-02-20T11:39:18.126725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_clean_scrub_stamp":"2026-02-20T11:39:15.109020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.125992+0000","last_change":"2026-02-20T11:39:18.129914+0000","last_active":"2026-02-20T11:39:18.125992+0000","last_peered":"2026-02-20T11:39:18.125992+0000","last_clean":"2026-02-20T11:39:18.125992+0000","last_became_active":"2026-02-20T11:39:16.141960+0000","last_became_peered":"2026-02-20T11:39:16.141960+0000","last_unstale":"2026-02-20T11:39:18.125992+0000","last_undegraded":"2026-02-20T11:39:18.125992+0000","last_fullsized":"2026-02-20T11:39:18.125992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_clean_scrub_stamp":"2026-02-20T11:39:15.109020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.127716+0000","last_change":"2026-02-20T11:39:18.128818+0000","last_active":"2026-02-20T11:39:18.127716+0000","last_peered":"2026-02-20T11:39:18.127716+0000","last_clean":"2026-02-20T11:39:18.127716+0000","last_became_active":"2026-02-20T11:39:16.140342+0000","last_became_peered":"2026-02-20T11:39:16.140342+0000","last_unstale":"2026-02-20T11:39:18.127716+0000","last_undegraded":"2026-02-20T11:39:18.127716+0000","last_fullsized":"2026-02-20T11:39:18.127716+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_clean_scrub_stamp":"2026-02-20T11:39:15.109020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.126959+0000","last_change":"2026-02-20T11:39:18.126959+0000","last_active":"2026-02-20T11:39:18.126959+0000","last_peered":"2026-02-20T11:39:18.126959+0000","last_clean":"2026-02-20T11:39:18.126959+0000","last_became_active":"2026-02-20T11:39:16.139621+0000","last_became_peered":"2026-02-20T11:39:16.139621+0000","last_unstale":"2026-02-20T11:39:18.126959+0000","last_undegraded":"2026-02-20T11:39:18.126959+0000","last_fullsized":"2026-02-20T11:39:18.126959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_clean_scrub_stamp":"2026-02-20T11:39:15.109020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.126643+0000","last_change":"2026-02-20T11:39:18.127622+0000","last_active":"2026-02-20T11:39:18.126643+0000","last_peered":"2026-02-20T11:39:18.126643+0000","last_clean":"2026-02-20T11:39:18.126643+0000","last_became_active":"2026-02-20T11:39:16.143761+0000","last_became_peered":"2026-02-20T11:39:16.143761+0000","last_unstale":"2026-02-20T11:39:18.126643+0000","last_undegraded":"2026-02-20T11:39:18.126643+0000","last_fullsized":"2026-02-20T11:39:18.126643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_clean_scrub_stamp":"2026-02-20T11:39:15.109020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.125037+0000","last_change":"2026-02-20T11:39:18.126803+0000","last_active":"2026-02-20T11:39:18.125037+0000","last_peered":"2026-02-20T11:39:18.125037+0000","last_clean":"2026-02-20T11:39:18.125037+0000","last_became_active":"2026-02-20T11:39:16.140036+0000","last_became_peered":"2026-02-20T11:39:16.140036+0000","last_unstale":"2026-02-20T11:39:18.125037+0000","last_undegraded":"2026-02-20T11:39:18.125037+0000","last_fullsized":"2026-02-20T11:39:18.125037+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_clean_scrub_stamp":"2026-02-20T11:39:15.109020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.126701+0000","last_change":"2026-02-20T11:39:18.127956+0000","last_active":"2026-02-20T11:39:18.126701+0000","last_peered":"2026-02-20T11:39:18.126701+0000","last_clean":"2026-02-20T11:39:18.126701+0000","last_became_active":"2026-02-20T11:39:16.135374+0000","last_became_peered":"2026-02-20T11:39:16.135374+0000","last_unstale":"2026-02-20T11:39:18.126701+0000","last_undegraded":"2026-02-20T11:39:18.126701+0000","last_fullsized":"2026-02-20T11:39:18.126701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_clean_scrub_stamp":"2026-02-20T11:39:15.109020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":90,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.125845+0000","last_change":"2026-02-20T11:39:12.116512+0000","last_active":"2026-02-20T11:39:18.125845+0000","last_peered":"2026-02-20T11:39:18.125845+0000","last_clean":"2026-02-20T11:39:18.125845+0000","last_became_active":"2026-02-20T11:39:12.114474+0000","last_became_peered":"2026-02-20T11:39:12.114474+0000","last_unstale":"2026-02-20T11:39:18.125845+0000","last_undegraded":"2026-02-20T11:39:18.125845+0000","last_fullsized":"2026-02-20T11:39:18.125845+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:11.098417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:11.098417+0000","last_clean_scrub_stamp":"2026-02-20T11:39:11.098417+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30581,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26972,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344868,"statfs":{"total":96636764160,"available":96609144832,"internally_reserved":0,"allocated":208896,"data_stored":628093,"data_compressed":30581,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26908,"kb_used_data":140,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344932,"statfs":{"total":96636764160,"available":96609210368,"internally_reserved":0,"allocated":143360,"data_stored":37706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26972,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344868,"statfs":{"total":96636764160,"available":96609144832,"internally_reserved":0,"allocated":208896,"data_stored":628093,"data_compressed":30581,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30581,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:39:22.046 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:39:22.123 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:22.118+0000 7fd679e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:22.124 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:22.121+0000 7fd679e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:22.235 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:39:22.235 INFO:teuthology.orchestra.run.trial051.stderr:dumped all 2026-02-20T11:39:22.244 INFO:teuthology.orchestra.run.trial051.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-20T11:39:20.969666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":80852,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":80256,"kb_avail":283034668,"statfs":{"total":289910292480,"available":289827500032,"internally_reserved":0,"allocated":561152,"data_stored":1293892,"data_compressed":61162,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82182144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.857001"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.125210+0000","last_change":"2026-02-20T11:39:18.129817+0000","last_active":"2026-02-20T11:39:18.125210+0000","last_peered":"2026-02-20T11:39:18.125210+0000","last_clean":"2026-02-20T11:39:18.125210+0000","last_became_active":"2026-02-20T11:39:16.135476+0000","last_became_peered":"2026-02-20T11:39:16.135476+0000","last_unstale":"2026-02-20T11:39:18.125210+0000","last_undegraded":"2026-02-20T11:39:18.125210+0000","last_fullsized":"2026-02-20T11:39:18.125210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_clean_scrub_stamp":"2026-02-20T11:39:15.109020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.126725+0000","last_change":"2026-02-20T11:39:18.127773+0000","last_active":"2026-02-20T11:39:18.126725+0000","last_peered":"2026-02-20T11:39:18.126725+0000","last_clean":"2026-02-20T11:39:18.126725+0000","last_became_active":"2026-02-20T11:39:16.145355+0000","last_became_peered":"2026-02-20T11:39:16.145355+0000","last_unstale":"2026-02-20T11:39:18.126725+0000","last_undegraded":"2026-02-20T11:39:18.126725+0000","last_fullsized":"2026-02-20T11:39:18.126725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_clean_scrub_stamp":"2026-02-20T11:39:15.109020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.125992+0000","last_change":"2026-02-20T11:39:18.129914+0000","last_active":"2026-02-20T11:39:18.125992+0000","last_peered":"2026-02-20T11:39:18.125992+0000","last_clean":"2026-02-20T11:39:18.125992+0000","last_became_active":"2026-02-20T11:39:16.141960+0000","last_became_peered":"2026-02-20T11:39:16.141960+0000","last_unstale":"2026-02-20T11:39:18.125992+0000","last_undegraded":"2026-02-20T11:39:18.125992+0000","last_fullsized":"2026-02-20T11:39:18.125992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_clean_scrub_stamp":"2026-02-20T11:39:15.109020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.127716+0000","last_change":"2026-02-20T11:39:18.128818+0000","last_active":"2026-02-20T11:39:18.127716+0000","last_peered":"2026-02-20T11:39:18.127716+0000","last_clean":"2026-02-20T11:39:18.127716+0000","last_became_active":"2026-02-20T11:39:16.140342+0000","last_became_peered":"2026-02-20T11:39:16.140342+0000","last_unstale":"2026-02-20T11:39:18.127716+0000","last_undegraded":"2026-02-20T11:39:18.127716+0000","last_fullsized":"2026-02-20T11:39:18.127716+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_clean_scrub_stamp":"2026-02-20T11:39:15.109020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.126959+0000","last_change":"2026-02-20T11:39:18.126959+0000","last_active":"2026-02-20T11:39:18.126959+0000","last_peered":"2026-02-20T11:39:18.126959+0000","last_clean":"2026-02-20T11:39:18.126959+0000","last_became_active":"2026-02-20T11:39:16.139621+0000","last_became_peered":"2026-02-20T11:39:16.139621+0000","last_unstale":"2026-02-20T11:39:18.126959+0000","last_undegraded":"2026-02-20T11:39:18.126959+0000","last_fullsized":"2026-02-20T11:39:18.126959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_clean_scrub_stamp":"2026-02-20T11:39:15.109020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.126643+0000","last_change":"2026-02-20T11:39:18.127622+0000","last_active":"2026-02-20T11:39:18.126643+0000","last_peered":"2026-02-20T11:39:18.126643+0000","last_clean":"2026-02-20T11:39:18.126643+0000","last_became_active":"2026-02-20T11:39:16.143761+0000","last_became_peered":"2026-02-20T11:39:16.143761+0000","last_unstale":"2026-02-20T11:39:18.126643+0000","last_undegraded":"2026-02-20T11:39:18.126643+0000","last_fullsized":"2026-02-20T11:39:18.126643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_clean_scrub_stamp":"2026-02-20T11:39:15.109020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.125037+0000","last_change":"2026-02-20T11:39:18.126803+0000","last_active":"2026-02-20T11:39:18.125037+0000","last_peered":"2026-02-20T11:39:18.125037+0000","last_clean":"2026-02-20T11:39:18.125037+0000","last_became_active":"2026-02-20T11:39:16.140036+0000","last_became_peered":"2026-02-20T11:39:16.140036+0000","last_unstale":"2026-02-20T11:39:18.125037+0000","last_undegraded":"2026-02-20T11:39:18.125037+0000","last_fullsized":"2026-02-20T11:39:18.125037+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_clean_scrub_stamp":"2026-02-20T11:39:15.109020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.126701+0000","last_change":"2026-02-20T11:39:18.127956+0000","last_active":"2026-02-20T11:39:18.126701+0000","last_peered":"2026-02-20T11:39:18.126701+0000","last_clean":"2026-02-20T11:39:18.126701+0000","last_became_active":"2026-02-20T11:39:16.135374+0000","last_became_peered":"2026-02-20T11:39:16.135374+0000","last_unstale":"2026-02-20T11:39:18.126701+0000","last_undegraded":"2026-02-20T11:39:18.126701+0000","last_fullsized":"2026-02-20T11:39:18.126701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:15.109020+0000","last_clean_scrub_stamp":"2026-02-20T11:39:15.109020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":90,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:39:18.125845+0000","last_change":"2026-02-20T11:39:12.116512+0000","last_active":"2026-02-20T11:39:18.125845+0000","last_peered":"2026-02-20T11:39:18.125845+0000","last_clean":"2026-02-20T11:39:18.125845+0000","last_became_active":"2026-02-20T11:39:12.114474+0000","last_became_peered":"2026-02-20T11:39:12.114474+0000","last_unstale":"2026-02-20T11:39:18.125845+0000","last_undegraded":"2026-02-20T11:39:18.125845+0000","last_fullsized":"2026-02-20T11:39:18.125845+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:39:11.098417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:39:11.098417+0000","last_clean_scrub_stamp":"2026-02-20T11:39:11.098417+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30581,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26972,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344868,"statfs":{"total":96636764160,"available":96609144832,"internally_reserved":0,"allocated":208896,"data_stored":628093,"data_compressed":30581,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26908,"kb_used_data":140,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344932,"statfs":{"total":96636764160,"available":96609210368,"internally_reserved":0,"allocated":143360,"data_stored":37706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26972,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344868,"statfs":{"total":96636764160,"available":96609144832,"internally_reserved":0,"allocated":208896,"data_stored":628093,"data_compressed":30581,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30581,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:39:22.245 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T11:39:22.246 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-20T11:39:22.246 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-20T11:39:22.246 DEBUG:teuthology.orchestra.run.trial051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-20T11:39:22.321 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:22.317+0000 7fb031ddc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:22.322 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:39:22.320+0000 7fb031ddc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:22.461 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:39:22.461 INFO:teuthology.orchestra.run.trial051.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-20T11:39:22.471 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-20T11:39:22.472 INFO:teuthology.run_tasks:Running task ssh_keys... 2026-02-20T11:39:22.563 DEBUG:teuthology.orchestra.run.trial051:> echo 'StrictHostKeyChecking no 2026-02-20T11:39:22.563 DEBUG:teuthology.orchestra.run.trial051:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2026-02-20T11:39:22.579 INFO:teuthology.task.ssh_keys:generated public key AAAAB3NzaC1yc2EAAAADAQABAAABAQClxtypbJufVd6U82OJkgEVmrw8kmhiBpG+aYBTRsea/qG15mRE6UAGGAT+IDBHEsRDFGTetS3oMiDj0WTQ4hzlIrB7KXR/ywjf5bnJjlJeLwPZdbr6cfCMDHh8MSiScOjCXUjqDC8LXYtyL7pPG9lZs5+a5/WnB6SgdG1bdtbop/QlJdcQugFhU1Odmim64ipoK5k0NDE/KI4w3aTFlSit+Od6h1FHVOybnoSmXjBy9YdAs6XEItgZ92vGMB+y4KFBYJ+CMvbWWzwQg94QuRZfFOVpBkLQiNsj48ximXGUlDmpWhCabaitIHqOLUUuhGi5qVwR6dswPtdip7e37iKV 2026-02-20T11:39:22.579 INFO:teuthology.task.ssh_keys:pushing keys to trial051.front.sepia.ceph.com for ubuntu 2026-02-20T11:39:22.579 DEBUG:teuthology.orchestra.run.trial051:> rm -f -- /home/ubuntu/.ssh/id_rsa 2026-02-20T11:39:22.635 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:39:22.635 DEBUG:teuthology.orchestra.run.trial051:> dd of=/home/ubuntu/.ssh/id_rsa 2026-02-20T11:39:22.635 DEBUG:teuthology.orchestra.run.trial051:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2026-02-20T11:39:22.692 DEBUG:teuthology.orchestra.run.trial051:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2026-02-20T11:39:22.748 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:39:22.748 DEBUG:teuthology.orchestra.run.trial051:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2026-02-20T11:39:22.804 DEBUG:teuthology.orchestra.run.trial051:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2026-02-20_11:39:22:804550 2026-02-20T11:39:22.861 INFO:teuthology.orchestra.run.trial051.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2026-02-20_11:39:22:804550' 2026-02-20T11:39:22.861 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:39:22.861 DEBUG:teuthology.orchestra.run.trial051:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2026-02-20T11:39:22.917 INFO:teuthology.run_tasks:Running task cbt... 2026-02-20T11:39:22.942 INFO:tasks.cbt:cbt configuration is {'cluster': {'user': 'ubuntu', 'head': 'ubuntu@trial051.front.sepia.ceph.com', 'osds': ['ubuntu@trial051.front.sepia.ceph.com'], 'mons': ['ubuntu@trial051.front.sepia.ceph.com'], 'clients': ['ubuntu@trial051.front.sepia.ceph.com'], 'rgws': {'ubuntu@trial051.front.sepia.ceph.com': None}, 'osds_per_node': 3, 'rebuild_every_test': False, 'use_existing': True, 'is_teuthology': True, 'iterations': 1, 'tmp_dir': '/tmp/cbt', 'pool_profiles': {'rbd': {'pg_size': 128, 'pgp_size': 128, 'replication': 3}}, 'pid_dir': '/var/run/ceph'}, 'benchmarks': {'librbdfio': {'iodepth': [32], 'log_avg_msec': 100, 'mode': ['randread'], 'norandommap': True, 'op_size': [4194304], 'osd_ra': [4096], 'pool_profile': 'rbd', 'procs_per_volume': [1], 'time': 60, 'vol_size': 4096, 'volumes_per_client': [2], 'cmd_path': '/home/ubuntu/cephtest/fio/fio'}}, 'client_endpoints': None, 'monitoring_profiles': {'perf': {'args': 'stat -p {pid} -o {perf_dir}/perf_stat.{pid}', 'nodes': ['osds'], 'perf_cmd': 'perf', 'pid_glob': 'crimson-osd.*.pid'}}} 2026-02-20T11:39:22.942 DEBUG:teuthology.orchestra.run.trial051:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/cbt 2026-02-20T11:39:22.975 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:39:22.975 DEBUG:teuthology.orchestra.run.trial051:> dd of=/home/ubuntu/cephtest/archive/cbt/cbt_config.yaml 2026-02-20T11:39:23.030 DEBUG:teuthology.orchestra.run.trial051:> git clone --depth 1 -b master https://github.com/ceph/cbt.git /home/ubuntu/cephtest/cbt 2026-02-20T11:39:23.093 INFO:teuthology.orchestra.run.trial051.stderr:Cloning into '/home/ubuntu/cephtest/cbt'... 2026-02-20T11:39:23.333 INFO:tasks.cbt:Installing collectl 2026-02-20T11:39:23.334 DEBUG:teuthology.orchestra.run.trial051:> sudo mkdir collectl && cd collectl && sudo wget https://sourceforge.net/projects/collectl/files/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz/download -O collectl.tar.gz && sudo tar -xvf collectl.tar.gz && cd collectl-4.3.1 && sudo ./INSTALL 2026-02-20T11:39:23.409 INFO:teuthology.orchestra.run.trial051.stderr:--2026-02-20 11:39:23-- https://sourceforge.net/projects/collectl/files/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz/download 2026-02-20T11:39:23.542 INFO:teuthology.orchestra.run.trial051.stderr:Resolving sourceforge.net (sourceforge.net)... 104.18.13.149, 104.18.12.149, 2606:4700::6812:c95, ... 2026-02-20T11:39:23.623 INFO:teuthology.orchestra.run.trial051.stderr:Connecting to sourceforge.net (sourceforge.net)|104.18.13.149|:443... connected. 2026-02-20T11:39:23.964 INFO:teuthology.orchestra.run.trial051.stderr:HTTP request sent, awaiting response... 302 Found 2026-02-20T11:39:23.965 INFO:teuthology.orchestra.run.trial051.stderr:Location: https://downloads.sourceforge.net/project/collectl/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz?ts=gAAAAABpmEfrGKmXETGdSXly63BS6eyw8bSZ-y86IqYGfU8sR5jKWWrkj_eamIUPWGD3YwSti0JTn21l4ZF0QbK3IZr1YhT1Lg%3D%3D&use_mirror=phoenixnap&r= [following] 2026-02-20T11:39:23.966 INFO:teuthology.orchestra.run.trial051.stderr:--2026-02-20 11:39:23-- https://downloads.sourceforge.net/project/collectl/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz?ts=gAAAAABpmEfrGKmXETGdSXly63BS6eyw8bSZ-y86IqYGfU8sR5jKWWrkj_eamIUPWGD3YwSti0JTn21l4ZF0QbK3IZr1YhT1Lg%3D%3D&use_mirror=phoenixnap&r= 2026-02-20T11:39:24.055 INFO:teuthology.orchestra.run.trial051.stderr:Resolving downloads.sourceforge.net (downloads.sourceforge.net)... 104.18.12.149, 104.18.13.149, 2606:4700::6812:c95, ... 2026-02-20T11:39:24.139 INFO:teuthology.orchestra.run.trial051.stderr:Connecting to downloads.sourceforge.net (downloads.sourceforge.net)|104.18.12.149|:443... connected. 2026-02-20T11:39:24.460 INFO:teuthology.orchestra.run.trial051.stderr:HTTP request sent, awaiting response... 302 Found 2026-02-20T11:39:24.460 INFO:teuthology.orchestra.run.trial051.stderr:Location: https://phoenixnap.dl.sourceforge.net/project/collectl/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz?viasf=1 [following] 2026-02-20T11:39:24.461 INFO:teuthology.orchestra.run.trial051.stderr:--2026-02-20 11:39:24-- https://phoenixnap.dl.sourceforge.net/project/collectl/collectl/collectl-4.3.1/collectl-4.3.1.src.tar.gz?viasf=1 2026-02-20T11:39:24.543 INFO:teuthology.orchestra.run.trial051.stderr:Resolving phoenixnap.dl.sourceforge.net (phoenixnap.dl.sourceforge.net)... 184.164.141.26 2026-02-20T11:39:24.605 INFO:teuthology.orchestra.run.trial051.stderr:Connecting to phoenixnap.dl.sourceforge.net (phoenixnap.dl.sourceforge.net)|184.164.141.26|:443... connected. 2026-02-20T11:39:24.898 INFO:teuthology.orchestra.run.trial051.stderr:HTTP request sent, awaiting response... 200 OK 2026-02-20T11:39:24.899 INFO:teuthology.orchestra.run.trial051.stderr:Length: 620693 (606K) [application/x-gzip] 2026-02-20T11:39:24.899 INFO:teuthology.orchestra.run.trial051.stderr:Saving to: ‘collectl.tar.gz’ 2026-02-20T11:39:24.899 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-20T11:39:24.960 INFO:teuthology.orchestra.run.trial051.stderr: 0K .......... .......... .......... .......... .......... 8% 807K 1s 2026-02-20T11:39:25.023 INFO:teuthology.orchestra.run.trial051.stderr: 50K .......... .......... .......... .......... .......... 16% 811K 1s 2026-02-20T11:39:25.024 INFO:teuthology.orchestra.run.trial051.stderr: 100K .......... .......... .......... .......... .......... 24% 110M 0s 2026-02-20T11:39:25.062 INFO:teuthology.orchestra.run.trial051.stderr: 150K .......... .......... .......... .......... .......... 32% 1.21M 0s 2026-02-20T11:39:25.086 INFO:teuthology.orchestra.run.trial051.stderr: 200K .......... .......... .......... .......... .......... 41% 2.29M 0s 2026-02-20T11:39:25.086 INFO:teuthology.orchestra.run.trial051.stderr: 250K .......... .......... .......... .......... .......... 49% 214M 0s 2026-02-20T11:39:25.086 INFO:teuthology.orchestra.run.trial051.stderr: 300K .......... .......... .......... .......... .......... 57% 247M 0s 2026-02-20T11:39:25.086 INFO:teuthology.orchestra.run.trial051.stderr: 350K .......... .......... .......... .......... .......... 65% 239M 0s 2026-02-20T11:39:25.149 INFO:teuthology.orchestra.run.trial051.stderr: 400K .......... .......... .......... .......... .......... 74% 821K 0s 2026-02-20T11:39:25.149 INFO:teuthology.orchestra.run.trial051.stderr: 450K .......... .......... .......... .......... .......... 82% 210M 0s 2026-02-20T11:39:25.150 INFO:teuthology.orchestra.run.trial051.stderr: 500K .......... .......... .......... .......... .......... 90% 288M 0s 2026-02-20T11:39:25.150 INFO:teuthology.orchestra.run.trial051.stderr: 550K .......... .......... .......... .......... .......... 98% 175M 0s 2026-02-20T11:39:25.150 INFO:teuthology.orchestra.run.trial051.stderr: 600K ...... 100% 11.4T=0.2s 2026-02-20T11:39:25.150 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-20T11:39:25.150 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20 11:39:25 (2.39 MB/s) - ‘collectl.tar.gz’ saved [620693/620693] 2026-02-20T11:39:25.150 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-20T11:39:25.168 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/ 2026-02-20T11:39:25.169 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/collectl.conf 2026-02-20T11:39:25.169 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/ 2026-02-20T11:39:25.169 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/SlowProc.html 2026-02-20T11:39:25.169 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/BuddyInfo.html 2026-02-20T11:39:25.169 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/WhySummary.html 2026-02-20T11:39:25.169 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Socket.html 2026-02-20T11:39:25.169 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/colmux.html 2026-02-20T11:39:25.169 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Tutorial.html 2026-02-20T11:39:25.169 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Gexpr.html 2026-02-20T11:39:25.169 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Import.html 2026-02-20T11:39:25.170 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/style.css 2026-02-20T11:39:25.170 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Ganglia3.jpg 2026-02-20T11:39:25.170 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Ganglia2.jpg 2026-02-20T11:39:25.170 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/FileNaming.html 2026-02-20T11:39:25.170 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/TheMath.html 2026-02-20T11:39:25.170 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Environmental.html 2026-02-20T11:39:25.170 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Process.html 2026-02-20T11:39:25.170 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/OutputFiles.html 2026-02-20T11:39:25.170 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/HiResTime.html 2026-02-20T11:39:25.170 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/OutputFormats.html 2026-02-20T11:39:25.170 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/slub.jpg 2026-02-20T11:39:25.170 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Lustre.html 2026-02-20T11:39:25.171 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Documentation.html 2026-02-20T11:39:25.171 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Inodes.html 2026-02-20T11:39:25.171 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Graphite.html 2026-02-20T11:39:25.171 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/InputFiles.html 2026-02-20T11:39:25.171 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Export.html 2026-02-20T11:39:25.171 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Interrupts.html 2026-02-20T11:39:25.171 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Startup.html 2026-02-20T11:39:25.171 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Performance.html 2026-02-20T11:39:25.171 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Messages.html 2026-02-20T11:39:25.171 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Logging.html 2026-02-20T11:39:25.171 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Data-detail.html 2026-02-20T11:39:25.171 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/CPUs.html 2026-02-20T11:39:25.172 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Matrix.html 2026-02-20T11:39:25.172 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Data-brief.html 2026-02-20T11:39:25.172 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/SlabInfo.html 2026-02-20T11:39:25.172 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Misc.html 2026-02-20T11:39:25.172 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Examples.html 2026-02-20T11:39:25.172 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/OpenStack.html 2026-02-20T11:39:25.172 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Plotfiles.html 2026-02-20T11:39:25.172 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/ColmuxCPU.jpg 2026-02-20T11:39:25.172 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Tutorial-Lustre.html 2026-02-20T11:39:25.172 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Data-verbose.html 2026-02-20T11:39:25.172 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Data.html 2026-02-20T11:39:25.172 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Exceptions.html 2026-02-20T11:39:25.173 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/RunningAsAService.html 2026-02-20T11:39:25.173 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/FAQ-collectl.html 2026-02-20T11:39:25.173 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Ganglia.jpg 2026-02-20T11:39:25.173 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/OperationalModes.html 2026-02-20T11:39:25.173 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Playback.html 2026-02-20T11:39:25.173 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Hello.html 2026-02-20T11:39:25.173 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Sockets.html 2026-02-20T11:39:25.173 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Network.html 2026-02-20T11:39:25.173 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Infiniband.html 2026-02-20T11:39:25.173 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Memory.html 2026-02-20T11:39:25.173 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/ColmuxLustre.jpg 2026-02-20T11:39:25.173 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/Disks.html 2026-02-20T11:39:25.174 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/docs/NfsInfo.html 2026-02-20T11:39:25.174 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/service/ 2026-02-20T11:39:25.174 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/service/collectl.service 2026-02-20T11:39:25.174 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/initd/ 2026-02-20T11:39:25.174 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/initd/collectl-suse 2026-02-20T11:39:25.174 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/initd/collectl-debian 2026-02-20T11:39:25.174 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/initd/collectl-generic 2026-02-20T11:39:25.174 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/initd/collectl 2026-02-20T11:39:25.174 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/misc.ph 2026-02-20T11:39:25.174 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/gexpr.ph 2026-02-20T11:39:25.174 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/statsd.ph 2026-02-20T11:39:25.174 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/envrules.std 2026-02-20T11:39:25.175 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/hello.ph 2026-02-20T11:39:25.175 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/vmsum.ph 2026-02-20T11:39:25.175 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/proctree.ph 2026-02-20T11:39:25.175 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/README-WINDOWS 2026-02-20T11:39:25.175 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/formatit.ph 2026-02-20T11:39:25.175 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/colmux 2026-02-20T11:39:25.175 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/INSTALL 2026-02-20T11:39:25.175 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/graphite.ph 2026-02-20T11:39:25.175 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/RELEASE-collectl 2026-02-20T11:39:25.175 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/vmstat.ph 2026-02-20T11:39:25.175 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/README 2026-02-20T11:39:25.175 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/man1/ 2026-02-20T11:39:25.175 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/man1/collectl.1 2026-02-20T11:39:25.176 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/man1/colmux.1 2026-02-20T11:39:25.176 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/lexpr.ph 2026-02-20T11:39:25.176 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/client.pl 2026-02-20T11:39:25.176 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/collectl 2026-02-20T11:39:25.176 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/COPYING 2026-02-20T11:39:25.176 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/vnet.ph 2026-02-20T11:39:25.176 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/GPL 2026-02-20T11:39:25.176 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/UNINSTALL 2026-02-20T11:39:25.176 INFO:teuthology.orchestra.run.trial051.stdout:collectl-4.3.1/ARTISTIC 2026-02-20T11:39:25.211 INFO:teuthology.orchestra.run.trial051.stderr:./INSTALL: line 90: chkconfig: command not found 2026-02-20T11:39:25.213 DEBUG:teuthology.orchestra.run.trial051:> sudo yum -y install librbd-devel pdsh pdsh-rcmd-ssh perf 2026-02-20T11:39:25.566 INFO:teuthology.orchestra.run.trial051.stdout:Last metadata expiration check: 0:01:02 ago on Fri 20 Feb 2026 11:38:23 AM UTC. 2026-02-20T11:39:25.653 INFO:teuthology.orchestra.run.trial051.stdout:Dependencies resolved. 2026-02-20T11:39:25.654 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:39:25.654 INFO:teuthology.orchestra.run.trial051.stdout: Package Arch Version Repository Size 2026-02-20T11:39:25.654 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:39:25.654 INFO:teuthology.orchestra.run.trial051.stdout:Installing: 2026-02-20T11:39:25.654 INFO:teuthology.orchestra.run.trial051.stdout: librbd-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 24 k 2026-02-20T11:39:25.654 INFO:teuthology.orchestra.run.trial051.stdout: pdsh x86_64 2.34-7.el9 epel 118 k 2026-02-20T11:39:25.654 INFO:teuthology.orchestra.run.trial051.stdout: pdsh-rcmd-ssh x86_64 2.34-7.el9 epel 13 k 2026-02-20T11:39:25.654 INFO:teuthology.orchestra.run.trial051.stdout: perf x86_64 5.14.0-681.el9 appstream 3.2 M 2026-02-20T11:39:25.655 INFO:teuthology.orchestra.run.trial051.stdout:Installing dependencies: 2026-02-20T11:39:25.655 INFO:teuthology.orchestra.run.trial051.stdout: libradospp-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 31 k 2026-02-20T11:39:25.655 INFO:teuthology.orchestra.run.trial051.stdout: libtraceevent x86_64 1.8.4-2.el9 baseos 290 k 2026-02-20T11:39:25.655 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:39:25.655 INFO:teuthology.orchestra.run.trial051.stdout:Transaction Summary 2026-02-20T11:39:25.655 INFO:teuthology.orchestra.run.trial051.stdout:================================================================================ 2026-02-20T11:39:25.655 INFO:teuthology.orchestra.run.trial051.stdout:Install 6 Packages 2026-02-20T11:39:25.655 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:39:25.656 INFO:teuthology.orchestra.run.trial051.stdout:Total download size: 3.7 M 2026-02-20T11:39:25.656 INFO:teuthology.orchestra.run.trial051.stdout:Installed size: 14 M 2026-02-20T11:39:25.656 INFO:teuthology.orchestra.run.trial051.stdout:Downloading Packages: 2026-02-20T11:39:26.457 INFO:teuthology.orchestra.run.trial051.stdout:(1/6): librbd-devel-20.3.0-5357.g0c3148ca.el9.x 75 kB/s | 24 kB 00:00 2026-02-20T11:39:26.457 INFO:teuthology.orchestra.run.trial051.stdout:(2/6): libradospp-devel-20.3.0-5357.g0c3148ca.e 98 kB/s | 31 kB 00:00 2026-02-20T11:39:26.670 INFO:teuthology.orchestra.run.trial051.stdout:(3/6): pdsh-2.34-7.el9.x86_64.rpm 557 kB/s | 118 kB 00:00 2026-02-20T11:39:26.692 INFO:teuthology.orchestra.run.trial051.stdout:(4/6): pdsh-rcmd-ssh-2.34-7.el9.x86_64.rpm 612 kB/s | 13 kB 00:00 2026-02-20T11:39:26.830 INFO:teuthology.orchestra.run.trial051.stdout:(5/6): perf-5.14.0-681.el9.x86_64.rpm 8.6 MB/s | 3.2 MB 00:00 2026-02-20T11:39:27.251 INFO:teuthology.orchestra.run.trial051.stdout:(6/6): libtraceevent-1.8.4-2.el9.x86_64.rpm 261 kB/s | 290 kB 00:01 2026-02-20T11:39:27.254 INFO:teuthology.orchestra.run.trial051.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:39:27.254 INFO:teuthology.orchestra.run.trial051.stdout:Total 2.3 MB/s | 3.7 MB 00:01 2026-02-20T11:39:27.278 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction check 2026-02-20T11:39:27.288 INFO:teuthology.orchestra.run.trial051.stdout:Transaction check succeeded. 2026-02-20T11:39:27.288 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction test 2026-02-20T11:39:27.345 INFO:teuthology.orchestra.run.trial051.stdout:Transaction test succeeded. 2026-02-20T11:39:27.346 INFO:teuthology.orchestra.run.trial051.stdout:Running transaction 2026-02-20T11:39:27.423 INFO:teuthology.orchestra.run.trial051.stdout: Preparing : 1/1 2026-02-20T11:39:27.428 INFO:teuthology.orchestra.run.trial051.stdout: Installing : pdsh-rcmd-ssh-2.34-7.el9.x86_64 1/6 2026-02-20T11:39:27.469 INFO:teuthology.orchestra.run.trial051.stdout: Installing : pdsh-2.34-7.el9.x86_64 2/6 2026-02-20T11:39:27.473 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libtraceevent-1.8.4-2.el9.x86_64 3/6 2026-02-20T11:39:27.475 INFO:teuthology.orchestra.run.trial051.stdout: Installing : libradospp-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/6 2026-02-20T11:39:27.637 INFO:teuthology.orchestra.run.trial051.stdout: Installing : librbd-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 5/6 2026-02-20T11:39:27.658 INFO:teuthology.orchestra.run.trial051.stdout: Installing : perf-5.14.0-681.el9.x86_64 6/6 2026-02-20T11:39:27.769 INFO:teuthology.orchestra.run.trial051.stdout: Running scriptlet: perf-5.14.0-681.el9.x86_64 6/6 2026-02-20T11:39:27.769 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libradospp-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/6 2026-02-20T11:39:27.770 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : librbd-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/6 2026-02-20T11:39:27.770 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : libtraceevent-1.8.4-2.el9.x86_64 3/6 2026-02-20T11:39:27.770 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : perf-5.14.0-681.el9.x86_64 4/6 2026-02-20T11:39:27.770 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : pdsh-2.34-7.el9.x86_64 5/6 2026-02-20T11:39:27.829 INFO:teuthology.orchestra.run.trial051.stdout: Verifying : pdsh-rcmd-ssh-2.34-7.el9.x86_64 6/6 2026-02-20T11:39:27.829 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:39:27.829 INFO:teuthology.orchestra.run.trial051.stdout:Installed: 2026-02-20T11:39:27.829 INFO:teuthology.orchestra.run.trial051.stdout: libradospp-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:39:27.829 INFO:teuthology.orchestra.run.trial051.stdout: librbd-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:39:27.829 INFO:teuthology.orchestra.run.trial051.stdout: libtraceevent-1.8.4-2.el9.x86_64 2026-02-20T11:39:27.829 INFO:teuthology.orchestra.run.trial051.stdout: pdsh-2.34-7.el9.x86_64 2026-02-20T11:39:27.830 INFO:teuthology.orchestra.run.trial051.stdout: pdsh-rcmd-ssh-2.34-7.el9.x86_64 2026-02-20T11:39:27.830 INFO:teuthology.orchestra.run.trial051.stdout: perf-5.14.0-681.el9.x86_64 2026-02-20T11:39:27.830 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:39:27.830 INFO:teuthology.orchestra.run.trial051.stdout:Complete! 2026-02-20T11:39:27.859 DEBUG:teuthology.orchestra.run.trial051:> python3 -m pip install -r /home/ubuntu/cephtest/cbt/requirements.txt 2026-02-20T11:39:27.997 INFO:teuthology.orchestra.run.trial051.stdout:Defaulting to user installation because normal site-packages is not writeable 2026-02-20T11:39:28.008 INFO:teuthology.orchestra.run.trial051.stdout:Requirement already satisfied: pyyaml in /usr/lib64/python3.9/site-packages (from -r /home/ubuntu/cephtest/cbt/requirements.txt (line 1)) (5.4.1) 2026-02-20T11:39:28.008 INFO:teuthology.orchestra.run.trial051.stdout:Requirement already satisfied: lxml in /usr/lib64/python3.9/site-packages (from -r /home/ubuntu/cephtest/cbt/requirements.txt (line 2)) (4.6.5) 2026-02-20T11:39:28.794 INFO:teuthology.orchestra.run.trial051.stdout:Collecting matplotlib 2026-02-20T11:39:29.023 INFO:teuthology.orchestra.run.trial051.stdout: Downloading matplotlib-3.9.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.3 MB) 2026-02-20T11:39:29.855 INFO:teuthology.orchestra.run.trial051.stdout:Collecting kiwisolver>=1.3.1 2026-02-20T11:39:29.932 INFO:teuthology.orchestra.run.trial051.stdout: Downloading kiwisolver-1.4.7-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.6 MB) 2026-02-20T11:39:30.170 INFO:teuthology.orchestra.run.trial051.stdout:Collecting contourpy>=1.0.1 2026-02-20T11:39:30.245 INFO:teuthology.orchestra.run.trial051.stdout: Downloading contourpy-1.3.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (321 kB) 2026-02-20T11:39:30.693 INFO:teuthology.orchestra.run.trial051.stdout:Collecting fonttools>=4.22.0 2026-02-20T11:39:30.772 INFO:teuthology.orchestra.run.trial051.stdout: Downloading fonttools-4.60.2-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (4.8 MB) 2026-02-20T11:39:30.870 INFO:teuthology.orchestra.run.trial051.stdout:Requirement already satisfied: numpy>=1.23 in /usr/lib64/python3.9/site-packages (from matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (1.23.5) 2026-02-20T11:39:30.870 INFO:teuthology.orchestra.run.trial051.stdout:Requirement already satisfied: packaging>=20.0 in /usr/lib/python3.9/site-packages (from matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (20.9) 2026-02-20T11:39:30.958 INFO:teuthology.orchestra.run.trial051.stdout:Collecting cycler>=0.10 2026-02-20T11:39:31.039 INFO:teuthology.orchestra.run.trial051.stdout: Downloading cycler-0.12.1-py3-none-any.whl (8.3 kB) 2026-02-20T11:39:31.551 INFO:teuthology.orchestra.run.trial051.stdout:Collecting pillow>=8 2026-02-20T11:39:31.637 INFO:teuthology.orchestra.run.trial051.stdout: Downloading pillow-11.3.0-cp39-cp39-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (6.6 MB) 2026-02-20T11:39:31.739 INFO:teuthology.orchestra.run.trial051.stdout:Requirement already satisfied: python-dateutil>=2.7 in /usr/lib/python3.9/site-packages (from matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (2.9.0.post0) 2026-02-20T11:39:31.847 INFO:teuthology.orchestra.run.trial051.stdout:Collecting importlib-resources>=3.2.0 2026-02-20T11:39:31.924 INFO:teuthology.orchestra.run.trial051.stdout: Downloading importlib_resources-6.5.2-py3-none-any.whl (37 kB) 2026-02-20T11:39:31.925 INFO:teuthology.orchestra.run.trial051.stdout:Requirement already satisfied: pyparsing>=2.3.1 in /usr/lib/python3.9/site-packages (from matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (2.4.7) 2026-02-20T11:39:32.049 INFO:teuthology.orchestra.run.trial051.stdout:Collecting zipp>=3.1.0 2026-02-20T11:39:32.129 INFO:teuthology.orchestra.run.trial051.stdout: Downloading zipp-3.23.0-py3-none-any.whl (10 kB) 2026-02-20T11:39:32.140 INFO:teuthology.orchestra.run.trial051.stdout:Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil>=2.7->matplotlib->-r /home/ubuntu/cephtest/cbt/requirements.txt (line 3)) (1.15.0) 2026-02-20T11:39:32.256 INFO:teuthology.orchestra.run.trial051.stdout:Installing collected packages: zipp, pillow, kiwisolver, importlib-resources, fonttools, cycler, contourpy, matplotlib 2026-02-20T11:39:33.317 INFO:teuthology.orchestra.run.trial051.stdout:Successfully installed contourpy-1.3.0 cycler-0.12.1 fonttools-4.60.2 importlib-resources-6.5.2 kiwisolver-1.4.7 matplotlib-3.9.4 pillow-11.3.0 zipp-3.23.0 2026-02-20T11:39:33.762 INFO:tasks.cbt:benchmark: librbdfio 2026-02-20T11:39:33.763 DEBUG:teuthology.orchestra.run.trial051:> git clone -b master https://github.com/axboe/fio.git /home/ubuntu/cephtest/fio 2026-02-20T11:39:33.780 INFO:teuthology.orchestra.run.trial051.stderr:Cloning into '/home/ubuntu/cephtest/fio'... 2026-02-20T11:39:34.561 DEBUG:teuthology.orchestra.run.trial051:> cd /home/ubuntu/cephtest/fio && ./configure && make 2026-02-20T11:39:34.731 INFO:teuthology.orchestra.run.trial051.stdout:Operating system Linux 2026-02-20T11:39:34.731 INFO:teuthology.orchestra.run.trial051.stdout:CPU x86_64 2026-02-20T11:39:34.732 INFO:teuthology.orchestra.run.trial051.stdout:Big endian no 2026-02-20T11:39:34.732 INFO:teuthology.orchestra.run.trial051.stdout:Compiler gcc 2026-02-20T11:39:34.732 INFO:teuthology.orchestra.run.trial051.stdout:Cross compile no 2026-02-20T11:39:34.732 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:39:34.732 INFO:teuthology.orchestra.run.trial051.stdout:Static build no 2026-02-20T11:39:34.780 INFO:teuthology.orchestra.run.trial051.stdout:Wordsize 64 2026-02-20T11:39:34.786 INFO:teuthology.orchestra.run.trial051.stdout:zlib no 2026-02-20T11:39:34.798 INFO:teuthology.orchestra.run.trial051.stdout:fcntl(F_FULLFSYNC) no 2026-02-20T11:39:34.808 INFO:teuthology.orchestra.run.trial051.stdout:Linux AIO support no 2026-02-20T11:39:34.808 INFO:teuthology.orchestra.run.trial051.stdout:Linux AIO support rw flags no 2026-02-20T11:39:34.832 INFO:teuthology.orchestra.run.trial051.stdout:POSIX AIO support yes 2026-02-20T11:39:34.832 INFO:teuthology.orchestra.run.trial051.stdout:POSIX AIO support needs -lrt no 2026-02-20T11:39:34.852 INFO:teuthology.orchestra.run.trial051.stdout:POSIX AIO fsync yes 2026-02-20T11:39:34.872 INFO:teuthology.orchestra.run.trial051.stdout:POSIX pshared support yes 2026-02-20T11:39:34.897 INFO:teuthology.orchestra.run.trial051.stdout:pthread_condattr_setclock() yes 2026-02-20T11:39:34.921 INFO:teuthology.orchestra.run.trial051.stdout:pthread_sigmask() yes 2026-02-20T11:39:34.945 INFO:teuthology.orchestra.run.trial051.stdout:pthread_getaffinity_np() yes 2026-02-20T11:39:34.952 INFO:teuthology.orchestra.run.trial051.stdout:Solaris AIO support no 2026-02-20T11:39:34.973 INFO:teuthology.orchestra.run.trial051.stdout:__sync_fetch_and_add yes 2026-02-20T11:39:34.994 INFO:teuthology.orchestra.run.trial051.stdout:__sync_synchronize yes 2026-02-20T11:39:35.014 INFO:teuthology.orchestra.run.trial051.stdout:__sync_val_compare_and_swap yes 2026-02-20T11:39:35.019 INFO:teuthology.orchestra.run.trial051.stdout:libverbs no 2026-02-20T11:39:35.028 INFO:teuthology.orchestra.run.trial051.stdout:rdmacm no 2026-02-20T11:39:35.049 INFO:teuthology.orchestra.run.trial051.stdout:asprintf() yes 2026-02-20T11:39:35.071 INFO:teuthology.orchestra.run.trial051.stdout:vasprintf() yes 2026-02-20T11:39:35.091 INFO:teuthology.orchestra.run.trial051.stdout:Linux fallocate yes 2026-02-20T11:39:35.114 INFO:teuthology.orchestra.run.trial051.stdout:POSIX fadvise yes 2026-02-20T11:39:35.136 INFO:teuthology.orchestra.run.trial051.stdout:POSIX fallocate yes 2026-02-20T11:39:35.157 INFO:teuthology.orchestra.run.trial051.stdout:sched_setaffinity(3 arg) yes 2026-02-20T11:39:35.157 INFO:teuthology.orchestra.run.trial051.stdout:sched_setaffinity(2 arg) no 2026-02-20T11:39:35.178 INFO:teuthology.orchestra.run.trial051.stdout:clock_gettime yes 2026-02-20T11:39:35.201 INFO:teuthology.orchestra.run.trial051.stdout:CLOCK_MONOTONIC yes 2026-02-20T11:39:35.222 INFO:teuthology.orchestra.run.trial051.stdout:gettimeofday yes 2026-02-20T11:39:35.244 INFO:teuthology.orchestra.run.trial051.stdout:fdatasync yes 2026-02-20T11:39:35.267 INFO:teuthology.orchestra.run.trial051.stdout:pipe() yes 2026-02-20T11:39:35.287 INFO:teuthology.orchestra.run.trial051.stdout:pipe2() yes 2026-02-20T11:39:35.309 INFO:teuthology.orchestra.run.trial051.stdout:pread() yes 2026-02-20T11:39:35.333 INFO:teuthology.orchestra.run.trial051.stdout:sync_file_range yes 2026-02-20T11:39:35.339 INFO:teuthology.orchestra.run.trial051.stdout:ASharedMemory_create no 2026-02-20T11:39:35.347 INFO:teuthology.orchestra.run.trial051.stdout:EXT4 move extent yes 2026-02-20T11:39:35.369 INFO:teuthology.orchestra.run.trial051.stdout:Linux splice(2) yes 2026-02-20T11:39:35.374 INFO:teuthology.orchestra.run.trial051.stdout:libnuma no 2026-02-20T11:39:35.393 INFO:teuthology.orchestra.run.trial051.stdout:strsep yes 2026-02-20T11:39:35.414 INFO:teuthology.orchestra.run.trial051.stdout:strcasestr yes 2026-02-20T11:39:35.423 INFO:teuthology.orchestra.run.trial051.stdout:strlcat no 2026-02-20T11:39:35.445 INFO:teuthology.orchestra.run.trial051.stdout:getopt_long_only() yes 2026-02-20T11:39:35.470 INFO:teuthology.orchestra.run.trial051.stdout:inet_aton yes 2026-02-20T11:39:35.493 INFO:teuthology.orchestra.run.trial051.stdout:socklen_t yes 2026-02-20T11:39:35.515 INFO:teuthology.orchestra.run.trial051.stdout:__thread yes 2026-02-20T11:39:35.536 INFO:teuthology.orchestra.run.trial051.stdout:RUSAGE_THREAD yes 2026-02-20T11:39:35.556 INFO:teuthology.orchestra.run.trial051.stdout:SCHED_IDLE yes 2026-02-20T11:39:35.578 INFO:teuthology.orchestra.run.trial051.stdout:TCP_NODELAY yes 2026-02-20T11:39:35.601 INFO:teuthology.orchestra.run.trial051.stdout:vsock yes 2026-02-20T11:39:35.625 INFO:teuthology.orchestra.run.trial051.stdout:Net engine window_size yes 2026-02-20T11:39:35.648 INFO:teuthology.orchestra.run.trial051.stdout:TCP_MAXSEG yes 2026-02-20T11:39:35.668 INFO:teuthology.orchestra.run.trial051.stdout:RLIMIT_MEMLOCK yes 2026-02-20T11:39:35.690 INFO:teuthology.orchestra.run.trial051.stdout:pwritev/preadv yes 2026-02-20T11:39:35.711 INFO:teuthology.orchestra.run.trial051.stdout:pwritev2/preadv2 yes 2026-02-20T11:39:35.736 INFO:teuthology.orchestra.run.trial051.stdout:IPv6 helpers yes 2026-02-20T11:39:35.748 INFO:teuthology.orchestra.run.trial051.stdout:http engine no 2026-02-20T11:39:35.804 INFO:teuthology.orchestra.run.trial051.stdout:Rados engine yes 2026-02-20T11:39:35.872 INFO:teuthology.orchestra.run.trial051.stdout:Rados Block Device engine yes 2026-02-20T11:39:35.938 INFO:teuthology.orchestra.run.trial051.stdout:rbd_poll yes 2026-02-20T11:39:36.001 INFO:teuthology.orchestra.run.trial051.stdout:rbd_invalidate_cache yes 2026-02-20T11:39:36.068 INFO:teuthology.orchestra.run.trial051.stdout:rbd_encryption_load yes 2026-02-20T11:39:36.088 INFO:teuthology.orchestra.run.trial051.stdout:setvbuf yes 2026-02-20T11:39:36.094 INFO:teuthology.orchestra.run.trial051.stdout:Gluster API engine no 2026-02-20T11:39:36.105 INFO:teuthology.orchestra.run.trial051.stdout:s390_z196_facilities no 2026-02-20T11:39:36.105 INFO:teuthology.orchestra.run.trial051.stdout:HDFS engine no 2026-02-20T11:39:36.126 INFO:teuthology.orchestra.run.trial051.stdout:MTD yes 2026-02-20T11:39:36.132 INFO:teuthology.orchestra.run.trial051.stdout:libpmem no 2026-02-20T11:39:36.132 INFO:teuthology.orchestra.run.trial051.stdout:libpmem1_5 no 2026-02-20T11:39:36.137 INFO:teuthology.orchestra.run.trial051.stdout:libpmem2 no 2026-02-20T11:39:36.137 INFO:teuthology.orchestra.run.trial051.stdout:PMDK dev-dax engine no 2026-02-20T11:39:36.137 INFO:teuthology.orchestra.run.trial051.stdout:PMDK libpmem engine no 2026-02-20T11:39:36.143 INFO:teuthology.orchestra.run.trial051.stdout:DDN's Infinite Memory Engine no 2026-02-20T11:39:36.143 INFO:teuthology.orchestra.run.trial051.stdout:iscsi engine no 2026-02-20T11:39:36.143 INFO:teuthology.orchestra.run.trial051.stdout:NBD engine no 2026-02-20T11:39:36.149 INFO:teuthology.orchestra.run.trial051.stdout:DAOS File System (dfs) Engine no 2026-02-20T11:39:36.156 INFO:teuthology.orchestra.run.trial051.stdout:NFS engine no 2026-02-20T11:39:36.156 INFO:teuthology.orchestra.run.trial051.stdout:lex/yacc for arithmetic no 2026-02-20T11:39:36.177 INFO:teuthology.orchestra.run.trial051.stdout:getmntent yes 2026-02-20T11:39:36.189 INFO:teuthology.orchestra.run.trial051.stdout:getmntinfo no 2026-02-20T11:39:36.218 INFO:teuthology.orchestra.run.trial051.stdout:Static Assert yes 2026-02-20T11:39:36.237 INFO:teuthology.orchestra.run.trial051.stdout:bool yes 2026-02-20T11:39:36.259 INFO:teuthology.orchestra.run.trial051.stdout:strndup yes 2026-02-20T11:39:36.265 INFO:teuthology.orchestra.run.trial051.stdout:Valgrind headers no 2026-02-20T11:39:36.285 INFO:teuthology.orchestra.run.trial051.stdout:Zoned block device support yes 2026-02-20T11:39:36.305 INFO:teuthology.orchestra.run.trial051.stdout:Zoned block device capacity yes 2026-02-20T11:39:36.311 INFO:teuthology.orchestra.run.trial051.stdout:libzbc engine no 2026-02-20T11:39:36.330 INFO:teuthology.orchestra.run.trial051.stdout:NVMe uring command support yes 2026-02-20T11:39:36.342 INFO:teuthology.orchestra.run.trial051.stdout:xnvme engine no 2026-02-20T11:39:36.347 INFO:teuthology.orchestra.run.trial051.stdout:isal no 2026-02-20T11:39:36.348 INFO:teuthology.orchestra.run.trial051.stdout:isal CRC64 no 2026-02-20T11:39:36.360 INFO:teuthology.orchestra.run.trial051.stdout:libblkio engine no 2026-02-20T11:39:36.360 INFO:teuthology.orchestra.run.trial051.stdout:march_armv8_a_crc_crypto no 2026-02-20T11:39:36.360 INFO:teuthology.orchestra.run.trial051.stdout:cuda no 2026-02-20T11:39:36.360 INFO:teuthology.orchestra.run.trial051.stdout:libcufile no 2026-02-20T11:39:36.381 INFO:teuthology.orchestra.run.trial051.stdout:Build march=native yes 2026-02-20T11:39:36.387 INFO:teuthology.orchestra.run.trial051.stdout:CUnit no 2026-02-20T11:39:36.408 INFO:teuthology.orchestra.run.trial051.stdout:__kernel_rwf_t yes 2026-02-20T11:39:36.428 INFO:teuthology.orchestra.run.trial051.stdout:-Wimplicit-fallthrough=2 yes 2026-02-20T11:39:36.448 INFO:teuthology.orchestra.run.trial051.stdout:-Wno-stringop-truncation yes 2026-02-20T11:39:36.469 INFO:teuthology.orchestra.run.trial051.stdout:MADV_HUGEPAGE yes 2026-02-20T11:39:36.491 INFO:teuthology.orchestra.run.trial051.stdout:gettid yes 2026-02-20T11:39:36.514 INFO:teuthology.orchestra.run.trial051.stdout:statx(2)/libc yes 2026-02-20T11:39:36.537 INFO:teuthology.orchestra.run.trial051.stdout:statx(2)/syscall yes 2026-02-20T11:39:36.538 INFO:teuthology.orchestra.run.trial051.stdout:Windows PDB generation no 2026-02-20T11:39:36.559 INFO:teuthology.orchestra.run.trial051.stdout:timerfd_create yes 2026-02-20T11:39:36.561 INFO:teuthology.orchestra.run.trial051.stdout:Consider installing zlib1g-dev (zlib-devel) as some fio features depend on it. 2026-02-20T11:39:36.561 INFO:teuthology.orchestra.run.trial051.stdout:Lib-based ioengines dynamic no 2026-02-20T11:39:36.602 INFO:teuthology.orchestra.run.trial051.stdout:TCMalloc support yes 2026-02-20T11:39:36.603 INFO:teuthology.orchestra.run.trial051.stdout:seed_buckets 4 2026-02-20T11:39:36.648 INFO:teuthology.orchestra.run.trial051.stderr:FIO_VERSION = fio-3.41-110-g1a04e5 2026-02-20T11:39:36.672 INFO:teuthology.orchestra.run.trial051.stdout: CC crc/crc16.o 2026-02-20T11:39:36.707 INFO:teuthology.orchestra.run.trial051.stdout: CC crc/crc32.o 2026-02-20T11:39:36.735 INFO:teuthology.orchestra.run.trial051.stdout: CC crc/crc32c-arm64.o 2026-02-20T11:39:36.782 INFO:teuthology.orchestra.run.trial051.stdout: CC crc/crc32c-intel.o 2026-02-20T11:39:36.813 INFO:teuthology.orchestra.run.trial051.stdout: CC crc/crc32c.o 2026-02-20T11:39:36.842 INFO:teuthology.orchestra.run.trial051.stdout: CC crc/crc64.o 2026-02-20T11:39:36.870 INFO:teuthology.orchestra.run.trial051.stdout: CC crc/crc7.o 2026-02-20T11:39:36.894 INFO:teuthology.orchestra.run.trial051.stdout: CC crc/crct10dif_common.o 2026-02-20T11:39:36.919 INFO:teuthology.orchestra.run.trial051.stdout: CC crc/fnv.o 2026-02-20T11:39:36.948 INFO:teuthology.orchestra.run.trial051.stdout: CC crc/md5.o 2026-02-20T11:39:37.003 INFO:teuthology.orchestra.run.trial051.stdout: CC crc/murmur3.o 2026-02-20T11:39:37.035 INFO:teuthology.orchestra.run.trial051.stdout: CC crc/sha1.o 2026-02-20T11:39:37.133 INFO:teuthology.orchestra.run.trial051.stdout: CC crc/sha256.o 2026-02-20T11:39:37.275 INFO:teuthology.orchestra.run.trial051.stdout: CC crc/sha3.o 2026-02-20T11:39:37.359 INFO:teuthology.orchestra.run.trial051.stdout: CC crc/sha512.o 2026-02-20T11:39:37.428 INFO:teuthology.orchestra.run.trial051.stdout: CC crc/test.o 2026-02-20T11:39:37.522 INFO:teuthology.orchestra.run.trial051.stdout: CC crc/xxhash.o 2026-02-20T11:39:37.578 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/axmap.o 2026-02-20T11:39:37.651 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/bloom.o 2026-02-20T11:39:37.703 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/flist_sort.o 2026-02-20T11:39:37.749 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/gauss.o 2026-02-20T11:39:37.800 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/getrusage.o 2026-02-20T11:39:37.828 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/hweight.o 2026-02-20T11:39:37.856 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/ieee754.o 2026-02-20T11:39:37.889 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/lfsr.o 2026-02-20T11:39:37.948 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/memalign.o 2026-02-20T11:39:37.979 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/memcpy.o 2026-02-20T11:39:38.065 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/mountcheck.o 2026-02-20T11:39:38.094 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/num2str.o 2026-02-20T11:39:38.140 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/output_buffer.o 2026-02-20T11:39:38.175 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/pattern.o 2026-02-20T11:39:38.258 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/prio_tree.o 2026-02-20T11:39:38.329 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/rand.o 2026-02-20T11:39:38.404 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/rbtree.o 2026-02-20T11:39:38.475 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/strntol.o 2026-02-20T11:39:38.509 INFO:teuthology.orchestra.run.trial051.stdout: CC lib/zipf.o 2026-02-20T11:39:38.574 INFO:teuthology.orchestra.run.trial051.stdout: CC gettime.o 2026-02-20T11:39:38.725 INFO:teuthology.orchestra.run.trial051.stdout: CC ioengines.o 2026-02-20T11:39:38.861 INFO:teuthology.orchestra.run.trial051.stdout: CC init.o 2026-02-20T11:39:39.239 INFO:teuthology.orchestra.run.trial051.stdout: CC stat.o 2026-02-20T11:39:39.947 INFO:teuthology.orchestra.run.trial051.stdout: CC log.o 2026-02-20T11:39:40.023 INFO:teuthology.orchestra.run.trial051.stdout: CC time.o 2026-02-20T11:39:40.112 INFO:teuthology.orchestra.run.trial051.stdout: CC filesetup.o 2026-02-20T11:39:40.454 INFO:teuthology.orchestra.run.trial051.stdout: CC eta.o 2026-02-20T11:39:40.618 INFO:teuthology.orchestra.run.trial051.stdout: CC verify.o 2026-02-20T11:39:40.959 INFO:teuthology.orchestra.run.trial051.stdout: CC memory.o 2026-02-20T11:39:41.054 INFO:teuthology.orchestra.run.trial051.stdout: CC io_u.o 2026-02-20T11:39:41.440 INFO:teuthology.orchestra.run.trial051.stdout: CC parse.o 2026-02-20T11:39:41.661 INFO:teuthology.orchestra.run.trial051.stdout: CC fio_sem.o 2026-02-20T11:39:41.726 INFO:teuthology.orchestra.run.trial051.stdout: CC rwlock.o 2026-02-20T11:39:41.777 INFO:teuthology.orchestra.run.trial051.stdout: CC pshared.o 2026-02-20T11:39:41.820 INFO:teuthology.orchestra.run.trial051.stdout: CC options.o 2026-02-20T11:39:42.223 INFO:teuthology.orchestra.run.trial051.stdout: CC fio_shared_sem.o 2026-02-20T11:39:42.254 INFO:teuthology.orchestra.run.trial051.stdout: CC smalloc.o 2026-02-20T11:39:42.356 INFO:teuthology.orchestra.run.trial051.stdout: CC filehash.o 2026-02-20T11:39:42.441 INFO:teuthology.orchestra.run.trial051.stdout: CC profile.o 2026-02-20T11:39:42.512 INFO:teuthology.orchestra.run.trial051.stdout: CC debug.o 2026-02-20T11:39:42.541 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/cpu.o 2026-02-20T11:39:42.624 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/mmap.o 2026-02-20T11:39:42.712 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/sync.o 2026-02-20T11:39:42.832 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/null.o 2026-02-20T11:39:42.903 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/net.o 2026-02-20T11:39:43.113 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/ftruncate.o 2026-02-20T11:39:43.176 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/fileoperations.o 2026-02-20T11:39:43.265 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/exec.o 2026-02-20T11:39:43.349 INFO:teuthology.orchestra.run.trial051.stdout: CC server.o 2026-02-20T11:39:43.709 INFO:teuthology.orchestra.run.trial051.stdout: CC client.o 2026-02-20T11:39:43.988 INFO:teuthology.orchestra.run.trial051.stdout: CC iolog.o 2026-02-20T11:39:44.218 INFO:teuthology.orchestra.run.trial051.stdout: CC backend.o 2026-02-20T11:39:44.635 INFO:teuthology.orchestra.run.trial051.stdout: CC libfio.o 2026-02-20T11:39:44.731 INFO:teuthology.orchestra.run.trial051.stdout: CC flow.o 2026-02-20T11:39:44.799 INFO:teuthology.orchestra.run.trial051.stdout: CC cconv.o 2026-02-20T11:39:45.019 INFO:teuthology.orchestra.run.trial051.stdout: CC gettime-thread.o 2026-02-20T11:39:45.081 INFO:teuthology.orchestra.run.trial051.stdout: CC helpers.o 2026-02-20T11:39:45.122 INFO:teuthology.orchestra.run.trial051.stdout: CC json.o 2026-02-20T11:39:45.221 INFO:teuthology.orchestra.run.trial051.stdout: CC idletime.o 2026-02-20T11:39:45.339 INFO:teuthology.orchestra.run.trial051.stdout: CC td_error.o 2026-02-20T11:39:45.398 INFO:teuthology.orchestra.run.trial051.stdout: CC profiles/tiobench.o 2026-02-20T11:39:45.458 INFO:teuthology.orchestra.run.trial051.stdout: CC profiles/act.o 2026-02-20T11:39:45.546 INFO:teuthology.orchestra.run.trial051.stdout: CC io_u_queue.o 2026-02-20T11:39:45.581 INFO:teuthology.orchestra.run.trial051.stdout: CC filelock.o 2026-02-20T11:39:45.654 INFO:teuthology.orchestra.run.trial051.stdout: CC workqueue.o 2026-02-20T11:39:45.753 INFO:teuthology.orchestra.run.trial051.stdout: CC rate-submit.o 2026-02-20T11:39:45.839 INFO:teuthology.orchestra.run.trial051.stdout: CC optgroup.o 2026-02-20T11:39:45.872 INFO:teuthology.orchestra.run.trial051.stdout: CC helper_thread.o 2026-02-20T11:39:45.972 INFO:teuthology.orchestra.run.trial051.stdout: CC steadystate.o 2026-02-20T11:39:46.115 INFO:teuthology.orchestra.run.trial051.stdout: CC zone-dist.o 2026-02-20T11:39:46.195 INFO:teuthology.orchestra.run.trial051.stdout: CC zbd.o 2026-02-20T11:39:46.557 INFO:teuthology.orchestra.run.trial051.stdout: CC dedupe.o 2026-02-20T11:39:46.638 INFO:teuthology.orchestra.run.trial051.stdout: CC dataplacement.o 2026-02-20T11:39:46.731 INFO:teuthology.orchestra.run.trial051.stdout: CC sprandom.o 2026-02-20T11:39:46.890 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/posixaio.o 2026-02-20T11:39:46.967 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/falloc.o 2026-02-20T11:39:47.035 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/e4defrag.o 2026-02-20T11:39:47.113 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/splice.o 2026-02-20T11:39:47.217 INFO:teuthology.orchestra.run.trial051.stdout: CC oslib/asprintf.o 2026-02-20T11:39:47.245 INFO:teuthology.orchestra.run.trial051.stdout: CC oslib/strlcat.o 2026-02-20T11:39:47.277 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/mtd.o 2026-02-20T11:39:47.364 INFO:teuthology.orchestra.run.trial051.stdout: CC oslib/libmtd.o 2026-02-20T11:39:47.557 INFO:teuthology.orchestra.run.trial051.stdout: CC oslib/libmtd_legacy.o 2026-02-20T11:39:47.629 INFO:teuthology.orchestra.run.trial051.stdout: CC diskutil.o 2026-02-20T11:39:47.744 INFO:teuthology.orchestra.run.trial051.stdout: CC fifo.o 2026-02-20T11:39:47.784 INFO:teuthology.orchestra.run.trial051.stdout: CC blktrace.o 2026-02-20T11:39:47.950 INFO:teuthology.orchestra.run.trial051.stdout: CC cgroup.o 2026-02-20T11:39:48.036 INFO:teuthology.orchestra.run.trial051.stdout: CC trim.o 2026-02-20T11:39:48.105 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/sg.o 2026-02-20T11:39:48.300 INFO:teuthology.orchestra.run.trial051.stdout: CC oslib/linux-dev-lookup.o 2026-02-20T11:39:48.339 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/io_uring.o 2026-02-20T11:39:48.568 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/nvme.o 2026-02-20T11:39:48.729 INFO:teuthology.orchestra.run.trial051.stdout: CC oslib/linux-blkzoned.o 2026-02-20T11:39:48.819 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/cmdprio.o 2026-02-20T11:39:48.948 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/rados.o 2026-02-20T11:39:49.051 INFO:teuthology.orchestra.run.trial051.stdout: CC engines/rbd.o 2026-02-20T11:39:49.161 INFO:teuthology.orchestra.run.trial051.stdout: CC fio.o 2026-02-20T11:39:49.217 INFO:teuthology.orchestra.run.trial051.stdout: LINK fio 2026-02-20T11:39:49.341 INFO:teuthology.orchestra.run.trial051.stdout: CC t/log.o 2026-02-20T11:39:49.372 INFO:teuthology.orchestra.run.trial051.stdout: CC t/genzipf.o 2026-02-20T11:39:49.446 INFO:teuthology.orchestra.run.trial051.stdout: CC oslib/strcasestr.o 2026-02-20T11:39:49.467 INFO:teuthology.orchestra.run.trial051.stdout: CC oslib/strndup.o 2026-02-20T11:39:49.488 INFO:teuthology.orchestra.run.trial051.stdout: LINK t/fio-genzipf 2026-02-20T11:39:49.544 INFO:teuthology.orchestra.run.trial051.stdout: CC t/btrace2fio.o 2026-02-20T11:39:49.744 INFO:teuthology.orchestra.run.trial051.stdout: LINK t/fio-btrace2fio 2026-02-20T11:39:49.798 INFO:teuthology.orchestra.run.trial051.stdout: CC t/verify-state.o 2026-02-20T11:39:49.858 INFO:teuthology.orchestra.run.trial051.stdout: CC t/debug.o 2026-02-20T11:39:49.884 INFO:teuthology.orchestra.run.trial051.stdout: LINK t/fio-verify-state 2026-02-20T11:39:49.938 INFO:teuthology.orchestra.run.trial051.stdout: CC t/stest.o 2026-02-20T11:39:49.987 INFO:teuthology.orchestra.run.trial051.stdout: CC t/arch.o 2026-02-20T11:39:50.011 INFO:teuthology.orchestra.run.trial051.stdout: LINK t/stest 2026-02-20T11:39:50.069 INFO:teuthology.orchestra.run.trial051.stdout: CC t/ieee754.o 2026-02-20T11:39:50.098 INFO:teuthology.orchestra.run.trial051.stdout: LINK t/ieee754 2026-02-20T11:39:50.151 INFO:teuthology.orchestra.run.trial051.stdout: CC t/axmap.o 2026-02-20T11:39:50.210 INFO:teuthology.orchestra.run.trial051.stdout: LINK t/axmap 2026-02-20T11:39:50.265 INFO:teuthology.orchestra.run.trial051.stdout: CC t/lfsr-test.o 2026-02-20T11:39:50.321 INFO:teuthology.orchestra.run.trial051.stdout: LINK t/lfsr-test 2026-02-20T11:39:50.377 INFO:teuthology.orchestra.run.trial051.stdout: CC t/gen-rand.o 2026-02-20T11:39:50.432 INFO:teuthology.orchestra.run.trial051.stdout: LINK t/gen-rand 2026-02-20T11:39:50.486 INFO:teuthology.orchestra.run.trial051.stdout: CC t/memlock.o 2026-02-20T11:39:50.527 INFO:teuthology.orchestra.run.trial051.stdout: LINK t/memlock 2026-02-20T11:39:50.580 INFO:teuthology.orchestra.run.trial051.stdout: CC t/read-to-pipe-async.o 2026-02-20T11:39:50.681 INFO:teuthology.orchestra.run.trial051.stdout: LINK t/read-to-pipe-async 2026-02-20T11:39:50.735 INFO:teuthology.orchestra.run.trial051.stdout: CC t/io_uring.o 2026-02-20T11:39:51.008 INFO:teuthology.orchestra.run.trial051.stdout: LINK t/io_uring 2026-02-20T11:39:51.061 DEBUG:teuthology.orchestra.run.trial051:> sudo /sbin/sysctl -q -w kernel.perf_event_paranoid=0 2026-02-20T11:39:51.100 DEBUG:teuthology.orchestra.run.trial051:> /home/ubuntu/cephtest/cbt/cbt.py -a /home/ubuntu/cephtest/archive/cbt /home/ubuntu/cephtest/archive/cbt/cbt_config.yaml 2026-02-20T11:39:51.213 INFO:teuthology.orchestra.run.trial051.stderr:11:39:51 - DEBUG - cbt - Settings.cluster: 2026-02-20T11:39:51.213 INFO:teuthology.orchestra.run.trial051.stderr: {'archive_dir': '/home/ubuntu/cephtest/archive/cbt', 2026-02-20T11:39:51.213 INFO:teuthology.orchestra.run.trial051.stderr: 'clients': ['ubuntu@trial051.front.sepia.ceph.com'], 2026-02-20T11:39:51.213 INFO:teuthology.orchestra.run.trial051.stderr: 'conf_file': '/etc/ceph/ceph.conf', 2026-02-20T11:39:51.213 INFO:teuthology.orchestra.run.trial051.stderr: 'head': 'ubuntu@trial051.front.sepia.ceph.com', 2026-02-20T11:39:51.213 INFO:teuthology.orchestra.run.trial051.stderr: 'is_teuthology': True, 2026-02-20T11:39:51.213 INFO:teuthology.orchestra.run.trial051.stderr: 'iterations': 1, 2026-02-20T11:39:51.214 INFO:teuthology.orchestra.run.trial051.stderr: 'mons': ['ubuntu@trial051.front.sepia.ceph.com'], 2026-02-20T11:39:51.214 INFO:teuthology.orchestra.run.trial051.stderr: 'osds': ['ubuntu@trial051.front.sepia.ceph.com'], 2026-02-20T11:39:51.214 INFO:teuthology.orchestra.run.trial051.stderr: 'osds_per_node': 3, 2026-02-20T11:39:51.214 INFO:teuthology.orchestra.run.trial051.stderr: 'pid_dir': '/var/run/ceph', 2026-02-20T11:39:51.214 INFO:teuthology.orchestra.run.trial051.stderr: 'pool_profiles': {'rbd': {'pg_size': 128, 'pgp_size': 128, 'replication': 3}}, 2026-02-20T11:39:51.214 INFO:teuthology.orchestra.run.trial051.stderr: 'rebuild_every_test': False, 2026-02-20T11:39:51.214 INFO:teuthology.orchestra.run.trial051.stderr: 'rgws': {'ubuntu@trial051.front.sepia.ceph.com': None}, 2026-02-20T11:39:51.214 INFO:teuthology.orchestra.run.trial051.stderr: 'tmp_dir': '/tmp/cbt', 2026-02-20T11:39:51.214 INFO:teuthology.orchestra.run.trial051.stderr: 'use_existing': True, 2026-02-20T11:39:51.214 INFO:teuthology.orchestra.run.trial051.stderr: 'user': 'ubuntu'} 2026-02-20T11:39:51.214 INFO:teuthology.orchestra.run.trial051.stderr:11:39:51 - INFO - cbt - Results dir: /home/ubuntu/cephtest/archive/cbt/results/00000000/id-3eb54433 2026-02-20T11:39:51.215 INFO:teuthology.orchestra.run.trial051.stderr:11:39:51 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com if [ -d "/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread" ]; then rm -rf /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread; fi 2026-02-20T11:39:51.379 INFO:teuthology.orchestra.run.trial051.stderr:11:39:51 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread 2026-02-20T11:39:51.551 INFO:teuthology.orchestra.run.trial051.stderr:11:39:51 - INFO - cbt - Pausing for 60s for idle monitoring. 2026-02-20T11:39:51.552 INFO:teuthology.orchestra.run.trial051.stderr:11:39:51 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/idle_monitoring/collectl 2026-02-20T11:39:51.706 INFO:teuthology.orchestra.run.trial051.stderr:11:39:51 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com collectl -s+mYZ -i 1:10 -F0 -f /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/idle_monitoring/collectl --rawdskfilt \"+cciss/c\d+d\d+ |hd[ab] | sd[a-z]+ |dm-\d+ |xvd[a-z] |fio[a-z]+ | vd[a-z]+ |emcpower[a-z]+ |psv\d+ |nvme[0-9]n[0-9]+p[0-9]+ \" 2026-02-20T11:39:51.707 INFO:teuthology.orchestra.run.trial051.stderr:11:39:51 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/idle_monitoring/perf 2026-02-20T11:39:51.879 INFO:teuthology.orchestra.run.trial051.stderr:11:39:51 - DEBUG - cbt - PerfMonitoring: remote_node 2026-02-20T11:39:51.879 INFO:teuthology.orchestra.run.trial051.stderr:11:39:51 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com for pid in `cat /var/run/ceph/crimson-osd.*.pid`; do perf stat -p ${pid} -o /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/idle_monitoring/perf/perf_stat.${pid} & done 2026-02-20T11:40:51.944 INFO:teuthology.orchestra.run.trial051.stderr:11:40:51 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com pkill -SIGINT -f collectl 2026-02-20T11:40:52.124 INFO:teuthology.orchestra.run.trial051.stderr:11:40:52 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo pkill -SIGINT -f perf\ 2026-02-20T11:40:52.307 INFO:teuthology.orchestra.run.trial051.stderr:11:40:52 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo chown -R ubuntu.ubuntu /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/* 2026-02-20T11:40:52.479 INFO:teuthology.orchestra.run.trial051.stderr:11:40:52 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=rpdcp -f 10 -R ssh -w ubuntu@trial051.front.sepia.ceph.com -r /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/* /home/ubuntu/cephtest/archive/cbt/results/00000000/id-3eb54433 2026-02-20T11:40:52.638 INFO:teuthology.orchestra.run.trial051.stderr:11:40:52 - INFO - cbt - Creating fio images... 2026-02-20T11:40:52.638 INFO:teuthology.orchestra.run.trial051.stderr:11:40:52 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/pool_monitoring/collectl 2026-02-20T11:40:52.797 INFO:teuthology.orchestra.run.trial051.stderr:11:40:52 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com collectl -s+mYZ -i 1:10 -F0 -f /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/pool_monitoring/collectl --rawdskfilt \"+cciss/c\d+d\d+ |hd[ab] | sd[a-z]+ |dm-\d+ |xvd[a-z] |fio[a-z]+ | vd[a-z]+ |emcpower[a-z]+ |psv\d+ |nvme[0-9]n[0-9]+p[0-9]+ \" 2026-02-20T11:40:52.799 INFO:teuthology.orchestra.run.trial051.stderr:11:40:52 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/pool_monitoring/perf 2026-02-20T11:40:52.965 INFO:teuthology.orchestra.run.trial051.stderr:11:40:52 - DEBUG - cbt - PerfMonitoring: remote_node 2026-02-20T11:40:52.965 INFO:teuthology.orchestra.run.trial051.stderr:11:40:52 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com for pid in `cat /var/run/ceph/crimson-osd.*.pid`; do perf stat -p ${pid} -o /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/pool_monitoring/perf/perf_stat.${pid} & done 2026-02-20T11:40:52.966 INFO:teuthology.orchestra.run.trial051.stderr:11:40:52 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool delete cbt-librbdfio cbt-librbdfio --yes-i-really-really-mean-it 2026-02-20T11:40:53.308 INFO:teuthology.orchestra.run.trial051.stderr:11:40:53 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool create cbt-librbdfio 128 128 2026-02-20T11:40:54.198 INFO:teuthology.orchestra.run.trial051.stderr:11:40:54 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool application enable cbt-librbdfio rbd 2026-02-20T11:40:55.206 INFO:teuthology.orchestra.run.trial051.stderr:11:40:55 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool set cbt-librbdfio size 3 2026-02-20T11:40:56.205 INFO:teuthology.orchestra.run.trial051.stderr:11:40:56 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool set cbt-librbdfio min_size 2 2026-02-20T11:40:57.212 INFO:teuthology.orchestra.run.trial051.stderr:11:40:57 - INFO - cbt - Checking Health after pool creation. 2026-02-20T11:41:02.217 INFO:teuthology.orchestra.run.trial051.stderr:11:41:02 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com /usr/bin/ceph -c /etc/ceph/ceph.conf health 2026-02-20T11:41:02.573 INFO:teuthology.orchestra.run.trial051.stderr:11:41:02 - INFO - cbt - Final Pool Health Check. 2026-02-20T11:41:07.579 INFO:teuthology.orchestra.run.trial051.stderr:11:41:07 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com /usr/bin/ceph -c /etc/ceph/ceph.conf health 2026-02-20T11:41:07.942 INFO:teuthology.orchestra.run.trial051.stderr:11:41:07 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com hostname -f 2026-02-20T11:41:08.105 INFO:teuthology.orchestra.run.trial051.stderr:11:41:08 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com /usr/bin/rbd -c /etc/ceph/ceph.conf create cbt-librbdfio-trial051-0 --size 4096 --pool cbt-librbdfio --order 22 2026-02-20T11:41:10.277 INFO:teuthology.orchestra.run.trial051.stderr:11:41:10 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com /usr/bin/rbd -c /etc/ceph/ceph.conf create cbt-librbdfio-trial051-1 --size 4096 --pool cbt-librbdfio --order 22 2026-02-20T11:41:10.504 INFO:teuthology.orchestra.run.trial051.stderr:11:41:10 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com pkill -SIGINT -f collectl 2026-02-20T11:41:10.681 INFO:teuthology.orchestra.run.trial051.stderr:11:41:10 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo pkill -SIGINT -f perf\ 2026-02-20T11:41:10.862 INFO:teuthology.orchestra.run.trial051.stderr:11:41:10 - INFO - cbt - Attempting to prefill fio images... 2026-02-20T11:41:10.862 INFO:teuthology.orchestra.run.trial051.stderr:11:41:10 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-0 --invalidate=0 --rw=write --numjobs=1 --bs=4M --size 4096M --name=cbt-librbdfio-`hostname -f`-file-0 --output-format=json,normal > /dev/null 2026-02-20T11:41:10.864 INFO:teuthology.orchestra.run.trial051.stderr:11:41:10 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-1 --invalidate=0 --rw=write --numjobs=1 --bs=4M --size 4096M --name=cbt-librbdfio-`hostname -f`-file-0 --output-format=json,normal > /dev/null 2026-02-20T11:41:50.453 INFO:teuthology.orchestra.run.trial051.stderr:11:41:50 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-0 --invalidate=0 --rw=write --numjobs=1 --bs=4M --size 4096M --name=cbt-librbdfio-`hostname -f`-file-0 --output-format=json,normal > /dev/null 2026-02-20T11:41:50.455 INFO:teuthology.orchestra.run.trial051.stderr:11:41:50 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-1 --invalidate=0 --rw=write --numjobs=1 --bs=4M --size 4096M --name=cbt-librbdfio-`hostname -f`-file-0 --output-format=json,normal > /dev/null 2026-02-20T11:42:27.802 INFO:teuthology.orchestra.run.trial051.stderr:11:42:27 - INFO - cbt - Results dir: /home/ubuntu/cephtest/archive/cbt/results/00000000/id-3eb54433 2026-02-20T11:42:27.803 INFO:teuthology.orchestra.run.trial051.stderr:11:42:27 - INFO - cbt - Skipping existing test in /home/ubuntu/cephtest/archive/cbt/results/00000000/id-3eb54433. 2026-02-20T11:42:27.803 INFO:teuthology.orchestra.run.trial051.stderr:11:42:27 - INFO - cbt - Running benchmark /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread 2026-02-20T11:42:27.803 INFO:teuthology.orchestra.run.trial051.stderr:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-3eb54433 2026-02-20T11:42:27.803 INFO:teuthology.orchestra.run.trial051.stderr:{'cmd_path': '/home/ubuntu/cephtest/fio/fio', 'log_avg_msec': 100, 'norandommap': True, 'pool_profile': 'rbd', 'time': 60, 'vol_size': 4096, 'iodepth': 32, 'mode': 'randread', 'op_size': 4194304, 'osd_ra': 4096, 'procs_per_volume': 1, 'volumes_per_client': 2, 'benchmark': 'librbdfio', 'iteration': 0} == iteration 0 == 2026-02-20T11:42:27.803 INFO:teuthology.orchestra.run.trial051.stderr:11:42:27 - INFO - cbt - Setting OSD Read Ahead to: 4096 2026-02-20T11:42:27.803 INFO:teuthology.orchestra.run.trial051.stderr:11:42:27 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com find /dev/disk/by-partlabel/osd-device-*data -exec readlink {} \; | cut -d"/" -f 3 | sed "s/[0-9]$//" | xargs -I{} sudo sh -c "echo 4096 > /sys/block/'{}'/queue/read_ahead_kb" 2026-02-20T11:42:27.804 INFO:teuthology.orchestra.run.trial051.stderr:11:42:27 - DEBUG - cbt - Cleaning existing temporary run directory: /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread 2026-02-20T11:42:27.804 INFO:teuthology.orchestra.run.trial051.stderr:11:42:27 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo rm -rf /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread 2026-02-20T11:42:27.978 INFO:teuthology.orchestra.run.trial051.stderr:11:42:27 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sync 2026-02-20T11:42:28.854 INFO:teuthology.orchestra.run.trial051.stderr:11:42:28 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com echo 3 | sudo tee /proc/sys/vm/drop_caches 2026-02-20T11:42:30.310 INFO:teuthology.orchestra.run.trial051.stderr:11:42:30 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread 2026-02-20T11:42:30.506 INFO:teuthology.orchestra.run.trial051.stderr:11:42:30 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf daemon osd.0 config show > /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/ceph_settings.out 2026-02-20T11:42:55.826 INFO:teuthology.orchestra.run.trial051.stderr:11:42:55 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com echo "[`date`] ceph progress" >> /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/pgautoscaler.log;/usr/bin/ceph -c /etc/ceph/ceph.conf progress | tee -a /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/pgautoscaler.log 2026-02-20T11:42:56.192 INFO:teuthology.orchestra.run.trial051.stderr:11:42:56 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/collectl 2026-02-20T11:42:56.358 INFO:teuthology.orchestra.run.trial051.stderr:11:42:56 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com collectl -s+mYZ -i 1:10 -F0 -f /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/collectl --rawdskfilt \"+cciss/c\d+d\d+ |hd[ab] | sd[a-z]+ |dm-\d+ |xvd[a-z] |fio[a-z]+ | vd[a-z]+ |emcpower[a-z]+ |psv\d+ |nvme[0-9]n[0-9]+p[0-9]+ \" 2026-02-20T11:42:56.360 INFO:teuthology.orchestra.run.trial051.stderr:11:42:56 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/perf 2026-02-20T11:42:56.522 INFO:teuthology.orchestra.run.trial051.stderr:11:42:56 - DEBUG - cbt - PerfMonitoring: remote_node 2026-02-20T11:42:56.522 INFO:teuthology.orchestra.run.trial051.stderr:11:42:56 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com for pid in `cat /var/run/ceph/crimson-osd.*.pid`; do perf stat -p ${pid} -o /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/perf/perf_stat.${pid} & done 2026-02-20T11:42:56.524 INFO:teuthology.orchestra.run.trial051.stderr:11:42:56 - INFO - cbt - Running rbd fio randread test. 2026-02-20T11:42:56.524 INFO:teuthology.orchestra.run.trial051.stderr:11:42:56 - DEBUG - cbt - Using rbdname cbt-librbdfio-`hostname -f`-0 2026-02-20T11:42:56.524 INFO:teuthology.orchestra.run.trial051.stderr:11:42:56 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-0 --invalidate=0 --rw=randread --output-format=json,normal --runtime=60 --numjobs=1 --direct=1 --bs=4194304B --iodepth=32 --end_fsync=0 --norandommap --write_iops_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/output.0 --write_bw_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/output.0 --write_lat_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/output.0 --log_avg_msec=100 --name=cbt-librbdfio-`hostname -f`-file-0 > /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/output.0 2026-02-20T11:42:56.525 INFO:teuthology.orchestra.run.trial051.stderr:11:42:56 - DEBUG - cbt - Using rbdname cbt-librbdfio-`hostname -f`-1 2026-02-20T11:42:56.526 INFO:teuthology.orchestra.run.trial051.stderr:11:42:56 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo /home/ubuntu/cephtest/fio/fio --ioengine=rbd --clientname=admin --pool=cbt-librbdfio --rbdname=cbt-librbdfio-`hostname -f`-1 --invalidate=0 --rw=randread --output-format=json,normal --runtime=60 --numjobs=1 --direct=1 --bs=4194304B --iodepth=32 --end_fsync=0 --norandommap --write_iops_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/output.1 --write_bw_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/output.1 --write_lat_log=/tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/output.1 --log_avg_msec=100 --name=cbt-librbdfio-`hostname -f`-file-0 > /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/output.1 2026-02-20T11:43:02.729 INFO:teuthology.orchestra.run.trial051.stderr:11:43:02 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com pkill -SIGINT -f collectl 2026-02-20T11:43:02.901 INFO:teuthology.orchestra.run.trial051.stderr:11:43:02 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo pkill -SIGINT -f perf\ 2026-02-20T11:43:03.085 INFO:teuthology.orchestra.run.trial051.stderr:11:43:03 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/perf/perf.data 2026-02-20T11:43:03.087 INFO:teuthology.orchestra.run.trial051.stderr:11:43:03 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/perf/perf_stat.* 2026-02-20T11:43:03.088 INFO:teuthology.orchestra.run.trial051.stderr:11:43:03 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com find /var/run/ceph/ceph-osd*.asok -maxdepth 1 -exec sudo /usr/bin/ceph --admin-daemon {} dump_historic_ops \; > /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/historic_ops.out 2026-02-20T11:43:03.446 INFO:teuthology.orchestra.run.trial051.stderr:11:43:03 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial051.front.sepia.ceph.com sudo chown -R ubuntu.ubuntu /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/* 2026-02-20T11:43:03.618 INFO:teuthology.orchestra.run.trial051.stderr:11:43:03 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=rpdcp -f 10 -R ssh -w ubuntu@trial051.front.sepia.ceph.com -r /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread/* /home/ubuntu/cephtest/archive/cbt/results/00000000/id-3eb54433 2026-02-20T11:43:03.782 INFO:teuthology.orchestra.run.trial051.stderr:11:43:03 - INFO - cbt - Convert results to json format. 2026-02-20T11:43:03.783 INFO:teuthology.orchestra.run.trial051.stdout:cleaning remote dir /tmp/cbt/00000000/LibrbdFio/osd_ra-00004096/op_size-04194304/concurrent_procs-002/iodepth-032/randread 2026-02-20T11:43:03.783 INFO:teuthology.orchestra.run.trial051.stdout:trial051: trial051 2026-02-20T11:43:03.783 INFO:teuthology.orchestra.run.trial051.stdout: 2026-02-20T11:43:03.783 INFO:teuthology.orchestra.run.trial051.stdout:['trial051'] 2026-02-20T11:43:03.794 DEBUG:teuthology.run_tasks:Unwinding manager cbt 2026-02-20T11:43:03.810 DEBUG:teuthology.orchestra.run.trial051:> rm --one-file-system -rf -- /home/ubuntu/cephtest/cbt 2026-02-20T11:43:03.836 DEBUG:teuthology.orchestra.run.trial051:> rm --one-file-system -rf -- /home/ubuntu/cephtest/fio 2026-02-20T11:43:03.915 INFO:tasks.cbt_performance:Collecting CBT performance data config 2026-02-20T11:43:03.916 INFO:tasks.cbt_performance:reading cbt preferences 2026-02-20T11:43:03.916 DEBUG:teuthology.orchestra.run.trial051:> find /home/ubuntu/cephtest -name 'json_output.*' 2026-02-20T11:43:03.973 INFO:teuthology.orchestra.run.trial051.stdout:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-3eb54433/json_output.0.trial051.front.sepia.ceph.com 2026-02-20T11:43:03.973 INFO:teuthology.orchestra.run.trial051.stdout:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-3eb54433/json_output.1.trial051.front.sepia.ceph.com 2026-02-20T11:43:03.974 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:43:03.974 DEBUG:teuthology.orchestra.run.trial051:> dd if=/home/ubuntu/cephtest/archive/cbt/results/00000000/id-3eb54433/json_output.0.trial051.front.sepia.ceph.com of=/dev/stdout 2026-02-20T11:43:04.035 INFO:tasks.cbt_performance:reading total cpu cycles 2026-02-20T11:43:04.035 DEBUG:teuthology.orchestra.run.trial051:> find /home/ubuntu/cephtest/archive/cbt/results/00000000/id-3eb54433 -name 'perf_stat.*' 2026-02-20T11:43:04.090 INFO:tasks.cbt_performance:cpu_cycles_paths: [''] 2026-02-20T11:43:04.091 INFO:tasks.cbt_performance:total cpu cycles: 0 2026-02-20T11:43:04.091 DEBUG:teuthology.orchestra.run.trial051:> set -ex 2026-02-20T11:43:04.091 DEBUG:teuthology.orchestra.run.trial051:> dd if=/home/ubuntu/cephtest/archive/cbt/results/00000000/id-3eb54433/json_output.1.trial051.front.sepia.ceph.com of=/dev/stdout 2026-02-20T11:43:04.150 INFO:tasks.cbt_performance:reading total cpu cycles 2026-02-20T11:43:04.150 DEBUG:teuthology.orchestra.run.trial051:> find /home/ubuntu/cephtest/archive/cbt/results/00000000/id-3eb54433 -name 'perf_stat.*' 2026-02-20T11:43:04.206 INFO:tasks.cbt_performance:cpu_cycles_paths: [''] 2026-02-20T11:43:04.206 INFO:tasks.cbt_performance:total cpu cycles: 0 2026-02-20T11:43:04.211 WARNING:tasks.cbt_performance:Could not send performance data to http://mira118.front.sepia.ceph.com:4000/cbt_performance: HTTPConnectionPool(host='mira118.front.sepia.ceph.com', port=4000): Max retries exceeded with url: /cbt_performance (Caused by NewConnectionError(': Failed to establish a new connection: [Errno -2] Name or service not known')) 2026-02-20T11:43:04.211 WARNING:tasks.cbt_performance:Continuing without performance data collection 2026-02-20T11:43:04.212 DEBUG:teuthology.run_tasks:Unwinding manager ssh_keys 2026-02-20T11:43:04.227 INFO:teuthology.task.ssh_keys:Cleaning up SSH keys 2026-02-20T11:43:04.227 INFO:teuthology.task.ssh_keys:cleaning up keys added for testing 2026-02-20T11:43:04.227 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on trial051.front.sepia.ceph.com 2026-02-20T11:43:04.227 DEBUG:teuthology.orchestra.run.trial051:> rm -- /home/ubuntu/.ssh/id_rsa 2026-02-20T11:43:04.262 DEBUG:teuthology.orchestra.run.trial051:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2026-02-20T11:43:04.319 DEBUG:teuthology.orchestra.run.trial051:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2026-02-20T11:43:04.376 INFO:teuthology.orchestra.run.trial051.stdout:"600" 2026-02-20T11:43:04.377 DEBUG:teuthology.orchestra.run.trial051:> mv -- /home/ubuntu/.ssh/authorized_keys_2026-02-20_11:39:22:804550 /home/ubuntu/.ssh/authorized_keys 2026-02-20T11:43:04.434 DEBUG:teuthology.orchestra.run.trial051:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2026-02-20T11:43:04.491 DEBUG:teuthology.orchestra.run.trial051:> rm /home/ubuntu/.ssh/config 2026-02-20T11:43:04.547 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-20T11:43:04.562 DEBUG:teuthology.orchestra.run.trial051:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-20T11:43:04.662 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:43:04.655+0000 7ffb0d7e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:43:04.663 INFO:teuthology.orchestra.run.trial051.stderr:2026-02-20T11:43:04.660+0000 7ffb0d7e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:43:04.789 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-20T11:43:04.789 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-20T11:43:04.789 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-20T11:43:04.789 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:43:09.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2026-02-20T11:43:10.891 INFO:tasks.ceph.osd.0:Stopped 2026-02-20T11:43:10.891 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-20T11:43:10.891 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:43:14.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2026-02-20T11:43:14.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2026-02-20T11:43:16.993 INFO:tasks.ceph.osd.1:Stopped 2026-02-20T11:43:16.993 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-20T11:43:16.993 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:43:20.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-20T11:43:20.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2026-02-20T11:43:23.095 INFO:tasks.ceph.osd.2:Stopped 2026-02-20T11:43:23.095 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-20T11:43:23.095 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-20T11:43:23.095 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:43:23.135 INFO:tasks.ceph.mgr.x:Stopped 2026-02-20T11:43:23.136 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-20T11:43:23.136 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-20T11:43:23.136 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:43:23.185 INFO:tasks.ceph.mon.a:Stopped 2026-02-20T11:43:23.185 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-20T11:43:23.186 DEBUG:teuthology.orchestra.run.trial051:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v '\(PG_' | grep -E -v '\(OSD_' | grep -E -v '\(OBJECT_' | grep -E -v 'overall HEALTH' | head -n 1 2026-02-20T11:43:23.252 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial051.front.sepia.ceph.com 2026-02-20T11:43:23.252 DEBUG:teuthology.orchestra.run.trial051:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-20T11:43:23.436 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial051.front.sepia.ceph.com 2026-02-20T11:43:23.437 DEBUG:teuthology.orchestra.run.trial051:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-20T11:43:23.471 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial051.front.sepia.ceph.com 2026-02-20T11:43:23.472 DEBUG:teuthology.orchestra.run.trial051:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-20T11:43:23.540 INFO:tasks.ceph:Archiving mon data... 2026-02-20T11:43:23.542 DEBUG:teuthology.misc:Transferring archived files from trial051:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60529/data/mon.a.tgz 2026-02-20T11:43:23.542 DEBUG:teuthology.orchestra.run.trial051:> mktemp 2026-02-20T11:43:23.600 INFO:teuthology.orchestra.run.trial051.stdout:/tmp/tmp.dz6Vbj1B8z 2026-02-20T11:43:23.601 DEBUG:teuthology.orchestra.run.trial051:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.dz6Vbj1B8z 2026-02-20T11:43:23.692 DEBUG:teuthology.orchestra.run.trial051:> sudo chmod 0666 /tmp/tmp.dz6Vbj1B8z 2026-02-20T11:43:23.775 DEBUG:teuthology.orchestra.remote:trial051:/tmp/tmp.dz6Vbj1B8z is 201KB 2026-02-20T11:43:23.826 DEBUG:teuthology.orchestra.run.trial051:> rm -fr /tmp/tmp.dz6Vbj1B8z 2026-02-20T11:43:23.842 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-20T11:43:23.842 DEBUG:teuthology.orchestra.run.trial051:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-20T11:43:23.963 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-20T11:43:23.963 INFO:tasks.ceph:Archiving crash dumps... 2026-02-20T11:43:23.965 DEBUG:teuthology.misc:Transferring archived files from trial051:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60529/remote/trial051/crash 2026-02-20T11:43:23.967 DEBUG:teuthology.orchestra.run.trial051:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-20T11:43:24.028 INFO:tasks.ceph:Compressing logs... 2026-02-20T11:43:24.028 DEBUG:teuthology.orchestra.run.trial051:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T11:43:24.094 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-20T11:43:24.105 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48394.log 2026-02-20T11:43:24.105 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-20T11:43:24.105 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48052.log 2026-02-20T11:43:24.105 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-mon.a.log: 66.9% -- replaced with /var/log/ceph/ceph-client.admin.48394.log.gz 2026-02-20T11:43:24.105 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-20T11:43:24.105 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42862.log 2026-02-20T11:43:24.105 INFO:teuthology.orchestra.run.trial051.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48052.log.gz 2026-02-20T11:43:24.105 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42225.log 2026-02-20T11:43:24.106 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42862.log: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-20T11:43:24.106 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41773.log 2026-02-20T11:43:24.106 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42862.log.gz 2026-02-20T11:43:24.106 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42475.log 2026-02-20T11:43:24.106 INFO:teuthology.orchestra.run.trial051.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42225.log.gz 2026-02-20T11:43:24.106 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.41773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41918.log 2026-02-20T11:43:24.106 INFO:teuthology.orchestra.run.trial051.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41773.log.gz 2026-02-20T11:43:24.106 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42327.log 2026-02-20T11:43:24.106 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42475.log.gz 2026-02-20T11:43:24.106 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.41918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41183.log 2026-02-20T11:43:24.106 INFO:teuthology.orchestra.run.trial051.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41918.log.gz 2026-02-20T11:43:24.106 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47996.log 2026-02-20T11:43:24.106 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42327.log.gz 2026-02-20T11:43:24.107 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.41183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41402.log 2026-02-20T11:43:24.107 INFO:teuthology.orchestra.run.trial051.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41183.log.gz 2026-02-20T11:43:24.107 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.47996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42693.log 2026-02-20T11:43:24.107 INFO:teuthology.orchestra.run.trial051.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47996.log.gz 2026-02-20T11:43:24.107 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.41402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40952.log 2026-02-20T11:43:24.107 INFO:teuthology.orchestra.run.trial051.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41402.log.gz 2026-02-20T11:43:24.107 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41136.log 2026-02-20T11:43:24.107 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42693.log.gz 2026-02-20T11:43:24.107 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.40952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48166.log 2026-02-20T11:43:24.107 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40952.log.gz 2026-02-20T11:43:24.107 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.41136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49084.log 2026-02-20T11:43:24.108 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41136.log.gz 2026-02-20T11:43:24.108 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49086.log 2026-02-20T11:43:24.108 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48166.log.gz 2026-02-20T11:43:24.108 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40905.log 2026-02-20T11:43:24.108 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49084.log.gz 2026-02-20T11:43:24.108 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48110.log 2026-02-20T11:43:24.108 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49086.log.gz 2026-02-20T11:43:24.108 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.40905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49422.log 2026-02-20T11:43:24.108 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40905.log.gz 2026-02-20T11:43:24.108 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42127.log 2026-02-20T11:43:24.108 INFO:teuthology.orchestra.run.trial051.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48110.log.gz 2026-02-20T11:43:24.108 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42813.log 2026-02-20T11:43:24.108 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49422.log.gz 2026-02-20T11:43:24.109 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48254.log 2026-02-20T11:43:24.109 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42127.log.gz 2026-02-20T11:43:24.109 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40810.log 2026-02-20T11:43:24.109 INFO:teuthology.orchestra.run.trial051.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42813.log.gz 2026-02-20T11:43:24.109 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49657.log 2026-02-20T11:43:24.109 INFO:teuthology.orchestra.run.trial051.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48254.log.gz 2026-02-20T11:43:24.109 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.40810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48222.log 2026-02-20T11:43:24.109 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40810.log.gz 2026-02-20T11:43:24.109 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49657.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-20T11:43:24.109 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49657.log.gz 2026-02-20T11:43:24.109 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41988.log 2026-02-20T11:43:24.109 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph.audit.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48222.log.gz 2026-02-20T11:43:24.109 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48620.log 2026-02-20T11:43:24.109 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.41988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42326.log 2026-02-20T11:43:24.110 INFO:teuthology.orchestra.run.trial051.stderr: 86.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-20T11:43:24.110 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41988.log.gz 2026-02-20T11:43:24.110 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49658.log 2026-02-20T11:43:24.110 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48620.log.gz 2026-02-20T11:43:24.110 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42326.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-20T11:43:24.110 INFO:teuthology.orchestra.run.trial051.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42326.log.gz 2026-02-20T11:43:24.110 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.49658.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49658.log.gz 2026-02-20T11:43:24.110 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42596.log 2026-02-20T11:43:24.110 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42328.log 2026-02-20T11:43:24.110 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42078.log 2026-02-20T11:43:24.110 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42596.log.gz 2026-02-20T11:43:24.110 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42568.log 2026-02-20T11:43:24.115 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42328.log.gz 2026-02-20T11:43:24.116 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.42078.log: /var/log/ceph/ceph-client.admin.42764.log 2026-02-20T11:43:24.116 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42568.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42078.log.gz 2026-02-20T11:43:24.116 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42013.log 2026-02-20T11:43:24.116 INFO:teuthology.orchestra.run.trial051.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42568.log.gz 2026-02-20T11:43:24.116 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42764.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-20T11:43:24.116 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42764.log.gz 2026-02-20T11:43:24.116 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42474.log 2026-02-20T11:43:24.116 INFO:teuthology.orchestra.run.trial051.stderr: 66.9% -- replaced with /var/log/ceph/ceph-client.admin.42013.log.gz 2026-02-20T11:43:24.116 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41089.log 2026-02-20T11:43:24.116 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42474.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-20T11:43:24.116 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.41089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42473.log 2026-02-20T11:43:24.116 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42474.log.gz 2026-02-20T11:43:24.117 INFO:teuthology.orchestra.run.trial051.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41089.log.gz 2026-02-20T11:43:24.117 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48619.log 2026-02-20T11:43:24.117 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42473.log: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-20T11:43:24.117 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42176.log 2026-02-20T11:43:24.117 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48619.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42473.log.gz 2026-02-20T11:43:24.117 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42666.log 2026-02-20T11:43:24.117 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48619.log.gz 2026-02-20T11:43:24.117 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50314.log 2026-02-20T11:43:24.117 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.42666.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.42176.log.gz -5 2026-02-20T11:43:24.117 INFO:teuthology.orchestra.run.trial051.stderr: --verbose -- /var/log/ceph/ceph.tmp-client.admin.39109.log 2026-02-20T11:43:24.117 INFO:teuthology.orchestra.run.trial051.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42666.log.gz 2026-02-20T11:43:24.117 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.50314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41433.log 2026-02-20T11:43:24.117 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50314.log.gz 2026-02-20T11:43:24.118 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph.tmp-client.admin.39109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48308.log 2026-02-20T11:43:24.118 INFO:teuthology.orchestra.run.trial051.stderr: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.39109.log.gz 2026-02-20T11:43:24.118 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.41433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48442.log 2026-02-20T11:43:24.118 INFO:teuthology.orchestra.run.trial051.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41433.log.gz 2026-02-20T11:43:24.118 INFO:teuthology.orchestra.run.trial051.stderr:/var/log/ceph/ceph-client.admin.48308.log: /var/log/ceph/ceph-client.admin.48442.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48308.log.gz 2026-02-20T11:43:24.118 INFO:teuthology.orchestra.run.trial051.stderr: 66.1% -- replaced with /var/log/ceph/ceph-client.admin.48442.log.gz 2026-02-20T11:43:24.118 INFO:teuthology.orchestra.run.trial051.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-20T11:43:25.170 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2026-02-20T11:43:28.994 INFO:teuthology.orchestra.run.trial051.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-20T11:43:29.048 INFO:teuthology.orchestra.run.trial051.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-20T11:43:29.378 INFO:teuthology.orchestra.run.trial051.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-20T11:43:29.380 INFO:teuthology.orchestra.run.trial051.stderr: 2026-02-20T11:43:29.380 INFO:teuthology.orchestra.run.trial051.stderr:real 0m5.295s 2026-02-20T11:43:29.380 INFO:teuthology.orchestra.run.trial051.stderr:user 0m13.880s 2026-02-20T11:43:29.380 INFO:teuthology.orchestra.run.trial051.stderr:sys 0m1.229s 2026-02-20T11:43:29.381 INFO:tasks.ceph:Archiving logs... 2026-02-20T11:43:29.381 DEBUG:teuthology.misc:Transferring archived files from trial051:/var/log/ceph to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60529/remote/trial051/log 2026-02-20T11:43:29.382 DEBUG:teuthology.orchestra.run.trial051:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T11:43:30.535 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T11:43:30.606 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T11:43:30.617 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-20T11:43:30.617 DEBUG:teuthology.orchestra.run.trial051:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T11:43:30.644 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-20T11:43:30.655 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-20T11:43:30.655 DEBUG:teuthology.orchestra.run.trial051:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T11:43:30.700 INFO:teuthology.orchestra.run.trial051.stderr:bash: line 1: ntpq: command not found 2026-02-20T11:43:31.018 INFO:teuthology.orchestra.run.trial051.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T11:43:31.019 INFO:teuthology.orchestra.run.trial051.stdout:=============================================================================== 2026-02-20T11:43:31.019 INFO:teuthology.orchestra.run.trial051.stdout:^- ntp1.glypnod.com 2 6 377 19 -978us[ -877us] +/- 41ms 2026-02-20T11:43:31.019 INFO:teuthology.orchestra.run.trial051.stdout:^+ wsip-24-249-17-253.dc.dc> 2 6 377 18 +2031us[+2031us] +/- 10ms 2026-02-20T11:43:31.019 INFO:teuthology.orchestra.run.trial051.stdout:^- ntp.sfo.icanbwell.com 2 6 377 16 -1180us[-1180us] +/- 35ms 2026-02-20T11:43:31.019 INFO:teuthology.orchestra.run.trial051.stdout:^* ntp0.alb1.inoc.net 2 6 377 19 -1231us[-1129us] +/- 4044us 2026-02-20T11:43:31.020 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-20T11:43:31.038 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-20T11:43:31.039 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-20T11:43:31.055 DEBUG:teuthology.orchestra.run.trial051:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T11:43:31.122 DEBUG:teuthology.orchestra.run.trial051:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T11:43:31.148 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:43:31.148 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-20T11:43:31.164 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-20T11:43:31.180 INFO:teuthology.task.internal:Duration was 1095.429548 seconds 2026-02-20T11:43:31.180 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-20T11:43:31.197 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-20T11:43:31.197 DEBUG:teuthology.orchestra.run.trial051:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T11:43:31.236 INFO:teuthology.orchestra.run.trial051.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T11:43:31.488 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-20T11:43:31.488 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial051.front.sepia.ceph.com 2026-02-20T11:43:31.489 DEBUG:teuthology.orchestra.run.trial051:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T11:43:31.547 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-20T11:43:31.547 DEBUG:teuthology.orchestra.run.trial051:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T11:43:31.653 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-20T11:43:31.654 DEBUG:teuthology.orchestra.run.trial051:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T11:43:31.678 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:43:31.679 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:43:31.679 INFO:teuthology.orchestra.run.trial051.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T11:43:31.679 INFO:teuthology.orchestra.run.trial051.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T11:43:31.679 INFO:teuthology.orchestra.run.trial051.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T11:43:31.688 INFO:teuthology.orchestra.run.trial051.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T11:43:31.691 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-20T11:43:31.708 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-20T11:43:31.708 DEBUG:teuthology.orchestra.run.trial051:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T11:43:31.755 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-20T11:43:31.772 DEBUG:teuthology.orchestra.run.trial051:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T11:43:31.819 INFO:teuthology.orchestra.run.trial051.stdout:kernel.core_pattern = core 2026-02-20T11:43:31.838 DEBUG:teuthology.orchestra.run.trial051:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T11:43:31.893 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:43:31.894 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-20T11:43:31.912 INFO:teuthology.task.internal:Transferring archived files... 2026-02-20T11:43:31.913 DEBUG:teuthology.misc:Transferring archived files from trial051:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60529/remote/trial051 2026-02-20T11:43:31.913 DEBUG:teuthology.orchestra.run.trial051:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T11:43:31.997 INFO:teuthology.task.internal:Removing archive directory... 2026-02-20T11:43:31.997 DEBUG:teuthology.orchestra.run.trial051:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T11:43:32.025 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-20T11:43:32.045 INFO:teuthology.task.internal:Not uploading archives. 2026-02-20T11:43:32.045 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-20T11:43:32.069 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-20T11:43:32.069 DEBUG:teuthology.orchestra.run.trial051:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T11:43:32.086 INFO:teuthology.orchestra.run.trial051.stdout: 917576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 11:43 /home/ubuntu/cephtest 2026-02-20T11:43:32.088 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-20T11:43:32.112 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-20T11:43:32.148 INFO:teuthology.run:Summary data: description: crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/crimson_bluestore perf_ignorelist settings/optimized workloads/fio_4M_rand_read} duration: 1095.429547548294 flavor: debug owner: scheduled_jjperez@soko04.front.sepia.ceph.com success: true 2026-02-20T11:43:32.148 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T11:43:32.424 INFO:teuthology.run:pass