2026-02-12T06:33:44.255 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-12T06:33:44.270 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:33:44.347 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:23:35-crimson-rados-main-distro-debug-trial/45991 branch: main description: crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/cls} email: null first_in_suite: false flavor: debug job_id: '45991' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: moagrawa-2026-02-12_06:23:35-crimson-rados-main-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd pool default crimson: true osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug ms: 20 debug objclass: 20 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd objectstore: seastore osd shutdown pgref assert: true seastore cachepin size pershard: 64M seastore main device type: RANDOM_BLOCK_SSD seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: debug sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 workunit: branch: seastore_io_uring env: CRIMSON_COMPAT: '1' sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 owner: scheduled_moagrawa@soko04.front.sepia.ceph.com priority: 20 repo: https://github.com/ceph/ceph.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 4661 sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 sleep_before_teardown: 0 suite: crimson-rados suite_branch: seastore_io_uring suite_path: /home/teuthworker/src/github.com_mohit84_ceph_5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/qa suite_relpath: qa suite_repo: https://github.com/mohit84/ceph.git suite_sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 targets: trial058.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOaOO8ckUMpwugv8nps8atj/kZaE1yV+IqYyFRdgpKIIxZq2PCWUapeQzJ8yy0QbKt9ImA1beMgmHpyP1foIIOs= trial106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL1r+EXnU9p9/Myr/6NsfWm53TzOVxvtsqyKYUY8d/L2gNHhyrwQjbPs0e34N53Rtjf8KM//He3N/fAK8cCYdbA= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 - workunit: clients: client.0: - cls/test_cls_cmpomap.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-12_06:23:35 tube: trial user: moagrawa verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.2161924 2026-02-12T06:33:44.347 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_mohit84_ceph_5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/qa; will attempt to use it 2026-02-12T06:33:44.348 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_mohit84_ceph_5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/qa/tasks 2026-02-12T06:33:44.348 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T06:33:44.349 INFO:teuthology.task.internal:Checking packages... 2026-02-12T06:33:44.349 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0' 2026-02-12T06:33:44.349 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T06:33:44.349 INFO:teuthology.packaging:ref: None 2026-02-12T06:33:44.349 INFO:teuthology.packaging:tag: None 2026-02-12T06:33:44.349 INFO:teuthology.packaging:branch: main 2026-02-12T06:33:44.349 INFO:teuthology.packaging:sha1: 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T06:33:44.349 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=main 2026-02-12T06:33:44.508 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5256.gf2a98edf 2026-02-12T06:33:44.509 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T06:33:44.521 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T06:33:44.521 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T06:33:44.535 INFO:teuthology.task.internal:Saving configuration 2026-02-12T06:33:44.551 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T06:33:44.563 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T06:33:44.648 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial058.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:23:35-crimson-rados-main-distro-debug-trial/45991', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 06:30:22.348328', 'locked_by': 'scheduled_moagrawa@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOaOO8ckUMpwugv8nps8atj/kZaE1yV+IqYyFRdgpKIIxZq2PCWUapeQzJ8yy0QbKt9ImA1beMgmHpyP1foIIOs='} 2026-02-12T06:33:44.705 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial106.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:23:35-crimson-rados-main-distro-debug-trial/45991', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 06:30:22.347648', 'locked_by': 'scheduled_moagrawa@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL1r+EXnU9p9/Myr/6NsfWm53TzOVxvtsqyKYUY8d/L2gNHhyrwQjbPs0e34N53Rtjf8KM//He3N/fAK8cCYdbA='} 2026-02-12T06:33:44.705 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T06:33:44.716 INFO:teuthology.task.internal:roles: ubuntu@trial058.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2026-02-12T06:33:44.716 INFO:teuthology.task.internal:roles: ubuntu@trial106.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2026-02-12T06:33:44.716 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T06:33:44.848 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7a9850a0f420>, signals=[15]) 2026-02-12T06:33:44.848 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T06:33:44.859 INFO:teuthology.task.internal:Opening connections... 2026-02-12T06:33:44.859 DEBUG:teuthology.task.internal:connecting to ubuntu@trial058.front.sepia.ceph.com 2026-02-12T06:33:44.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T06:33:44.922 DEBUG:teuthology.task.internal:connecting to ubuntu@trial106.front.sepia.ceph.com 2026-02-12T06:33:44.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T06:33:44.986 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T06:33:44.997 DEBUG:teuthology.orchestra.run.trial058:> uname -m 2026-02-12T06:33:45.013 INFO:teuthology.orchestra.run.trial058.stdout:x86_64 2026-02-12T06:33:45.013 DEBUG:teuthology.orchestra.run.trial058:> cat /etc/os-release 2026-02-12T06:33:45.069 INFO:teuthology.orchestra.run.trial058.stdout:NAME="CentOS Stream" 2026-02-12T06:33:45.069 INFO:teuthology.orchestra.run.trial058.stdout:VERSION="9" 2026-02-12T06:33:45.069 INFO:teuthology.orchestra.run.trial058.stdout:ID="centos" 2026-02-12T06:33:45.069 INFO:teuthology.orchestra.run.trial058.stdout:ID_LIKE="rhel fedora" 2026-02-12T06:33:45.069 INFO:teuthology.orchestra.run.trial058.stdout:VERSION_ID="9" 2026-02-12T06:33:45.069 INFO:teuthology.orchestra.run.trial058.stdout:PLATFORM_ID="platform:el9" 2026-02-12T06:33:45.069 INFO:teuthology.orchestra.run.trial058.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T06:33:45.069 INFO:teuthology.orchestra.run.trial058.stdout:ANSI_COLOR="0;31" 2026-02-12T06:33:45.069 INFO:teuthology.orchestra.run.trial058.stdout:LOGO="fedora-logo-icon" 2026-02-12T06:33:45.069 INFO:teuthology.orchestra.run.trial058.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T06:33:45.069 INFO:teuthology.orchestra.run.trial058.stdout:HOME_URL="https://centos.org/" 2026-02-12T06:33:45.069 INFO:teuthology.orchestra.run.trial058.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T06:33:45.069 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T06:33:45.069 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T06:33:45.070 INFO:teuthology.lock.ops:Updating trial058.front.sepia.ceph.com on lock server 2026-02-12T06:33:45.141 DEBUG:teuthology.orchestra.run.trial106:> uname -m 2026-02-12T06:33:45.156 INFO:teuthology.orchestra.run.trial106.stdout:x86_64 2026-02-12T06:33:45.156 DEBUG:teuthology.orchestra.run.trial106:> cat /etc/os-release 2026-02-12T06:33:45.211 INFO:teuthology.orchestra.run.trial106.stdout:NAME="CentOS Stream" 2026-02-12T06:33:45.211 INFO:teuthology.orchestra.run.trial106.stdout:VERSION="9" 2026-02-12T06:33:45.211 INFO:teuthology.orchestra.run.trial106.stdout:ID="centos" 2026-02-12T06:33:45.211 INFO:teuthology.orchestra.run.trial106.stdout:ID_LIKE="rhel fedora" 2026-02-12T06:33:45.211 INFO:teuthology.orchestra.run.trial106.stdout:VERSION_ID="9" 2026-02-12T06:33:45.211 INFO:teuthology.orchestra.run.trial106.stdout:PLATFORM_ID="platform:el9" 2026-02-12T06:33:45.211 INFO:teuthology.orchestra.run.trial106.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T06:33:45.211 INFO:teuthology.orchestra.run.trial106.stdout:ANSI_COLOR="0;31" 2026-02-12T06:33:45.212 INFO:teuthology.orchestra.run.trial106.stdout:LOGO="fedora-logo-icon" 2026-02-12T06:33:45.212 INFO:teuthology.orchestra.run.trial106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T06:33:45.212 INFO:teuthology.orchestra.run.trial106.stdout:HOME_URL="https://centos.org/" 2026-02-12T06:33:45.212 INFO:teuthology.orchestra.run.trial106.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T06:33:45.212 INFO:teuthology.orchestra.run.trial106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T06:33:45.212 INFO:teuthology.orchestra.run.trial106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T06:33:45.212 INFO:teuthology.lock.ops:Updating trial106.front.sepia.ceph.com on lock server 2026-02-12T06:33:45.291 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T06:33:45.303 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T06:33:45.315 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T06:33:45.315 DEBUG:teuthology.orchestra.run.trial058:> test '!' -e /home/ubuntu/cephtest 2026-02-12T06:33:45.316 DEBUG:teuthology.orchestra.run.trial106:> test '!' -e /home/ubuntu/cephtest 2026-02-12T06:33:45.331 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T06:33:45.343 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T06:33:45.343 DEBUG:teuthology.orchestra.run.trial058:> test -z $(ls -A /var/lib/ceph) 2026-02-12T06:33:45.372 DEBUG:teuthology.orchestra.run.trial106:> test -z $(ls -A /var/lib/ceph) 2026-02-12T06:33:45.389 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T06:33:45.580 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T06:33:45.599 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-12T06:33:45.599 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-12T06:33:45.599 DEBUG:teuthology.orchestra.run.trial058:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T06:33:45.600 DEBUG:teuthology.orchestra.run.trial106:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T06:33:45.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T06:33:45.614 DEBUG:teuthology.orchestra.run.trial058:> uname -r 2026-02-12T06:33:45.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T06:33:45.615 DEBUG:teuthology.orchestra.run.trial106:> uname -r 2026-02-12T06:33:45.670 INFO:teuthology.orchestra.run.trial058.stdout:5.14.0-645.el9.x86_64 2026-02-12T06:33:45.670 INFO:teuthology.task.kernel:Running kernel on trial058: 5.14.0-645.el9.x86_64 2026-02-12T06:33:45.670 DEBUG:teuthology.orchestra.run.trial058:> sudo yum install -y kernel 2026-02-12T06:33:45.671 INFO:teuthology.orchestra.run.trial106.stdout:5.14.0-645.el9.x86_64 2026-02-12T06:33:45.671 INFO:teuthology.task.kernel:Running kernel on trial106: 5.14.0-645.el9.x86_64 2026-02-12T06:33:45.671 DEBUG:teuthology.orchestra.run.trial106:> sudo yum install -y kernel 2026-02-12T06:33:46.738 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-12T06:33:46.765 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-12T06:33:49.942 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-12T06:33:50.182 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 27 MB 00:02 2026-02-12T06:33:53.604 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - CRB 6.0 MB/s | 7.8 MB 00:01 2026-02-12T06:33:54.397 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - Extras packages 246 kB/s | 20 kB 00:00 2026-02-12T06:33:54.741 INFO:teuthology.orchestra.run.trial106.stdout:Extra Packages for Enterprise Linux 77 MB/s | 20 MB 00:00 2026-02-12T06:33:57.972 INFO:teuthology.orchestra.run.trial106.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-12T06:33:59.035 INFO:teuthology.orchestra.run.trial106.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T06:33:59.055 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:33:59.056 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:33:59.056 INFO:teuthology.orchestra.run.trial106.stdout: Package Architecture Version Repository Size 2026-02-12T06:33:59.057 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:33:59.057 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-12T06:33:59.057 INFO:teuthology.orchestra.run.trial106.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T06:33:59.057 INFO:teuthology.orchestra.run.trial106.stdout:Installing dependencies: 2026-02-12T06:33:59.057 INFO:teuthology.orchestra.run.trial106.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T06:33:59.057 INFO:teuthology.orchestra.run.trial106.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T06:33:59.057 INFO:teuthology.orchestra.run.trial106.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T06:33:59.057 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:33:59.057 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-12T06:33:59.057 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:33:59.057 INFO:teuthology.orchestra.run.trial106.stdout:Install 4 Packages 2026-02-12T06:33:59.057 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:33:59.058 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 88 M 2026-02-12T06:33:59.058 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 135 M 2026-02-12T06:33:59.058 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-12T06:33:59.335 INFO:teuthology.orchestra.run.trial106.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 3.4 MB/s | 768 kB 00:00 2026-02-12T06:33:59.473 INFO:teuthology.orchestra.run.trial106.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 48 MB/s | 17 MB 00:00 2026-02-12T06:33:59.704 INFO:teuthology.orchestra.run.trial106.stdout:(3/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 67 MB/s | 40 MB 00:00 2026-02-12T06:33:59.744 INFO:teuthology.orchestra.run.trial106.stdout:(4/4): kernel-modules-core-5.14.0-677.el9.x86_6 75 MB/s | 31 MB 00:00 2026-02-12T06:33:59.745 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:33:59.745 INFO:teuthology.orchestra.run.trial106.stdout:Total 128 MB/s | 88 MB 00:00 2026-02-12T06:33:59.935 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-12T06:34:00.141 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-12T06:34:00.141 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-12T06:34:00.487 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-12T06:34:00.487 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-12T06:34:00.852 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - CRB 959 kB/s | 7.8 MB 00:08 2026-02-12T06:34:01.569 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-12T06:34:01.750 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - Extras packages 116 kB/s | 20 kB 00:00 2026-02-12T06:34:01.853 INFO:teuthology.orchestra.run.trial106.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T06:34:01.872 INFO:teuthology.orchestra.run.trial106.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T06:34:02.005 INFO:teuthology.orchestra.run.trial058.stdout:Extra Packages for Enterprise Linux 112 MB/s | 20 MB 00:00 2026-02-12T06:34:03.648 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T06:34:03.677 INFO:teuthology.orchestra.run.trial106.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T06:34:05.216 INFO:teuthology.orchestra.run.trial058.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-12T06:34:06.274 INFO:teuthology.orchestra.run.trial058.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T06:34:06.294 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:34:06.295 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:34:06.295 INFO:teuthology.orchestra.run.trial058.stdout: Package Architecture Version Repository Size 2026-02-12T06:34:06.295 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:34:06.295 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-12T06:34:06.295 INFO:teuthology.orchestra.run.trial058.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T06:34:06.295 INFO:teuthology.orchestra.run.trial058.stdout:Installing dependencies: 2026-02-12T06:34:06.295 INFO:teuthology.orchestra.run.trial058.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T06:34:06.296 INFO:teuthology.orchestra.run.trial058.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T06:34:06.296 INFO:teuthology.orchestra.run.trial058.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T06:34:06.296 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:34:06.296 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-12T06:34:06.296 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:34:06.296 INFO:teuthology.orchestra.run.trial058.stdout:Install 4 Packages 2026-02-12T06:34:06.296 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:34:06.296 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 88 M 2026-02-12T06:34:06.296 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 135 M 2026-02-12T06:34:06.296 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-12T06:34:06.414 INFO:teuthology.orchestra.run.trial058.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 13 MB/s | 768 kB 00:00 2026-02-12T06:34:06.490 INFO:teuthology.orchestra.run.trial058.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 126 MB/s | 17 MB 00:00 2026-02-12T06:34:06.577 INFO:teuthology.orchestra.run.trial058.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 189 MB/s | 31 MB 00:00 2026-02-12T06:34:06.648 INFO:teuthology.orchestra.run.trial058.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 135 MB/s | 40 MB 00:00 2026-02-12T06:34:06.649 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:34:06.649 INFO:teuthology.orchestra.run.trial058.stdout:Total 250 MB/s | 88 MB 00:00 2026-02-12T06:34:06.699 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T06:34:06.706 INFO:teuthology.orchestra.run.trial106.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T06:34:06.839 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-12T06:34:07.041 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-12T06:34:07.042 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-12T06:34:07.388 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-12T06:34:07.389 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-12T06:34:08.483 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-12T06:34:08.767 INFO:teuthology.orchestra.run.trial058.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T06:34:08.786 INFO:teuthology.orchestra.run.trial058.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T06:34:09.735 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T06:34:10.545 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T06:34:10.574 INFO:teuthology.orchestra.run.trial058.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T06:34:13.658 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T06:34:13.664 INFO:teuthology.orchestra.run.trial058.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T06:34:16.905 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T06:34:40.400 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T06:34:40.421 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T06:34:40.594 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T06:34:40.594 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T06:34:40.594 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T06:34:40.594 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T06:34:40.646 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T06:34:40.646 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:34:40.646 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-12T06:34:40.646 INFO:teuthology.orchestra.run.trial106.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T06:34:40.646 INFO:teuthology.orchestra.run.trial106.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T06:34:40.646 INFO:teuthology.orchestra.run.trial106.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T06:34:40.647 INFO:teuthology.orchestra.run.trial106.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T06:34:40.647 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:34:40.647 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:34:40.704 DEBUG:teuthology.orchestra.run.trial106:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T06:34:40.772 INFO:teuthology.orchestra.run.trial106.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T06:34:40.773 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T06:34:40.773 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T06:34:40.773 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T06:34:40.773 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T06:34:40.773 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2026-02-12T06:34:40.773 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial106.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T06:34:40.774 DEBUG:teuthology.orchestra.run.trial106:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T06:34:40.836 INFO:teuthology.orchestra.run.trial106.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T06:34:40.837 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T06:34:40.837 DEBUG:teuthology.orchestra.run.trial106:> sudo rpm -qi grub2-tools 2026-02-12T06:34:40.906 INFO:teuthology.orchestra.run.trial106.stdout:Name : grub2-tools 2026-02-12T06:34:40.906 INFO:teuthology.orchestra.run.trial106.stdout:Epoch : 1 2026-02-12T06:34:40.906 INFO:teuthology.orchestra.run.trial106.stdout:Version : 2.06 2026-02-12T06:34:40.906 INFO:teuthology.orchestra.run.trial106.stdout:Release : 118.el9 2026-02-12T06:34:40.907 INFO:teuthology.orchestra.run.trial106.stdout:Architecture: x86_64 2026-02-12T06:34:40.907 INFO:teuthology.orchestra.run.trial106.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T06:34:40.907 INFO:teuthology.orchestra.run.trial106.stdout:Group : Unspecified 2026-02-12T06:34:40.907 INFO:teuthology.orchestra.run.trial106.stdout:Size : 8393909 2026-02-12T06:34:40.907 INFO:teuthology.orchestra.run.trial106.stdout:License : GPLv3+ 2026-02-12T06:34:40.907 INFO:teuthology.orchestra.run.trial106.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T06:34:40.907 INFO:teuthology.orchestra.run.trial106.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T06:34:40.907 INFO:teuthology.orchestra.run.trial106.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T06:34:40.907 INFO:teuthology.orchestra.run.trial106.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T06:34:40.907 INFO:teuthology.orchestra.run.trial106.stdout:Packager : builder@centos.org 2026-02-12T06:34:40.907 INFO:teuthology.orchestra.run.trial106.stdout:Vendor : CentOS 2026-02-12T06:34:40.907 INFO:teuthology.orchestra.run.trial106.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T06:34:40.908 INFO:teuthology.orchestra.run.trial106.stdout:Summary : Support tools for GRUB. 2026-02-12T06:34:40.908 INFO:teuthology.orchestra.run.trial106.stdout:Description : 2026-02-12T06:34:40.908 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:34:40.908 INFO:teuthology.orchestra.run.trial106.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T06:34:40.908 INFO:teuthology.orchestra.run.trial106.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T06:34:40.908 INFO:teuthology.orchestra.run.trial106.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T06:34:40.908 INFO:teuthology.orchestra.run.trial106.stdout:hardware devices. 2026-02-12T06:34:40.908 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:34:40.908 INFO:teuthology.orchestra.run.trial106.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T06:34:40.909 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T06:34:40.909 INFO:teuthology.task.kernel:Updating grub on trial106 to boot 5.14.0-677.el9.x86_64 2026-02-12T06:34:40.910 DEBUG:teuthology.orchestra.run.trial106:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T06:34:40.974 INFO:teuthology.orchestra.run.trial106.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T06:34:40.976 DEBUG:teuthology.orchestra.run.trial106:> sudo command -v grubby && echo yes || echo no 2026-02-12T06:34:41.040 INFO:teuthology.orchestra.run.trial106.stdout:/sbin/grubby 2026-02-12T06:34:41.041 INFO:teuthology.orchestra.run.trial106.stdout:yes 2026-02-12T06:34:41.041 DEBUG:teuthology.orchestra.run.trial106:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T06:34:41.104 INFO:teuthology.orchestra.run.trial106.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T06:34:41.106 DEBUG:teuthology.orchestra.run.trial106:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T06:34:41.180 DEBUG:teuthology.orchestra.run.trial106:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T06:34:41.388 INFO:teuthology.orchestra.run.trial106.stderr:Generating grub configuration file ... 2026-02-12T06:34:41.451 INFO:teuthology.orchestra.run.trial106.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T06:34:41.457 INFO:teuthology.orchestra.run.trial106.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T06:34:41.710 INFO:teuthology.orchestra.run.trial106.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T06:34:41.717 INFO:teuthology.orchestra.run.trial106.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T06:34:41.748 INFO:teuthology.orchestra.run.trial106.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T06:34:41.754 INFO:teuthology.orchestra.run.trial106.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T06:34:41.777 INFO:teuthology.orchestra.run.trial106.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T06:34:41.784 INFO:teuthology.orchestra.run.trial106.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T06:34:41.866 INFO:teuthology.orchestra.run.trial106.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T06:34:41.874 INFO:teuthology.orchestra.run.trial106.stderr:done 2026-02-12T06:34:41.876 DEBUG:teuthology.orchestra.run.trial106:> test -d /sys/firmware/efi 2026-02-12T06:34:41.892 DEBUG:teuthology.orchestra.run.trial106:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T06:34:41.957 INFO:teuthology.orchestra.run.trial106.stdout:/boot/efi/EFI/BOOT 2026-02-12T06:34:41.957 INFO:teuthology.orchestra.run.trial106.stdout:/boot/efi/EFI/centos 2026-02-12T06:34:41.959 DEBUG:teuthology.orchestra.run.trial106:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T06:34:42.024 INFO:teuthology.orchestra.run.trial106.stdout:no 2026-02-12T06:34:42.025 DEBUG:teuthology.orchestra.run.trial106:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T06:34:42.089 INFO:teuthology.orchestra.run.trial106.stdout:yes 2026-02-12T06:34:42.089 DEBUG:teuthology.orchestra.run.trial106:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T06:34:42.154 DEBUG:teuthology.orchestra.run.trial106:> sudo shutdown -r now 2026-02-12T06:34:42.229 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T06:34:47.442 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T06:34:47.464 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T06:34:47.529 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T06:34:47.529 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T06:34:47.529 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T06:34:47.529 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T06:34:47.581 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T06:34:47.581 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:34:47.581 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-12T06:34:47.581 INFO:teuthology.orchestra.run.trial058.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T06:34:47.581 INFO:teuthology.orchestra.run.trial058.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T06:34:47.582 INFO:teuthology.orchestra.run.trial058.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T06:34:47.582 INFO:teuthology.orchestra.run.trial058.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T06:34:47.582 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:34:47.582 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:34:47.640 DEBUG:teuthology.orchestra.run.trial058:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T06:34:47.665 INFO:teuthology.orchestra.run.trial058.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T06:34:47.667 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T06:34:47.667 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T06:34:47.667 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T06:34:47.667 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T06:34:47.667 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T06:34:47.667 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial058.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T06:34:47.668 DEBUG:teuthology.orchestra.run.trial058:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T06:34:47.731 INFO:teuthology.orchestra.run.trial058.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T06:34:47.733 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T06:34:47.733 DEBUG:teuthology.orchestra.run.trial058:> sudo rpm -qi grub2-tools 2026-02-12T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout:Name : grub2-tools 2026-02-12T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout:Epoch : 1 2026-02-12T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout:Version : 2.06 2026-02-12T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout:Release : 118.el9 2026-02-12T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout:Architecture: x86_64 2026-02-12T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout:Group : Unspecified 2026-02-12T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout:Size : 8393909 2026-02-12T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout:License : GPLv3+ 2026-02-12T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout:Packager : builder@centos.org 2026-02-12T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout:Vendor : CentOS 2026-02-12T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout:Summary : Support tools for GRUB. 2026-02-12T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout:Description : 2026-02-12T06:34:47.804 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:34:47.804 INFO:teuthology.orchestra.run.trial058.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T06:34:47.804 INFO:teuthology.orchestra.run.trial058.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T06:34:47.804 INFO:teuthology.orchestra.run.trial058.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T06:34:47.804 INFO:teuthology.orchestra.run.trial058.stdout:hardware devices. 2026-02-12T06:34:47.804 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:34:47.804 INFO:teuthology.orchestra.run.trial058.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T06:34:47.805 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T06:34:47.806 INFO:teuthology.task.kernel:Updating grub on trial058 to boot 5.14.0-677.el9.x86_64 2026-02-12T06:34:47.806 DEBUG:teuthology.orchestra.run.trial058:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T06:34:47.869 INFO:teuthology.orchestra.run.trial058.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T06:34:47.870 DEBUG:teuthology.orchestra.run.trial058:> sudo command -v grubby && echo yes || echo no 2026-02-12T06:34:47.934 INFO:teuthology.orchestra.run.trial058.stdout:/sbin/grubby 2026-02-12T06:34:47.935 INFO:teuthology.orchestra.run.trial058.stdout:yes 2026-02-12T06:34:47.936 DEBUG:teuthology.orchestra.run.trial058:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T06:34:47.998 INFO:teuthology.orchestra.run.trial058.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T06:34:47.999 DEBUG:teuthology.orchestra.run.trial058:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T06:34:48.073 DEBUG:teuthology.orchestra.run.trial058:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T06:34:48.282 INFO:teuthology.orchestra.run.trial058.stderr:Generating grub configuration file ... 2026-02-12T06:34:48.344 INFO:teuthology.orchestra.run.trial058.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T06:34:48.351 INFO:teuthology.orchestra.run.trial058.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T06:34:48.597 INFO:teuthology.orchestra.run.trial058.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T06:34:48.604 INFO:teuthology.orchestra.run.trial058.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T06:34:48.636 INFO:teuthology.orchestra.run.trial058.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T06:34:48.642 INFO:teuthology.orchestra.run.trial058.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T06:34:48.665 INFO:teuthology.orchestra.run.trial058.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T06:34:48.671 INFO:teuthology.orchestra.run.trial058.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T06:34:48.756 INFO:teuthology.orchestra.run.trial058.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T06:34:48.764 INFO:teuthology.orchestra.run.trial058.stderr:done 2026-02-12T06:34:48.765 DEBUG:teuthology.orchestra.run.trial058:> test -d /sys/firmware/efi 2026-02-12T06:34:48.781 DEBUG:teuthology.orchestra.run.trial058:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T06:34:48.848 INFO:teuthology.orchestra.run.trial058.stdout:/boot/efi/EFI/BOOT 2026-02-12T06:34:48.848 INFO:teuthology.orchestra.run.trial058.stdout:/boot/efi/EFI/centos 2026-02-12T06:34:48.849 DEBUG:teuthology.orchestra.run.trial058:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T06:34:48.916 INFO:teuthology.orchestra.run.trial058.stdout:no 2026-02-12T06:34:48.916 DEBUG:teuthology.orchestra.run.trial058:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T06:34:48.982 INFO:teuthology.orchestra.run.trial058.stdout:yes 2026-02-12T06:34:48.983 DEBUG:teuthology.orchestra.run.trial058:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T06:34:49.047 DEBUG:teuthology.orchestra.run.trial058:> sudo shutdown -r now 2026-02-12T06:34:49.122 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T06:35:12.221 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2026-02-12T06:35:12.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial106.front.sepia.ceph.com' 2026-02-12T06:35:12.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T06:35:19.097 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T06:35:19.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial058.front.sepia.ceph.com' 2026-02-12T06:35:19.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T06:36:12.277 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T06:36:19.105 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T06:36:21.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial106.front.sepia.ceph.com' 2026-02-12T06:36:21.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T06:36:21.416 DEBUG:teuthology.orchestra.run.trial106:> true 2026-02-12T06:36:21.575 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial106.front.sepia.ceph.com' 2026-02-12T06:36:21.575 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-677.el9.x86_64"... 2026-02-12T06:36:21.576 DEBUG:teuthology.orchestra.run.trial106:> uname -r 2026-02-12T06:36:21.633 INFO:teuthology.orchestra.run.trial106.stdout:5.14.0-677.el9.x86_64 2026-02-12T06:36:21.633 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T06:36:21.633 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T06:36:21.633 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T06:36:22.634 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-12T06:36:22.635 DEBUG:teuthology.orchestra.run.trial106:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T06:36:22.665 INFO:teuthology.orchestra.run.trial106.stdout:ttyS1 2026-02-12T06:36:22.684 DEBUG:teuthology.parallel:result is None 2026-02-12T06:36:28.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial058.front.sepia.ceph.com' 2026-02-12T06:36:28.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T06:36:28.249 DEBUG:teuthology.orchestra.run.trial058:> true 2026-02-12T06:36:28.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial058.front.sepia.ceph.com' 2026-02-12T06:36:28.433 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T06:36:28.433 DEBUG:teuthology.orchestra.run.trial058:> uname -r 2026-02-12T06:36:28.490 INFO:teuthology.orchestra.run.trial058.stdout:5.14.0-677.el9.x86_64 2026-02-12T06:36:28.490 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T06:36:28.490 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T06:36:28.490 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T06:36:29.491 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-12T06:36:29.492 DEBUG:teuthology.orchestra.run.trial058:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T06:36:29.521 INFO:teuthology.orchestra.run.trial058.stdout:ttyS1 2026-02-12T06:36:29.541 DEBUG:teuthology.parallel:result is None 2026-02-12T06:36:29.541 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-12T06:36:29.553 INFO:teuthology.task.internal:Creating test directory... 2026-02-12T06:36:29.553 DEBUG:teuthology.orchestra.run.trial058:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T06:36:29.584 DEBUG:teuthology.orchestra.run.trial106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T06:36:29.602 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-12T06:36:29.614 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-12T06:36:29.627 INFO:teuthology.task.internal:Creating archive directory... 2026-02-12T06:36:29.627 DEBUG:teuthology.orchestra.run.trial058:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T06:36:29.640 DEBUG:teuthology.orchestra.run.trial106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T06:36:29.668 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-12T06:36:29.681 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-12T06:36:29.682 DEBUG:teuthology.orchestra.run.trial058:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T06:36:29.698 DEBUG:teuthology.orchestra.run.trial106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T06:36:29.719 INFO:teuthology.orchestra.run.trial058.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T06:36:29.725 INFO:teuthology.orchestra.run.trial106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T06:36:29.728 INFO:teuthology.orchestra.run.trial058.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T06:36:29.734 INFO:teuthology.orchestra.run.trial106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T06:36:29.737 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-12T06:36:29.748 INFO:teuthology.task.internal:Configuring sudo... 2026-02-12T06:36:29.749 DEBUG:teuthology.orchestra.run.trial058:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T06:36:29.772 DEBUG:teuthology.orchestra.run.trial106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T06:36:29.802 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-12T06:36:29.819 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-12T06:36:29.820 DEBUG:teuthology.orchestra.run.trial058:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T06:36:29.837 DEBUG:teuthology.orchestra.run.trial106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T06:36:29.858 DEBUG:teuthology.orchestra.run.trial058:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T06:36:30.012 DEBUG:teuthology.orchestra.run.trial058:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T06:36:30.037 DEBUG:teuthology.orchestra.run.trial058:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T06:36:30.188 DEBUG:teuthology.orchestra.run.trial058:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T06:36:30.212 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:36:30.213 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T06:36:30.278 DEBUG:teuthology.orchestra.run.trial106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T06:36:30.404 DEBUG:teuthology.orchestra.run.trial106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T06:36:30.430 DEBUG:teuthology.orchestra.run.trial106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T06:36:30.568 DEBUG:teuthology.orchestra.run.trial106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T06:36:30.592 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-12T06:36:30.592 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T06:36:30.657 DEBUG:teuthology.orchestra.run.trial058:> sudo service rsyslog restart 2026-02-12T06:36:30.659 DEBUG:teuthology.orchestra.run.trial106:> sudo service rsyslog restart 2026-02-12T06:36:30.686 INFO:teuthology.orchestra.run.trial058.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T06:36:30.724 INFO:teuthology.orchestra.run.trial106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T06:36:31.020 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-12T06:36:31.033 INFO:teuthology.task.internal:Starting timer... 2026-02-12T06:36:31.033 INFO:teuthology.run_tasks:Running task pcp... 2026-02-12T06:36:31.056 INFO:teuthology.run_tasks:Running task selinux... 2026-02-12T06:36:31.075 DEBUG:teuthology.orchestra.run.trial058:> sudo service auditd rotate 2026-02-12T06:36:31.104 INFO:teuthology.orchestra.run.trial058.stdout:Rotating logs: 2026-02-12T06:36:31.106 DEBUG:teuthology.orchestra.run.trial106:> sudo service auditd rotate 2026-02-12T06:36:31.135 INFO:teuthology.orchestra.run.trial106.stdout:Rotating logs: 2026-02-12T06:36:31.137 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-12T06:36:31.137 DEBUG:teuthology.orchestra.run.trial058:> /usr/sbin/getenforce 2026-02-12T06:36:31.163 INFO:teuthology.orchestra.run.trial058.stdout:Permissive 2026-02-12T06:36:31.163 DEBUG:teuthology.orchestra.run.trial106:> /usr/sbin/getenforce 2026-02-12T06:36:31.194 INFO:teuthology.orchestra.run.trial106.stdout:Permissive 2026-02-12T06:36:31.194 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial058.front.sepia.ceph.com': 'permissive', 'ubuntu@trial106.front.sepia.ceph.com': 'permissive'} 2026-02-12T06:36:31.195 DEBUG:teuthology.orchestra.run.trial058:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T06:36:31.228 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T06:36:31.229 DEBUG:teuthology.orchestra.run.trial106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T06:36:31.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T06:36:31.260 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-12T06:36:31.260 DEBUG:teuthology.orchestra.run.trial058:> sudo /usr/sbin/setenforce permissive 2026-02-12T06:36:31.294 DEBUG:teuthology.orchestra.run.trial106:> sudo /usr/sbin/setenforce permissive 2026-02-12T06:36:31.326 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-12T06:36:31.342 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-12T06:36:31.355 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-12T06:36:31.356 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial058.front.sepia.ceph.com,trial106.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-12T06:37:39.587 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial058.front.sepia.ceph.com'), Remote(name='ubuntu@trial106.front.sepia.ceph.com')] 2026-02-12T06:37:39.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial058.front.sepia.ceph.com' 2026-02-12T06:37:39.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T06:37:39.701 DEBUG:teuthology.orchestra.run.trial058:> true 2026-02-12T06:37:39.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial058.front.sepia.ceph.com' 2026-02-12T06:37:39.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial106.front.sepia.ceph.com' 2026-02-12T06:37:39.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T06:37:39.869 DEBUG:teuthology.orchestra.run.trial106:> true 2026-02-12T06:37:39.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial106.front.sepia.ceph.com' 2026-02-12T06:37:39.949 INFO:teuthology.run_tasks:Running task clock... 2026-02-12T06:37:39.964 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-12T06:37:39.964 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T06:37:39.964 DEBUG:teuthology.orchestra.run.trial058:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T06:37:39.966 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T06:37:39.967 DEBUG:teuthology.orchestra.run.trial106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T06:37:39.992 INFO:teuthology.orchestra.run.trial058.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T06:37:40.004 INFO:teuthology.orchestra.run.trial058.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T06:37:40.017 INFO:teuthology.orchestra.run.trial106.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T06:37:40.024 INFO:teuthology.orchestra.run.trial058.stderr:sudo: ntpd: command not found 2026-02-12T06:37:40.029 INFO:teuthology.orchestra.run.trial106.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T06:37:40.033 INFO:teuthology.orchestra.run.trial058.stdout:506 Cannot talk to daemon 2026-02-12T06:37:40.044 INFO:teuthology.orchestra.run.trial058.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T06:37:40.049 INFO:teuthology.orchestra.run.trial106.stderr:sudo: ntpd: command not found 2026-02-12T06:37:40.056 INFO:teuthology.orchestra.run.trial058.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T06:37:40.060 INFO:teuthology.orchestra.run.trial106.stdout:506 Cannot talk to daemon 2026-02-12T06:37:40.071 INFO:teuthology.orchestra.run.trial106.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T06:37:40.083 INFO:teuthology.orchestra.run.trial106.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T06:37:40.101 INFO:teuthology.orchestra.run.trial058.stderr:bash: line 1: ntpq: command not found 2026-02-12T06:37:40.122 INFO:teuthology.orchestra.run.trial058.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T06:37:40.122 INFO:teuthology.orchestra.run.trial058.stdout:=============================================================================== 2026-02-12T06:37:40.122 INFO:teuthology.orchestra.run.trial058.stdout:^? 172-234-37-140.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T06:37:40.122 INFO:teuthology.orchestra.run.trial058.stdout:^? 144.202.41.38.vultruserc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T06:37:40.122 INFO:teuthology.orchestra.run.trial058.stdout:^? 144.202.62.209.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T06:37:40.122 INFO:teuthology.orchestra.run.trial058.stdout:^? 23-95-35-34-host.colocro> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T06:37:40.126 INFO:teuthology.orchestra.run.trial106.stderr:bash: line 1: ntpq: command not found 2026-02-12T06:37:40.142 INFO:teuthology.orchestra.run.trial106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T06:37:40.142 INFO:teuthology.orchestra.run.trial106.stdout:=============================================================================== 2026-02-12T06:37:40.142 INFO:teuthology.orchestra.run.trial106.stdout:^? 172-232-15-202.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T06:37:40.142 INFO:teuthology.orchestra.run.trial106.stdout:^? arm1.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T06:37:40.142 INFO:teuthology.orchestra.run.trial106.stdout:^? time.ecansol.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T06:37:40.142 INFO:teuthology.orchestra.run.trial106.stdout:^? time2.trtnw.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T06:37:40.143 INFO:teuthology.run_tasks:Running task install... 2026-02-12T06:37:40.158 DEBUG:teuthology.task.install:project ceph 2026-02-12T06:37:40.158 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}} 2026-02-12T06:37:40.158 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'} 2026-02-12T06:37:40.158 INFO:teuthology.task.install:Using flavor: debug 2026-02-12T06:37:40.168 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-12T06:37:40.168 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-12T06:37:40.169 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0', 'tag': None, 'wait_for_package': False} 2026-02-12T06:37:40.169 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T06:37:40.172 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0', 'tag': None, 'wait_for_package': False} 2026-02-12T06:37:40.172 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T06:37:40.359 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/ 2026-02-12T06:37:40.359 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5145.g5fdb7d8f 2026-02-12T06:37:40.368 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/ 2026-02-12T06:37:40.369 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5145.g5fdb7d8f 2026-02-12T06:37:40.642 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T06:37:40.642 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:37:40.642 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T06:37:40.668 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-12T06:37:40.669 DEBUG:teuthology.orchestra.run.trial058:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T06:37:40.680 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T06:37:40.681 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-12T06:37:40.681 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T06:37:40.707 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-12T06:37:40.707 DEBUG:teuthology.orchestra.run.trial106:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T06:37:40.733 DEBUG:teuthology.orchestra.run.trial058:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T06:37:40.771 DEBUG:teuthology.orchestra.run.trial106:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T06:37:40.807 DEBUG:teuthology.orchestra.run.trial058:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T06:37:40.846 DEBUG:teuthology.orchestra.run.trial106:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T06:37:40.874 INFO:teuthology.orchestra.run.trial058.stdout:check_obsoletes = 1 2026-02-12T06:37:40.876 DEBUG:teuthology.orchestra.run.trial058:> sudo yum clean all 2026-02-12T06:37:40.914 INFO:teuthology.orchestra.run.trial106.stdout:check_obsoletes = 1 2026-02-12T06:37:40.916 DEBUG:teuthology.orchestra.run.trial106:> sudo yum clean all 2026-02-12T06:37:41.035 INFO:teuthology.orchestra.run.trial058.stdout:41 files removed 2026-02-12T06:37:41.049 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-radosgw 2026-02-12T06:37:41.069 INFO:teuthology.orchestra.run.trial106.stdout:41 files removed 2026-02-12T06:37:41.084 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-radosgw 2026-02-12T06:37:41.698 INFO:teuthology.orchestra.run.trial058.stdout:ceph packages for x86_64 187 kB/s | 94 kB 00:00 2026-02-12T06:37:41.747 INFO:teuthology.orchestra.run.trial106.stdout:ceph packages for x86_64 180 kB/s | 94 kB 00:00 2026-02-12T06:37:42.203 INFO:teuthology.orchestra.run.trial058.stdout:ceph noarch packages 51 kB/s | 24 kB 00:00 2026-02-12T06:37:42.252 INFO:teuthology.orchestra.run.trial106.stdout:ceph noarch packages 51 kB/s | 24 kB 00:00 2026-02-12T06:37:42.651 INFO:teuthology.orchestra.run.trial058.stdout:ceph source packages 4.9 kB/s | 2.1 kB 00:00 2026-02-12T06:37:42.675 INFO:teuthology.orchestra.run.trial106.stdout:ceph source packages 5.2 kB/s | 2.1 kB 00:00 2026-02-12T06:37:43.409 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-12T06:37:44.306 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.9 MB 00:01 2026-02-12T06:37:46.447 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-12T06:37:47.556 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 27 MB 00:02 2026-02-12T06:37:50.383 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 7.8 MB 00:01 2026-02-12T06:37:51.475 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 7.8 MB 00:01 2026-02-12T06:37:51.946 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 20 kB 00:00 2026-02-12T06:37:52.376 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - Extras packages 110 kB/s | 20 kB 00:00 2026-02-12T06:37:52.580 INFO:teuthology.orchestra.run.trial106.stdout:Extra Packages for Enterprise Linux 36 MB/s | 20 MB 00:00 2026-02-12T06:37:53.843 INFO:teuthology.orchestra.run.trial058.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2026-02-12T06:37:55.814 INFO:teuthology.orchestra.run.trial106.stdout:lab-extras 961 kB/s | 50 kB 00:00 2026-02-12T06:37:57.018 INFO:teuthology.orchestra.run.trial058.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-12T06:37:57.100 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:37:57.102 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:37:57.102 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repository Size 2026-02-12T06:37:57.102 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:37:57.102 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-12T06:37:57.102 INFO:teuthology.orchestra.run.trial106.stdout: ceph-radosgw x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 11 M 2026-02-12T06:37:57.102 INFO:teuthology.orchestra.run.trial106.stdout:Upgrading: 2026-02-12T06:37:57.102 INFO:teuthology.orchestra.run.trial106.stdout: librados2 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 3.3 M 2026-02-12T06:37:57.103 INFO:teuthology.orchestra.run.trial106.stdout: librbd1 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 2.7 M 2026-02-12T06:37:57.103 INFO:teuthology.orchestra.run.trial106.stdout:Installing dependencies: 2026-02-12T06:37:57.103 INFO:teuthology.orchestra.run.trial106.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T06:37:57.103 INFO:teuthology.orchestra.run.trial106.stdout: ceph-base x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 5.1 M 2026-02-12T06:37:57.103 INFO:teuthology.orchestra.run.trial106.stdout: ceph-common x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 21 M 2026-02-12T06:37:57.103 INFO:teuthology.orchestra.run.trial106.stdout: ceph-selinux x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 25 k 2026-02-12T06:37:57.103 INFO:teuthology.orchestra.run.trial106.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T06:37:57.103 INFO:teuthology.orchestra.run.trial106.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T06:37:57.103 INFO:teuthology.orchestra.run.trial106.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T06:37:57.103 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs2 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 860 k 2026-02-12T06:37:57.103 INFO:teuthology.orchestra.run.trial106.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T06:37:57.104 INFO:teuthology.orchestra.run.trial106.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T06:37:57.104 INFO:teuthology.orchestra.run.trial106.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T06:37:57.104 INFO:teuthology.orchestra.run.trial106.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T06:37:57.104 INFO:teuthology.orchestra.run.trial106.stdout: libradosstriper1 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 263 k 2026-02-12T06:37:57.104 INFO:teuthology.orchestra.run.trial106.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T06:37:57.104 INFO:teuthology.orchestra.run.trial106.stdout: librgw2 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 5.6 M 2026-02-12T06:37:57.104 INFO:teuthology.orchestra.run.trial106.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T06:37:57.104 INFO:teuthology.orchestra.run.trial106.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T06:37:57.104 INFO:teuthology.orchestra.run.trial106.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T06:37:57.104 INFO:teuthology.orchestra.run.trial106.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T06:37:57.105 INFO:teuthology.orchestra.run.trial106.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T06:37:57.105 INFO:teuthology.orchestra.run.trial106.stdout: python3-ceph-argparse x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 45 k 2026-02-12T06:37:57.105 INFO:teuthology.orchestra.run.trial106.stdout: python3-ceph-common x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 184 k 2026-02-12T06:37:57.105 INFO:teuthology.orchestra.run.trial106.stdout: python3-cephfs x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 203 k 2026-02-12T06:37:57.105 INFO:teuthology.orchestra.run.trial106.stdout: python3-rados x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 324 k 2026-02-12T06:37:57.105 INFO:teuthology.orchestra.run.trial106.stdout: python3-rbd x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 305 k 2026-02-12T06:37:57.105 INFO:teuthology.orchestra.run.trial106.stdout: python3-rgw x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 100 k 2026-02-12T06:37:57.105 INFO:teuthology.orchestra.run.trial106.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T06:37:57.105 INFO:teuthology.orchestra.run.trial106.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T06:37:57.106 INFO:teuthology.orchestra.run.trial106.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T06:37:57.106 INFO:teuthology.orchestra.run.trial106.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T06:37:57.106 INFO:teuthology.orchestra.run.trial106.stdout:Installing weak dependencies: 2026-02-12T06:37:57.106 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs-daemon x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 35 k 2026-02-12T06:37:57.106 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 24 k 2026-02-12T06:37:57.106 INFO:teuthology.orchestra.run.trial106.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-12T06:37:57.106 INFO:teuthology.orchestra.run.trial106.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T06:37:57.106 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:37:57.106 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-12T06:37:57.107 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:37:57.107 INFO:teuthology.orchestra.run.trial106.stdout:Install 35 Packages 2026-02-12T06:37:57.107 INFO:teuthology.orchestra.run.trial106.stdout:Upgrade 2 Packages 2026-02-12T06:37:57.107 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:37:57.108 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 61 M 2026-02-12T06:37:57.108 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-12T06:37:58.275 INFO:teuthology.orchestra.run.trial106.stdout:(1/37): ceph-base-20.3.0-5145.g5fdb7d8f.el9.x86 7.8 MB/s | 5.1 MB 00:00 2026-02-12T06:37:58.306 INFO:teuthology.orchestra.run.trial106.stdout:(2/37): ceph-selinux-20.3.0-5145.g5fdb7d8f.el9. 815 kB/s | 25 kB 00:00 2026-02-12T06:37:58.318 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:37:58.320 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:37:58.320 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repository Size 2026-02-12T06:37:58.320 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:37:58.320 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-12T06:37:58.321 INFO:teuthology.orchestra.run.trial058.stdout: ceph-radosgw x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 11 M 2026-02-12T06:37:58.321 INFO:teuthology.orchestra.run.trial058.stdout:Upgrading: 2026-02-12T06:37:58.321 INFO:teuthology.orchestra.run.trial058.stdout: librados2 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 3.3 M 2026-02-12T06:37:58.321 INFO:teuthology.orchestra.run.trial058.stdout: librbd1 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 2.7 M 2026-02-12T06:37:58.321 INFO:teuthology.orchestra.run.trial058.stdout:Installing dependencies: 2026-02-12T06:37:58.321 INFO:teuthology.orchestra.run.trial058.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T06:37:58.321 INFO:teuthology.orchestra.run.trial058.stdout: ceph-base x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 5.1 M 2026-02-12T06:37:58.321 INFO:teuthology.orchestra.run.trial058.stdout: ceph-common x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 21 M 2026-02-12T06:37:58.321 INFO:teuthology.orchestra.run.trial058.stdout: ceph-selinux x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 25 k 2026-02-12T06:37:58.321 INFO:teuthology.orchestra.run.trial058.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T06:37:58.321 INFO:teuthology.orchestra.run.trial058.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T06:37:58.321 INFO:teuthology.orchestra.run.trial058.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T06:37:58.322 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs2 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 860 k 2026-02-12T06:37:58.322 INFO:teuthology.orchestra.run.trial058.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T06:37:58.322 INFO:teuthology.orchestra.run.trial058.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T06:37:58.322 INFO:teuthology.orchestra.run.trial058.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T06:37:58.322 INFO:teuthology.orchestra.run.trial058.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T06:37:58.322 INFO:teuthology.orchestra.run.trial058.stdout: libradosstriper1 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 263 k 2026-02-12T06:37:58.322 INFO:teuthology.orchestra.run.trial058.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T06:37:58.322 INFO:teuthology.orchestra.run.trial058.stdout: librgw2 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 5.6 M 2026-02-12T06:37:58.322 INFO:teuthology.orchestra.run.trial058.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T06:37:58.322 INFO:teuthology.orchestra.run.trial058.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T06:37:58.322 INFO:teuthology.orchestra.run.trial058.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T06:37:58.322 INFO:teuthology.orchestra.run.trial058.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T06:37:58.323 INFO:teuthology.orchestra.run.trial058.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T06:37:58.323 INFO:teuthology.orchestra.run.trial058.stdout: python3-ceph-argparse x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 45 k 2026-02-12T06:37:58.323 INFO:teuthology.orchestra.run.trial058.stdout: python3-ceph-common x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 184 k 2026-02-12T06:37:58.323 INFO:teuthology.orchestra.run.trial058.stdout: python3-cephfs x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 203 k 2026-02-12T06:37:58.323 INFO:teuthology.orchestra.run.trial058.stdout: python3-rados x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 324 k 2026-02-12T06:37:58.323 INFO:teuthology.orchestra.run.trial058.stdout: python3-rbd x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 305 k 2026-02-12T06:37:58.323 INFO:teuthology.orchestra.run.trial058.stdout: python3-rgw x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 100 k 2026-02-12T06:37:58.323 INFO:teuthology.orchestra.run.trial058.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T06:37:58.323 INFO:teuthology.orchestra.run.trial058.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T06:37:58.323 INFO:teuthology.orchestra.run.trial058.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T06:37:58.323 INFO:teuthology.orchestra.run.trial058.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T06:37:58.323 INFO:teuthology.orchestra.run.trial058.stdout:Installing weak dependencies: 2026-02-12T06:37:58.323 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-daemon x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 35 k 2026-02-12T06:37:58.324 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 24 k 2026-02-12T06:37:58.324 INFO:teuthology.orchestra.run.trial058.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-12T06:37:58.324 INFO:teuthology.orchestra.run.trial058.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T06:37:58.324 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:37:58.324 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-12T06:37:58.324 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:37:58.324 INFO:teuthology.orchestra.run.trial058.stdout:Install 35 Packages 2026-02-12T06:37:58.324 INFO:teuthology.orchestra.run.trial058.stdout:Upgrade 2 Packages 2026-02-12T06:37:58.324 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:37:58.325 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 61 M 2026-02-12T06:37:58.325 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-12T06:37:58.338 INFO:teuthology.orchestra.run.trial106.stdout:(3/37): libcephfs-daemon-20.3.0-5145.g5fdb7d8f. 1.1 MB/s | 35 kB 00:00 2026-02-12T06:37:58.372 INFO:teuthology.orchestra.run.trial106.stdout:(4/37): libcephfs-proxy2-20.3.0-5145.g5fdb7d8f. 723 kB/s | 24 kB 00:00 2026-02-12T06:37:58.458 INFO:teuthology.orchestra.run.trial106.stdout:(5/37): ceph-radosgw-20.3.0-5145.g5fdb7d8f.el9. 13 MB/s | 11 MB 00:00 2026-02-12T06:37:58.478 INFO:teuthology.orchestra.run.trial106.stdout:(6/37): libcephfs2-20.3.0-5145.g5fdb7d8f.el9.x8 7.9 MB/s | 860 kB 00:00 2026-02-12T06:37:58.486 INFO:teuthology.orchestra.run.trial106.stdout:(7/37): libradosstriper1-20.3.0-5145.g5fdb7d8f. 9.2 MB/s | 263 kB 00:00 2026-02-12T06:37:58.517 INFO:teuthology.orchestra.run.trial106.stdout:(8/37): python3-ceph-argparse-20.3.0-5145.g5fdb 1.4 MB/s | 45 kB 00:00 2026-02-12T06:37:58.552 INFO:teuthology.orchestra.run.trial106.stdout:(9/37): python3-ceph-common-20.3.0-5145.g5fdb7d 5.1 MB/s | 184 kB 00:00 2026-02-12T06:37:58.589 INFO:teuthology.orchestra.run.trial106.stdout:(10/37): python3-cephfs-20.3.0-5145.g5fdb7d8f.e 5.4 MB/s | 203 kB 00:00 2026-02-12T06:37:58.629 INFO:teuthology.orchestra.run.trial106.stdout:(11/37): python3-rados-20.3.0-5145.g5fdb7d8f.el 8.0 MB/s | 324 kB 00:00 2026-02-12T06:37:58.669 INFO:teuthology.orchestra.run.trial106.stdout:(12/37): python3-rbd-20.3.0-5145.g5fdb7d8f.el9. 7.5 MB/s | 305 kB 00:00 2026-02-12T06:37:58.708 INFO:teuthology.orchestra.run.trial106.stdout:(13/37): python3-rgw-20.3.0-5145.g5fdb7d8f.el9. 2.5 MB/s | 100 kB 00:00 2026-02-12T06:37:58.876 INFO:teuthology.orchestra.run.trial106.stdout:(14/37): librgw2-20.3.0-5145.g5fdb7d8f.el9.x86_ 14 MB/s | 5.6 MB 00:00 2026-02-12T06:37:59.158 INFO:teuthology.orchestra.run.trial106.stdout:(15/37): ceph-common-20.3.0-5145.g5fdb7d8f.el9. 14 MB/s | 21 MB 00:01 2026-02-12T06:37:59.249 INFO:teuthology.orchestra.run.trial106.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 61 kB/s | 33 kB 00:00 2026-02-12T06:37:59.290 INFO:teuthology.orchestra.run.trial106.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 2.5 MB/s | 104 kB 00:00 2026-02-12T06:37:59.310 INFO:teuthology.orchestra.run.trial106.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 7.9 MB/s | 164 kB 00:00 2026-02-12T06:37:59.325 INFO:teuthology.orchestra.run.trial106.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 11 MB/s | 160 kB 00:00 2026-02-12T06:37:59.335 INFO:teuthology.orchestra.run.trial106.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 4.5 MB/s | 45 kB 00:00 2026-02-12T06:37:59.360 INFO:teuthology.orchestra.run.trial106.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 26 MB/s | 662 kB 00:00 2026-02-12T06:37:59.372 INFO:teuthology.orchestra.run.trial106.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 24 MB/s | 292 kB 00:00 2026-02-12T06:37:59.382 INFO:teuthology.orchestra.run.trial106.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 23 MB/s | 240 kB 00:00 2026-02-12T06:37:59.390 INFO:teuthology.orchestra.run.trial106.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 4.4 MB/s | 37 kB 00:00 2026-02-12T06:37:59.399 INFO:teuthology.orchestra.run.trial106.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 7.7 MB/s | 66 kB 00:00 2026-02-12T06:37:59.647 INFO:teuthology.orchestra.run.trial058.stdout:(1/37): ceph-base-20.3.0-5145.g5fdb7d8f.el9.x86 4.6 MB/s | 5.1 MB 00:01 2026-02-12T06:37:59.687 INFO:teuthology.orchestra.run.trial058.stdout:(2/37): ceph-selinux-20.3.0-5145.g5fdb7d8f.el9. 624 kB/s | 25 kB 00:00 2026-02-12T06:37:59.727 INFO:teuthology.orchestra.run.trial058.stdout:(3/37): libcephfs-daemon-20.3.0-5145.g5fdb7d8f. 895 kB/s | 35 kB 00:00 2026-02-12T06:37:59.753 INFO:teuthology.orchestra.run.trial106.stdout:(26/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 868 kB/s | 308 kB 00:00 2026-02-12T06:37:59.767 INFO:teuthology.orchestra.run.trial058.stdout:(4/37): libcephfs-proxy2-20.3.0-5145.g5fdb7d8f. 602 kB/s | 24 kB 00:00 2026-02-12T06:37:59.776 INFO:teuthology.orchestra.run.trial106.stdout:(27/37): pciutils-3.7.0-7.el9.x86_64.rpm 151 kB/s | 93 kB 00:00 2026-02-12T06:37:59.909 INFO:teuthology.orchestra.run.trial058.stdout:(5/37): libcephfs2-20.3.0-5145.g5fdb7d8f.el9.x8 5.9 MB/s | 860 kB 00:00 2026-02-12T06:37:59.940 INFO:teuthology.orchestra.run.trial106.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 151 kB/s | 25 kB 00:00 2026-02-12T06:37:59.960 INFO:teuthology.orchestra.run.trial058.stdout:(6/37): libradosstriper1-20.3.0-5145.g5fdb7d8f. 5.1 MB/s | 263 kB 00:00 2026-02-12T06:38:00.024 INFO:teuthology.orchestra.run.trial106.stdout:(29/37): libarrow-9.0.0-15.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2026-02-12T06:38:00.052 INFO:teuthology.orchestra.run.trial106.stdout:(30/37): liboath-2.6.12-1.el9.x86_64.rpm 439 kB/s | 49 kB 00:00 2026-02-12T06:38:00.077 INFO:teuthology.orchestra.run.trial106.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2026-02-12T06:38:00.130 INFO:teuthology.orchestra.run.trial106.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 3.5 MB/s | 191 kB 00:00 2026-02-12T06:38:00.214 INFO:teuthology.orchestra.run.trial106.stdout:(33/37): thrift-0.15.0-4.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2026-02-12T06:38:00.300 INFO:teuthology.orchestra.run.trial106.stdout:(34/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 3.3 MB/s | 838 kB 00:00 2026-02-12T06:38:00.369 INFO:teuthology.orchestra.run.trial058.stdout:(7/37): ceph-radosgw-20.3.0-5145.g5fdb7d8f.el9. 6.1 MB/s | 11 MB 00:01 2026-02-12T06:38:00.421 INFO:teuthology.orchestra.run.trial058.stdout:(8/37): python3-ceph-argparse-20.3.0-5145.g5fdb 873 kB/s | 45 kB 00:00 2026-02-12T06:38:00.481 INFO:teuthology.orchestra.run.trial058.stdout:(9/37): python3-ceph-common-20.3.0-5145.g5fdb7d 3.0 MB/s | 184 kB 00:00 2026-02-12T06:38:00.556 INFO:teuthology.orchestra.run.trial106.stdout:(35/37): nvme-cli-2.13-1.el9.x86_64.rpm 669 kB/s | 1.1 MB 00:01 2026-02-12T06:38:00.719 INFO:teuthology.orchestra.run.trial106.stdout:(36/37): librbd1-20.3.0-5145.g5fdb7d8f.el9.x86_ 6.4 MB/s | 2.7 MB 00:00 2026-02-12T06:38:00.721 INFO:teuthology.orchestra.run.trial058.stdout:(10/37): python3-cephfs-20.3.0-5145.g5fdb7d8f.e 843 kB/s | 203 kB 00:00 2026-02-12T06:38:00.782 INFO:teuthology.orchestra.run.trial058.stdout:(11/37): python3-rados-20.3.0-5145.g5fdb7d8f.el 5.2 MB/s | 324 kB 00:00 2026-02-12T06:38:00.786 INFO:teuthology.orchestra.run.trial106.stdout:(37/37): librados2-20.3.0-5145.g5fdb7d8f.el9.x8 5.7 MB/s | 3.3 MB 00:00 2026-02-12T06:38:00.789 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:38:00.789 INFO:teuthology.orchestra.run.trial106.stdout:Total 17 MB/s | 61 MB 00:03 2026-02-12T06:38:00.831 INFO:teuthology.orchestra.run.trial058.stdout:(12/37): python3-rbd-20.3.0-5145.g5fdb7d8f.el9. 6.1 MB/s | 305 kB 00:00 2026-02-12T06:38:00.847 INFO:teuthology.orchestra.run.trial058.stdout:(13/37): librgw2-20.3.0-5145.g5fdb7d8f.el9.x86_ 6.3 MB/s | 5.6 MB 00:00 2026-02-12T06:38:00.878 INFO:teuthology.orchestra.run.trial058.stdout:(14/37): python3-rgw-20.3.0-5145.g5fdb7d8f.el9. 2.1 MB/s | 100 kB 00:00 2026-02-12T06:38:00.888 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-12T06:38:00.906 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-12T06:38:00.906 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-12T06:38:01.152 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-12T06:38:01.153 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-12T06:38:01.370 INFO:teuthology.orchestra.run.trial058.stdout:(15/37): ceph-common-20.3.0-5145.g5fdb7d8f.el9. 7.4 MB/s | 21 MB 00:02 2026-02-12T06:38:01.423 INFO:teuthology.orchestra.run.trial058.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 58 kB/s | 33 kB 00:00 2026-02-12T06:38:01.442 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-12T06:38:01.583 INFO:teuthology.orchestra.run.trial106.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-12T06:38:01.587 INFO:teuthology.orchestra.run.trial106.stdout: Upgrading : librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/39 2026-02-12T06:38:01.638 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/39 2026-02-12T06:38:01.639 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 3/39 2026-02-12T06:38:01.652 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 3/39 2026-02-12T06:38:01.656 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libcephfs-daemon-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 4/39 2026-02-12T06:38:01.656 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libcephfs-proxy2-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 5/39 2026-02-12T06:38:01.684 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 5/39 2026-02-12T06:38:01.687 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 6/39 2026-02-12T06:38:01.695 INFO:teuthology.orchestra.run.trial106.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-12T06:38:01.697 INFO:teuthology.orchestra.run.trial106.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-12T06:38:01.700 INFO:teuthology.orchestra.run.trial106.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-12T06:38:01.704 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-12T06:38:01.716 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-ceph-argparse-2:20.3.0-5145.g5fdb7d8f.el9. 11/39 2026-02-12T06:38:01.728 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 12/39 2026-02-12T06:38:01.729 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libradosstriper1-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 13/39 2026-02-12T06:38:01.750 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 13/39 2026-02-12T06:38:01.754 INFO:teuthology.orchestra.run.trial106.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-12T06:38:01.784 INFO:teuthology.orchestra.run.trial106.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-12T06:38:01.788 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-12T06:38:01.794 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-12T06:38:01.796 INFO:teuthology.orchestra.run.trial106.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-12T06:38:01.800 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-12T06:38:01.830 INFO:teuthology.orchestra.run.trial058.stdout:(17/37): nvme-cli-2.13-1.el9.x86_64.rpm 1.2 MB/s | 1.1 MB 00:00 2026-02-12T06:38:01.916 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T06:38:01.917 INFO:teuthology.orchestra.run.trial106.stdout: Upgrading : librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 21/39 2026-02-12T06:38:01.944 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 21/39 2026-02-12T06:38:01.946 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 22/39 2026-02-12T06:38:01.953 INFO:teuthology.orchestra.run.trial106.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-12T06:38:02.003 INFO:teuthology.orchestra.run.trial058.stdout:(18/37): boost-program-options-1.75.0-13.el9.x8 179 kB/s | 104 kB 00:00 2026-02-12T06:38:02.026 INFO:teuthology.orchestra.run.trial058.stdout:(19/37): pciutils-3.7.0-7.el9.x86_64.rpm 142 kB/s | 93 kB 00:00 2026-02-12T06:38:02.200 INFO:teuthology.orchestra.run.trial106.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-12T06:38:02.201 INFO:teuthology.orchestra.run.trial106.stdout: Installing : librgw2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 25/39 2026-02-12T06:38:02.217 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librgw2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 25/39 2026-02-12T06:38:02.221 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 26/39 2026-02-12T06:38:02.225 INFO:teuthology.orchestra.run.trial106.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-12T06:38:02.228 INFO:teuthology.orchestra.run.trial106.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-12T06:38:02.228 INFO:teuthology.orchestra.run.trial106.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T06:38:02.246 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T06:38:02.249 INFO:teuthology.orchestra.run.trial058.stdout:(20/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 653 kB/s | 160 kB 00:00 2026-02-12T06:38:02.357 INFO:teuthology.orchestra.run.trial106.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-12T06:38:02.359 INFO:teuthology.orchestra.run.trial106.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T06:38:02.457 INFO:teuthology.orchestra.run.trial058.stdout:(21/37): libnbd-1.20.3-4.el9.x86_64.rpm 261 kB/s | 164 kB 00:00 2026-02-12T06:38:02.507 INFO:teuthology.orchestra.run.trial058.stdout:(22/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 94 kB/s | 45 kB 00:00 2026-02-12T06:38:02.640 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T06:38:02.640 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T06:38:02.641 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:02.683 INFO:teuthology.orchestra.run.trial106.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-12T06:38:02.686 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x8 33/39 2026-02-12T06:38:02.831 INFO:teuthology.orchestra.run.trial058.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 740 kB/s | 240 kB 00:00 2026-02-12T06:38:02.854 INFO:teuthology.orchestra.run.trial058.stdout:(24/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 737 kB/s | 292 kB 00:00 2026-02-12T06:38:02.928 INFO:teuthology.orchestra.run.trial058.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 384 kB/s | 37 kB 00:00 2026-02-12T06:38:02.952 INFO:teuthology.orchestra.run.trial058.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 677 kB/s | 66 kB 00:00 2026-02-12T06:38:03.019 INFO:teuthology.orchestra.run.trial058.stdout:(27/37): librdkafka-1.6.1-102.el9.x86_64.rpm 861 kB/s | 662 kB 00:00 2026-02-12T06:38:03.180 INFO:teuthology.orchestra.run.trial058.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 154 kB/s | 25 kB 00:00 2026-02-12T06:38:03.224 INFO:teuthology.orchestra.run.trial058.stdout:(29/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.0 MB/s | 308 kB 00:00 2026-02-12T06:38:03.256 INFO:teuthology.orchestra.run.trial058.stdout:(30/37): liboath-2.6.12-1.el9.x86_64.rpm 641 kB/s | 49 kB 00:00 2026-02-12T06:38:03.266 INFO:teuthology.orchestra.run.trial058.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2026-02-12T06:38:03.319 INFO:teuthology.orchestra.run.trial058.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 3.5 MB/s | 191 kB 00:00 2026-02-12T06:38:03.384 INFO:teuthology.orchestra.run.trial058.stdout:(33/37): libarrow-9.0.0-15.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2026-02-12T06:38:03.433 INFO:teuthology.orchestra.run.trial058.stdout:(34/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.6 MB/s | 838 kB 00:00 2026-02-12T06:38:03.455 INFO:teuthology.orchestra.run.trial058.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2026-02-12T06:38:03.628 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 34/39 2026-02-12T06:38:03.631 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 34/39 2026-02-12T06:38:03.890 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 34/39 2026-02-12T06:38:03.893 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 35/39 2026-02-12T06:38:03.934 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 35/39 2026-02-12T06:38:03.934 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T06:38:03.934 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T06:38:03.934 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:03.938 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-selinux-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 36/39 2026-02-12T06:38:04.788 INFO:teuthology.orchestra.run.trial058.stdout:(36/37): librbd1-20.3.0-5145.g5fdb7d8f.el9.x86_ 2.0 MB/s | 2.7 MB 00:01 2026-02-12T06:38:05.138 INFO:teuthology.orchestra.run.trial058.stdout:(37/37): librados2-20.3.0-5145.g5fdb7d8f.el9.x8 1.9 MB/s | 3.3 MB 00:01 2026-02-12T06:38:05.142 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:38:05.143 INFO:teuthology.orchestra.run.trial058.stdout:Total 9.0 MB/s | 61 MB 00:06 2026-02-12T06:38:05.246 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-12T06:38:05.264 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-12T06:38:05.264 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-12T06:38:05.511 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-12T06:38:05.511 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-12T06:38:05.804 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-12T06:38:05.947 INFO:teuthology.orchestra.run.trial058.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-12T06:38:05.952 INFO:teuthology.orchestra.run.trial058.stdout: Upgrading : librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/39 2026-02-12T06:38:06.003 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/39 2026-02-12T06:38:06.004 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 3/39 2026-02-12T06:38:06.017 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 3/39 2026-02-12T06:38:06.019 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephfs-daemon-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 4/39 2026-02-12T06:38:06.020 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephfs-proxy2-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 5/39 2026-02-12T06:38:06.048 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 5/39 2026-02-12T06:38:06.050 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 6/39 2026-02-12T06:38:06.058 INFO:teuthology.orchestra.run.trial058.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-12T06:38:06.061 INFO:teuthology.orchestra.run.trial058.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-12T06:38:06.064 INFO:teuthology.orchestra.run.trial058.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-12T06:38:06.068 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-12T06:38:06.079 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-ceph-argparse-2:20.3.0-5145.g5fdb7d8f.el9. 11/39 2026-02-12T06:38:06.092 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 12/39 2026-02-12T06:38:06.093 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libradosstriper1-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 13/39 2026-02-12T06:38:06.115 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 13/39 2026-02-12T06:38:06.119 INFO:teuthology.orchestra.run.trial058.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-12T06:38:06.148 INFO:teuthology.orchestra.run.trial058.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-12T06:38:06.153 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-12T06:38:06.160 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-12T06:38:06.162 INFO:teuthology.orchestra.run.trial058.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-12T06:38:06.166 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-12T06:38:06.282 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T06:38:06.283 INFO:teuthology.orchestra.run.trial058.stdout: Upgrading : librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 21/39 2026-02-12T06:38:06.309 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 21/39 2026-02-12T06:38:06.312 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 22/39 2026-02-12T06:38:06.318 INFO:teuthology.orchestra.run.trial058.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-12T06:38:06.570 INFO:teuthology.orchestra.run.trial058.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-12T06:38:06.571 INFO:teuthology.orchestra.run.trial058.stdout: Installing : librgw2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 25/39 2026-02-12T06:38:06.587 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librgw2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 25/39 2026-02-12T06:38:06.591 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 26/39 2026-02-12T06:38:06.595 INFO:teuthology.orchestra.run.trial058.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-12T06:38:06.598 INFO:teuthology.orchestra.run.trial058.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-12T06:38:06.599 INFO:teuthology.orchestra.run.trial058.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T06:38:06.616 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T06:38:06.729 INFO:teuthology.orchestra.run.trial058.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-12T06:38:06.731 INFO:teuthology.orchestra.run.trial058.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T06:38:06.991 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T06:38:06.991 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T06:38:06.991 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:07.034 INFO:teuthology.orchestra.run.trial058.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-12T06:38:07.036 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x8 33/39 2026-02-12T06:38:07.994 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 34/39 2026-02-12T06:38:07.996 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 34/39 2026-02-12T06:38:08.260 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 34/39 2026-02-12T06:38:08.264 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 35/39 2026-02-12T06:38:08.300 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 35/39 2026-02-12T06:38:08.300 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T06:38:08.300 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T06:38:08.300 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:08.303 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-selinux-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 36/39 2026-02-12T06:38:08.447 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 36/39 2026-02-12T06:38:08.447 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /sys 2026-02-12T06:38:08.447 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /proc 2026-02-12T06:38:08.447 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /mnt 2026-02-12T06:38:08.448 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /var/tmp 2026-02-12T06:38:08.448 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /home 2026-02-12T06:38:08.448 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /root 2026-02-12T06:38:08.448 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /tmp 2026-02-12T06:38:08.448 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:08.942 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 37/39 2026-02-12T06:38:08.964 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 37/39 2026-02-12T06:38:08.965 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T06:38:08.965 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T06:38:08.965 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T06:38:08.965 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T06:38:08.965 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:08.966 INFO:teuthology.orchestra.run.trial106.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T06:38:08.978 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T06:38:08.978 INFO:teuthology.orchestra.run.trial106.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T06:38:09.033 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T06:38:09.033 INFO:teuthology.orchestra.run.trial106.stdout:Creating group 'qat' with GID 992. 2026-02-12T06:38:09.033 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:09.318 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/39 2026-02-12T06:38:09.319 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/39 2026-02-12T06:38:09.319 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 3/39 2026-02-12T06:38:09.319 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-selinux-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 4/39 2026-02-12T06:38:09.319 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libcephfs-daemon-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 5/39 2026-02-12T06:38:09.319 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 6/39 2026-02-12T06:38:09.319 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 7/39 2026-02-12T06:38:09.319 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libradosstriper1-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 8/39 2026-02-12T06:38:09.319 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librgw2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 9/39 2026-02-12T06:38:09.319 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5145.g5fdb7d8f.el9. 10/39 2026-02-12T06:38:09.319 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x8 11/39 2026-02-12T06:38:09.320 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 12/39 2026-02-12T06:38:09.320 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 13/39 2026-02-12T06:38:09.320 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 14/39 2026-02-12T06:38:09.320 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 15/39 2026-02-12T06:38:09.320 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-12T06:38:09.320 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-12T06:38:09.320 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-12T06:38:09.320 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-12T06:38:09.320 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T06:38:09.320 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-12T06:38:09.320 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-12T06:38:09.320 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-12T06:38:09.320 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-12T06:38:09.321 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-12T06:38:09.321 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-12T06:38:09.321 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-12T06:38:09.321 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-12T06:38:09.321 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-12T06:38:09.321 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-12T06:38:09.321 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-12T06:38:09.321 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-12T06:38:09.321 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-12T06:38:09.321 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-12T06:38:09.321 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-12T06:38:09.321 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 36/39 2026-02-12T06:38:09.321 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-12T06:38:09.322 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 38/39 2026-02-12T06:38:09.379 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T06:38:09.379 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:09.380 INFO:teuthology.orchestra.run.trial106.stdout:Upgraded: 2026-02-12T06:38:09.380 INFO:teuthology.orchestra.run.trial106.stdout: librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:09.380 INFO:teuthology.orchestra.run.trial106.stdout: librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:09.380 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-12T06:38:09.380 INFO:teuthology.orchestra.run.trial106.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T06:38:09.380 INFO:teuthology.orchestra.run.trial106.stdout: ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:09.380 INFO:teuthology.orchestra.run.trial106.stdout: ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:09.380 INFO:teuthology.orchestra.run.trial106.stdout: ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:09.380 INFO:teuthology.orchestra.run.trial106.stdout: ceph-selinux-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:09.380 INFO:teuthology.orchestra.run.trial106.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T06:38:09.380 INFO:teuthology.orchestra.run.trial106.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T06:38:09.381 INFO:teuthology.orchestra.run.trial106.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T06:38:09.381 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs-daemon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:09.381 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs-proxy2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:09.381 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:09.381 INFO:teuthology.orchestra.run.trial106.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T06:38:09.381 INFO:teuthology.orchestra.run.trial106.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T06:38:09.381 INFO:teuthology.orchestra.run.trial106.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T06:38:09.381 INFO:teuthology.orchestra.run.trial106.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T06:38:09.381 INFO:teuthology.orchestra.run.trial106.stdout: libradosstriper1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:09.381 INFO:teuthology.orchestra.run.trial106.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T06:38:09.381 INFO:teuthology.orchestra.run.trial106.stdout: librgw2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:09.381 INFO:teuthology.orchestra.run.trial106.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T06:38:09.382 INFO:teuthology.orchestra.run.trial106.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T06:38:09.382 INFO:teuthology.orchestra.run.trial106.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T06:38:09.382 INFO:teuthology.orchestra.run.trial106.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-12T06:38:09.382 INFO:teuthology.orchestra.run.trial106.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T06:38:09.382 INFO:teuthology.orchestra.run.trial106.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T06:38:09.382 INFO:teuthology.orchestra.run.trial106.stdout: python3-ceph-argparse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:09.382 INFO:teuthology.orchestra.run.trial106.stdout: python3-ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:09.382 INFO:teuthology.orchestra.run.trial106.stdout: python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:09.382 INFO:teuthology.orchestra.run.trial106.stdout: python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:09.382 INFO:teuthology.orchestra.run.trial106.stdout: python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:09.382 INFO:teuthology.orchestra.run.trial106.stdout: python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:09.382 INFO:teuthology.orchestra.run.trial106.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T06:38:09.383 INFO:teuthology.orchestra.run.trial106.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T06:38:09.383 INFO:teuthology.orchestra.run.trial106.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T06:38:09.383 INFO:teuthology.orchestra.run.trial106.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T06:38:09.383 INFO:teuthology.orchestra.run.trial106.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T06:38:09.383 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:09.383 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:38:09.420 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-test 2026-02-12T06:38:09.719 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:14 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:38:09.802 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:38:09.803 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:38:09.803 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repository Size 2026-02-12T06:38:09.803 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:38:09.803 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-12T06:38:09.803 INFO:teuthology.orchestra.run.trial106.stdout: ceph-test x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 126 M 2026-02-12T06:38:09.803 INFO:teuthology.orchestra.run.trial106.stdout:Installing dependencies: 2026-02-12T06:38:09.803 INFO:teuthology.orchestra.run.trial106.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-12T06:38:09.804 INFO:teuthology.orchestra.run.trial106.stdout: libasan8 x86_64 15.1.1-2.5.el9 appstream 523 k 2026-02-12T06:38:09.804 INFO:teuthology.orchestra.run.trial106.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-12T06:38:09.804 INFO:teuthology.orchestra.run.trial106.stdout: libcephsqlite x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 153 k 2026-02-12T06:38:09.804 INFO:teuthology.orchestra.run.trial106.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-12T06:38:09.804 INFO:teuthology.orchestra.run.trial106.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T06:38:09.804 INFO:teuthology.orchestra.run.trial106.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-12T06:38:09.804 INFO:teuthology.orchestra.run.trial106.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T06:38:09.804 INFO:teuthology.orchestra.run.trial106.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T06:38:09.804 INFO:teuthology.orchestra.run.trial106.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T06:38:09.804 INFO:teuthology.orchestra.run.trial106.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-12T06:38:09.804 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:09.804 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-12T06:38:09.805 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:38:09.805 INFO:teuthology.orchestra.run.trial106.stdout:Install 12 Packages 2026-02-12T06:38:09.805 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:09.805 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 131 M 2026-02-12T06:38:09.805 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 977 M 2026-02-12T06:38:09.806 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-12T06:38:10.284 INFO:teuthology.orchestra.run.trial106.stdout:(1/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 11 MB/s | 2.1 MB 00:00 2026-02-12T06:38:10.306 INFO:teuthology.orchestra.run.trial106.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 1.0 MB/s | 23 kB 00:00 2026-02-12T06:38:10.328 INFO:teuthology.orchestra.run.trial106.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 4.1 MB/s | 94 kB 00:00 2026-02-12T06:38:10.561 INFO:teuthology.orchestra.run.trial106.stdout:(4/12): libcephsqlite-20.3.0-5145.g5fdb7d8f.el9 326 kB/s | 153 kB 00:00 2026-02-12T06:38:11.192 INFO:teuthology.orchestra.run.trial106.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 278 kB/s | 176 kB 00:00 2026-02-12T06:38:11.359 INFO:teuthology.orchestra.run.trial106.stdout:(6/12): libasan8-15.1.1-2.5.el9.x86_64.rpm 508 kB/s | 523 kB 00:01 2026-02-12T06:38:11.515 INFO:teuthology.orchestra.run.trial106.stdout:(7/12): libxslt-1.1.34-12.el9.x86_64.rpm 721 kB/s | 233 kB 00:00 2026-02-12T06:38:11.915 INFO:teuthology.orchestra.run.trial106.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 760 kB/s | 303 kB 00:00 2026-02-12T06:38:12.011 INFO:teuthology.orchestra.run.trial106.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 662 kB/s | 64 kB 00:00 2026-02-12T06:38:12.148 INFO:teuthology.orchestra.run.trial106.stdout:(10/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 890 kB/s | 122 kB 00:00 2026-02-12T06:38:12.516 INFO:teuthology.orchestra.run.trial106.stdout:(11/12): protobuf-3.14.0-17.el9.x86_64.rpm 889 kB/s | 1.0 MB 00:01 2026-02-12T06:38:12.847 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 36/39 2026-02-12T06:38:12.847 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /sys 2026-02-12T06:38:12.847 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /proc 2026-02-12T06:38:12.847 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /mnt 2026-02-12T06:38:12.847 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /var/tmp 2026-02-12T06:38:12.847 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /home 2026-02-12T06:38:12.847 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /root 2026-02-12T06:38:12.847 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /tmp 2026-02-12T06:38:12.848 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:13.347 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 37/39 2026-02-12T06:38:13.370 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 37/39 2026-02-12T06:38:13.371 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T06:38:13.371 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T06:38:13.371 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T06:38:13.371 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T06:38:13.371 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:13.373 INFO:teuthology.orchestra.run.trial058.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T06:38:13.387 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T06:38:13.387 INFO:teuthology.orchestra.run.trial058.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T06:38:13.444 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T06:38:13.445 INFO:teuthology.orchestra.run.trial058.stdout:Creating group 'qat' with GID 992. 2026-02-12T06:38:13.445 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:13.727 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/39 2026-02-12T06:38:13.728 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/39 2026-02-12T06:38:13.728 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 3/39 2026-02-12T06:38:13.728 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-selinux-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 4/39 2026-02-12T06:38:13.728 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephfs-daemon-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 5/39 2026-02-12T06:38:13.728 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 6/39 2026-02-12T06:38:13.728 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 7/39 2026-02-12T06:38:13.728 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libradosstriper1-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 8/39 2026-02-12T06:38:13.728 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librgw2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 9/39 2026-02-12T06:38:13.728 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5145.g5fdb7d8f.el9. 10/39 2026-02-12T06:38:13.728 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x8 11/39 2026-02-12T06:38:13.729 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 12/39 2026-02-12T06:38:13.729 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 13/39 2026-02-12T06:38:13.729 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 14/39 2026-02-12T06:38:13.729 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 15/39 2026-02-12T06:38:13.729 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-12T06:38:13.729 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-12T06:38:13.729 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-12T06:38:13.729 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-12T06:38:13.729 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T06:38:13.729 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-12T06:38:13.729 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-12T06:38:13.729 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-12T06:38:13.730 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-12T06:38:13.730 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-12T06:38:13.730 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-12T06:38:13.730 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-12T06:38:13.730 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-12T06:38:13.730 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-12T06:38:13.730 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-12T06:38:13.730 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-12T06:38:13.730 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-12T06:38:13.730 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-12T06:38:13.730 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-12T06:38:13.730 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-12T06:38:13.730 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 36/39 2026-02-12T06:38:13.731 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-12T06:38:13.731 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 38/39 2026-02-12T06:38:13.788 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T06:38:13.788 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:13.788 INFO:teuthology.orchestra.run.trial058.stdout:Upgraded: 2026-02-12T06:38:13.788 INFO:teuthology.orchestra.run.trial058.stdout: librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:13.789 INFO:teuthology.orchestra.run.trial058.stdout: librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:13.789 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-12T06:38:13.789 INFO:teuthology.orchestra.run.trial058.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T06:38:13.789 INFO:teuthology.orchestra.run.trial058.stdout: ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:13.789 INFO:teuthology.orchestra.run.trial058.stdout: ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:13.789 INFO:teuthology.orchestra.run.trial058.stdout: ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:13.789 INFO:teuthology.orchestra.run.trial058.stdout: ceph-selinux-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:13.789 INFO:teuthology.orchestra.run.trial058.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T06:38:13.789 INFO:teuthology.orchestra.run.trial058.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T06:38:13.789 INFO:teuthology.orchestra.run.trial058.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T06:38:13.789 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-daemon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:13.790 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-proxy2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:13.790 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:13.790 INFO:teuthology.orchestra.run.trial058.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T06:38:13.790 INFO:teuthology.orchestra.run.trial058.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T06:38:13.790 INFO:teuthology.orchestra.run.trial058.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T06:38:13.790 INFO:teuthology.orchestra.run.trial058.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T06:38:13.790 INFO:teuthology.orchestra.run.trial058.stdout: libradosstriper1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:13.790 INFO:teuthology.orchestra.run.trial058.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T06:38:13.790 INFO:teuthology.orchestra.run.trial058.stdout: librgw2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:13.790 INFO:teuthology.orchestra.run.trial058.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T06:38:13.790 INFO:teuthology.orchestra.run.trial058.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T06:38:13.790 INFO:teuthology.orchestra.run.trial058.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T06:38:13.791 INFO:teuthology.orchestra.run.trial058.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-12T06:38:13.791 INFO:teuthology.orchestra.run.trial058.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T06:38:13.791 INFO:teuthology.orchestra.run.trial058.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T06:38:13.791 INFO:teuthology.orchestra.run.trial058.stdout: python3-ceph-argparse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:13.791 INFO:teuthology.orchestra.run.trial058.stdout: python3-ceph-common-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:13.791 INFO:teuthology.orchestra.run.trial058.stdout: python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:13.791 INFO:teuthology.orchestra.run.trial058.stdout: python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:13.791 INFO:teuthology.orchestra.run.trial058.stdout: python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:13.791 INFO:teuthology.orchestra.run.trial058.stdout: python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:13.791 INFO:teuthology.orchestra.run.trial058.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T06:38:13.791 INFO:teuthology.orchestra.run.trial058.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T06:38:13.791 INFO:teuthology.orchestra.run.trial058.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T06:38:13.791 INFO:teuthology.orchestra.run.trial058.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T06:38:13.792 INFO:teuthology.orchestra.run.trial058.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T06:38:13.792 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:13.792 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:38:13.830 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-test 2026-02-12T06:38:14.137 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:17 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:38:14.221 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:38:14.221 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:38:14.221 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repository Size 2026-02-12T06:38:14.221 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:38:14.222 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-12T06:38:14.222 INFO:teuthology.orchestra.run.trial058.stdout: ceph-test x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 126 M 2026-02-12T06:38:14.222 INFO:teuthology.orchestra.run.trial058.stdout:Installing dependencies: 2026-02-12T06:38:14.222 INFO:teuthology.orchestra.run.trial058.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-12T06:38:14.222 INFO:teuthology.orchestra.run.trial058.stdout: libasan8 x86_64 15.1.1-2.5.el9 appstream 523 k 2026-02-12T06:38:14.222 INFO:teuthology.orchestra.run.trial058.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-12T06:38:14.222 INFO:teuthology.orchestra.run.trial058.stdout: libcephsqlite x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 153 k 2026-02-12T06:38:14.222 INFO:teuthology.orchestra.run.trial058.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-12T06:38:14.222 INFO:teuthology.orchestra.run.trial058.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T06:38:14.222 INFO:teuthology.orchestra.run.trial058.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-12T06:38:14.222 INFO:teuthology.orchestra.run.trial058.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T06:38:14.223 INFO:teuthology.orchestra.run.trial058.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T06:38:14.223 INFO:teuthology.orchestra.run.trial058.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T06:38:14.223 INFO:teuthology.orchestra.run.trial058.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-12T06:38:14.223 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:14.223 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-12T06:38:14.223 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:38:14.223 INFO:teuthology.orchestra.run.trial058.stdout:Install 12 Packages 2026-02-12T06:38:14.223 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:14.224 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 131 M 2026-02-12T06:38:14.224 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 977 M 2026-02-12T06:38:14.224 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-12T06:38:15.619 INFO:teuthology.orchestra.run.trial058.stdout:(1/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 10 MB/s | 2.1 MB 00:00 2026-02-12T06:38:15.642 INFO:teuthology.orchestra.run.trial058.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 978 kB/s | 23 kB 00:00 2026-02-12T06:38:15.666 INFO:teuthology.orchestra.run.trial058.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 3.8 MB/s | 94 kB 00:00 2026-02-12T06:38:15.728 INFO:teuthology.orchestra.run.trial058.stdout:(4/12): libasan8-15.1.1-2.5.el9.x86_64.rpm 8.2 MB/s | 523 kB 00:00 2026-02-12T06:38:15.754 INFO:teuthology.orchestra.run.trial058.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 6.8 MB/s | 176 kB 00:00 2026-02-12T06:38:15.776 INFO:teuthology.orchestra.run.trial058.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 10 MB/s | 233 kB 00:00 2026-02-12T06:38:15.811 INFO:teuthology.orchestra.run.trial058.stdout:(7/12): protobuf-3.14.0-17.el9.x86_64.rpm 29 MB/s | 1.0 MB 00:00 2026-02-12T06:38:15.832 INFO:teuthology.orchestra.run.trial058.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 14 MB/s | 303 kB 00:00 2026-02-12T06:38:15.845 INFO:teuthology.orchestra.run.trial058.stdout:(9/12): libcephsqlite-20.3.0-5145.g5fdb7d8f.el9 357 kB/s | 153 kB 00:00 2026-02-12T06:38:15.860 INFO:teuthology.orchestra.run.trial058.stdout:(10/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.3 MB/s | 64 kB 00:00 2026-02-12T06:38:16.340 INFO:teuthology.orchestra.run.trial058.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 246 kB/s | 122 kB 00:00 2026-02-12T06:38:17.853 INFO:teuthology.orchestra.run.trial106.stdout:(12/12): ceph-test-20.3.0-5145.g5fdb7d8f.el9.x8 16 MB/s | 126 MB 00:07 2026-02-12T06:38:17.857 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:38:17.857 INFO:teuthology.orchestra.run.trial106.stdout:Total 16 MB/s | 131 MB 00:08 2026-02-12T06:38:17.937 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-12T06:38:17.948 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-12T06:38:17.948 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-12T06:38:18.374 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-12T06:38:18.375 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-12T06:38:18.829 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-12T06:38:18.837 INFO:teuthology.orchestra.run.trial106.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-12T06:38:18.846 INFO:teuthology.orchestra.run.trial106.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-12T06:38:18.851 INFO:teuthology.orchestra.run.trial106.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-12T06:38:18.855 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-12T06:38:18.858 INFO:teuthology.orchestra.run.trial106.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-12T06:38:18.862 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-12T06:38:18.863 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libasan8-15.1.1-2.5.el9.x86_64 7/12 2026-02-12T06:38:18.880 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libasan8-15.1.1-2.5.el9.x86_64 7/12 2026-02-12T06:38:18.882 INFO:teuthology.orchestra.run.trial106.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-12T06:38:18.892 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-12T06:38:18.900 INFO:teuthology.orchestra.run.trial106.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-12T06:38:18.901 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libcephsqlite-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 11/12 2026-02-12T06:38:24.670 INFO:teuthology.orchestra.run.trial058.stdout:(12/12): ceph-test-20.3.0-5145.g5fdb7d8f.el9.x8 14 MB/s | 126 MB 00:09 2026-02-12T06:38:24.673 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:38:24.673 INFO:teuthology.orchestra.run.trial058.stdout:Total 13 MB/s | 131 MB 00:10 2026-02-12T06:38:24.752 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-12T06:38:24.763 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-12T06:38:24.763 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-12T06:38:25.189 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-12T06:38:25.190 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-12T06:38:25.644 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-12T06:38:25.652 INFO:teuthology.orchestra.run.trial058.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-12T06:38:25.661 INFO:teuthology.orchestra.run.trial058.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-12T06:38:25.667 INFO:teuthology.orchestra.run.trial058.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-12T06:38:25.672 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-12T06:38:25.674 INFO:teuthology.orchestra.run.trial058.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-12T06:38:25.679 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-12T06:38:25.680 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libasan8-15.1.1-2.5.el9.x86_64 7/12 2026-02-12T06:38:25.697 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libasan8-15.1.1-2.5.el9.x86_64 7/12 2026-02-12T06:38:25.699 INFO:teuthology.orchestra.run.trial058.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-12T06:38:25.709 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-12T06:38:25.718 INFO:teuthology.orchestra.run.trial058.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-12T06:38:25.719 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephsqlite-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 11/12 2026-02-12T06:38:25.786 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 11/12 2026-02-12T06:38:25.804 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 12/12 2026-02-12T06:38:26.587 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 12/12 2026-02-12T06:38:26.587 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/12 2026-02-12T06:38:26.587 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libcephsqlite-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/12 2026-02-12T06:38:26.588 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-12T06:38:26.588 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-12T06:38:26.588 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-12T06:38:26.588 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libasan8-15.1.1-2.5.el9.x86_64 6/12 2026-02-12T06:38:26.588 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-12T06:38:26.588 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-12T06:38:26.588 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-12T06:38:26.588 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-12T06:38:26.588 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-12T06:38:26.640 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-12T06:38:26.640 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:26.640 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-12T06:38:26.641 INFO:teuthology.orchestra.run.trial106.stdout: ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:26.641 INFO:teuthology.orchestra.run.trial106.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-12T06:38:26.641 INFO:teuthology.orchestra.run.trial106.stdout: libasan8-15.1.1-2.5.el9.x86_64 2026-02-12T06:38:26.641 INFO:teuthology.orchestra.run.trial106.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-12T06:38:26.641 INFO:teuthology.orchestra.run.trial106.stdout: libcephsqlite-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:26.641 INFO:teuthology.orchestra.run.trial106.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-12T06:38:26.641 INFO:teuthology.orchestra.run.trial106.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T06:38:26.641 INFO:teuthology.orchestra.run.trial106.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-12T06:38:26.641 INFO:teuthology.orchestra.run.trial106.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T06:38:26.641 INFO:teuthology.orchestra.run.trial106.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T06:38:26.641 INFO:teuthology.orchestra.run.trial106.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T06:38:26.641 INFO:teuthology.orchestra.run.trial106.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-12T06:38:26.642 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:26.642 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:38:26.681 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph 2026-02-12T06:38:26.976 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:31 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:38:27.062 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:38:27.065 INFO:teuthology.orchestra.run.trial106.stdout:======================================================================================= 2026-02-12T06:38:27.065 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repository Size 2026-02-12T06:38:27.066 INFO:teuthology.orchestra.run.trial106.stdout:======================================================================================= 2026-02-12T06:38:27.066 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-12T06:38:27.066 INFO:teuthology.orchestra.run.trial106.stdout: ceph x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 6.5 k 2026-02-12T06:38:27.066 INFO:teuthology.orchestra.run.trial106.stdout:Installing dependencies: 2026-02-12T06:38:27.066 INFO:teuthology.orchestra.run.trial106.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T06:38:27.066 INFO:teuthology.orchestra.run.trial106.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 57 k 2026-02-12T06:38:27.066 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mds x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 2.0 M 2026-02-12T06:38:27.066 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 937 k 2026-02-12T06:38:27.066 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 297 k 2026-02-12T06:38:27.066 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mon x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 4.8 M 2026-02-12T06:38:27.066 INFO:teuthology.orchestra.run.trial106.stdout: ceph-osd x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 163 k 2026-02-12T06:38:27.067 INFO:teuthology.orchestra.run.trial106.stdout: ceph-osd-classic x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 15 M 2026-02-12T06:38:27.067 INFO:teuthology.orchestra.run.trial106.stdout: ceph-osd-crimson x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 87 M 2026-02-12T06:38:27.067 INFO:teuthology.orchestra.run.trial106.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 17 k 2026-02-12T06:38:27.067 INFO:teuthology.orchestra.run.trial106.stdout: cephadm noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 1.0 M 2026-02-12T06:38:27.067 INFO:teuthology.orchestra.run.trial106.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T06:38:27.067 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T06:38:27.067 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T06:38:27.067 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T06:38:27.067 INFO:teuthology.orchestra.run.trial106.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T06:38:27.067 INFO:teuthology.orchestra.run.trial106.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T06:38:27.067 INFO:teuthology.orchestra.run.trial106.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T06:38:27.067 INFO:teuthology.orchestra.run.trial106.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T06:38:27.068 INFO:teuthology.orchestra.run.trial106.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T06:38:27.068 INFO:teuthology.orchestra.run.trial106.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T06:38:27.068 INFO:teuthology.orchestra.run.trial106.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T06:38:27.068 INFO:teuthology.orchestra.run.trial106.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T06:38:27.068 INFO:teuthology.orchestra.run.trial106.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T06:38:27.068 INFO:teuthology.orchestra.run.trial106.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T06:38:27.068 INFO:teuthology.orchestra.run.trial106.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T06:38:27.068 INFO:teuthology.orchestra.run.trial106.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T06:38:27.068 INFO:teuthology.orchestra.run.trial106.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T06:38:27.068 INFO:teuthology.orchestra.run.trial106.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T06:38:27.068 INFO:teuthology.orchestra.run.trial106.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T06:38:27.068 INFO:teuthology.orchestra.run.trial106.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T06:38:27.069 INFO:teuthology.orchestra.run.trial106.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T06:38:27.069 INFO:teuthology.orchestra.run.trial106.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T06:38:27.069 INFO:teuthology.orchestra.run.trial106.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T06:38:27.069 INFO:teuthology.orchestra.run.trial106.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T06:38:27.069 INFO:teuthology.orchestra.run.trial106.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T06:38:27.069 INFO:teuthology.orchestra.run.trial106.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T06:38:27.069 INFO:teuthology.orchestra.run.trial106.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T06:38:27.069 INFO:teuthology.orchestra.run.trial106.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T06:38:27.069 INFO:teuthology.orchestra.run.trial106.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T06:38:27.069 INFO:teuthology.orchestra.run.trial106.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T06:38:27.069 INFO:teuthology.orchestra.run.trial106.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T06:38:27.069 INFO:teuthology.orchestra.run.trial106.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-12T06:38:27.070 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T06:38:27.070 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T06:38:27.070 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-12T06:38:27.070 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T06:38:27.070 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T06:38:27.070 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T06:38:27.070 INFO:teuthology.orchestra.run.trial106.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T06:38:27.070 INFO:teuthology.orchestra.run.trial106.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T06:38:27.070 INFO:teuthology.orchestra.run.trial106.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T06:38:27.070 INFO:teuthology.orchestra.run.trial106.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T06:38:27.070 INFO:teuthology.orchestra.run.trial106.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-12T06:38:27.070 INFO:teuthology.orchestra.run.trial106.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T06:38:27.071 INFO:teuthology.orchestra.run.trial106.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T06:38:27.071 INFO:teuthology.orchestra.run.trial106.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-12T06:38:27.071 INFO:teuthology.orchestra.run.trial106.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T06:38:27.071 INFO:teuthology.orchestra.run.trial106.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T06:38:27.071 INFO:teuthology.orchestra.run.trial106.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T06:38:27.071 INFO:teuthology.orchestra.run.trial106.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T06:38:27.071 INFO:teuthology.orchestra.run.trial106.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T06:38:27.071 INFO:teuthology.orchestra.run.trial106.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T06:38:27.071 INFO:teuthology.orchestra.run.trial106.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T06:38:27.071 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T06:38:27.071 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T06:38:27.071 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T06:38:27.071 INFO:teuthology.orchestra.run.trial106.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T06:38:27.072 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T06:38:27.072 INFO:teuthology.orchestra.run.trial106.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T06:38:27.072 INFO:teuthology.orchestra.run.trial106.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T06:38:27.072 INFO:teuthology.orchestra.run.trial106.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T06:38:27.072 INFO:teuthology.orchestra.run.trial106.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T06:38:27.072 INFO:teuthology.orchestra.run.trial106.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T06:38:27.072 INFO:teuthology.orchestra.run.trial106.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T06:38:27.072 INFO:teuthology.orchestra.run.trial106.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T06:38:27.072 INFO:teuthology.orchestra.run.trial106.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T06:38:27.072 INFO:teuthology.orchestra.run.trial106.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T06:38:27.072 INFO:teuthology.orchestra.run.trial106.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T06:38:27.072 INFO:teuthology.orchestra.run.trial106.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T06:38:27.072 INFO:teuthology.orchestra.run.trial106.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-12T06:38:27.072 INFO:teuthology.orchestra.run.trial106.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T06:38:27.073 INFO:teuthology.orchestra.run.trial106.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T06:38:27.073 INFO:teuthology.orchestra.run.trial106.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T06:38:27.073 INFO:teuthology.orchestra.run.trial106.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-12T06:38:27.073 INFO:teuthology.orchestra.run.trial106.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-12T06:38:27.073 INFO:teuthology.orchestra.run.trial106.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T06:38:27.073 INFO:teuthology.orchestra.run.trial106.stdout:Installing weak dependencies: 2026-02-12T06:38:27.073 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 183 k 2026-02-12T06:38:27.073 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 15 M 2026-02-12T06:38:27.073 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 7.4 M 2026-02-12T06:38:27.073 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 22 k 2026-02-12T06:38:27.073 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-rook noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 50 k 2026-02-12T06:38:27.073 INFO:teuthology.orchestra.run.trial106.stdout: ceph-volume noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 299 k 2026-02-12T06:38:27.074 INFO:teuthology.orchestra.run.trial106.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-12T06:38:27.074 INFO:teuthology.orchestra.run.trial106.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-12T06:38:27.074 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:27.074 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-12T06:38:27.074 INFO:teuthology.orchestra.run.trial106.stdout:======================================================================================= 2026-02-12T06:38:27.074 INFO:teuthology.orchestra.run.trial106.stdout:Install 96 Packages 2026-02-12T06:38:27.074 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:27.075 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 189 M 2026-02-12T06:38:27.075 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 1.4 G 2026-02-12T06:38:27.075 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-12T06:38:27.812 INFO:teuthology.orchestra.run.trial106.stdout:(1/96): ceph-20.3.0-5145.g5fdb7d8f.el9.x86_64.r 26 kB/s | 6.5 kB 00:00 2026-02-12T06:38:28.418 INFO:teuthology.orchestra.run.trial106.stdout:(2/96): ceph-mgr-20.3.0-5145.g5fdb7d8f.el9.x86_ 1.1 MB/s | 937 kB 00:00 2026-02-12T06:38:28.536 INFO:teuthology.orchestra.run.trial106.stdout:(3/96): ceph-osd-20.3.0-5145.g5fdb7d8f.el9.x86_ 1.4 MB/s | 163 kB 00:00 2026-02-12T06:38:28.646 INFO:teuthology.orchestra.run.trial106.stdout:(4/96): ceph-mds-20.3.0-5145.g5fdb7d8f.el9.x86_ 1.9 MB/s | 2.0 MB 00:01 2026-02-12T06:38:31.302 INFO:teuthology.orchestra.run.trial106.stdout:(5/96): ceph-mon-20.3.0-5145.g5fdb7d8f.el9.x86_ 1.4 MB/s | 4.8 MB 00:03 2026-02-12T06:38:31.336 INFO:teuthology.orchestra.run.trial106.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5145.g5f 1.7 MB/s | 57 kB 00:00 2026-02-12T06:38:31.388 INFO:teuthology.orchestra.run.trial106.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5145.g5fdb7d8f. 3.4 MB/s | 183 kB 00:00 2026-02-12T06:38:32.655 INFO:teuthology.orchestra.run.trial106.stdout:(8/96): ceph-osd-classic-20.3.0-5145.g5fdb7d8f. 3.6 MB/s | 15 MB 00:04 2026-02-12T06:38:32.713 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 11/12 2026-02-12T06:38:32.732 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 12/12 2026-02-12T06:38:33.481 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 12/12 2026-02-12T06:38:33.481 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/12 2026-02-12T06:38:33.482 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephsqlite-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/12 2026-02-12T06:38:33.482 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-12T06:38:33.482 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-12T06:38:33.482 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-12T06:38:33.482 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libasan8-15.1.1-2.5.el9.x86_64 6/12 2026-02-12T06:38:33.482 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-12T06:38:33.482 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-12T06:38:33.482 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-12T06:38:33.482 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-12T06:38:33.482 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-12T06:38:33.537 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-12T06:38:33.537 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:33.537 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-12T06:38:33.537 INFO:teuthology.orchestra.run.trial058.stdout: ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:33.537 INFO:teuthology.orchestra.run.trial058.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-12T06:38:33.537 INFO:teuthology.orchestra.run.trial058.stdout: libasan8-15.1.1-2.5.el9.x86_64 2026-02-12T06:38:33.537 INFO:teuthology.orchestra.run.trial058.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-12T06:38:33.537 INFO:teuthology.orchestra.run.trial058.stdout: libcephsqlite-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:33.537 INFO:teuthology.orchestra.run.trial058.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-12T06:38:33.537 INFO:teuthology.orchestra.run.trial058.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T06:38:33.538 INFO:teuthology.orchestra.run.trial058.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-12T06:38:33.538 INFO:teuthology.orchestra.run.trial058.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T06:38:33.538 INFO:teuthology.orchestra.run.trial058.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T06:38:33.538 INFO:teuthology.orchestra.run.trial058.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T06:38:33.538 INFO:teuthology.orchestra.run.trial058.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-12T06:38:33.538 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:33.538 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:38:33.567 INFO:teuthology.orchestra.run.trial106.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-51 8.1 MB/s | 7.4 MB 00:00 2026-02-12T06:38:33.578 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph 2026-02-12T06:38:33.581 INFO:teuthology.orchestra.run.trial106.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5145.g5fdb7d 1.6 MB/s | 22 kB 00:00 2026-02-12T06:38:33.613 INFO:teuthology.orchestra.run.trial106.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5145.g5fd 9.1 MB/s | 297 kB 00:00 2026-02-12T06:38:33.628 INFO:teuthology.orchestra.run.trial106.stdout:(12/96): ceph-mgr-rook-20.3.0-5145.g5fdb7d8f.el 3.4 MB/s | 50 kB 00:00 2026-02-12T06:38:33.642 INFO:teuthology.orchestra.run.trial106.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5145.g5f 1.2 MB/s | 17 kB 00:00 2026-02-12T06:38:33.674 INFO:teuthology.orchestra.run.trial106.stdout:(14/96): ceph-volume-20.3.0-5145.g5fdb7d8f.el9. 9.2 MB/s | 299 kB 00:00 2026-02-12T06:38:33.761 INFO:teuthology.orchestra.run.trial106.stdout:(15/96): cephadm-20.3.0-5145.g5fdb7d8f.el9.noar 12 MB/s | 1.0 MB 00:00 2026-02-12T06:38:33.869 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:36 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:38:33.899 INFO:teuthology.orchestra.run.trial106.stdout:(16/96): ceph-mgr-dashboard-20.3.0-5145.g5fdb7d 6.0 MB/s | 15 MB 00:02 2026-02-12T06:38:33.957 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:38:33.959 INFO:teuthology.orchestra.run.trial058.stdout:======================================================================================= 2026-02-12T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repository Size 2026-02-12T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout:======================================================================================= 2026-02-12T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-12T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout: ceph x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 6.5 k 2026-02-12T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout:Installing dependencies: 2026-02-12T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 57 k 2026-02-12T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mds x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 2.0 M 2026-02-12T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 937 k 2026-02-12T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 297 k 2026-02-12T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mon x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 4.8 M 2026-02-12T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 163 k 2026-02-12T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-classic x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 15 M 2026-02-12T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-crimson x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 87 M 2026-02-12T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 17 k 2026-02-12T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: cephadm noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 1.0 M 2026-02-12T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-12T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-12T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-12T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-12T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-12T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-12T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-12T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout:Installing weak dependencies: 2026-02-12T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 183 k 2026-02-12T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 15 M 2026-02-12T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 7.4 M 2026-02-12T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 22 k 2026-02-12T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-rook noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 50 k 2026-02-12T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: ceph-volume noarch 2:20.3.0-5145.g5fdb7d8f.el9 ceph-noarch 299 k 2026-02-12T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-12T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-12T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-12T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout:======================================================================================= 2026-02-12T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout:Install 96 Packages 2026-02-12T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:33.969 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 189 M 2026-02-12T06:38:33.969 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 1.4 G 2026-02-12T06:38:33.969 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-12T06:38:34.312 INFO:teuthology.orchestra.run.trial106.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 99 kB/s | 40 kB 00:00 2026-02-12T06:38:34.486 INFO:teuthology.orchestra.run.trial106.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 414 kB/s | 72 kB 00:00 2026-02-12T06:38:34.581 INFO:teuthology.orchestra.run.trial106.stdout:(19/96): cryptsetup-2.8.1-2.el9.x86_64.rpm 427 kB/s | 350 kB 00:00 2026-02-12T06:38:34.582 INFO:teuthology.orchestra.run.trial058.stdout:(1/96): ceph-20.3.0-5145.g5fdb7d8f.el9.x86_64.r 121 kB/s | 6.5 kB 00:00 2026-02-12T06:38:34.722 INFO:teuthology.orchestra.run.trial058.stdout:(2/96): ceph-mgr-20.3.0-5145.g5fdb7d8f.el9.x86_ 4.7 MB/s | 937 kB 00:00 2026-02-12T06:38:34.746 INFO:teuthology.orchestra.run.trial058.stdout:(3/96): ceph-osd-20.3.0-5145.g5fdb7d8f.el9.x86_ 6.5 MB/s | 163 kB 00:00 2026-02-12T06:38:34.785 INFO:teuthology.orchestra.run.trial058.stdout:(4/96): ceph-mds-20.3.0-5145.g5fdb7d8f.el9.x86_ 7.9 MB/s | 2.0 MB 00:00 2026-02-12T06:38:34.827 INFO:teuthology.orchestra.run.trial106.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 750 kB/s | 184 kB 00:00 2026-02-12T06:38:35.149 INFO:teuthology.orchestra.run.trial106.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 788 kB/s | 253 kB 00:00 2026-02-12T06:38:35.261 INFO:teuthology.orchestra.run.trial058.stdout:(5/96): ceph-mon-20.3.0-5145.g5fdb7d8f.el9.x86_ 7.1 MB/s | 4.8 MB 00:00 2026-02-12T06:38:35.300 INFO:teuthology.orchestra.run.trial058.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5145.g5f 1.5 MB/s | 57 kB 00:00 2026-02-12T06:38:35.340 INFO:teuthology.orchestra.run.trial058.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5145.g5fdb7d8f. 4.5 MB/s | 183 kB 00:00 2026-02-12T06:38:35.426 INFO:teuthology.orchestra.run.trial106.stdout:(22/96): libgfortran-11.5.0-14.el9.x86_64.rpm 845 kB/s | 794 kB 00:00 2026-02-12T06:38:35.600 INFO:teuthology.orchestra.run.trial106.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 611 kB/s | 106 kB 00:00 2026-02-12T06:38:35.775 INFO:teuthology.orchestra.run.trial106.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 775 kB/s | 135 kB 00:00 2026-02-12T06:38:35.851 INFO:teuthology.orchestra.run.trial058.stdout:(8/96): ceph-osd-classic-20.3.0-5145.g5fdb7d8f. 13 MB/s | 15 MB 00:01 2026-02-12T06:38:36.025 INFO:teuthology.orchestra.run.trial106.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 600 kB/s | 150 kB 00:00 2026-02-12T06:38:36.200 INFO:teuthology.orchestra.run.trial106.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 724 kB/s | 126 kB 00:00 2026-02-12T06:38:36.360 INFO:teuthology.orchestra.run.trial058.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-51 15 MB/s | 7.4 MB 00:00 2026-02-12T06:38:36.406 INFO:teuthology.orchestra.run.trial058.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5145.g5fdb7d 490 kB/s | 22 kB 00:00 2026-02-12T06:38:36.454 INFO:teuthology.orchestra.run.trial058.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5145.g5fd 6.0 MB/s | 297 kB 00:00 2026-02-12T06:38:36.497 INFO:teuthology.orchestra.run.trial058.stdout:(12/96): ceph-mgr-rook-20.3.0-5145.g5fdb7d8f.el 1.1 MB/s | 50 kB 00:00 2026-02-12T06:38:36.528 INFO:teuthology.orchestra.run.trial106.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 665 kB/s | 218 kB 00:00 2026-02-12T06:38:36.541 INFO:teuthology.orchestra.run.trial058.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5145.g5f 398 kB/s | 17 kB 00:00 2026-02-12T06:38:36.592 INFO:teuthology.orchestra.run.trial058.stdout:(14/96): ceph-volume-20.3.0-5145.g5fdb7d8f.el9. 5.7 MB/s | 299 kB 00:00 2026-02-12T06:38:36.596 INFO:teuthology.orchestra.run.trial106.stdout:(28/96): python3-cryptography-36.0.1-5.el9.x86_ 881 kB/s | 1.2 MB 00:01 2026-02-12T06:38:36.712 INFO:teuthology.orchestra.run.trial058.stdout:(15/96): cephadm-20.3.0-5145.g5fdb7d8f.el9.noar 8.5 MB/s | 1.0 MB 00:00 2026-02-12T06:38:36.741 INFO:teuthology.orchestra.run.trial058.stdout:(16/96): cryptsetup-2.8.1-2.el9.x86_64.rpm 12 MB/s | 350 kB 00:00 2026-02-12T06:38:36.745 INFO:teuthology.orchestra.run.trial058.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 9.2 MB/s | 40 kB 00:00 2026-02-12T06:38:36.750 INFO:teuthology.orchestra.run.trial058.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 15 MB/s | 72 kB 00:00 2026-02-12T06:38:36.770 INFO:teuthology.orchestra.run.trial058.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 39 MB/s | 794 kB 00:00 2026-02-12T06:38:36.778 INFO:teuthology.orchestra.run.trial106.stdout:(29/96): unzip-6.0-59.el9.x86_64.rpm 726 kB/s | 182 kB 00:00 2026-02-12T06:38:36.780 INFO:teuthology.orchestra.run.trial058.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 18 MB/s | 184 kB 00:00 2026-02-12T06:38:36.790 INFO:teuthology.orchestra.run.trial058.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 25 MB/s | 253 kB 00:00 2026-02-12T06:38:36.833 INFO:teuthology.orchestra.run.trial058.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 29 MB/s | 1.2 MB 00:00 2026-02-12T06:38:36.834 INFO:teuthology.orchestra.run.trial106.stdout:(30/96): flexiblas-3.0.4-8.el9.x86_64.rpm 581 kB/s | 33 kB 00:00 2026-02-12T06:38:36.839 INFO:teuthology.orchestra.run.trial058.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 17 MB/s | 106 kB 00:00 2026-02-12T06:38:36.845 INFO:teuthology.orchestra.run.trial058.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 22 MB/s | 135 kB 00:00 2026-02-12T06:38:36.851 INFO:teuthology.orchestra.run.trial058.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 24 MB/s | 150 kB 00:00 2026-02-12T06:38:36.858 INFO:teuthology.orchestra.run.trial058.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 19 MB/s | 126 kB 00:00 2026-02-12T06:38:36.865 INFO:teuthology.orchestra.run.trial058.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 31 MB/s | 218 kB 00:00 2026-02-12T06:38:36.872 INFO:teuthology.orchestra.run.trial058.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 26 MB/s | 182 kB 00:00 2026-02-12T06:38:36.882 INFO:teuthology.orchestra.run.trial058.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 26 MB/s | 266 kB 00:00 2026-02-12T06:38:36.917 INFO:teuthology.orchestra.run.trial106.stdout:(31/96): zip-3.0-35.el9.x86_64.rpm 826 kB/s | 266 kB 00:00 2026-02-12T06:38:36.942 INFO:teuthology.orchestra.run.trial058.stdout:(30/96): ceph-mgr-dashboard-20.3.0-5145.g5fdb7d 9.3 MB/s | 15 MB 00:01 2026-02-12T06:38:36.967 INFO:teuthology.orchestra.run.trial106.stdout:(32/96): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 23 MB/s | 3.0 MB 00:00 2026-02-12T06:38:36.968 INFO:teuthology.orchestra.run.trial058.stdout:(31/96): flexiblas-3.0.4-8.el9.x86_64.rpm 383 kB/s | 33 kB 00:00 2026-02-12T06:38:36.984 INFO:teuthology.orchestra.run.trial106.stdout:(33/96): flexiblas-openblas-openmp-3.0.4-8.el9. 274 kB/s | 18 kB 00:00 2026-02-12T06:38:36.989 INFO:teuthology.orchestra.run.trial106.stdout:(34/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 11 MB/s | 246 kB 00:00 2026-02-12T06:38:37.000 INFO:teuthology.orchestra.run.trial058.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-8.el9. 561 kB/s | 18 kB 00:00 2026-02-12T06:38:37.063 INFO:teuthology.orchestra.run.trial106.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 565 kB/s | 42 kB 00:00 2026-02-12T06:38:37.099 INFO:teuthology.orchestra.run.trial058.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.4 MB/s | 246 kB 00:00 2026-02-12T06:38:37.113 INFO:teuthology.orchestra.run.trial106.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 106 MB/s | 5.3 MB 00:00 2026-02-12T06:38:37.114 INFO:teuthology.orchestra.run.trial106.stdout:(37/96): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2026-02-12T06:38:37.134 INFO:teuthology.orchestra.run.trial058.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 5.2 MB/s | 188 kB 00:00 2026-02-12T06:38:37.160 INFO:teuthology.orchestra.run.trial058.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-12T06:38:37.162 INFO:teuthology.orchestra.run.trial106.stdout:(38/96): python3-devel-3.9.25-2.el9.x86_64.rpm 5.0 MB/s | 244 kB 00:00 2026-02-12T06:38:37.174 INFO:teuthology.orchestra.run.trial106.stdout:(39/96): python3-babel-2.9.1-2.el9.noarch.rpm 98 MB/s | 6.0 MB 00:00 2026-02-12T06:38:37.185 INFO:teuthology.orchestra.run.trial058.stdout:(36/96): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 12 MB/s | 3.0 MB 00:00 2026-02-12T06:38:37.188 INFO:teuthology.orchestra.run.trial106.stdout:(40/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 9.3 MB/s | 249 kB 00:00 2026-02-12T06:38:37.195 INFO:teuthology.orchestra.run.trial106.stdout:(41/96): python3-jmespath-1.0.1-1.el9.noarch.rp 2.3 MB/s | 48 kB 00:00 2026-02-12T06:38:37.216 INFO:teuthology.orchestra.run.trial106.stdout:(42/96): python3-libstoragemgmt-1.10.1-1.el9.x8 6.6 MB/s | 177 kB 00:00 2026-02-12T06:38:37.220 INFO:teuthology.orchestra.run.trial106.stdout:(43/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 49 MB/s | 1.2 MB 00:00 2026-02-12T06:38:37.239 INFO:teuthology.orchestra.run.trial106.stdout:(44/96): python3-markupsafe-1.1.1-12.el9.x86_64 1.4 MB/s | 35 kB 00:00 2026-02-12T06:38:37.258 INFO:teuthology.orchestra.run.trial058.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 81 MB/s | 6.0 MB 00:00 2026-02-12T06:38:37.266 INFO:teuthology.orchestra.run.trial106.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 16 MB/s | 442 kB 00:00 2026-02-12T06:38:37.275 INFO:teuthology.orchestra.run.trial106.stdout:(46/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 112 MB/s | 6.1 MB 00:00 2026-02-12T06:38:37.286 INFO:teuthology.orchestra.run.trial058.stdout:(38/96): python3-devel-3.9.25-2.el9.x86_64.rpm 8.6 MB/s | 244 kB 00:00 2026-02-12T06:38:37.290 INFO:teuthology.orchestra.run.trial106.stdout:(47/96): python3-packaging-20.9-5.el9.noarch.rp 3.1 MB/s | 77 kB 00:00 2026-02-12T06:38:37.297 INFO:teuthology.orchestra.run.trial106.stdout:(48/96): python3-protobuf-3.14.0-17.el9.noarch. 12 MB/s | 267 kB 00:00 2026-02-12T06:38:37.299 INFO:teuthology.orchestra.run.trial058.stdout:(39/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 38 MB/s | 5.3 MB 00:00 2026-02-12T06:38:37.313 INFO:teuthology.orchestra.run.trial058.stdout:(40/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 8.9 MB/s | 249 kB 00:00 2026-02-12T06:38:37.315 INFO:teuthology.orchestra.run.trial106.stdout:(49/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 6.4 MB/s | 159 kB 00:00 2026-02-12T06:38:37.320 INFO:teuthology.orchestra.run.trial106.stdout:(50/96): python3-pyasn1-modules-0.4.8-6.el9.noa 12 MB/s | 279 kB 00:00 2026-02-12T06:38:37.325 INFO:teuthology.orchestra.run.trial058.stdout:(41/96): python3-jmespath-1.0.1-1.el9.noarch.rp 1.8 MB/s | 48 kB 00:00 2026-02-12T06:38:37.339 INFO:teuthology.orchestra.run.trial106.stdout:(51/96): python3-requests-oauthlib-1.3.0-12.el9 2.2 MB/s | 54 kB 00:00 2026-02-12T06:38:37.342 INFO:teuthology.orchestra.run.trial058.stdout:(42/96): python3-libstoragemgmt-1.10.1-1.el9.x8 6.1 MB/s | 177 kB 00:00 2026-02-12T06:38:37.355 INFO:teuthology.orchestra.run.trial058.stdout:(43/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 41 MB/s | 1.2 MB 00:00 2026-02-12T06:38:37.362 INFO:teuthology.orchestra.run.trial106.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 1.7 MB/s | 42 kB 00:00 2026-02-12T06:38:37.368 INFO:teuthology.orchestra.run.trial058.stdout:(44/96): python3-markupsafe-1.1.1-12.el9.x86_64 1.3 MB/s | 35 kB 00:00 2026-02-12T06:38:37.386 INFO:teuthology.orchestra.run.trial106.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.8 MB/s | 189 kB 00:00 2026-02-12T06:38:37.395 INFO:teuthology.orchestra.run.trial058.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 16 MB/s | 442 kB 00:00 2026-02-12T06:38:37.411 INFO:teuthology.orchestra.run.trial106.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.6 MB/s | 90 kB 00:00 2026-02-12T06:38:37.421 INFO:teuthology.orchestra.run.trial058.stdout:(46/96): python3-packaging-20.9-5.el9.noarch.rp 2.9 MB/s | 77 kB 00:00 2026-02-12T06:38:37.440 INFO:teuthology.orchestra.run.trial058.stdout:(47/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 71 MB/s | 6.1 MB 00:00 2026-02-12T06:38:37.447 INFO:teuthology.orchestra.run.trial058.stdout:(48/96): python3-protobuf-3.14.0-17.el9.noarch. 9.9 MB/s | 267 kB 00:00 2026-02-12T06:38:37.468 INFO:teuthology.orchestra.run.trial058.stdout:(49/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 5.7 MB/s | 159 kB 00:00 2026-02-12T06:38:37.470 INFO:teuthology.orchestra.run.trial106.stdout:(55/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 128 MB/s | 19 MB 00:00 2026-02-12T06:38:37.475 INFO:teuthology.orchestra.run.trial058.stdout:(50/96): python3-pyasn1-modules-0.4.8-6.el9.noa 9.9 MB/s | 279 kB 00:00 2026-02-12T06:38:37.492 INFO:teuthology.orchestra.run.trial106.stdout:(56/96): lua-devel-5.4.4-4.el9.x86_64.rpm 276 kB/s | 22 kB 00:00 2026-02-12T06:38:37.493 INFO:teuthology.orchestra.run.trial058.stdout:(51/96): python3-requests-oauthlib-1.3.0-12.el9 2.1 MB/s | 54 kB 00:00 2026-02-12T06:38:37.519 INFO:teuthology.orchestra.run.trial058.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 1.6 MB/s | 42 kB 00:00 2026-02-12T06:38:37.544 INFO:teuthology.orchestra.run.trial058.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.3 MB/s | 189 kB 00:00 2026-02-12T06:38:37.570 INFO:teuthology.orchestra.run.trial058.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.5 MB/s | 90 kB 00:00 2026-02-12T06:38:37.597 INFO:teuthology.orchestra.run.trial106.stdout:(57/96): protobuf-compiler-3.14.0-17.el9.x86_64 6.6 MB/s | 862 kB 00:00 2026-02-12T06:38:37.599 INFO:teuthology.orchestra.run.trial058.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 768 kB/s | 22 kB 00:00 2026-02-12T06:38:37.640 INFO:teuthology.orchestra.run.trial058.stdout:(56/96): protobuf-compiler-3.14.0-17.el9.x86_64 20 MB/s | 862 kB 00:00 2026-02-12T06:38:37.669 INFO:teuthology.orchestra.run.trial058.stdout:(57/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 100 MB/s | 19 MB 00:00 2026-02-12T06:38:37.681 INFO:teuthology.orchestra.run.trial106.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 233 kB/s | 19 kB 00:00 2026-02-12T06:38:37.746 INFO:teuthology.orchestra.run.trial106.stdout:(59/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.1 MB/s | 551 kB 00:00 2026-02-12T06:38:37.751 INFO:teuthology.orchestra.run.trial058.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 246 kB/s | 19 kB 00:00 2026-02-12T06:38:37.767 INFO:teuthology.orchestra.run.trial106.stdout:(60/96): luarocks-3.9.2-5.el9.noarch.rpm 1.7 MB/s | 151 kB 00:00 2026-02-12T06:38:37.821 INFO:teuthology.orchestra.run.trial058.stdout:(59/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 3.0 MB/s | 551 kB 00:00 2026-02-12T06:38:37.821 INFO:teuthology.orchestra.run.trial058.stdout:(60/96): luarocks-3.9.2-5.el9.noarch.rpm 2.1 MB/s | 151 kB 00:00 2026-02-12T06:38:37.825 INFO:teuthology.orchestra.run.trial106.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 511 kB/s | 29 kB 00:00 2026-02-12T06:38:37.837 INFO:teuthology.orchestra.run.trial106.stdout:(62/96): python3-asyncssh-2.13.2-5.el9.noarch.r 5.9 MB/s | 548 kB 00:00 2026-02-12T06:38:37.845 INFO:teuthology.orchestra.run.trial058.stdout:(61/96): python3-asyncssh-2.13.2-5.el9.noarch.r 22 MB/s | 548 kB 00:00 2026-02-12T06:38:37.845 INFO:teuthology.orchestra.run.trial058.stdout:(62/96): python3-autocommand-2.2.2-8.el9.noarch 1.2 MB/s | 29 kB 00:00 2026-02-12T06:38:37.855 INFO:teuthology.orchestra.run.trial106.stdout:(63/96): python3-backports-tarfile-1.2.0-1.el9. 2.0 MB/s | 60 kB 00:00 2026-02-12T06:38:37.867 INFO:teuthology.orchestra.run.trial058.stdout:(63/96): python3-backports-tarfile-1.2.0-1.el9. 2.7 MB/s | 60 kB 00:00 2026-02-12T06:38:37.867 INFO:teuthology.orchestra.run.trial058.stdout:(64/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.0 MB/s | 43 kB 00:00 2026-02-12T06:38:37.870 INFO:teuthology.orchestra.run.trial106.stdout:(64/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.3 MB/s | 43 kB 00:00 2026-02-12T06:38:37.885 INFO:teuthology.orchestra.run.trial106.stdout:(65/96): python3-cachetools-4.2.4-1.el9.noarch. 1.1 MB/s | 32 kB 00:00 2026-02-12T06:38:37.888 INFO:teuthology.orchestra.run.trial058.stdout:(65/96): python3-cachetools-4.2.4-1.el9.noarch. 1.5 MB/s | 32 kB 00:00 2026-02-12T06:38:37.889 INFO:teuthology.orchestra.run.trial058.stdout:(66/96): python3-certifi-2023.05.07-4.el9.noarc 662 kB/s | 14 kB 00:00 2026-02-12T06:38:37.902 INFO:teuthology.orchestra.run.trial106.stdout:(66/96): python3-certifi-2023.05.07-4.el9.noarc 440 kB/s | 14 kB 00:00 2026-02-12T06:38:37.911 INFO:teuthology.orchestra.run.trial058.stdout:(67/96): python3-cheroot-10.0.1-4.el9.noarch.rp 7.6 MB/s | 173 kB 00:00 2026-02-12T06:38:37.913 INFO:teuthology.orchestra.run.trial058.stdout:(68/96): python3-cherrypy-18.6.1-2.el9.noarch.r 15 MB/s | 358 kB 00:00 2026-02-12T06:38:37.916 INFO:teuthology.orchestra.run.trial106.stdout:(67/96): python3-cheroot-10.0.1-4.el9.noarch.rp 5.4 MB/s | 173 kB 00:00 2026-02-12T06:38:37.934 INFO:teuthology.orchestra.run.trial058.stdout:(69/96): python3-google-auth-2.45.0-1.el9.noarc 11 MB/s | 254 kB 00:00 2026-02-12T06:38:37.937 INFO:teuthology.orchestra.run.trial106.stdout:(68/96): python3-cherrypy-18.6.1-2.el9.noarch.r 10 MB/s | 358 kB 00:00 2026-02-12T06:38:37.950 INFO:teuthology.orchestra.run.trial106.stdout:(69/96): python3-google-auth-2.45.0-1.el9.noarc 7.3 MB/s | 254 kB 00:00 2026-02-12T06:38:37.958 INFO:teuthology.orchestra.run.trial058.stdout:(70/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 45 MB/s | 2.0 MB 00:00 2026-02-12T06:38:37.959 INFO:teuthology.orchestra.run.trial058.stdout:(71/96): python3-grpcio-tools-1.46.7-10.el9.x86 5.6 MB/s | 144 kB 00:00 2026-02-12T06:38:37.980 INFO:teuthology.orchestra.run.trial058.stdout:(72/96): python3-influxdb-5.3.1-1.el9.noarch.rp 6.2 MB/s | 139 kB 00:00 2026-02-12T06:38:37.981 INFO:teuthology.orchestra.run.trial058.stdout:(73/96): python3-isodate-0.6.1-3.el9.noarch.rpm 2.5 MB/s | 56 kB 00:00 2026-02-12T06:38:37.986 INFO:teuthology.orchestra.run.trial106.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 4.0 MB/s | 144 kB 00:00 2026-02-12T06:38:38.001 INFO:teuthology.orchestra.run.trial058.stdout:(74/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 508 kB/s | 11 kB 00:00 2026-02-12T06:38:38.002 INFO:teuthology.orchestra.run.trial058.stdout:(75/96): python3-jaraco-classes-3.2.1-5.el9.noa 832 kB/s | 18 kB 00:00 2026-02-12T06:38:38.023 INFO:teuthology.orchestra.run.trial058.stdout:(76/96): python3-jaraco-collections-3.0.0-8.el9 1.1 MB/s | 23 kB 00:00 2026-02-12T06:38:38.023 INFO:teuthology.orchestra.run.trial058.stdout:(77/96): python3-jaraco-context-6.0.1-3.el9.noa 933 kB/s | 20 kB 00:00 2026-02-12T06:38:38.030 INFO:teuthology.orchestra.run.trial106.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 3.1 MB/s | 139 kB 00:00 2026-02-12T06:38:38.044 INFO:teuthology.orchestra.run.trial058.stdout:(78/96): python3-jaraco-functools-3.5.0-2.el9.n 917 kB/s | 19 kB 00:00 2026-02-12T06:38:38.045 INFO:teuthology.orchestra.run.trial058.stdout:(79/96): python3-jaraco-text-4.0.0-2.el9.noarch 1.2 MB/s | 26 kB 00:00 2026-02-12T06:38:38.071 INFO:teuthology.orchestra.run.trial058.stdout:(80/96): python3-kubernetes-26.1.0-3.el9.noarch 38 MB/s | 1.0 MB 00:00 2026-02-12T06:38:38.071 INFO:teuthology.orchestra.run.trial058.stdout:(81/96): python3-more-itertools-8.12.0-2.el9.no 2.9 MB/s | 79 kB 00:00 2026-02-12T06:38:38.093 INFO:teuthology.orchestra.run.trial058.stdout:(82/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 3.9 MB/s | 86 kB 00:00 2026-02-12T06:38:38.093 INFO:teuthology.orchestra.run.trial058.stdout:(83/96): python3-natsort-7.1.1-5.el9.noarch.rpm 2.6 MB/s | 58 kB 00:00 2026-02-12T06:38:38.114 INFO:teuthology.orchestra.run.trial058.stdout:(84/96): python3-portend-3.1.0-2.el9.noarch.rpm 770 kB/s | 16 kB 00:00 2026-02-12T06:38:38.115 INFO:teuthology.orchestra.run.trial058.stdout:(85/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 4.1 MB/s | 90 kB 00:00 2026-02-12T06:38:38.136 INFO:teuthology.orchestra.run.trial058.stdout:(86/96): python3-repoze-lru-0.7-16.el9.noarch.r 1.4 MB/s | 31 kB 00:00 2026-02-12T06:38:38.137 INFO:teuthology.orchestra.run.trial058.stdout:(87/96): python3-routes-2.5.1-5.el9.noarch.rpm 8.3 MB/s | 188 kB 00:00 2026-02-12T06:38:38.158 INFO:teuthology.orchestra.run.trial058.stdout:(88/96): python3-rsa-4.9-2.el9.noarch.rpm 2.7 MB/s | 59 kB 00:00 2026-02-12T06:38:38.161 INFO:teuthology.orchestra.run.trial058.stdout:(89/96): python3-saml-1.16.0-1.el9.noarch.rpm 5.3 MB/s | 125 kB 00:00 2026-02-12T06:38:38.162 INFO:teuthology.orchestra.run.trial106.stdout:(72/96): ceph-osd-crimson-20.3.0-5145.g5fdb7d8f 9.1 MB/s | 87 MB 00:09 2026-02-12T06:38:38.164 INFO:teuthology.orchestra.run.trial106.stdout:(73/96): python3-isodate-0.6.1-3.el9.noarch.rpm 418 kB/s | 56 kB 00:00 2026-02-12T06:38:38.168 INFO:teuthology.orchestra.run.trial106.stdout:(74/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 8.8 MB/s | 2.0 MB 00:00 2026-02-12T06:38:38.179 INFO:teuthology.orchestra.run.trial058.stdout:(90/96): python3-tempora-5.0.0-2.el9.noarch.rpm 1.6 MB/s | 36 kB 00:00 2026-02-12T06:38:38.182 INFO:teuthology.orchestra.run.trial058.stdout:(91/96): python3-typing-extensions-4.15.0-1.el9 3.9 MB/s | 86 kB 00:00 2026-02-12T06:38:38.193 INFO:teuthology.orchestra.run.trial106.stdout:(75/96): python3-jaraco-classes-3.2.1-5.el9.noa 604 kB/s | 18 kB 00:00 2026-02-12T06:38:38.200 INFO:teuthology.orchestra.run.trial106.stdout:(76/96): python3-jaraco-collections-3.0.0-8.el9 708 kB/s | 23 kB 00:00 2026-02-12T06:38:38.222 INFO:teuthology.orchestra.run.trial058.stdout:(92/96): python3-websocket-client-1.2.3-2.el9.n 2.1 MB/s | 90 kB 00:00 2026-02-12T06:38:38.222 INFO:teuthology.orchestra.run.trial058.stdout:(93/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.2 MB/s | 48 kB 00:00 2026-02-12T06:38:38.223 INFO:teuthology.orchestra.run.trial106.stdout:(77/96): python3-jaraco-context-6.0.1-3.el9.noa 669 kB/s | 20 kB 00:00 2026-02-12T06:38:38.227 INFO:teuthology.orchestra.run.trial106.stdout:(78/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 166 kB/s | 11 kB 00:00 2026-02-12T06:38:38.233 INFO:teuthology.orchestra.run.trial106.stdout:(79/96): python3-jaraco-functools-3.5.0-2.el9.n 601 kB/s | 19 kB 00:00 2026-02-12T06:38:38.259 INFO:teuthology.orchestra.run.trial106.stdout:(80/96): python3-jaraco-text-4.0.0-2.el9.noarch 743 kB/s | 26 kB 00:00 2026-02-12T06:38:38.260 INFO:teuthology.orchestra.run.trial058.stdout:(94/96): python3-xmltodict-0.12.0-15.el9.noarch 580 kB/s | 22 kB 00:00 2026-02-12T06:38:38.261 INFO:teuthology.orchestra.run.trial058.stdout:(95/96): python3-zc-lockfile-2.0-10.el9.noarch. 517 kB/s | 20 kB 00:00 2026-02-12T06:38:38.298 INFO:teuthology.orchestra.run.trial106.stdout:(81/96): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2026-02-12T06:38:38.333 INFO:teuthology.orchestra.run.trial106.stdout:(82/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2026-02-12T06:38:38.333 INFO:teuthology.orchestra.run.trial106.stdout:(83/96): python3-natsort-7.1.1-5.el9.noarch.rpm 1.6 MB/s | 58 kB 00:00 2026-02-12T06:38:38.366 INFO:teuthology.orchestra.run.trial106.stdout:(84/96): python3-portend-3.1.0-2.el9.noarch.rpm 487 kB/s | 16 kB 00:00 2026-02-12T06:38:38.368 INFO:teuthology.orchestra.run.trial106.stdout:(85/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.5 MB/s | 90 kB 00:00 2026-02-12T06:38:38.397 INFO:teuthology.orchestra.run.trial106.stdout:(86/96): python3-repoze-lru-0.7-16.el9.noarch.r 999 kB/s | 31 kB 00:00 2026-02-12T06:38:38.402 INFO:teuthology.orchestra.run.trial106.stdout:(87/96): python3-routes-2.5.1-5.el9.noarch.rpm 5.3 MB/s | 188 kB 00:00 2026-02-12T06:38:38.427 INFO:teuthology.orchestra.run.trial106.stdout:(88/96): python3-rsa-4.9-2.el9.noarch.rpm 1.9 MB/s | 59 kB 00:00 2026-02-12T06:38:38.456 INFO:teuthology.orchestra.run.trial106.stdout:(89/96): python3-kubernetes-26.1.0-3.el9.noarch 4.5 MB/s | 1.0 MB 00:00 2026-02-12T06:38:38.464 INFO:teuthology.orchestra.run.trial058.stdout:(96/96): ceph-osd-crimson-20.3.0-5145.g5fdb7d8f 24 MB/s | 87 MB 00:03 2026-02-12T06:38:38.467 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:38:38.467 INFO:teuthology.orchestra.run.trial058.stdout:Total 42 MB/s | 189 MB 00:04 2026-02-12T06:38:38.481 INFO:teuthology.orchestra.run.trial106.stdout:(90/96): python3-tempora-5.0.0-2.el9.noarch.rpm 674 kB/s | 36 kB 00:00 2026-02-12T06:38:38.482 INFO:teuthology.orchestra.run.trial106.stdout:(91/96): python3-saml-1.16.0-1.el9.noarch.rpm 1.5 MB/s | 125 kB 00:00 2026-02-12T06:38:38.490 INFO:teuthology.orchestra.run.trial106.stdout:(92/96): python3-typing-extensions-4.15.0-1.el9 2.5 MB/s | 86 kB 00:00 2026-02-12T06:38:38.512 INFO:teuthology.orchestra.run.trial106.stdout:(93/96): python3-websocket-client-1.2.3-2.el9.n 2.8 MB/s | 90 kB 00:00 2026-02-12T06:38:38.515 INFO:teuthology.orchestra.run.trial106.stdout:(94/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.4 MB/s | 48 kB 00:00 2026-02-12T06:38:38.524 INFO:teuthology.orchestra.run.trial106.stdout:(95/96): python3-xmltodict-0.12.0-15.el9.noarch 662 kB/s | 22 kB 00:00 2026-02-12T06:38:38.673 INFO:teuthology.orchestra.run.trial106.stdout:(96/96): python3-zc-lockfile-2.0-10.el9.noarch. 124 kB/s | 20 kB 00:00 2026-02-12T06:38:38.678 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:38:38.678 INFO:teuthology.orchestra.run.trial106.stdout:Total 16 MB/s | 189 MB 00:11 2026-02-12T06:38:38.866 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-12T06:38:38.904 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-12T06:38:38.904 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-12T06:38:39.100 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-12T06:38:39.137 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-12T06:38:39.137 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-12T06:38:39.593 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-12T06:38:39.593 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-12T06:38:39.825 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-12T06:38:39.825 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-12T06:38:40.311 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-12T06:38:40.313 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-12T06:38:40.317 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-12T06:38:40.339 INFO:teuthology.orchestra.run.trial058.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-12T06:38:40.372 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-12T06:38:40.379 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-12T06:38:40.381 INFO:teuthology.orchestra.run.trial058.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-12T06:38:40.385 INFO:teuthology.orchestra.run.trial058.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 7/96 2026-02-12T06:38:40.409 INFO:teuthology.orchestra.run.trial058.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-12T06:38:40.422 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-12T06:38:40.425 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-12T06:38:40.431 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-12T06:38:40.433 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-12T06:38:40.444 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-12T06:38:40.451 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-12T06:38:40.475 INFO:teuthology.orchestra.run.trial058.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-12T06:38:40.478 INFO:teuthology.orchestra.run.trial058.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-12T06:38:40.528 INFO:teuthology.orchestra.run.trial058.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-12T06:38:40.541 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-12T06:38:40.542 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-12T06:38:40.543 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-12T06:38:40.545 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-12T06:38:40.548 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-12T06:38:40.550 INFO:teuthology.orchestra.run.trial058.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-12T06:38:40.555 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-12T06:38:40.560 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-12T06:38:40.563 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-12T06:38:40.569 INFO:teuthology.orchestra.run.trial106.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-12T06:38:40.577 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-12T06:38:40.581 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-12T06:38:40.586 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-12T06:38:40.598 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-12T06:38:40.603 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-12T06:38:40.607 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-12T06:38:40.609 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-12T06:38:40.612 INFO:teuthology.orchestra.run.trial106.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-12T06:38:40.613 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-12T06:38:40.617 INFO:teuthology.orchestra.run.trial106.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 7/96 2026-02-12T06:38:40.632 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-12T06:38:40.640 INFO:teuthology.orchestra.run.trial106.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-12T06:38:40.644 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-12T06:38:40.652 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-12T06:38:40.656 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-12T06:38:40.660 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-12T06:38:40.662 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-12T06:38:40.663 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-12T06:38:40.664 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-12T06:38:40.672 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-12T06:38:40.675 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-12T06:38:40.681 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-12T06:38:40.705 INFO:teuthology.orchestra.run.trial106.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-12T06:38:40.708 INFO:teuthology.orchestra.run.trial106.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-12T06:38:40.712 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-12T06:38:40.758 INFO:teuthology.orchestra.run.trial106.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-12T06:38:40.771 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-12T06:38:40.773 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-12T06:38:40.780 INFO:teuthology.orchestra.run.trial106.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-12T06:38:40.785 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-12T06:38:40.790 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-12T06:38:40.793 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-12T06:38:40.807 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-12T06:38:40.812 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-12T06:38:40.817 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-12T06:38:40.828 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-12T06:38:40.837 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-12T06:38:40.843 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-12T06:38:40.862 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-12T06:38:40.873 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-12T06:38:40.889 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-12T06:38:40.893 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-12T06:38:40.901 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-12T06:38:40.941 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-12T06:38:41.034 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-12T06:38:41.044 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-12T06:38:41.048 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-12T06:38:41.054 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-12T06:38:41.055 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-12T06:38:41.082 INFO:teuthology.orchestra.run.trial058.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-12T06:38:41.125 INFO:teuthology.orchestra.run.trial058.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-12T06:38:41.133 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-12T06:38:41.139 INFO:teuthology.orchestra.run.trial058.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-12T06:38:41.142 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-12T06:38:41.148 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-12T06:38:41.152 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-12T06:38:41.158 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-12T06:38:41.162 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-12T06:38:41.189 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-12T06:38:41.199 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-12T06:38:41.205 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-12T06:38:41.212 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-12T06:38:41.246 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-12T06:38:41.264 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-12T06:38:41.274 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-12T06:38:41.278 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-12T06:38:41.283 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-12T06:38:41.286 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-12T06:38:41.313 INFO:teuthology.orchestra.run.trial106.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-12T06:38:41.356 INFO:teuthology.orchestra.run.trial106.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-12T06:38:41.365 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-12T06:38:41.370 INFO:teuthology.orchestra.run.trial106.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-12T06:38:41.374 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-12T06:38:41.380 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-12T06:38:41.383 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-12T06:38:41.390 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-12T06:38:41.394 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-12T06:38:41.421 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-12T06:38:41.431 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-12T06:38:41.437 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-12T06:38:41.444 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-12T06:38:41.469 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 55/96 2026-02-12T06:38:41.478 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-12T06:38:41.492 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-12T06:38:41.496 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-12T06:38:41.554 INFO:teuthology.orchestra.run.trial058.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-12T06:38:41.556 INFO:teuthology.orchestra.run.trial058.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-12T06:38:41.578 INFO:teuthology.orchestra.run.trial058.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 60/96 2026-02-12T06:38:41.700 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 55/96 2026-02-12T06:38:41.723 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-12T06:38:41.727 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-12T06:38:41.786 INFO:teuthology.orchestra.run.trial106.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-12T06:38:41.788 INFO:teuthology.orchestra.run.trial106.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-12T06:38:41.810 INFO:teuthology.orchestra.run.trial106.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 60/96 2026-02-12T06:38:41.901 INFO:teuthology.orchestra.run.trial058.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 61/96 2026-02-12T06:38:41.975 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-12T06:38:42.135 INFO:teuthology.orchestra.run.trial106.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 61/96 2026-02-12T06:38:42.208 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-12T06:38:42.651 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-12T06:38:42.668 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-12T06:38:42.678 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-12T06:38:42.684 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-12T06:38:42.698 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-12T06:38:42.713 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-12T06:38:42.789 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-12T06:38:42.798 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-12T06:38:42.822 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-12T06:38:42.852 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-12T06:38:42.875 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-12T06:38:42.892 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-12T06:38:42.901 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-12T06:38:42.902 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-12T06:38:42.908 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-12T06:38:42.908 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-12T06:38:42.913 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-12T06:38:42.914 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-12T06:38:42.921 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-12T06:38:42.932 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T06:38:42.932 INFO:teuthology.orchestra.run.trial058.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T06:38:42.932 INFO:teuthology.orchestra.run.trial058.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T06:38:42.932 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:42.937 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-12T06:38:42.941 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T06:38:42.965 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T06:38:42.965 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T06:38:42.965 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:42.999 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-12T06:38:43.012 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-12T06:38:43.020 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-12T06:38:43.044 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-12T06:38:43.073 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-12T06:38:43.123 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-12T06:38:43.129 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-12T06:38:43.132 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-12T06:38:43.134 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-12T06:38:43.151 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T06:38:43.151 INFO:teuthology.orchestra.run.trial106.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T06:38:43.151 INFO:teuthology.orchestra.run.trial106.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T06:38:43.151 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:43.159 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T06:38:43.183 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-12T06:38:43.184 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T06:38:43.184 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:43.218 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-12T06:38:43.585 INFO:teuthology.orchestra.run.trial058.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 79/96 2026-02-12T06:38:43.804 INFO:teuthology.orchestra.run.trial106.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 79/96 2026-02-12T06:38:48.910 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 80/96 2026-02-12T06:38:48.974 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 81/96 2026-02-12T06:38:48.976 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch 82/96 2026-02-12T06:38:48.990 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch 82/96 2026-02-12T06:38:48.990 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T06:38:48.990 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T06:38:48.991 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:49.002 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 83/96 2026-02-12T06:38:49.026 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 83/96 2026-02-12T06:38:49.026 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T06:38:49.027 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T06:38:49.027 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T06:38:49.027 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T06:38:49.027 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:49.087 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 84/96 2026-02-12T06:38:49.089 INFO:teuthology.orchestra.run.trial058.stdout: Installing : cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 84/96 2026-02-12T06:38:49.099 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5145.g5fdb7d8f.el9 85/96 2026-02-12T06:38:49.123 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5145.g5fdb7d8f.el 86/96 2026-02-12T06:38:49.124 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarc 87/96 2026-02-12T06:38:49.130 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 80/96 2026-02-12T06:38:49.193 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 81/96 2026-02-12T06:38:49.195 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch 82/96 2026-02-12T06:38:49.209 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch 82/96 2026-02-12T06:38:49.209 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T06:38:49.209 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T06:38:49.210 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:49.219 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 83/96 2026-02-12T06:38:49.243 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 83/96 2026-02-12T06:38:49.243 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T06:38:49.243 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T06:38:49.243 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T06:38:49.243 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T06:38:49.243 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:49.300 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 84/96 2026-02-12T06:38:49.302 INFO:teuthology.orchestra.run.trial106.stdout: Installing : cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 84/96 2026-02-12T06:38:49.312 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5145.g5fdb7d8f.el9 85/96 2026-02-12T06:38:49.335 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5145.g5fdb7d8f.el 86/96 2026-02-12T06:38:49.337 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarc 87/96 2026-02-12T06:38:50.693 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarc 87/96 2026-02-12T06:38:50.700 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noa 88/96 2026-02-12T06:38:50.908 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarc 87/96 2026-02-12T06:38:50.915 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noa 88/96 2026-02-12T06:38:51.153 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noa 88/96 2026-02-12T06:38:51.154 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7 89/96 2026-02-12T06:38:51.166 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7 89/96 2026-02-12T06:38:51.166 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5145.g5fdb7d8f.el9.noa 90/96 2026-02-12T06:38:51.228 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5145.g5fdb7d8f.el9.noa 90/96 2026-02-12T06:38:51.269 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5145.g5fdb7d8f.el9. 91/96 2026-02-12T06:38:51.270 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 92/96 2026-02-12T06:38:51.292 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 92/96 2026-02-12T06:38:51.292 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T06:38:51.292 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T06:38:51.292 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T06:38:51.292 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T06:38:51.292 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:51.304 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch 93/96 2026-02-12T06:38:51.365 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noa 88/96 2026-02-12T06:38:51.366 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7 89/96 2026-02-12T06:38:51.378 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7 89/96 2026-02-12T06:38:51.379 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5145.g5fdb7d8f.el9.noa 90/96 2026-02-12T06:38:51.444 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5145.g5fdb7d8f.el9.noa 90/96 2026-02-12T06:38:51.484 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5145.g5fdb7d8f.el9. 91/96 2026-02-12T06:38:51.485 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 92/96 2026-02-12T06:38:51.507 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 92/96 2026-02-12T06:38:51.507 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T06:38:51.507 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T06:38:51.507 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T06:38:51.507 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T06:38:51.507 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:51.517 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch 93/96 2026-02-12T06:38:51.518 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 94/96 2026-02-12T06:38:51.519 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch 93/96 2026-02-12T06:38:51.540 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 94/96 2026-02-12T06:38:51.540 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T06:38:51.541 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T06:38:51.541 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T06:38:51.541 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T06:38:51.541 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:51.624 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mds-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 95/96 2026-02-12T06:38:51.645 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mds-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 95/96 2026-02-12T06:38:51.645 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T06:38:51.645 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T06:38:51.646 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T06:38:51.646 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T06:38:51.646 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:51.647 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 96/96 2026-02-12T06:38:51.654 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 96/96 2026-02-12T06:38:51.678 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 96/96 2026-02-12T06:38:51.737 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch 93/96 2026-02-12T06:38:51.739 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 94/96 2026-02-12T06:38:51.760 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 94/96 2026-02-12T06:38:51.761 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T06:38:51.761 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T06:38:51.761 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T06:38:51.761 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T06:38:51.761 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:51.843 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mds-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 95/96 2026-02-12T06:38:51.863 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mds-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 95/96 2026-02-12T06:38:51.864 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T06:38:51.864 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T06:38:51.864 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T06:38:51.864 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T06:38:51.864 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:51.865 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 96/96 2026-02-12T06:38:51.871 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 96/96 2026-02-12T06:38:51.896 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 96/96 2026-02-12T06:38:52.963 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 96/96 2026-02-12T06:38:52.963 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/96 2026-02-12T06:38:52.963 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mds-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/96 2026-02-12T06:38:52.963 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 3/96 2026-02-12T06:38:52.963 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 4/96 2026-02-12T06:38:52.963 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 5/96 2026-02-12T06:38:52.963 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 6/96 2026-02-12T06:38:52.963 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 7/96 2026-02-12T06:38:52.963 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5145.g5fdb7d8f.el 8/96 2026-02-12T06:38:52.963 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarc 9/96 2026-02-12T06:38:52.963 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noa 10/96 2026-02-12T06:38:52.963 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7 11/96 2026-02-12T06:38:52.963 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5145.g5fdb7d8f.el9.noa 12/96 2026-02-12T06:38:52.963 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5145.g5fdb7d8f.el9. 13/96 2026-02-12T06:38:52.963 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch 14/96 2026-02-12T06:38:52.963 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5145.g5fdb7d8f.el9 15/96 2026-02-12T06:38:52.965 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch 16/96 2026-02-12T06:38:52.965 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 17/96 2026-02-12T06:38:52.965 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 18/96 2026-02-12T06:38:52.965 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-12T06:38:52.966 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-12T06:38:52.966 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-12T06:38:52.966 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-12T06:38:52.966 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-12T06:38:52.966 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-12T06:38:52.966 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-12T06:38:52.972 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-12T06:38:52.972 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-12T06:38:52.972 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-12T06:38:52.972 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-12T06:38:52.972 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-12T06:38:52.972 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-12T06:38:52.972 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 32/96 2026-02-12T06:38:52.972 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 33/96 2026-02-12T06:38:52.972 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 34/96 2026-02-12T06:38:52.972 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-12T06:38:52.972 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-12T06:38:52.972 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-12T06:38:52.972 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-12T06:38:52.972 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-12T06:38:52.972 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 40/96 2026-02-12T06:38:52.972 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-12T06:38:52.972 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-12T06:38:52.973 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-12T06:38:52.974 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-12T06:38:53.031 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-12T06:38:53.031 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:53.031 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-12T06:38:53.031 INFO:teuthology.orchestra.run.trial058.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T06:38:53.031 INFO:teuthology.orchestra.run.trial058.stdout: ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:53.031 INFO:teuthology.orchestra.run.trial058.stdout: ceph-grafana-dashboards-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.031 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mds-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:53.032 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:53.032 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.032 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.032 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.032 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-k8sevents-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.032 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-modules-core-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.032 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.032 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:53.032 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:53.032 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:53.032 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:53.033 INFO:teuthology.orchestra.run.trial058.stdout: ceph-prometheus-alerts-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.033 INFO:teuthology.orchestra.run.trial058.stdout: ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.033 INFO:teuthology.orchestra.run.trial058.stdout: cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.033 INFO:teuthology.orchestra.run.trial058.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T06:38:53.033 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T06:38:53.033 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T06:38:53.033 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T06:38:53.033 INFO:teuthology.orchestra.run.trial058.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T06:38:53.033 INFO:teuthology.orchestra.run.trial058.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T06:38:53.033 INFO:teuthology.orchestra.run.trial058.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T06:38:53.033 INFO:teuthology.orchestra.run.trial058.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T06:38:53.033 INFO:teuthology.orchestra.run.trial058.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T06:38:53.033 INFO:teuthology.orchestra.run.trial058.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T06:38:53.034 INFO:teuthology.orchestra.run.trial058.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T06:38:53.034 INFO:teuthology.orchestra.run.trial058.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T06:38:53.034 INFO:teuthology.orchestra.run.trial058.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T06:38:53.034 INFO:teuthology.orchestra.run.trial058.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T06:38:53.034 INFO:teuthology.orchestra.run.trial058.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T06:38:53.034 INFO:teuthology.orchestra.run.trial058.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T06:38:53.034 INFO:teuthology.orchestra.run.trial058.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T06:38:53.034 INFO:teuthology.orchestra.run.trial058.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T06:38:53.034 INFO:teuthology.orchestra.run.trial058.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T06:38:53.034 INFO:teuthology.orchestra.run.trial058.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T06:38:53.034 INFO:teuthology.orchestra.run.trial058.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T06:38:53.034 INFO:teuthology.orchestra.run.trial058.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T06:38:53.034 INFO:teuthology.orchestra.run.trial058.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T06:38:53.035 INFO:teuthology.orchestra.run.trial058.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T06:38:53.035 INFO:teuthology.orchestra.run.trial058.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T06:38:53.035 INFO:teuthology.orchestra.run.trial058.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T06:38:53.035 INFO:teuthology.orchestra.run.trial058.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T06:38:53.035 INFO:teuthology.orchestra.run.trial058.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T06:38:53.035 INFO:teuthology.orchestra.run.trial058.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T06:38:53.035 INFO:teuthology.orchestra.run.trial058.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T06:38:53.035 INFO:teuthology.orchestra.run.trial058.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T06:38:53.035 INFO:teuthology.orchestra.run.trial058.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-12T06:38:53.035 INFO:teuthology.orchestra.run.trial058.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-12T06:38:53.035 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T06:38:53.035 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T06:38:53.036 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T06:38:53.036 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T06:38:53.036 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T06:38:53.036 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T06:38:53.036 INFO:teuthology.orchestra.run.trial058.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T06:38:53.036 INFO:teuthology.orchestra.run.trial058.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T06:38:53.036 INFO:teuthology.orchestra.run.trial058.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T06:38:53.036 INFO:teuthology.orchestra.run.trial058.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T06:38:53.036 INFO:teuthology.orchestra.run.trial058.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-12T06:38:53.036 INFO:teuthology.orchestra.run.trial058.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T06:38:53.036 INFO:teuthology.orchestra.run.trial058.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T06:38:53.036 INFO:teuthology.orchestra.run.trial058.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-12T06:38:53.036 INFO:teuthology.orchestra.run.trial058.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T06:38:53.037 INFO:teuthology.orchestra.run.trial058.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T06:38:53.037 INFO:teuthology.orchestra.run.trial058.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T06:38:53.037 INFO:teuthology.orchestra.run.trial058.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T06:38:53.037 INFO:teuthology.orchestra.run.trial058.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T06:38:53.037 INFO:teuthology.orchestra.run.trial058.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T06:38:53.037 INFO:teuthology.orchestra.run.trial058.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T06:38:53.037 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T06:38:53.037 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T06:38:53.037 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T06:38:53.037 INFO:teuthology.orchestra.run.trial058.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T06:38:53.037 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T06:38:53.037 INFO:teuthology.orchestra.run.trial058.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T06:38:53.037 INFO:teuthology.orchestra.run.trial058.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T06:38:53.037 INFO:teuthology.orchestra.run.trial058.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T06:38:53.038 INFO:teuthology.orchestra.run.trial058.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T06:38:53.038 INFO:teuthology.orchestra.run.trial058.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T06:38:53.038 INFO:teuthology.orchestra.run.trial058.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-12T06:38:53.038 INFO:teuthology.orchestra.run.trial058.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T06:38:53.038 INFO:teuthology.orchestra.run.trial058.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T06:38:53.038 INFO:teuthology.orchestra.run.trial058.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T06:38:53.038 INFO:teuthology.orchestra.run.trial058.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T06:38:53.038 INFO:teuthology.orchestra.run.trial058.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T06:38:53.038 INFO:teuthology.orchestra.run.trial058.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T06:38:53.038 INFO:teuthology.orchestra.run.trial058.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-12T06:38:53.038 INFO:teuthology.orchestra.run.trial058.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T06:38:53.038 INFO:teuthology.orchestra.run.trial058.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T06:38:53.038 INFO:teuthology.orchestra.run.trial058.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T06:38:53.039 INFO:teuthology.orchestra.run.trial058.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-12T06:38:53.039 INFO:teuthology.orchestra.run.trial058.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-12T06:38:53.039 INFO:teuthology.orchestra.run.trial058.stdout: zip-3.0-35.el9.x86_64 2026-02-12T06:38:53.039 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:53.039 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:38:53.097 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-base 2026-02-12T06:38:53.200 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 96/96 2026-02-12T06:38:53.200 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/96 2026-02-12T06:38:53.200 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mds-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2/96 2026-02-12T06:38:53.200 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 3/96 2026-02-12T06:38:53.200 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 4/96 2026-02-12T06:38:53.201 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 5/96 2026-02-12T06:38:53.201 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 6/96 2026-02-12T06:38:53.201 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_6 7/96 2026-02-12T06:38:53.201 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5145.g5fdb7d8f.el 8/96 2026-02-12T06:38:53.201 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarc 9/96 2026-02-12T06:38:53.201 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noa 10/96 2026-02-12T06:38:53.201 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7 11/96 2026-02-12T06:38:53.201 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5145.g5fdb7d8f.el9.noa 12/96 2026-02-12T06:38:53.201 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5145.g5fdb7d8f.el9. 13/96 2026-02-12T06:38:53.201 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch 14/96 2026-02-12T06:38:53.201 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5145.g5fdb7d8f.el9 15/96 2026-02-12T06:38:53.201 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch 16/96 2026-02-12T06:38:53.202 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 17/96 2026-02-12T06:38:53.202 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 18/96 2026-02-12T06:38:53.202 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-12T06:38:53.202 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-12T06:38:53.202 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-12T06:38:53.202 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-12T06:38:53.202 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-12T06:38:53.202 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-12T06:38:53.202 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-12T06:38:53.202 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-12T06:38:53.202 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-12T06:38:53.202 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-12T06:38:53.202 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-12T06:38:53.203 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-12T06:38:53.203 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-12T06:38:53.203 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 32/96 2026-02-12T06:38:53.203 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 33/96 2026-02-12T06:38:53.203 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 34/96 2026-02-12T06:38:53.203 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-12T06:38:53.203 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-12T06:38:53.203 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-12T06:38:53.203 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-12T06:38:53.203 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-12T06:38:53.203 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 40/96 2026-02-12T06:38:53.203 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-12T06:38:53.203 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-12T06:38:53.204 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-12T06:38:53.204 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-12T06:38:53.204 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-12T06:38:53.204 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-12T06:38:53.204 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-12T06:38:53.204 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-12T06:38:53.204 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-12T06:38:53.204 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-12T06:38:53.204 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-12T06:38:53.204 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-12T06:38:53.204 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-12T06:38:53.204 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-12T06:38:53.204 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-12T06:38:53.205 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-12T06:38:53.205 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-12T06:38:53.205 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-12T06:38:53.205 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-12T06:38:53.205 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-12T06:38:53.205 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-12T06:38:53.205 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-12T06:38:53.205 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-12T06:38:53.205 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-12T06:38:53.205 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-12T06:38:53.205 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-12T06:38:53.205 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-12T06:38:53.205 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-12T06:38:53.206 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-12T06:38:53.206 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-12T06:38:53.206 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-12T06:38:53.206 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-12T06:38:53.206 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-12T06:38:53.206 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-12T06:38:53.206 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-12T06:38:53.206 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-12T06:38:53.206 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-12T06:38:53.206 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-12T06:38:53.206 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-12T06:38:53.206 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-12T06:38:53.206 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-12T06:38:53.207 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-12T06:38:53.207 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-12T06:38:53.207 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-12T06:38:53.207 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-12T06:38:53.207 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-12T06:38:53.207 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-12T06:38:53.207 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-12T06:38:53.207 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-12T06:38:53.207 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-12T06:38:53.207 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-12T06:38:53.207 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-12T06:38:53.207 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-12T06:38:53.207 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-12T06:38:53.207 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-12T06:38:53.260 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-12T06:38:53.260 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:53.260 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-12T06:38:53.260 INFO:teuthology.orchestra.run.trial106.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T06:38:53.260 INFO:teuthology.orchestra.run.trial106.stdout: ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:53.260 INFO:teuthology.orchestra.run.trial106.stdout: ceph-grafana-dashboards-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.260 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mds-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:53.260 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:53.260 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.261 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.261 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.261 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-k8sevents-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.261 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-modules-core-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.261 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.261 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mon-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:53.261 INFO:teuthology.orchestra.run.trial106.stdout: ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:53.261 INFO:teuthology.orchestra.run.trial106.stdout: ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:53.261 INFO:teuthology.orchestra.run.trial106.stdout: ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:53.261 INFO:teuthology.orchestra.run.trial106.stdout: ceph-prometheus-alerts-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.261 INFO:teuthology.orchestra.run.trial106.stdout: ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.262 INFO:teuthology.orchestra.run.trial106.stdout: cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch 2026-02-12T06:38:53.262 INFO:teuthology.orchestra.run.trial106.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T06:38:53.262 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T06:38:53.262 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T06:38:53.262 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T06:38:53.262 INFO:teuthology.orchestra.run.trial106.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T06:38:53.262 INFO:teuthology.orchestra.run.trial106.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T06:38:53.262 INFO:teuthology.orchestra.run.trial106.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T06:38:53.262 INFO:teuthology.orchestra.run.trial106.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T06:38:53.262 INFO:teuthology.orchestra.run.trial106.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T06:38:53.262 INFO:teuthology.orchestra.run.trial106.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T06:38:53.262 INFO:teuthology.orchestra.run.trial106.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T06:38:53.262 INFO:teuthology.orchestra.run.trial106.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T06:38:53.263 INFO:teuthology.orchestra.run.trial106.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T06:38:53.263 INFO:teuthology.orchestra.run.trial106.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T06:38:53.263 INFO:teuthology.orchestra.run.trial106.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T06:38:53.263 INFO:teuthology.orchestra.run.trial106.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T06:38:53.263 INFO:teuthology.orchestra.run.trial106.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T06:38:53.263 INFO:teuthology.orchestra.run.trial106.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T06:38:53.263 INFO:teuthology.orchestra.run.trial106.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T06:38:53.263 INFO:teuthology.orchestra.run.trial106.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T06:38:53.263 INFO:teuthology.orchestra.run.trial106.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T06:38:53.263 INFO:teuthology.orchestra.run.trial106.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T06:38:53.263 INFO:teuthology.orchestra.run.trial106.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T06:38:53.263 INFO:teuthology.orchestra.run.trial106.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T06:38:53.263 INFO:teuthology.orchestra.run.trial106.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T06:38:53.264 INFO:teuthology.orchestra.run.trial106.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T06:38:53.264 INFO:teuthology.orchestra.run.trial106.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T06:38:53.264 INFO:teuthology.orchestra.run.trial106.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T06:38:53.264 INFO:teuthology.orchestra.run.trial106.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T06:38:53.264 INFO:teuthology.orchestra.run.trial106.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T06:38:53.264 INFO:teuthology.orchestra.run.trial106.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T06:38:53.264 INFO:teuthology.orchestra.run.trial106.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-12T06:38:53.264 INFO:teuthology.orchestra.run.trial106.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-12T06:38:53.264 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T06:38:53.264 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T06:38:53.264 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T06:38:53.264 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T06:38:53.264 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T06:38:53.265 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T06:38:53.265 INFO:teuthology.orchestra.run.trial106.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T06:38:53.265 INFO:teuthology.orchestra.run.trial106.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T06:38:53.265 INFO:teuthology.orchestra.run.trial106.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T06:38:53.265 INFO:teuthology.orchestra.run.trial106.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T06:38:53.265 INFO:teuthology.orchestra.run.trial106.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-12T06:38:53.265 INFO:teuthology.orchestra.run.trial106.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T06:38:53.265 INFO:teuthology.orchestra.run.trial106.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T06:38:53.265 INFO:teuthology.orchestra.run.trial106.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-12T06:38:53.265 INFO:teuthology.orchestra.run.trial106.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T06:38:53.265 INFO:teuthology.orchestra.run.trial106.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T06:38:53.265 INFO:teuthology.orchestra.run.trial106.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T06:38:53.265 INFO:teuthology.orchestra.run.trial106.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T06:38:53.266 INFO:teuthology.orchestra.run.trial106.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T06:38:53.266 INFO:teuthology.orchestra.run.trial106.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T06:38:53.266 INFO:teuthology.orchestra.run.trial106.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T06:38:53.266 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T06:38:53.266 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T06:38:53.266 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T06:38:53.266 INFO:teuthology.orchestra.run.trial106.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T06:38:53.266 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T06:38:53.266 INFO:teuthology.orchestra.run.trial106.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T06:38:53.266 INFO:teuthology.orchestra.run.trial106.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T06:38:53.266 INFO:teuthology.orchestra.run.trial106.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T06:38:53.266 INFO:teuthology.orchestra.run.trial106.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T06:38:53.266 INFO:teuthology.orchestra.run.trial106.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T06:38:53.266 INFO:teuthology.orchestra.run.trial106.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-12T06:38:53.267 INFO:teuthology.orchestra.run.trial106.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T06:38:53.267 INFO:teuthology.orchestra.run.trial106.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T06:38:53.267 INFO:teuthology.orchestra.run.trial106.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T06:38:53.267 INFO:teuthology.orchestra.run.trial106.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T06:38:53.267 INFO:teuthology.orchestra.run.trial106.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T06:38:53.267 INFO:teuthology.orchestra.run.trial106.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T06:38:53.267 INFO:teuthology.orchestra.run.trial106.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-12T06:38:53.267 INFO:teuthology.orchestra.run.trial106.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T06:38:53.267 INFO:teuthology.orchestra.run.trial106.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T06:38:53.267 INFO:teuthology.orchestra.run.trial106.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T06:38:53.267 INFO:teuthology.orchestra.run.trial106.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-12T06:38:53.267 INFO:teuthology.orchestra.run.trial106.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-12T06:38:53.267 INFO:teuthology.orchestra.run.trial106.stdout: zip-3.0-35.el9.x86_64 2026-02-12T06:38:53.268 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:53.268 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:38:53.327 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-base 2026-02-12T06:38:53.419 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:56 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:38:53.484 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:38:53.503 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:38:53.503 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:38:53.503 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:38:53.525 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install cephadm 2026-02-12T06:38:53.632 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:58 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:38:53.698 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:38:53.716 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:38:53.717 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:38:53.717 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:38:53.739 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install cephadm 2026-02-12T06:38:53.829 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:56 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:38:53.894 INFO:teuthology.orchestra.run.trial058.stdout:Package cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:38:53.912 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:38:53.912 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:38:53.913 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:38:53.934 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T06:38:54.040 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:59 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:38:54.105 INFO:teuthology.orchestra.run.trial106.stdout:Package cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:38:54.123 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:38:54.124 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:38:54.124 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:38:54.145 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T06:38:54.231 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:57 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:38:54.315 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:38:54.315 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:38:54.316 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repo Size 2026-02-12T06:38:54.316 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:38:54.316 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-12T06:38:54.316 INFO:teuthology.orchestra.run.trial058.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 149 k 2026-02-12T06:38:54.316 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:54.316 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-12T06:38:54.316 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:38:54.316 INFO:teuthology.orchestra.run.trial058.stdout:Install 1 Package 2026-02-12T06:38:54.316 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:54.316 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 149 k 2026-02-12T06:38:54.317 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 455 k 2026-02-12T06:38:54.317 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-12T06:38:54.447 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:59 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:38:54.530 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:38:54.531 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:38:54.531 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repo Size 2026-02-12T06:38:54.531 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:38:54.531 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-12T06:38:54.531 INFO:teuthology.orchestra.run.trial106.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 149 k 2026-02-12T06:38:54.531 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:54.532 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-12T06:38:54.532 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:38:54.532 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-12T06:38:54.532 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:54.532 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 149 k 2026-02-12T06:38:54.532 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 455 k 2026-02-12T06:38:54.532 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-12T06:38:54.694 INFO:teuthology.orchestra.run.trial058.stdout:ceph-immutable-object-cache-20.3.0-5145.g5fdb7d 393 kB/s | 149 kB 00:00 2026-02-12T06:38:54.695 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:38:54.695 INFO:teuthology.orchestra.run.trial058.stdout:Total 392 kB/s | 149 kB 00:00 2026-02-12T06:38:54.695 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-12T06:38:54.700 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-12T06:38:54.700 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-12T06:38:54.732 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-12T06:38:54.732 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-12T06:38:54.788 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-12T06:38:54.789 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f. 1/1 2026-02-12T06:38:54.812 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f. 1/1 2026-02-12T06:38:54.812 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T06:38:54.812 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T06:38:54.813 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:54.832 INFO:teuthology.orchestra.run.trial106.stdout:ceph-immutable-object-cache-20.3.0-5145.g5fdb7d 495 kB/s | 149 kB 00:00 2026-02-12T06:38:54.833 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:38:54.833 INFO:teuthology.orchestra.run.trial106.stdout:Total 493 kB/s | 149 kB 00:00 2026-02-12T06:38:54.833 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-12T06:38:54.838 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-12T06:38:54.838 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-12T06:38:54.870 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-12T06:38:54.870 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-12T06:38:54.925 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-12T06:38:54.927 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f. 1/1 2026-02-12T06:38:54.949 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f. 1/1 2026-02-12T06:38:54.949 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T06:38:54.949 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T06:38:54.949 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:55.115 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f. 1/1 2026-02-12T06:38:55.115 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:55.115 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-12T06:38:55.116 INFO:teuthology.orchestra.run.trial058.stdout: ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:55.116 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:55.116 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:38:55.143 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-mgr 2026-02-12T06:38:55.240 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f. 1/1 2026-02-12T06:38:55.240 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:55.241 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-12T06:38:55.241 INFO:teuthology.orchestra.run.trial106.stdout: ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:55.241 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:55.241 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:38:55.268 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr 2026-02-12T06:38:55.444 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:58 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:38:55.509 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:38:55.528 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:38:55.528 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:38:55.528 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:38:55.549 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T06:38:55.575 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:00 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:38:55.640 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:38:55.659 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:38:55.660 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:38:55.660 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:38:55.681 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T06:38:55.844 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:58 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:38:55.907 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:38:55.926 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:38:55.926 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:38:55.927 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:38:55.948 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T06:38:55.987 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:00 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:38:56.051 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:38:56.070 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:38:56.070 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:38:56.071 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:38:56.092 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T06:38:56.244 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:59 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:38:56.308 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:38:56.327 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:38:56.327 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:38:56.327 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:38:56.348 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-mgr-rook 2026-02-12T06:38:56.394 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:01 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:38:56.459 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:38:56.477 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:38:56.478 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:38:56.478 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:38:56.499 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr-rook 2026-02-12T06:38:56.648 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:59 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:38:56.713 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:38:56.731 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:38:56.732 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:38:56.732 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:38:56.753 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T06:38:56.798 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:01 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:38:56.863 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:38:56.881 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:38:56.882 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:38:56.882 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:38:56.903 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T06:38:57.060 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:00 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:38:57.126 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:38:57.144 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:38:57.145 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:38:57.145 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:38:57.167 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-osd 2026-02-12T06:38:57.206 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:02 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:38:57.272 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:38:57.291 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:38:57.291 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:38:57.291 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:38:57.313 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-osd 2026-02-12T06:38:57.467 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:00 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:38:57.532 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:38:57.550 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:38:57.551 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:38:57.551 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:38:57.572 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-osd-classic 2026-02-12T06:38:57.613 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:02 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:38:57.679 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:38:57.697 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:38:57.698 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:38:57.698 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:38:57.719 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-osd-classic 2026-02-12T06:38:57.874 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:00 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:38:57.940 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:38:57.958 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:38:57.959 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:38:57.959 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:38:57.981 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-fuse 2026-02-12T06:38:58.023 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:03 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:38:58.088 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:38:58.107 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:38:58.107 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:38:58.107 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:38:58.129 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-fuse 2026-02-12T06:38:58.280 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:01 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:38:58.364 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:38:58.365 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:38:58.365 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repo Size 2026-02-12T06:38:58.365 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:38:58.365 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-12T06:38:58.365 INFO:teuthology.orchestra.run.trial058.stdout: ceph-fuse x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 914 k 2026-02-12T06:38:58.365 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:58.365 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-12T06:38:58.365 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:38:58.365 INFO:teuthology.orchestra.run.trial058.stdout:Install 1 Package 2026-02-12T06:38:58.365 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:58.366 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 914 k 2026-02-12T06:38:58.366 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 2.9 M 2026-02-12T06:38:58.366 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-12T06:38:58.434 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:03 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:38:58.518 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:38:58.518 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:38:58.518 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repo Size 2026-02-12T06:38:58.518 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:38:58.518 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-12T06:38:58.518 INFO:teuthology.orchestra.run.trial106.stdout: ceph-fuse x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 914 k 2026-02-12T06:38:58.519 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:58.519 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-12T06:38:58.519 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:38:58.519 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-12T06:38:58.519 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:58.519 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 914 k 2026-02-12T06:38:58.519 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 2.9 M 2026-02-12T06:38:58.519 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-12T06:38:58.520 INFO:teuthology.orchestra.run.trial058.stdout:ceph-fuse-20.3.0-5145.g5fdb7d8f.el9.x86_64.rpm 5.8 MB/s | 914 kB 00:00 2026-02-12T06:38:58.520 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:38:58.520 INFO:teuthology.orchestra.run.trial058.stdout:Total 5.8 MB/s | 914 kB 00:00 2026-02-12T06:38:58.520 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-12T06:38:58.523 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-12T06:38:58.523 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-12T06:38:58.558 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-12T06:38:58.558 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-12T06:38:58.637 INFO:teuthology.orchestra.run.trial106.stdout:ceph-fuse-20.3.0-5145.g5fdb7d8f.el9.x86_64.rpm 7.5 MB/s | 914 kB 00:00 2026-02-12T06:38:58.637 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:38:58.638 INFO:teuthology.orchestra.run.trial106.stdout:Total 7.5 MB/s | 914 kB 00:00 2026-02-12T06:38:58.638 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-12T06:38:58.642 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-12T06:38:58.642 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-12T06:38:58.648 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-12T06:38:58.665 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:38:58.676 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-12T06:38:58.677 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-12T06:38:58.768 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-12T06:38:58.785 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:38:58.883 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:38:58.939 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:38:58.939 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:58.939 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-12T06:38:58.939 INFO:teuthology.orchestra.run.trial058.stdout: ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:58.939 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:58.939 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:38:58.966 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-volume 2026-02-12T06:38:59.000 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:38:59.056 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:38:59.056 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:59.056 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-12T06:38:59.056 INFO:teuthology.orchestra.run.trial106.stdout: ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:38:59.056 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:59.056 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:38:59.083 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-volume 2026-02-12T06:38:59.270 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:02 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:38:59.335 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:38:59.352 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:38:59.353 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:38:59.353 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:38:59.375 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install librados-devel 2026-02-12T06:38:59.388 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:04 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:38:59.452 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:38:59.469 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:38:59.470 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:38:59.470 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:38:59.491 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install librados-devel 2026-02-12T06:38:59.672 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:02 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:38:59.754 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:38:59.755 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:38:59.755 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repo Size 2026-02-12T06:38:59.755 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:38:59.755 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-12T06:38:59.755 INFO:teuthology.orchestra.run.trial058.stdout: librados-devel x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 124 k 2026-02-12T06:38:59.756 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:59.756 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-12T06:38:59.756 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:38:59.756 INFO:teuthology.orchestra.run.trial058.stdout:Install 1 Package 2026-02-12T06:38:59.756 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:38:59.756 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 124 k 2026-02-12T06:38:59.756 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 434 k 2026-02-12T06:38:59.756 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-12T06:38:59.797 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:04 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:38:59.880 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:38:59.881 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:38:59.881 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repo Size 2026-02-12T06:38:59.881 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:38:59.881 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-12T06:38:59.881 INFO:teuthology.orchestra.run.trial106.stdout: librados-devel x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 124 k 2026-02-12T06:38:59.881 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:59.881 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-12T06:38:59.881 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:38:59.881 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-12T06:38:59.882 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:38:59.882 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 124 k 2026-02-12T06:38:59.882 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 434 k 2026-02-12T06:38:59.882 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-12T06:38:59.960 INFO:teuthology.orchestra.run.trial058.stdout:librados-devel-20.3.0-5145.g5fdb7d8f.el9.x86_64 606 kB/s | 124 kB 00:00 2026-02-12T06:38:59.960 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:38:59.960 INFO:teuthology.orchestra.run.trial058.stdout:Total 604 kB/s | 124 kB 00:00 2026-02-12T06:38:59.960 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-12T06:38:59.963 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-12T06:38:59.963 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-12T06:38:59.989 INFO:teuthology.orchestra.run.trial106.stdout:librados-devel-20.3.0-5145.g5fdb7d8f.el9.x86_64 1.1 MB/s | 124 kB 00:00 2026-02-12T06:38:59.989 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:38:59.990 INFO:teuthology.orchestra.run.trial106.stdout:Total 1.1 MB/s | 124 kB 00:00 2026-02-12T06:38:59.990 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-12T06:38:59.993 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-12T06:38:59.993 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-12T06:38:59.995 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-12T06:38:59.995 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-12T06:39:00.025 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-12T06:39:00.025 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-12T06:39:00.049 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-12T06:39:00.066 INFO:teuthology.orchestra.run.trial058.stdout: Installing : librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:00.079 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-12T06:39:00.096 INFO:teuthology.orchestra.run.trial106.stdout: Installing : librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:00.146 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:00.175 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:00.202 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:00.202 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:00.202 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-12T06:39:00.203 INFO:teuthology.orchestra.run.trial058.stdout: librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:39:00.203 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:00.203 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:39:00.231 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install libcephfs2 2026-02-12T06:39:00.232 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:00.232 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:00.232 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-12T06:39:00.232 INFO:teuthology.orchestra.run.trial106.stdout: librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:39:00.233 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:00.233 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:39:00.258 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install libcephfs2 2026-02-12T06:39:00.538 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:03 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:39:00.554 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:05 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:39:00.603 INFO:teuthology.orchestra.run.trial058.stdout:Package libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:39:00.619 INFO:teuthology.orchestra.run.trial106.stdout:Package libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:39:00.620 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:39:00.621 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:39:00.621 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:39:00.637 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:39:00.637 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:39:00.637 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:39:00.642 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install libcephfs-devel 2026-02-12T06:39:00.658 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install libcephfs-devel 2026-02-12T06:39:00.945 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:03 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:39:00.957 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:05 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:39:01.028 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:39:01.029 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:39:01.029 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repo Size 2026-02-12T06:39:01.029 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:39:01.029 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-12T06:39:01.029 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-devel x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 37 k 2026-02-12T06:39:01.029 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:01.029 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-12T06:39:01.029 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:39:01.029 INFO:teuthology.orchestra.run.trial058.stdout:Install 1 Package 2026-02-12T06:39:01.030 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:01.030 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 37 k 2026-02-12T06:39:01.030 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 171 k 2026-02-12T06:39:01.030 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-12T06:39:01.040 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:39:01.041 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:39:01.041 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repo Size 2026-02-12T06:39:01.041 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:39:01.041 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-12T06:39:01.041 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs-devel x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 37 k 2026-02-12T06:39:01.041 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:01.042 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-12T06:39:01.042 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:39:01.042 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-12T06:39:01.042 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:01.042 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 37 k 2026-02-12T06:39:01.042 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 171 k 2026-02-12T06:39:01.042 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-12T06:39:01.110 INFO:teuthology.orchestra.run.trial058.stdout:libcephfs-devel-20.3.0-5145.g5fdb7d8f.el9.x86_6 458 kB/s | 37 kB 00:00 2026-02-12T06:39:01.111 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:39:01.111 INFO:teuthology.orchestra.run.trial058.stdout:Total 454 kB/s | 37 kB 00:00 2026-02-12T06:39:01.111 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-12T06:39:01.113 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-12T06:39:01.113 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-12T06:39:01.116 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-12T06:39:01.116 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-12T06:39:01.138 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-12T06:39:01.154 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:01.206 INFO:teuthology.orchestra.run.trial106.stdout:libcephfs-devel-20.3.0-5145.g5fdb7d8f.el9.x86_6 227 kB/s | 37 kB 00:00 2026-02-12T06:39:01.207 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:39:01.207 INFO:teuthology.orchestra.run.trial106.stdout:Total 224 kB/s | 37 kB 00:00 2026-02-12T06:39:01.207 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-12T06:39:01.208 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:01.210 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-12T06:39:01.210 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-12T06:39:01.213 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-12T06:39:01.213 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-12T06:39:01.236 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-12T06:39:01.252 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:01.264 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:01.264 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:01.264 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-12T06:39:01.264 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:39:01.264 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:01.264 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:39:01.291 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install librados2 2026-02-12T06:39:01.309 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:01.365 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:01.365 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:01.365 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-12T06:39:01.365 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:39:01.365 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:01.366 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:39:01.392 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install librados2 2026-02-12T06:39:01.593 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:04 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:39:01.658 INFO:teuthology.orchestra.run.trial058.stdout:Package librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:39:01.675 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:39:01.676 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:39:01.676 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:39:01.693 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:06 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:39:01.697 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install librbd1 2026-02-12T06:39:01.757 INFO:teuthology.orchestra.run.trial106.stdout:Package librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:39:01.774 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:39:01.775 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:39:01.775 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:39:01.796 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install librbd1 2026-02-12T06:39:02.003 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:05 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:39:02.067 INFO:teuthology.orchestra.run.trial058.stdout:Package librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:39:02.085 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:39:02.085 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:39:02.085 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:39:02.096 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:07 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:39:02.106 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install python3-rados 2026-02-12T06:39:02.161 INFO:teuthology.orchestra.run.trial106.stdout:Package librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:39:02.178 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:39:02.179 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:39:02.179 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:39:02.201 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install python3-rados 2026-02-12T06:39:02.406 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:05 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:39:02.471 INFO:teuthology.orchestra.run.trial058.stdout:Package python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:39:02.488 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:39:02.488 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:39:02.489 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:39:02.499 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:07 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:39:02.509 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install python3-rgw 2026-02-12T06:39:02.565 INFO:teuthology.orchestra.run.trial106.stdout:Package python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:39:02.582 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:39:02.582 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:39:02.583 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:39:02.604 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install python3-rgw 2026-02-12T06:39:02.814 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:05 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:39:02.879 INFO:teuthology.orchestra.run.trial058.stdout:Package python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:39:02.896 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:39:02.897 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:39:02.897 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:39:02.908 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:07 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:39:02.918 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install python3-cephfs 2026-02-12T06:39:02.973 INFO:teuthology.orchestra.run.trial106.stdout:Package python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:39:02.990 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:39:02.991 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:39:02.991 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:39:03.014 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install python3-cephfs 2026-02-12T06:39:03.216 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:06 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:39:03.281 INFO:teuthology.orchestra.run.trial058.stdout:Package python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:39:03.298 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:39:03.298 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:39:03.298 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:39:03.316 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:08 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:39:03.320 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install python3-rbd 2026-02-12T06:39:03.382 INFO:teuthology.orchestra.run.trial106.stdout:Package python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:39:03.399 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:39:03.400 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:39:03.400 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:39:03.421 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install python3-rbd 2026-02-12T06:39:03.619 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:06 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:39:03.685 INFO:teuthology.orchestra.run.trial058.stdout:Package python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:39:03.702 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:39:03.702 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:39:03.703 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:39:03.725 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install rbd-fuse 2026-02-12T06:39:03.726 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:08 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:39:03.789 INFO:teuthology.orchestra.run.trial106.stdout:Package python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:39:03.806 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:39:03.807 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:39:03.807 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:39:03.828 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install rbd-fuse 2026-02-12T06:39:04.021 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:07 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:39:04.103 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:39:04.103 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:39:04.103 INFO:teuthology.orchestra.run.trial058.stdout: Package Architecture Version Repository Size 2026-02-12T06:39:04.103 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:39:04.103 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-12T06:39:04.104 INFO:teuthology.orchestra.run.trial058.stdout: rbd-fuse x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 87 k 2026-02-12T06:39:04.104 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:04.104 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-12T06:39:04.104 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:39:04.104 INFO:teuthology.orchestra.run.trial058.stdout:Install 1 Package 2026-02-12T06:39:04.104 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:04.104 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 87 k 2026-02-12T06:39:04.104 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 236 k 2026-02-12T06:39:04.104 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-12T06:39:04.131 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:09 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:39:04.213 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:39:04.214 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:39:04.214 INFO:teuthology.orchestra.run.trial106.stdout: Package Architecture Version Repository Size 2026-02-12T06:39:04.214 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:39:04.214 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-12T06:39:04.214 INFO:teuthology.orchestra.run.trial106.stdout: rbd-fuse x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 87 k 2026-02-12T06:39:04.214 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:04.214 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-12T06:39:04.215 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:39:04.215 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-12T06:39:04.215 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:04.215 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 87 k 2026-02-12T06:39:04.215 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 236 k 2026-02-12T06:39:04.215 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-12T06:39:04.436 INFO:teuthology.orchestra.run.trial058.stdout:rbd-fuse-20.3.0-5145.g5fdb7d8f.el9.x86_64.rpm 260 kB/s | 87 kB 00:00 2026-02-12T06:39:04.436 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:39:04.437 INFO:teuthology.orchestra.run.trial058.stdout:Total 260 kB/s | 87 kB 00:00 2026-02-12T06:39:04.437 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-12T06:39:04.441 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-12T06:39:04.441 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-12T06:39:04.472 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-12T06:39:04.473 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-12T06:39:04.524 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-12T06:39:04.540 INFO:teuthology.orchestra.run.trial058.stdout: Installing : rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:04.555 INFO:teuthology.orchestra.run.trial106.stdout:rbd-fuse-20.3.0-5145.g5fdb7d8f.el9.x86_64.rpm 254 kB/s | 87 kB 00:00 2026-02-12T06:39:04.555 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:39:04.555 INFO:teuthology.orchestra.run.trial106.stdout:Total 253 kB/s | 87 kB 00:00 2026-02-12T06:39:04.555 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-12T06:39:04.560 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-12T06:39:04.560 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-12T06:39:04.592 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-12T06:39:04.592 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-12T06:39:04.616 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:04.643 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-12T06:39:04.660 INFO:teuthology.orchestra.run.trial106.stdout: Installing : rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:04.673 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:04.673 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:04.673 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-12T06:39:04.673 INFO:teuthology.orchestra.run.trial058.stdout: rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:39:04.673 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:04.673 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:39:04.702 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install rbd-mirror 2026-02-12T06:39:04.741 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:04.797 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:04.797 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:04.798 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-12T06:39:04.798 INFO:teuthology.orchestra.run.trial106.stdout: rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:39:04.798 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:04.798 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:39:04.825 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install rbd-mirror 2026-02-12T06:39:05.007 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:08 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:39:05.089 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:39:05.090 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:39:05.090 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repo Size 2026-02-12T06:39:05.090 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:39:05.090 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-12T06:39:05.090 INFO:teuthology.orchestra.run.trial058.stdout: rbd-mirror x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 2.6 M 2026-02-12T06:39:05.090 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:05.090 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-12T06:39:05.090 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:39:05.090 INFO:teuthology.orchestra.run.trial058.stdout:Install 1 Package 2026-02-12T06:39:05.091 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:05.091 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 2.6 M 2026-02-12T06:39:05.091 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 11 M 2026-02-12T06:39:05.091 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-12T06:39:05.131 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:10 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:39:05.213 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:39:05.214 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:39:05.214 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repo Size 2026-02-12T06:39:05.214 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:39:05.215 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-12T06:39:05.215 INFO:teuthology.orchestra.run.trial106.stdout: rbd-mirror x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 2.6 M 2026-02-12T06:39:05.215 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:05.215 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-12T06:39:05.215 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:39:05.215 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-12T06:39:05.215 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:05.215 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 2.6 M 2026-02-12T06:39:05.215 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 11 M 2026-02-12T06:39:05.215 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-12T06:39:06.001 INFO:teuthology.orchestra.run.trial058.stdout:rbd-mirror-20.3.0-5145.g5fdb7d8f.el9.x86_64.rpm 2.8 MB/s | 2.6 MB 00:00 2026-02-12T06:39:06.002 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:39:06.002 INFO:teuthology.orchestra.run.trial058.stdout:Total 2.8 MB/s | 2.6 MB 00:00 2026-02-12T06:39:06.002 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-12T06:39:06.007 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-12T06:39:06.008 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-12T06:39:06.047 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-12T06:39:06.047 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-12T06:39:06.209 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-12T06:39:06.211 INFO:teuthology.orchestra.run.trial058.stdout: Installing : rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:06.233 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:06.234 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T06:39:06.234 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T06:39:06.234 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T06:39:06.234 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T06:39:06.234 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:06.251 INFO:teuthology.orchestra.run.trial106.stdout:rbd-mirror-20.3.0-5145.g5fdb7d8f.el9.x86_64.rpm 2.5 MB/s | 2.6 MB 00:01 2026-02-12T06:39:06.251 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:39:06.252 INFO:teuthology.orchestra.run.trial106.stdout:Total 2.5 MB/s | 2.6 MB 00:01 2026-02-12T06:39:06.252 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-12T06:39:06.256 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-12T06:39:06.256 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-12T06:39:06.295 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-12T06:39:06.295 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-12T06:39:06.458 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-12T06:39:06.459 INFO:teuthology.orchestra.run.trial106.stdout: Installing : rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:06.481 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:06.481 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T06:39:06.481 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T06:39:06.481 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T06:39:06.482 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T06:39:06.482 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:06.539 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:06.539 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:06.540 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-12T06:39:06.540 INFO:teuthology.orchestra.run.trial058.stdout: rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:39:06.540 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:06.540 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:39:06.567 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install rbd-nbd 2026-02-12T06:39:06.792 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:06.792 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:06.792 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-12T06:39:06.792 INFO:teuthology.orchestra.run.trial106.stdout: rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:39:06.792 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:06.792 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:39:06.820 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install rbd-nbd 2026-02-12T06:39:06.868 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:09 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:39:06.951 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:39:06.951 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:39:06.951 INFO:teuthology.orchestra.run.trial058.stdout: Package Architecture Version Repository Size 2026-02-12T06:39:06.951 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:39:06.951 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-12T06:39:06.951 INFO:teuthology.orchestra.run.trial058.stdout: rbd-nbd x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 167 k 2026-02-12T06:39:06.951 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:06.952 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-12T06:39:06.952 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:39:06.952 INFO:teuthology.orchestra.run.trial058.stdout:Install 1 Package 2026-02-12T06:39:06.952 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:06.952 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 167 k 2026-02-12T06:39:06.952 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 496 k 2026-02-12T06:39:06.952 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-12T06:39:07.127 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:12 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:39:07.209 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:39:07.210 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:39:07.210 INFO:teuthology.orchestra.run.trial106.stdout: Package Architecture Version Repository Size 2026-02-12T06:39:07.210 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:39:07.210 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-12T06:39:07.210 INFO:teuthology.orchestra.run.trial106.stdout: rbd-nbd x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 167 k 2026-02-12T06:39:07.210 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:07.210 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-12T06:39:07.211 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:39:07.211 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-12T06:39:07.211 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:07.211 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 167 k 2026-02-12T06:39:07.211 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 496 k 2026-02-12T06:39:07.211 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-12T06:39:07.247 INFO:teuthology.orchestra.run.trial058.stdout:rbd-nbd-20.3.0-5145.g5fdb7d8f.el9.x86_64.rpm 563 kB/s | 167 kB 00:00 2026-02-12T06:39:07.248 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:39:07.248 INFO:teuthology.orchestra.run.trial058.stdout:Total 561 kB/s | 167 kB 00:00 2026-02-12T06:39:07.248 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-12T06:39:07.253 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-12T06:39:07.253 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-12T06:39:07.285 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-12T06:39:07.285 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-12T06:39:07.341 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-12T06:39:07.357 INFO:teuthology.orchestra.run.trial058.stdout: Installing : rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:07.436 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:07.493 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:07.493 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:07.493 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-12T06:39:07.493 INFO:teuthology.orchestra.run.trial058.stdout: rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:39:07.494 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:07.494 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:39:07.513 INFO:teuthology.orchestra.run.trial106.stdout:rbd-nbd-20.3.0-5145.g5fdb7d8f.el9.x86_64.rpm 551 kB/s | 167 kB 00:00 2026-02-12T06:39:07.513 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:39:07.513 INFO:teuthology.orchestra.run.trial106.stdout:Total 548 kB/s | 167 kB 00:00 2026-02-12T06:39:07.513 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-12T06:39:07.518 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-12T06:39:07.518 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-12T06:39:07.523 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-osd-crimson 2026-02-12T06:39:07.550 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-12T06:39:07.550 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-12T06:39:07.606 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-12T06:39:07.623 INFO:teuthology.orchestra.run.trial106.stdout: Installing : rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:07.703 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:07.760 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/1 2026-02-12T06:39:07.760 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:07.760 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-12T06:39:07.760 INFO:teuthology.orchestra.run.trial106.stdout: rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:39:07.761 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:07.761 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:39:07.789 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-osd-crimson 2026-02-12T06:39:07.833 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:10 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:39:07.898 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:39:07.915 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:39:07.916 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:39:07.916 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:39:07.939 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-12T06:39:08.092 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:13 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:39:08.156 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-osd-crimson-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:39:08.174 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:39:08.174 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:39:08.175 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:39:08.197 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-12T06:39:08.253 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:11 ago on Thu 12 Feb 2026 06:37:57 AM UTC. 2026-02-12T06:39:08.337 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:39:08.337 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:39:08.337 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repo Size 2026-02-12T06:39:08.337 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:39:08.337 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-12T06:39:08.337 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 429 M 2026-02-12T06:39:08.337 INFO:teuthology.orchestra.run.trial058.stdout:Installing weak dependencies: 2026-02-12T06:39:08.337 INFO:teuthology.orchestra.run.trial058.stdout: ceph-debugsource x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 12 M 2026-02-12T06:39:08.338 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:08.338 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-12T06:39:08.338 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-12T06:39:08.338 INFO:teuthology.orchestra.run.trial058.stdout:Install 2 Packages 2026-02-12T06:39:08.338 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:39:08.338 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 441 M 2026-02-12T06:39:08.338 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 2.7 G 2026-02-12T06:39:08.338 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-12T06:39:08.501 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:01:13 ago on Thu 12 Feb 2026 06:37:55 AM UTC. 2026-02-12T06:39:08.584 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:39:08.584 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:39:08.584 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repo Size 2026-02-12T06:39:08.585 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:39:08.585 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-12T06:39:08.585 INFO:teuthology.orchestra.run.trial106.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 429 M 2026-02-12T06:39:08.585 INFO:teuthology.orchestra.run.trial106.stdout:Installing weak dependencies: 2026-02-12T06:39:08.585 INFO:teuthology.orchestra.run.trial106.stdout: ceph-debugsource x86_64 2:20.3.0-5145.g5fdb7d8f.el9 ceph 12 M 2026-02-12T06:39:08.585 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:08.585 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-12T06:39:08.585 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-12T06:39:08.585 INFO:teuthology.orchestra.run.trial106.stdout:Install 2 Packages 2026-02-12T06:39:08.585 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:39:08.585 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 441 M 2026-02-12T06:39:08.586 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 2.7 G 2026-02-12T06:39:08.586 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-12T06:39:10.043 INFO:teuthology.orchestra.run.trial058.stdout:(1/2): ceph-debugsource-20.3.0-5145.g5fdb7d8f.e 7.0 MB/s | 12 MB 00:01 2026-02-12T06:39:11.770 INFO:teuthology.orchestra.run.trial106.stdout:(1/2): ceph-debugsource-20.3.0-5145.g5fdb7d8f.e 3.8 MB/s | 12 MB 00:03 2026-02-12T06:39:48.550 INFO:teuthology.orchestra.run.trial106.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5145.g 11 MB/s | 429 MB 00:39 2026-02-12T06:39:48.551 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:39:48.551 INFO:teuthology.orchestra.run.trial106.stdout:Total 11 MB/s | 441 MB 00:39 2026-02-12T06:39:48.551 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-12T06:39:48.557 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-12T06:39:48.557 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-12T06:39:49.920 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-12T06:39:49.920 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-12T06:39:50.565 INFO:teuthology.orchestra.run.trial058.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5145.g 10 MB/s | 429 MB 00:42 2026-02-12T06:39:50.566 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-12T06:39:50.566 INFO:teuthology.orchestra.run.trial058.stdout:Total 10 MB/s | 441 MB 00:42 2026-02-12T06:39:50.566 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-12T06:39:50.571 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-12T06:39:50.571 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-12T06:39:51.929 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-12T06:39:51.929 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-12T06:39:53.505 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-12T06:39:55.480 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-12T06:40:15.625 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-debugsource-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/2 2026-02-12T06:40:15.642 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5145.g5fdb7d8f.e 2/2 2026-02-12T06:40:17.478 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-debugsource-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/2 2026-02-12T06:40:17.495 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5145.g5fdb7d8f.e 2/2 2026-02-12T06:40:17.572 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5145.g5fdb7d8f.e 2/2 2026-02-12T06:40:17.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-debugsource-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/2 2026-02-12T06:40:17.630 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5145.g5fdb7d8f.e 2/2 2026-02-12T06:40:17.631 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:40:17.631 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-12T06:40:17.631 INFO:teuthology.orchestra.run.trial106.stdout: ceph-debugsource-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:40:17.631 INFO:teuthology.orchestra.run.trial106.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:40:17.631 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:40:17.632 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:40:17.700 DEBUG:teuthology.parallel:result is None 2026-02-12T06:40:19.511 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5145.g5fdb7d8f.e 2/2 2026-02-12T06:40:19.511 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-debugsource-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 1/2 2026-02-12T06:40:19.571 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5145.g5fdb7d8f.e 2/2 2026-02-12T06:40:19.571 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:40:19.571 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-12T06:40:19.571 INFO:teuthology.orchestra.run.trial058.stdout: ceph-debugsource-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:40:19.571 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 2026-02-12T06:40:19.571 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:40:19.571 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:19.640 DEBUG:teuthology.parallel:result is None 2026-02-12T06:40:19.641 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T06:40:19.761 DEBUG:teuthology.orchestra.run.trial058:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T06:40:19.782 INFO:teuthology.orchestra.run.trial058.stdout:20.3.0-5145.g5fdb7d8f.el9 2026-02-12T06:40:19.783 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5145.g5fdb7d8f.el9 2026-02-12T06:40:19.783 INFO:teuthology.task.install:The correct ceph version 20.3.0-5145.g5fdb7d8f is installed. 2026-02-12T06:40:19.784 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T06:40:19.898 DEBUG:teuthology.orchestra.run.trial106:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T06:40:19.920 INFO:teuthology.orchestra.run.trial106.stdout:20.3.0-5145.g5fdb7d8f.el9 2026-02-12T06:40:19.920 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5145.g5fdb7d8f.el9 2026-02-12T06:40:19.920 INFO:teuthology.task.install:The correct ceph version 20.3.0-5145.g5fdb7d8f is installed. 2026-02-12T06:40:19.921 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-12T06:40:19.921 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:40:19.921 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T06:40:19.946 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-12T06:40:19.946 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T06:40:19.984 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-12T06:40:19.985 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:40:19.985 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T06:40:20.009 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T06:40:20.071 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-12T06:40:20.071 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T06:40:20.095 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T06:40:20.159 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-12T06:40:20.159 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:40:20.159 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T06:40:20.182 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T06:40:20.245 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-12T06:40:20.245 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T06:40:20.270 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T06:40:20.335 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-12T06:40:20.335 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:40:20.335 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T06:40:20.359 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T06:40:20.421 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-12T06:40:20.421 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T06:40:20.445 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T06:40:20.509 INFO:teuthology.run_tasks:Running task pexec... 2026-02-12T06:40:20.525 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-12T06:40:20.526 DEBUG:teuthology.orchestra.run.trial058:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-12T06:40:20.526 DEBUG:teuthology.orchestra.run.trial106:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-12T06:40:20.527 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial058.front.sepia.ceph.com 2026-02-12T06:40:20.527 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-12T06:40:20.551 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial106.front.sepia.ceph.com 2026-02-12T06:40:20.551 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-12T06:40:20.578 DEBUG:teuthology.parallel:result is None 2026-02-12T06:40:20.600 DEBUG:teuthology.parallel:result is None 2026-02-12T06:40:20.600 INFO:teuthology.run_tasks:Running task install... 2026-02-12T06:40:20.611 DEBUG:teuthology.task.install:project ceph 2026-02-12T06:40:20.611 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}} 2026-02-12T06:40:20.611 DEBUG:teuthology.task.install:config {'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'} 2026-02-12T06:40:20.611 INFO:teuthology.task.install:Using flavor: debug 2026-02-12T06:40:20.614 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-12T06:40:20.614 INFO:teuthology.task.install:extra packages: [] 2026-02-12T06:40:20.614 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0', 'tag': None, 'wait_for_package': False} 2026-02-12T06:40:20.614 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T06:40:20.615 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0', 'tag': None, 'wait_for_package': False} 2026-02-12T06:40:20.615 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T06:40:20.762 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/ 2026-02-12T06:40:20.762 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5145.g5fdb7d8f 2026-02-12T06:40:20.776 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/ 2026-02-12T06:40:20.776 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5145.g5fdb7d8f 2026-02-12T06:40:21.056 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T06:40:21.056 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:40:21.056 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T06:40:21.081 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-12T06:40:21.082 DEBUG:teuthology.orchestra.run.trial058:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T06:40:21.100 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-moagrawa-seastore-io-uring-again-crimson-only/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T06:40:21.101 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-12T06:40:21.101 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T06:40:21.126 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-12T06:40:21.127 DEBUG:teuthology.orchestra.run.trial106:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T06:40:21.145 DEBUG:teuthology.orchestra.run.trial058:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T06:40:21.190 DEBUG:teuthology.orchestra.run.trial106:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T06:40:21.210 DEBUG:teuthology.orchestra.run.trial058:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T06:40:21.254 DEBUG:teuthology.orchestra.run.trial106:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T06:40:21.265 INFO:teuthology.orchestra.run.trial058.stdout:check_obsoletes = 1 2026-02-12T06:40:21.274 DEBUG:teuthology.orchestra.run.trial058:> sudo yum clean all 2026-02-12T06:40:21.309 INFO:teuthology.orchestra.run.trial106.stdout:check_obsoletes = 1 2026-02-12T06:40:21.318 DEBUG:teuthology.orchestra.run.trial106:> sudo yum clean all 2026-02-12T06:40:21.436 INFO:teuthology.orchestra.run.trial058.stdout:56 files removed 2026-02-12T06:40:21.451 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-radosgw 2026-02-12T06:40:21.480 INFO:teuthology.orchestra.run.trial106.stdout:56 files removed 2026-02-12T06:40:21.494 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-radosgw 2026-02-12T06:40:22.166 INFO:teuthology.orchestra.run.trial058.stdout:ceph packages for x86_64 173 kB/s | 94 kB 00:00 2026-02-12T06:40:22.178 INFO:teuthology.orchestra.run.trial106.stdout:ceph packages for x86_64 176 kB/s | 94 kB 00:00 2026-02-12T06:40:22.760 INFO:teuthology.orchestra.run.trial058.stdout:ceph noarch packages 43 kB/s | 24 kB 00:00 2026-02-12T06:40:22.765 INFO:teuthology.orchestra.run.trial106.stdout:ceph noarch packages 43 kB/s | 24 kB 00:00 2026-02-12T06:40:23.217 INFO:teuthology.orchestra.run.trial106.stdout:ceph source packages 4.8 kB/s | 2.1 kB 00:00 2026-02-12T06:40:23.231 INFO:teuthology.orchestra.run.trial058.stdout:ceph source packages 4.6 kB/s | 2.1 kB 00:00 2026-02-12T06:40:24.249 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - BaseOS 8.9 MB/s | 8.9 MB 00:00 2026-02-12T06:40:27.437 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-12T06:40:30.845 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 7.8 MB 00:01 2026-02-12T06:40:32.176 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-12T06:40:32.815 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 20 kB 00:01 2026-02-12T06:40:33.834 INFO:teuthology.orchestra.run.trial058.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2026-02-12T06:40:35.278 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-12T06:40:37.070 INFO:teuthology.orchestra.run.trial058.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-12T06:40:38.324 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:38.341 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:38.342 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:38.342 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:38.366 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-test 2026-02-12T06:40:38.668 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:01 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:38.731 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:38.749 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:38.749 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:38.749 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:38.771 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph 2026-02-12T06:40:39.036 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - CRB 5.6 MB/s | 7.8 MB 00:01 2026-02-12T06:40:39.066 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:02 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:39.129 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:39.147 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:39.148 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:39.148 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:39.170 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-base 2026-02-12T06:40:39.466 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:02 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:39.530 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:39.547 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:39.548 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:39.548 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:39.570 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install cephadm 2026-02-12T06:40:39.865 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:02 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:39.930 INFO:teuthology.orchestra.run.trial058.stdout:Package cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:40:39.947 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:39.947 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:39.948 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:39.970 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T06:40:40.315 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:03 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:40.381 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:40.398 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:40.399 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:40.399 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:40.421 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-mgr 2026-02-12T06:40:40.562 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 20 kB 00:00 2026-02-12T06:40:40.718 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:03 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:40.782 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:40.799 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:40.800 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:40.800 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:40.822 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T06:40:41.121 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:41.186 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:40:41.203 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:41.204 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:41.204 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:41.226 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T06:40:41.529 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:41.594 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:40:41.611 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:41.612 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:41.612 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:41.634 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-mgr-rook 2026-02-12T06:40:41.932 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:41.997 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:40:42.015 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:42.015 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:42.015 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:42.037 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T06:40:42.333 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:05 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:42.397 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:40:42.415 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:42.415 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:42.416 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:42.437 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-osd 2026-02-12T06:40:42.731 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:05 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:42.795 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:42.812 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:42.813 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:42.813 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:42.834 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-osd-classic 2026-02-12T06:40:43.134 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:43.199 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:43.216 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:43.217 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:43.217 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:43.239 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-fuse 2026-02-12T06:40:43.535 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:43.599 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:43.616 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:43.617 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:43.617 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:43.639 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-volume 2026-02-12T06:40:43.941 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:44.006 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:40:44.023 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:44.024 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:44.024 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:44.046 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install librados-devel 2026-02-12T06:40:44.372 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:07 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:44.437 INFO:teuthology.orchestra.run.trial058.stdout:Package librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:44.454 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:44.454 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:44.455 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:44.476 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install libcephfs2 2026-02-12T06:40:44.773 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:07 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:44.838 INFO:teuthology.orchestra.run.trial058.stdout:Package libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:44.855 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:44.856 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:44.856 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:44.878 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install libcephfs-devel 2026-02-12T06:40:45.179 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:45.243 INFO:teuthology.orchestra.run.trial058.stdout:Package libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:45.261 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:45.261 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:45.261 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:45.283 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install librados2 2026-02-12T06:40:45.581 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:45.644 INFO:teuthology.orchestra.run.trial058.stdout:Package librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:45.662 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:45.662 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:45.663 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:45.684 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install librbd1 2026-02-12T06:40:45.976 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:46.040 INFO:teuthology.orchestra.run.trial058.stdout:Package librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:46.058 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:46.058 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:46.059 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:46.080 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install python3-rados 2026-02-12T06:40:46.382 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:09 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:46.447 INFO:teuthology.orchestra.run.trial058.stdout:Package python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:46.464 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:46.465 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:46.465 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:46.486 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install python3-rgw 2026-02-12T06:40:46.785 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:09 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:46.850 INFO:teuthology.orchestra.run.trial058.stdout:Package python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:46.867 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:46.868 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:46.868 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:46.890 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install python3-cephfs 2026-02-12T06:40:47.190 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:47.255 INFO:teuthology.orchestra.run.trial058.stdout:Package python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:47.273 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:47.273 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:47.273 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:47.295 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install python3-rbd 2026-02-12T06:40:47.592 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:47.657 INFO:teuthology.orchestra.run.trial058.stdout:Package python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:47.675 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:47.675 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:47.675 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:47.696 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install rbd-fuse 2026-02-12T06:40:47.995 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:48.059 INFO:teuthology.orchestra.run.trial058.stdout:Package rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:48.077 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:48.077 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:48.077 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:48.100 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install rbd-mirror 2026-02-12T06:40:48.405 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:11 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:48.469 INFO:teuthology.orchestra.run.trial058.stdout:Package rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:48.486 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:48.487 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:48.487 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:48.509 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install rbd-nbd 2026-02-12T06:40:48.801 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:11 ago on Thu 12 Feb 2026 06:40:37 AM UTC. 2026-02-12T06:40:48.867 INFO:teuthology.orchestra.run.trial058.stdout:Package rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:40:48.884 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-12T06:40:48.885 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-12T06:40:48.885 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-12T06:40:48.909 DEBUG:teuthology.parallel:result is None 2026-02-12T06:40:57.167 INFO:teuthology.orchestra.run.trial106.stdout:Extra Packages for Enterprise Linux 1.2 MB/s | 20 MB 00:16 2026-02-12T06:41:00.433 INFO:teuthology.orchestra.run.trial106.stdout:lab-extras 921 kB/s | 50 kB 00:00 2026-02-12T06:41:01.689 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-radosgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:01.707 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:01.707 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:01.707 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:01.731 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-test 2026-02-12T06:41:02.027 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:02 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:02.091 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-test-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:02.109 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:02.109 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:02.109 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:02.130 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph 2026-02-12T06:41:02.428 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:02 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:02.491 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:02.508 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:02.509 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:02.509 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:02.530 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-base 2026-02-12T06:41:02.835 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:02 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:02.899 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-base-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:02.916 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:02.917 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:02.917 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:02.938 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install cephadm 2026-02-12T06:41:03.237 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:03 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:03.301 INFO:teuthology.orchestra.run.trial106.stdout:Package cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:41:03.318 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:03.319 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:03.319 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:03.340 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T06:41:03.642 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:03 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:03.709 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-immutable-object-cache-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:03.727 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:03.727 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:03.727 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:03.749 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr 2026-02-12T06:41:04.045 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:04.109 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:04.127 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:04.127 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:04.127 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:04.149 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T06:41:04.445 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:04.509 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-dashboard-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:41:04.527 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:04.527 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:04.527 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:04.549 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T06:41:04.852 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:04 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:04.917 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:41:04.935 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:04.935 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:04.935 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:04.956 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr-rook 2026-02-12T06:41:05.258 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:05 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:05.323 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-rook-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:41:05.340 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:05.341 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:05.342 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:05.363 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T06:41:05.672 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:05 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:05.737 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-cephadm-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:41:05.755 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:05.755 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:05.755 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:05.777 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-osd 2026-02-12T06:41:06.080 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:06.144 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-osd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:06.161 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:06.162 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:06.162 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:06.185 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-osd-classic 2026-02-12T06:41:06.488 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:06.553 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-osd-classic-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:06.570 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:06.571 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:06.571 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:06.592 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-fuse 2026-02-12T06:41:06.891 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:06 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:06.956 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:06.973 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:06.974 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:06.974 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:06.996 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-volume 2026-02-12T06:41:07.301 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:07 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:07.366 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-volume-2:20.3.0-5145.g5fdb7d8f.el9.noarch is already installed. 2026-02-12T06:41:07.384 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:07.384 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:07.384 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:07.407 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install librados-devel 2026-02-12T06:41:07.714 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:07 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:07.779 INFO:teuthology.orchestra.run.trial106.stdout:Package librados-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:07.796 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:07.797 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:07.797 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:07.819 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install libcephfs2 2026-02-12T06:41:08.120 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:08.185 INFO:teuthology.orchestra.run.trial106.stdout:Package libcephfs2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:08.203 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:08.203 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:08.203 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:08.225 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install libcephfs-devel 2026-02-12T06:41:08.524 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:08.590 INFO:teuthology.orchestra.run.trial106.stdout:Package libcephfs-devel-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:08.607 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:08.608 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:08.608 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:08.630 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install librados2 2026-02-12T06:41:08.935 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:08 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:08.999 INFO:teuthology.orchestra.run.trial106.stdout:Package librados2-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:09.016 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:09.017 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:09.017 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:09.039 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install librbd1 2026-02-12T06:41:09.340 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:09 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:09.405 INFO:teuthology.orchestra.run.trial106.stdout:Package librbd1-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:09.422 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:09.423 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:09.424 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:09.445 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install python3-rados 2026-02-12T06:41:09.747 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:09 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:09.812 INFO:teuthology.orchestra.run.trial106.stdout:Package python3-rados-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:09.829 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:09.830 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:09.830 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:09.852 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install python3-rgw 2026-02-12T06:41:10.154 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:10.219 INFO:teuthology.orchestra.run.trial106.stdout:Package python3-rgw-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:10.237 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:10.237 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:10.238 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:10.260 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install python3-cephfs 2026-02-12T06:41:10.566 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:10.630 INFO:teuthology.orchestra.run.trial106.stdout:Package python3-cephfs-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:10.648 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:10.648 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:10.649 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:10.670 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install python3-rbd 2026-02-12T06:41:10.971 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:10 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:11.037 INFO:teuthology.orchestra.run.trial106.stdout:Package python3-rbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:11.054 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:11.075 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:11.075 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:11.077 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install rbd-fuse 2026-02-12T06:41:11.377 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:11 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:11.441 INFO:teuthology.orchestra.run.trial106.stdout:Package rbd-fuse-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:11.459 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:11.459 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:11.460 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:11.481 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install rbd-mirror 2026-02-12T06:41:11.785 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:11 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:11.850 INFO:teuthology.orchestra.run.trial106.stdout:Package rbd-mirror-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:11.868 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:11.868 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:11.869 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:11.890 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install rbd-nbd 2026-02-12T06:41:12.195 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:12 ago on Thu 12 Feb 2026 06:41:00 AM UTC. 2026-02-12T06:41:12.260 INFO:teuthology.orchestra.run.trial106.stdout:Package rbd-nbd-2:20.3.0-5145.g5fdb7d8f.el9.x86_64 is already installed. 2026-02-12T06:41:12.277 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-12T06:41:12.278 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-12T06:41:12.278 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-12T06:41:12.304 DEBUG:teuthology.parallel:result is None 2026-02-12T06:41:12.305 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T06:41:12.467 DEBUG:teuthology.orchestra.run.trial058:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T06:41:12.488 INFO:teuthology.orchestra.run.trial058.stdout:20.3.0-5145.g5fdb7d8f.el9 2026-02-12T06:41:12.488 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5145.g5fdb7d8f.el9 2026-02-12T06:41:12.488 INFO:teuthology.task.install:The correct ceph version 20.3.0-5145.g5fdb7d8f is installed. 2026-02-12T06:41:12.491 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T06:41:12.650 DEBUG:teuthology.orchestra.run.trial106:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T06:41:12.671 INFO:teuthology.orchestra.run.trial106.stdout:20.3.0-5145.g5fdb7d8f.el9 2026-02-12T06:41:12.671 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5145.g5fdb7d8f.el9 2026-02-12T06:41:12.671 INFO:teuthology.task.install:The correct ceph version 20.3.0-5145.g5fdb7d8f is installed. 2026-02-12T06:41:12.673 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-12T06:41:12.674 INFO:teuthology.run_tasks:Running task ceph... 2026-02-12T06:41:12.777 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-12T06:41:12.777 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod 777 /var/log/ceph 2026-02-12T06:41:12.779 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod 777 /var/log/ceph 2026-02-12T06:41:12.804 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-12T06:41:12.804 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T06:41:12.846 DEBUG:teuthology.orchestra.run.trial106:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T06:41:12.870 INFO:tasks.ceph:Creating extra log directories... 2026-02-12T06:41:12.871 DEBUG:teuthology.orchestra.run.trial058:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T06:41:12.914 DEBUG:teuthology.orchestra.run.trial106:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T06:41:12.954 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-12T06:41:12.954 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug objclass': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-12T06:41:12.955 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:23:35-crimson-rados-main-distro-debug-trial/45991', 'branch': 'main', 'description': 'crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/cls}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '45991', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'moagrawa-2026-02-12_06:23:35-crimson-rados-main-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug objclass': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}}, 'workunit': {'branch': 'seastore_io_uring', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}}, 'owner': 'scheduled_moagrawa@soko04.front.sepia.ceph.com', 'priority': 20, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 4661, 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'seastore_io_uring', 'suite_path': '/home/teuthworker/src/github.com_mohit84_ceph_5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/mohit84/ceph.git', 'suite_sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0', 'targets': {'trial058.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOaOO8ckUMpwugv8nps8atj/kZaE1yV+IqYyFRdgpKIIxZq2PCWUapeQzJ8yy0QbKt9ImA1beMgmHpyP1foIIOs=', 'trial106.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL1r+EXnU9p9/Myr/6NsfWm53TzOVxvtsqyKYUY8d/L2gNHhyrwQjbPs0e34N53Rtjf8KM//He3N/fAK8cCYdbA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug objclass': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'sha1': '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_cmpomap.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8bec0da71becad44414c54979f64c9ef0e7099c6', 'timestamp': '2026-02-12_06:23:35', 'tube': 'trial', 'user': 'moagrawa', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.2161924'} 2026-02-12T06:41:12.955 DEBUG:teuthology.orchestra.run.trial058:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T06:41:12.978 DEBUG:teuthology.orchestra.run.trial106:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T06:41:12.995 DEBUG:teuthology.orchestra.run.trial058:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T06:41:13.036 DEBUG:teuthology.orchestra.run.trial106:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T06:41:13.061 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:41:13.061 DEBUG:teuthology.orchestra.run.trial058:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T06:41:13.117 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T06:41:13.117 DEBUG:teuthology.orchestra.run.trial058:> stat /dev/vg_nvme/lv_1 2026-02-12T06:41:13.173 INFO:teuthology.orchestra.run.trial058.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T06:41:13.174 INFO:teuthology.orchestra.run.trial058.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T06:41:13.174 INFO:teuthology.orchestra.run.trial058.stdout:Device: 6h/6d Inode: 1316 Links: 1 2026-02-12T06:41:13.174 INFO:teuthology.orchestra.run.trial058.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T06:41:13.174 INFO:teuthology.orchestra.run.trial058.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T06:41:13.174 INFO:teuthology.orchestra.run.trial058.stdout:Access: 2026-02-12 06:39:06.376696738 +0000 2026-02-12T06:41:13.174 INFO:teuthology.orchestra.run.trial058.stdout:Modify: 2026-02-12 06:38:07.021107852 +0000 2026-02-12T06:41:13.174 INFO:teuthology.orchestra.run.trial058.stdout:Change: 2026-02-12 06:38:07.021107852 +0000 2026-02-12T06:41:13.174 INFO:teuthology.orchestra.run.trial058.stdout: Birth: 2026-02-12 06:38:07.021107852 +0000 2026-02-12T06:41:13.175 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T06:41:13.238 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records in 2026-02-12T06:41:13.238 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records out 2026-02-12T06:41:13.238 INFO:teuthology.orchestra.run.trial058.stderr:512 bytes copied, 0.000180046 s, 2.8 MB/s 2026-02-12T06:41:13.239 DEBUG:teuthology.orchestra.run.trial058:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T06:41:13.296 DEBUG:teuthology.orchestra.run.trial058:> stat /dev/vg_nvme/lv_2 2026-02-12T06:41:13.367 INFO:teuthology.orchestra.run.trial058.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T06:41:13.368 INFO:teuthology.orchestra.run.trial058.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T06:41:13.368 INFO:teuthology.orchestra.run.trial058.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-12T06:41:13.368 INFO:teuthology.orchestra.run.trial058.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T06:41:13.368 INFO:teuthology.orchestra.run.trial058.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T06:41:13.368 INFO:teuthology.orchestra.run.trial058.stdout:Access: 2026-02-12 06:39:06.376696738 +0000 2026-02-12T06:41:13.368 INFO:teuthology.orchestra.run.trial058.stdout:Modify: 2026-02-12 06:38:07.020107869 +0000 2026-02-12T06:41:13.368 INFO:teuthology.orchestra.run.trial058.stdout:Change: 2026-02-12 06:38:07.020107869 +0000 2026-02-12T06:41:13.368 INFO:teuthology.orchestra.run.trial058.stdout: Birth: 2026-02-12 06:38:07.020107869 +0000 2026-02-12T06:41:13.369 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T06:41:13.434 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records in 2026-02-12T06:41:13.435 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records out 2026-02-12T06:41:13.435 INFO:teuthology.orchestra.run.trial058.stderr:512 bytes copied, 0.00014436 s, 3.5 MB/s 2026-02-12T06:41:13.436 DEBUG:teuthology.orchestra.run.trial058:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T06:41:13.493 DEBUG:teuthology.orchestra.run.trial058:> stat /dev/vg_nvme/lv_3 2026-02-12T06:41:13.549 INFO:teuthology.orchestra.run.trial058.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T06:41:13.549 INFO:teuthology.orchestra.run.trial058.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T06:41:13.549 INFO:teuthology.orchestra.run.trial058.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-12T06:41:13.550 INFO:teuthology.orchestra.run.trial058.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T06:41:13.550 INFO:teuthology.orchestra.run.trial058.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T06:41:13.550 INFO:teuthology.orchestra.run.trial058.stdout:Access: 2026-02-12 06:39:06.376696738 +0000 2026-02-12T06:41:13.550 INFO:teuthology.orchestra.run.trial058.stdout:Modify: 2026-02-12 06:38:07.020107869 +0000 2026-02-12T06:41:13.550 INFO:teuthology.orchestra.run.trial058.stdout:Change: 2026-02-12 06:38:07.020107869 +0000 2026-02-12T06:41:13.550 INFO:teuthology.orchestra.run.trial058.stdout: Birth: 2026-02-12 06:38:07.020107869 +0000 2026-02-12T06:41:13.551 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T06:41:13.611 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records in 2026-02-12T06:41:13.611 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records out 2026-02-12T06:41:13.611 INFO:teuthology.orchestra.run.trial058.stderr:512 bytes copied, 0.000158056 s, 3.2 MB/s 2026-02-12T06:41:13.613 DEBUG:teuthology.orchestra.run.trial058:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T06:41:13.671 DEBUG:teuthology.orchestra.run.trial058:> stat /dev/vg_nvme/lv_4 2026-02-12T06:41:13.727 INFO:teuthology.orchestra.run.trial058.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T06:41:13.727 INFO:teuthology.orchestra.run.trial058.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T06:41:13.727 INFO:teuthology.orchestra.run.trial058.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-12T06:41:13.727 INFO:teuthology.orchestra.run.trial058.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T06:41:13.728 INFO:teuthology.orchestra.run.trial058.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T06:41:13.728 INFO:teuthology.orchestra.run.trial058.stdout:Access: 2026-02-12 06:39:06.377696889 +0000 2026-02-12T06:41:13.728 INFO:teuthology.orchestra.run.trial058.stdout:Modify: 2026-02-12 06:38:07.020107869 +0000 2026-02-12T06:41:13.728 INFO:teuthology.orchestra.run.trial058.stdout:Change: 2026-02-12 06:38:07.020107869 +0000 2026-02-12T06:41:13.728 INFO:teuthology.orchestra.run.trial058.stdout: Birth: 2026-02-12 06:38:07.020107869 +0000 2026-02-12T06:41:13.728 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T06:41:13.791 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records in 2026-02-12T06:41:13.791 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records out 2026-02-12T06:41:13.791 INFO:teuthology.orchestra.run.trial058.stderr:512 bytes copied, 0.00014462 s, 3.5 MB/s 2026-02-12T06:41:13.793 DEBUG:teuthology.orchestra.run.trial058:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T06:41:13.850 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-12T06:41:13.851 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-12T06:41:13.851 DEBUG:teuthology.orchestra.run.trial106:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T06:41:13.870 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T06:41:13.870 DEBUG:teuthology.orchestra.run.trial106:> stat /dev/vg_nvme/lv_1 2026-02-12T06:41:13.927 INFO:teuthology.orchestra.run.trial106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T06:41:13.927 INFO:teuthology.orchestra.run.trial106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T06:41:13.927 INFO:teuthology.orchestra.run.trial106.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-12T06:41:13.928 INFO:teuthology.orchestra.run.trial106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T06:41:13.928 INFO:teuthology.orchestra.run.trial106.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T06:41:13.928 INFO:teuthology.orchestra.run.trial106.stdout:Access: 2026-02-12 06:39:06.617727949 +0000 2026-02-12T06:41:13.928 INFO:teuthology.orchestra.run.trial106.stdout:Modify: 2026-02-12 06:38:02.665306932 +0000 2026-02-12T06:41:13.928 INFO:teuthology.orchestra.run.trial106.stdout:Change: 2026-02-12 06:38:02.665306932 +0000 2026-02-12T06:41:13.928 INFO:teuthology.orchestra.run.trial106.stdout: Birth: 2026-02-12 06:38:02.665306932 +0000 2026-02-12T06:41:13.928 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T06:41:13.991 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records in 2026-02-12T06:41:13.991 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records out 2026-02-12T06:41:13.991 INFO:teuthology.orchestra.run.trial106.stderr:512 bytes copied, 0.000145229 s, 3.5 MB/s 2026-02-12T06:41:13.993 DEBUG:teuthology.orchestra.run.trial106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T06:41:14.055 DEBUG:teuthology.orchestra.run.trial106:> stat /dev/vg_nvme/lv_2 2026-02-12T06:41:14.111 INFO:teuthology.orchestra.run.trial106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T06:41:14.111 INFO:teuthology.orchestra.run.trial106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T06:41:14.111 INFO:teuthology.orchestra.run.trial106.stdout:Device: 6h/6d Inode: 1308 Links: 1 2026-02-12T06:41:14.112 INFO:teuthology.orchestra.run.trial106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T06:41:14.112 INFO:teuthology.orchestra.run.trial106.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T06:41:14.112 INFO:teuthology.orchestra.run.trial106.stdout:Access: 2026-02-12 06:39:06.617727949 +0000 2026-02-12T06:41:14.112 INFO:teuthology.orchestra.run.trial106.stdout:Modify: 2026-02-12 06:38:02.665306932 +0000 2026-02-12T06:41:14.112 INFO:teuthology.orchestra.run.trial106.stdout:Change: 2026-02-12 06:38:02.665306932 +0000 2026-02-12T06:41:14.112 INFO:teuthology.orchestra.run.trial106.stdout: Birth: 2026-02-12 06:38:02.665306932 +0000 2026-02-12T06:41:14.112 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T06:41:14.177 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records in 2026-02-12T06:41:14.177 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records out 2026-02-12T06:41:14.177 INFO:teuthology.orchestra.run.trial106.stderr:512 bytes copied, 0.000147604 s, 3.5 MB/s 2026-02-12T06:41:14.178 DEBUG:teuthology.orchestra.run.trial106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T06:41:14.236 DEBUG:teuthology.orchestra.run.trial106:> stat /dev/vg_nvme/lv_3 2026-02-12T06:41:14.295 INFO:teuthology.orchestra.run.trial106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T06:41:14.295 INFO:teuthology.orchestra.run.trial106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T06:41:14.295 INFO:teuthology.orchestra.run.trial106.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-12T06:41:14.295 INFO:teuthology.orchestra.run.trial106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T06:41:14.295 INFO:teuthology.orchestra.run.trial106.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T06:41:14.296 INFO:teuthology.orchestra.run.trial106.stdout:Access: 2026-02-12 06:39:06.618728029 +0000 2026-02-12T06:41:14.296 INFO:teuthology.orchestra.run.trial106.stdout:Modify: 2026-02-12 06:38:02.665306932 +0000 2026-02-12T06:41:14.296 INFO:teuthology.orchestra.run.trial106.stdout:Change: 2026-02-12 06:38:02.665306932 +0000 2026-02-12T06:41:14.296 INFO:teuthology.orchestra.run.trial106.stdout: Birth: 2026-02-12 06:38:02.665306932 +0000 2026-02-12T06:41:14.296 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T06:41:14.357 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records in 2026-02-12T06:41:14.357 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records out 2026-02-12T06:41:14.357 INFO:teuthology.orchestra.run.trial106.stderr:512 bytes copied, 0.000157843 s, 3.2 MB/s 2026-02-12T06:41:14.358 DEBUG:teuthology.orchestra.run.trial106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T06:41:14.415 DEBUG:teuthology.orchestra.run.trial106:> stat /dev/vg_nvme/lv_4 2026-02-12T06:41:14.472 INFO:teuthology.orchestra.run.trial106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T06:41:14.473 INFO:teuthology.orchestra.run.trial106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T06:41:14.473 INFO:teuthology.orchestra.run.trial106.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-12T06:41:14.473 INFO:teuthology.orchestra.run.trial106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T06:41:14.473 INFO:teuthology.orchestra.run.trial106.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T06:41:14.473 INFO:teuthology.orchestra.run.trial106.stdout:Access: 2026-02-12 06:39:06.618728029 +0000 2026-02-12T06:41:14.473 INFO:teuthology.orchestra.run.trial106.stdout:Modify: 2026-02-12 06:38:02.665306932 +0000 2026-02-12T06:41:14.473 INFO:teuthology.orchestra.run.trial106.stdout:Change: 2026-02-12 06:38:02.665306932 +0000 2026-02-12T06:41:14.473 INFO:teuthology.orchestra.run.trial106.stdout: Birth: 2026-02-12 06:38:02.665306932 +0000 2026-02-12T06:41:14.474 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T06:41:14.535 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records in 2026-02-12T06:41:14.535 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records out 2026-02-12T06:41:14.535 INFO:teuthology.orchestra.run.trial106.stderr:512 bytes copied, 0.000145399 s, 3.5 MB/s 2026-02-12T06:41:14.537 DEBUG:teuthology.orchestra.run.trial106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T06:41:14.594 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-12T06:41:14.594 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial058.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial106.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-12T06:41:14.594 INFO:tasks.ceph:Generating config... 2026-02-12T06:41:14.596 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-12T06:41:14.597 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-12T06:41:14.597 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-12T06:41:14.597 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-12T06:41:14.597 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-12T06:41:14.597 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-12T06:41:14.597 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-12T06:41:14.597 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-12T06:41:14.597 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-12T06:41:14.598 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-12T06:41:14.598 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-12T06:41:14.598 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-12T06:41:14.598 INFO:tasks.ceph:[osd] debug ms = 20 2026-02-12T06:41:14.598 INFO:tasks.ceph:[osd] debug objclass = 20 2026-02-12T06:41:14.598 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-12T06:41:14.598 INFO:tasks.ceph:[osd] debug seastore = 20 2026-02-12T06:41:14.598 INFO:tasks.ceph:[osd] debug seastore backref = 20 2026-02-12T06:41:14.598 INFO:tasks.ceph:[osd] debug seastore cache = 20 2026-02-12T06:41:14.598 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2026-02-12T06:41:14.598 INFO:tasks.ceph:[osd] debug seastore device = 20 2026-02-12T06:41:14.598 INFO:tasks.ceph:[osd] debug seastore epm = 20 2026-02-12T06:41:14.599 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2026-02-12T06:41:14.599 INFO:tasks.ceph:[osd] debug seastore journal = 20 2026-02-12T06:41:14.599 INFO:tasks.ceph:[osd] debug seastore lba = 20 2026-02-12T06:41:14.599 INFO:tasks.ceph:[osd] debug seastore odata = 20 2026-02-12T06:41:14.599 INFO:tasks.ceph:[osd] debug seastore omap = 20 2026-02-12T06:41:14.599 INFO:tasks.ceph:[osd] debug seastore onode = 20 2026-02-12T06:41:14.599 INFO:tasks.ceph:[osd] debug seastore t = 20 2026-02-12T06:41:14.599 INFO:tasks.ceph:[osd] debug seastore tm = 20 2026-02-12T06:41:14.599 INFO:tasks.ceph:[osd] osd objectstore = seastore 2026-02-12T06:41:14.599 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-12T06:41:14.599 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-12T06:41:14.599 INFO:tasks.ceph:[osd] seastore main device type = RANDOM_BLOCK_SSD 2026-02-12T06:41:14.600 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-12T06:41:14.600 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-12T06:41:14.600 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-12T06:41:14.600 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-12T06:41:14.600 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-12T06:41:14.600 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-12T06:41:14.600 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-12T06:41:14.600 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-12T06:41:14.600 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-12T06:41:14.600 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-12T06:41:14.601 INFO:tasks.ceph:Setting up mon.a... 2026-02-12T06:41:14.601 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-12T06:41:14.643 INFO:teuthology.orchestra.run.trial058.stdout:creating /etc/ceph/ceph.keyring 2026-02-12T06:41:14.646 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-12T06:41:14.733 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T06:41:14.757 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.58')] 2026-02-12T06:41:14.757 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.58', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug objclass': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-12T06:41:14.759 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:41:14.759 DEBUG:teuthology.orchestra.run.trial058:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T06:41:14.815 DEBUG:teuthology.orchestra.run.trial058:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.58 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-12T06:41:14.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:14.898+0000 7f4c6d032f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:14.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:14.898+0000 7f4c6d032f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:14.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:14.898+0000 7f4c6d032f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:14.896 INFO:teuthology.orchestra.run.trial058.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-12T06:41:14.896 INFO:teuthology.orchestra.run.trial058.stdout:monmaptool: generated fsid d37d84c8-e358-473e-b2a6-41c5fd7faa02 2026-02-12T06:41:14.896 INFO:teuthology.orchestra.run.trial058.stdout:setting min_mon_release = tentacle 2026-02-12T06:41:14.896 INFO:teuthology.orchestra.run.trial058.stdout:epoch 0 2026-02-12T06:41:14.897 INFO:teuthology.orchestra.run.trial058.stdout:fsid d37d84c8-e358-473e-b2a6-41c5fd7faa02 2026-02-12T06:41:14.897 INFO:teuthology.orchestra.run.trial058.stdout:last_changed 2026-02-12T06:41:14.900039+0000 2026-02-12T06:41:14.897 INFO:teuthology.orchestra.run.trial058.stdout:created 2026-02-12T06:41:14.900039+0000 2026-02-12T06:41:14.897 INFO:teuthology.orchestra.run.trial058.stdout:min_mon_release 20 (tentacle) 2026-02-12T06:41:14.897 INFO:teuthology.orchestra.run.trial058.stdout:election_strategy: 1 2026-02-12T06:41:14.897 INFO:teuthology.orchestra.run.trial058.stdout:0: [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] mon.a 2026-02-12T06:41:14.897 INFO:teuthology.orchestra.run.trial058.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-12T06:41:14.899 DEBUG:teuthology.orchestra.run.trial058:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T06:41:14.954 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d37d84c8-e358-473e-b2a6-41c5fd7faa02... 2026-02-12T06:41:14.956 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T06:41:14.997 DEBUG:teuthology.orchestra.run.trial106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T06:41:15.035 INFO:teuthology.orchestra.run.trial058.stdout:[global] 2026-02-12T06:41:15.035 INFO:teuthology.orchestra.run.trial058.stdout: chdir = "" 2026-02-12T06:41:15.036 INFO:teuthology.orchestra.run.trial058.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T06:41:15.036 INFO:teuthology.orchestra.run.trial058.stdout: auth supported = cephx 2026-02-12T06:41:15.036 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.036 INFO:teuthology.orchestra.run.trial058.stdout: filestore xattr use omap = true 2026-02-12T06:41:15.036 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.036 INFO:teuthology.orchestra.run.trial058.stdout: mon clock drift allowed = 1.000 2026-02-12T06:41:15.036 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.036 INFO:teuthology.orchestra.run.trial058.stdout: osd crush chooseleaf type = 0 2026-02-12T06:41:15.036 INFO:teuthology.orchestra.run.trial058.stdout: auth debug = true 2026-02-12T06:41:15.036 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.036 INFO:teuthology.orchestra.run.trial058.stdout: ms die on old message = true 2026-02-12T06:41:15.036 INFO:teuthology.orchestra.run.trial058.stdout: ms die on bug = true 2026-02-12T06:41:15.036 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.036 INFO:teuthology.orchestra.run.trial058.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T06:41:15.037 INFO:teuthology.orchestra.run.trial058.stdout: mon pg warn max object skew = 0 2026-02-12T06:41:15.037 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.037 INFO:teuthology.orchestra.run.trial058.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T06:41:15.037 INFO:teuthology.orchestra.run.trial058.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T06:41:15.037 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.037 INFO:teuthology.orchestra.run.trial058.stdout: osd pool default size = 2 2026-02-12T06:41:15.037 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.037 INFO:teuthology.orchestra.run.trial058.stdout: mon osd allow primary affinity = true 2026-02-12T06:41:15.037 INFO:teuthology.orchestra.run.trial058.stdout: mon osd allow pg remap = true 2026-02-12T06:41:15.037 INFO:teuthology.orchestra.run.trial058.stdout: mon warn on legacy crush tunables = false 2026-02-12T06:41:15.037 INFO:teuthology.orchestra.run.trial058.stdout: mon warn on crush straw calc version zero = false 2026-02-12T06:41:15.037 INFO:teuthology.orchestra.run.trial058.stdout: mon warn on no sortbitwise = false 2026-02-12T06:41:15.037 INFO:teuthology.orchestra.run.trial058.stdout: mon warn on osd down out interval zero = false 2026-02-12T06:41:15.037 INFO:teuthology.orchestra.run.trial058.stdout: mon warn on too few osds = false 2026-02-12T06:41:15.037 INFO:teuthology.orchestra.run.trial058.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T06:41:15.037 INFO:teuthology.orchestra.run.trial058.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T06:41:15.038 INFO:teuthology.orchestra.run.trial058.stdout: mon_allow_pool_size_one = true 2026-02-12T06:41:15.038 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.038 INFO:teuthology.orchestra.run.trial058.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T06:41:15.038 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.038 INFO:teuthology.orchestra.run.trial058.stdout: osd default data pool replay window = 5 2026-02-12T06:41:15.038 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.038 INFO:teuthology.orchestra.run.trial058.stdout: mon allow pool delete = true 2026-02-12T06:41:15.038 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.038 INFO:teuthology.orchestra.run.trial058.stdout: mon cluster log file level = debug 2026-02-12T06:41:15.038 INFO:teuthology.orchestra.run.trial058.stdout: debug asserts on shutdown = true 2026-02-12T06:41:15.038 INFO:teuthology.orchestra.run.trial058.stdout: mon health detail to clog = false 2026-02-12T06:41:15.038 INFO:teuthology.orchestra.run.trial058.stdout: mon host = 10.20.193.58 2026-02-12T06:41:15.038 INFO:teuthology.orchestra.run.trial058.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-12T06:41:15.038 INFO:teuthology.orchestra.run.trial058.stdout: ms client mode = crc 2026-02-12T06:41:15.038 INFO:teuthology.orchestra.run.trial058.stdout: ms cluster mode = crc 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: ms mon client mode = crc 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: ms mon cluster mode = crc 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: ms mon service mode = crc 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: ms service mode = crc 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: fsid = d37d84c8-e358-473e-b2a6-41c5fd7faa02 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout:[osd] 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: osd journal size = 100 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: osd scrub load threshold = 5.0 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: osd scrub max interval = 600 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: osd mclock profile = high_recovery_ops 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: osd mclock skip benchmark = true 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: osd recover clone overlap = true 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: osd recovery max chunk = 1048576 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: osd debug shutdown = true 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: osd debug op order = true 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: osd debug verify stray on activate = true 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: osd debug trim objects = true 2026-02-12T06:41:15.039 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: osd open classes on start = true 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: osd debug pg log writeout = true 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: osd deep scrub update digest min age = 30 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: osd map max advance = 10 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: journal zero on create = true 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: filestore ondisk finisher threads = 3 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: filestore apply finisher threads = 3 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: bdev debug aio = true 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: osd debug misdirected ops = true 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: debug monc = 20 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: crimson cpu num = 4 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: crimson osd obc lru size = 10 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: debug ms = 20 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: debug objclass = 20 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: debug osd = 20 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: debug seastore = 20 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: debug seastore backref = 20 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: debug seastore cache = 20 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: debug seastore cleaner = 20 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: debug seastore device = 20 2026-02-12T06:41:15.040 INFO:teuthology.orchestra.run.trial058.stdout: debug seastore epm = 20 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: debug seastore fixedkv tree = 20 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: debug seastore journal = 20 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: debug seastore lba = 20 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: debug seastore odata = 20 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: debug seastore omap = 20 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: debug seastore onode = 20 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: debug seastore t = 20 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: debug seastore tm = 20 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: osd objectstore = seastore 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: osd shutdown pgref assert = True 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: seastore cachepin size pershard = 64M 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: seastore main device type = RANDOM_BLOCK_SSD 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: seastore max concurrent transactions = 8 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout:[mgr] 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: debug ms = 1 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: debug mgr = 20 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: debug mon = 20 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: debug auth = 20 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: mon reweight min pgs per osd = 4 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: mon reweight min bytes per osd = 10 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: mgr/telemetry/nag = false 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout:[mon] 2026-02-12T06:41:15.041 INFO:teuthology.orchestra.run.trial058.stdout: debug ms = 1 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: debug mon = 20 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: debug paxos = 20 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: debug auth = 20 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: mon data avail warn = 5 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: mon mgr mkfs grace = 240 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: mon reweight min pgs per osd = 4 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: mon osd reporter subtree level = osd 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: mon osd prime pg temp = true 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: mon reweight min bytes per osd = 10 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: # 1m isn't quite enough 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: mon_down_mkfs_grace = 2m 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: mon_warn_on_filestore_osds = false 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: mon min osdmap epochs = 50 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: mon osdmap full prune interval = 2 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: mon osdmap full prune min = 15 2026-02-12T06:41:15.042 INFO:teuthology.orchestra.run.trial058.stdout: mon osdmap full prune txsize = 2 2026-02-12T06:41:15.043 INFO:teuthology.orchestra.run.trial058.stdout: paxos service trim min = 10 2026-02-12T06:41:15.043 INFO:teuthology.orchestra.run.trial058.stdout: osd pool default crimson = True 2026-02-12T06:41:15.043 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:15.043 INFO:teuthology.orchestra.run.trial058.stdout:[client] 2026-02-12T06:41:15.043 INFO:teuthology.orchestra.run.trial058.stdout: rgw cache enabled = true 2026-02-12T06:41:15.043 INFO:teuthology.orchestra.run.trial058.stdout: rgw enable ops log = true 2026-02-12T06:41:15.043 INFO:teuthology.orchestra.run.trial058.stdout: rgw enable usage log = true 2026-02-12T06:41:15.043 INFO:teuthology.orchestra.run.trial058.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T06:41:15.043 INFO:teuthology.orchestra.run.trial058.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T06:41:15.043 INFO:teuthology.orchestra.run.trial058.stdout:[mon.a] 2026-02-12T06:41:15.043 INFO:teuthology.orchestra.run.trial106.stdout:[global] 2026-02-12T06:41:15.043 INFO:teuthology.orchestra.run.trial106.stdout: chdir = "" 2026-02-12T06:41:15.043 INFO:teuthology.orchestra.run.trial106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T06:41:15.043 INFO:teuthology.orchestra.run.trial106.stdout: auth supported = cephx 2026-02-12T06:41:15.043 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.043 INFO:teuthology.orchestra.run.trial106.stdout: filestore xattr use omap = true 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: mon clock drift allowed = 1.000 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: osd crush chooseleaf type = 0 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: auth debug = true 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: ms die on old message = true 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: ms die on bug = true 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: mon pg warn max object skew = 0 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: osd pool default size = 2 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: mon osd allow primary affinity = true 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: mon osd allow pg remap = true 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: mon warn on legacy crush tunables = false 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: mon warn on crush straw calc version zero = false 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: mon warn on no sortbitwise = false 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: mon warn on osd down out interval zero = false 2026-02-12T06:41:15.044 INFO:teuthology.orchestra.run.trial106.stdout: mon warn on too few osds = false 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: mon_allow_pool_size_one = true 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: osd default data pool replay window = 5 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: mon allow pool delete = true 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: mon cluster log file level = debug 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: debug asserts on shutdown = true 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: mon health detail to clog = false 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: mon host = 10.20.193.58 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: ms client mode = crc 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: ms cluster mode = crc 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: ms mon client mode = crc 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: ms mon cluster mode = crc 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: ms mon service mode = crc 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: ms service mode = crc 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: fsid = d37d84c8-e358-473e-b2a6-41c5fd7faa02 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout:[osd] 2026-02-12T06:41:15.045 INFO:teuthology.orchestra.run.trial106.stdout: osd journal size = 100 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: osd scrub load threshold = 5.0 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: osd scrub max interval = 600 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: osd mclock profile = high_recovery_ops 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: osd mclock skip benchmark = true 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: osd recover clone overlap = true 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: osd recovery max chunk = 1048576 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: osd debug shutdown = true 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: osd debug op order = true 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: osd debug verify stray on activate = true 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: osd debug trim objects = true 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: osd open classes on start = true 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: osd debug pg log writeout = true 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: osd deep scrub update digest min age = 30 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: osd map max advance = 10 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: journal zero on create = true 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: filestore ondisk finisher threads = 3 2026-02-12T06:41:15.046 INFO:teuthology.orchestra.run.trial106.stdout: filestore apply finisher threads = 3 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: bdev debug aio = true 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: osd debug misdirected ops = true 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug monc = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: crimson cpu num = 4 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: crimson osd obc lru size = 10 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug ms = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug objclass = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug osd = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug seastore = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug seastore backref = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug seastore cache = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug seastore cleaner = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug seastore device = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug seastore epm = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug seastore fixedkv tree = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug seastore journal = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug seastore lba = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug seastore odata = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug seastore omap = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug seastore onode = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug seastore t = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: debug seastore tm = 20 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: osd objectstore = seastore 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: osd shutdown pgref assert = True 2026-02-12T06:41:15.047 INFO:teuthology.orchestra.run.trial106.stdout: seastore cachepin size pershard = 64M 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: seastore main device type = RANDOM_BLOCK_SSD 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: seastore max concurrent transactions = 8 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout:[mgr] 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: debug ms = 1 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: debug mgr = 20 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: debug mon = 20 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: debug auth = 20 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: mon reweight min pgs per osd = 4 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: mon reweight min bytes per osd = 10 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: mgr/telemetry/nag = false 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout:[mon] 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: debug ms = 1 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: debug mon = 20 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: debug paxos = 20 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: debug auth = 20 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: mon data avail warn = 5 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: mon mgr mkfs grace = 240 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: mon reweight min pgs per osd = 4 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: mon osd reporter subtree level = osd 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: mon osd prime pg temp = true 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: mon reweight min bytes per osd = 10 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.048 INFO:teuthology.orchestra.run.trial106.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: # 1m isn't quite enough 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: mon_down_mkfs_grace = 2m 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: mon_warn_on_filestore_osds = false 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: mon min osdmap epochs = 50 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: mon osdmap full prune interval = 2 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: mon osdmap full prune min = 15 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: mon osdmap full prune txsize = 2 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: paxos service trim min = 10 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: osd pool default crimson = True 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout:[client] 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: rgw cache enabled = true 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: rgw enable ops log = true 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: rgw enable usage log = true 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T06:41:15.049 INFO:teuthology.orchestra.run.trial106.stdout:[mon.a] 2026-02-12T06:41:15.050 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-12T06:41:15.051 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-12T06:41:15.160 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-12T06:41:15.161 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:41:15.161 DEBUG:teuthology.orchestra.run.trial058:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-12T06:41:15.218 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:41:15.219 DEBUG:teuthology.orchestra.run.trial058:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-12T06:41:15.275 INFO:tasks.ceph:Sending monmap to node ubuntu@trial058.front.sepia.ceph.com 2026-02-12T06:41:15.276 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:41:15.276 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T06:41:15.276 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T06:41:15.349 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:41:15.349 DEBUG:teuthology.orchestra.run.trial058:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T06:41:15.406 INFO:tasks.ceph:Sending monmap to node ubuntu@trial106.front.sepia.ceph.com 2026-02-12T06:41:15.406 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-12T06:41:15.407 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T06:41:15.407 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T06:41:15.441 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-12T06:41:15.441 DEBUG:teuthology.orchestra.run.trial106:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T06:41:15.498 INFO:tasks.ceph:Setting up mon nodes... 2026-02-12T06:41:15.499 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-12T06:41:15.499 DEBUG:teuthology.orchestra.run.trial106:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T06:41:15.589 INFO:teuthology.orchestra.run.trial106.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T06:41:15.591 INFO:tasks.ceph:Setting up mds nodes... 2026-02-12T06:41:15.592 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-12T06:41:15.592 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-12T06:41:15.634 INFO:teuthology.orchestra.run.trial058.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-12T06:41:15.645 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-12T06:41:15.687 INFO:teuthology.orchestra.run.trial106.stdout:creating /etc/ceph/ceph.client.1.keyring 2026-02-12T06:41:15.699 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-12T06:41:15.700 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial058.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial106.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-12T06:41:15.700 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-12T06:41:15.725 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-12T06:41:15.725 INFO:tasks.ceph:role: osd.0 2026-02-12T06:41:15.725 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial058.front.sepia.ceph.com 2026-02-12T06:41:15.725 DEBUG:teuthology.orchestra.run.trial058:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T06:41:15.790 INFO:teuthology.orchestra.run.trial058.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T06:41:15.790 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T06:41:15.790 INFO:teuthology.orchestra.run.trial058.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T06:41:15.790 INFO:teuthology.orchestra.run.trial058.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T06:41:15.790 INFO:teuthology.orchestra.run.trial058.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T06:41:15.790 INFO:teuthology.orchestra.run.trial058.stdout: = sunit=0 swidth=0 blks 2026-02-12T06:41:15.790 INFO:teuthology.orchestra.run.trial058.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T06:41:15.791 INFO:teuthology.orchestra.run.trial058.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T06:41:15.791 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T06:41:15.791 INFO:teuthology.orchestra.run.trial058.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T06:41:16.371 INFO:teuthology.orchestra.run.trial058.stdout:Discarding blocks...Done. 2026-02-12T06:41:16.374 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial058.front.sepia.ceph.com -o noatime 2026-02-12T06:41:16.374 DEBUG:teuthology.orchestra.run.trial058:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-12T06:41:16.442 DEBUG:teuthology.orchestra.run.trial058:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-12T06:41:16.508 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-12T06:41:16.573 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-12T06:41:16.573 INFO:tasks.ceph:role: osd.1 2026-02-12T06:41:16.573 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial058.front.sepia.ceph.com 2026-02-12T06:41:16.574 DEBUG:teuthology.orchestra.run.trial058:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T06:41:16.639 INFO:teuthology.orchestra.run.trial058.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T06:41:16.639 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T06:41:16.639 INFO:teuthology.orchestra.run.trial058.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T06:41:16.639 INFO:teuthology.orchestra.run.trial058.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T06:41:16.639 INFO:teuthology.orchestra.run.trial058.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T06:41:16.639 INFO:teuthology.orchestra.run.trial058.stdout: = sunit=0 swidth=0 blks 2026-02-12T06:41:16.639 INFO:teuthology.orchestra.run.trial058.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T06:41:16.640 INFO:teuthology.orchestra.run.trial058.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T06:41:16.640 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T06:41:16.640 INFO:teuthology.orchestra.run.trial058.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T06:41:17.197 INFO:teuthology.orchestra.run.trial058.stdout:Discarding blocks...Done. 2026-02-12T06:41:17.199 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial058.front.sepia.ceph.com -o noatime 2026-02-12T06:41:17.199 DEBUG:teuthology.orchestra.run.trial058:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-12T06:41:17.271 DEBUG:teuthology.orchestra.run.trial058:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-12T06:41:17.341 DEBUG:teuthology.orchestra.run.trial058:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T06:41:17.491 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T06:41:17.550 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:17,554 seastar - Reactor backend: linux-aio 2026-02-12T06:41:17.568 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:17,572 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T06:41:17.568 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:17,572 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T06:41:17.570 INFO:teuthology.orchestra.run.trial058.stderr:==20886==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T06:41:17.626 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:17,630 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-12T06:41:17.626 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:17,630 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-12T06:41:17.626 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:17,630 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-12T06:41:17.626 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:17,630 [shard 0:main] osd - Configure option_name crimson_reactor_backend with value : linux-aio 2026-02-12T06:41:17.626 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:17,630 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-12T06:41:17.627 INFO:teuthology.orchestra.run.trial058.stderr:DEBUG 2026-02-12 06:41:17,630 [shard 0:main] seastar - reactor::drain 2026-02-12T06:41:19.716 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-12T06:41:19.716 INFO:teuthology.orchestra.run.trial058.stderr:Suppressions used: 2026-02-12T06:41:19.716 INFO:teuthology.orchestra.run.trial058.stderr: count bytes template 2026-02-12T06:41:19.716 INFO:teuthology.orchestra.run.trial058.stderr: 1 8 MallocExtension::Register 2026-02-12T06:41:19.716 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-12T06:41:19.716 INFO:teuthology.orchestra.run.trial058.stderr: 2026-02-12T06:41:19.735 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T06:41:19.735 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T06:41:19.786 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T06:41:19.786 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T06:41:19.792 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:19,797 seastar - Reactor backend: linux-aio 2026-02-12T06:41:19.803 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:19,807 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T06:41:19.803 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:19,807 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T06:41:19.807 INFO:teuthology.orchestra.run.trial058.stderr:==20884==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T06:41:19.807 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:19,811 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T06:41:19.864 INFO:teuthology.orchestra.run.trial058.stderr:DEBUG 2026-02-12 06:41:19,869 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-12T06:41:19.942 INFO:teuthology.orchestra.run.trial058.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65f2 /lib64/libasan.so.8+0x151b7 0x112781c 0xf2fda3 0x9d5ecb9 0x9d68edb 0x78a0be9 0x7bb280e 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:19.942 INFO:teuthology.orchestra.run.trial058.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0x1092b93 0xf2fdae 0x9c70283 0x9c7074d 0x9c709c0 0x9c726e7 0x9d51bd6 0x9d5202b 0x9d52516 0x9d528a9 0x9d65530 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:19.942 INFO:teuthology.orchestra.run.trial058.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297e4 /lib64/libasan.so.8+0xc6631 /lib64/libasan.so.8+0x151b7 0x112781c 0xf2fda3 0x9c70283 0x9c7074d 0x9c709c0 0x9c70c76 0x9c71725 0x9c71c23 0x9c72253 0x9c723bd 0x9d5272d 0x9d65530 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:20.088 INFO:teuthology.orchestra.run.trial058.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x151e1 0x112781c 0xf2fda3 0x9c70450 0x9c7074d 0x9c709c0 0x9c719c0 0x9c79a43 0x9c79dbf 0x9d6290c 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:20.088 INFO:teuthology.orchestra.run.trial058.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0x3606ac1 0x9c8294b 0x9c82a2e 0x9d427fb 0x9d42990 0x9d42d22 0x9d44309 0x9d45624 0x9d45a44 0x9d622cf 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:20.088 INFO:teuthology.orchestra.run.trial058.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0x316b36b 0x9c706d6 0x9c709c0 0x9c726e7 0x9d560be 0x9d57d10 0x9d5836a 0x9d588b0 0x9d62b3e 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:22.252 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-12T06:41:22.252 INFO:teuthology.orchestra.run.trial058.stderr:Suppressions used: 2026-02-12T06:41:22.252 INFO:teuthology.orchestra.run.trial058.stderr: count bytes template 2026-02-12T06:41:22.252 INFO:teuthology.orchestra.run.trial058.stderr: 1 8 MallocExtension::Register 2026-02-12T06:41:22.252 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-12T06:41:22.252 INFO:teuthology.orchestra.run.trial058.stderr: 2026-02-12T06:41:22.284 DEBUG:teuthology.orchestra.run.trial058:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-12T06:41:22.308 DEBUG:teuthology.orchestra.run.trial058:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T06:41:22.456 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T06:41:22.512 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:22,516 seastar - Reactor backend: linux-aio 2026-02-12T06:41:22.529 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:22,534 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T06:41:22.530 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:22,534 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T06:41:22.532 INFO:teuthology.orchestra.run.trial058.stderr:==20951==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T06:41:22.587 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:22,592 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-12T06:41:22.587 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:22,592 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-12T06:41:22.587 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:22,592 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-12T06:41:22.587 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:22,592 [shard 0:main] osd - Configure option_name crimson_reactor_backend with value : linux-aio 2026-02-12T06:41:22.588 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:22,592 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-12T06:41:22.588 INFO:teuthology.orchestra.run.trial058.stderr:DEBUG 2026-02-12 06:41:22,592 [shard 0:main] seastar - reactor::drain 2026-02-12T06:41:24.675 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-12T06:41:24.675 INFO:teuthology.orchestra.run.trial058.stderr:Suppressions used: 2026-02-12T06:41:24.675 INFO:teuthology.orchestra.run.trial058.stderr: count bytes template 2026-02-12T06:41:24.675 INFO:teuthology.orchestra.run.trial058.stderr: 1 8 MallocExtension::Register 2026-02-12T06:41:24.675 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-12T06:41:24.675 INFO:teuthology.orchestra.run.trial058.stderr: 2026-02-12T06:41:24.694 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T06:41:24.694 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T06:41:24.740 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T06:41:24.740 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T06:41:24.747 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:24,752 seastar - Reactor backend: linux-aio 2026-02-12T06:41:24.755 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:24,760 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T06:41:24.756 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:24,760 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T06:41:24.759 INFO:teuthology.orchestra.run.trial058.stderr:==20949==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T06:41:24.759 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-12 06:41:24,764 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T06:41:24.821 INFO:teuthology.orchestra.run.trial058.stderr:DEBUG 2026-02-12 06:41:24,825 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-12T06:41:24.901 INFO:teuthology.orchestra.run.trial058.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1006c8 /lib64/libasan.so.8+0xc6619 /lib64/libasan.so.8+0x157e7 0x1092cf7 0xf2fdae 0x9c70283 0x9c7074d 0x9c709c0 0x9c70c76 0x9c71725 0x9c71c23 0x9c72253 0x9c723bd 0x9d5272d 0x9d65530 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:24.901 INFO:teuthology.orchestra.run.trial058.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x129858 /lib64/libasan.so.8+0xc6631 /lib64/libasan.so.8+0x15e57 0x9c7060e 0x9c709c0 0x9c70c76 0x9c71238 0x9c796df 0x9c79dbf 0x9d6290c 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:24.901 INFO:teuthology.orchestra.run.trial058.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0x1092dc6 0xf2fdae 0x9c70283 0x9c7074d 0x9c709c0 0x9c70c76 0x9c71725 0x9c71c23 0x9c72253 0x9c723bd 0x9d5272d 0x9d65530 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:25.045 INFO:teuthology.orchestra.run.trial058.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0x1092bcf 0xf2fdae 0x9c70283 0x9c7074d 0x9c709c0 0x9c70c76 0x9c71725 0x9c71c23 0x9c72253 0x9c723bd 0x9d5272d 0x9d65530 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:25.046 INFO:teuthology.orchestra.run.trial058.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x4d733 0x30379ad 0x3165d90 0x4d43b3d 0x9d453ab 0x9d45550 0x9d45a44 0x9d622cf 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:25.046 INFO:teuthology.orchestra.run.trial058.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15ebe 0x9c7982a 0x9c79dbf 0x9d6290c 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:27.220 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-12T06:41:27.221 INFO:teuthology.orchestra.run.trial058.stderr:Suppressions used: 2026-02-12T06:41:27.221 INFO:teuthology.orchestra.run.trial058.stderr: count bytes template 2026-02-12T06:41:27.221 INFO:teuthology.orchestra.run.trial058.stderr: 1 8 MallocExtension::Register 2026-02-12T06:41:27.221 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-12T06:41:27.221 INFO:teuthology.orchestra.run.trial058.stderr: 2026-02-12T06:41:27.250 DEBUG:teuthology.orchestra.run.trial058:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-12T06:41:27.276 DEBUG:teuthology.orchestra.run.trial106:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-12T06:41:27.301 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-12T06:41:27.302 INFO:tasks.ceph:role: osd.2 2026-02-12T06:41:27.302 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial106.front.sepia.ceph.com 2026-02-12T06:41:27.302 DEBUG:teuthology.orchestra.run.trial106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T06:41:27.368 INFO:teuthology.orchestra.run.trial106.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T06:41:27.368 INFO:teuthology.orchestra.run.trial106.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T06:41:27.368 INFO:teuthology.orchestra.run.trial106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T06:41:27.368 INFO:teuthology.orchestra.run.trial106.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T06:41:27.369 INFO:teuthology.orchestra.run.trial106.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T06:41:27.369 INFO:teuthology.orchestra.run.trial106.stdout: = sunit=0 swidth=0 blks 2026-02-12T06:41:27.369 INFO:teuthology.orchestra.run.trial106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T06:41:27.369 INFO:teuthology.orchestra.run.trial106.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T06:41:27.369 INFO:teuthology.orchestra.run.trial106.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T06:41:27.369 INFO:teuthology.orchestra.run.trial106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T06:41:27.948 INFO:teuthology.orchestra.run.trial106.stdout:Discarding blocks...Done. 2026-02-12T06:41:27.950 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial106.front.sepia.ceph.com -o noatime 2026-02-12T06:41:27.950 DEBUG:teuthology.orchestra.run.trial106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-12T06:41:28.023 DEBUG:teuthology.orchestra.run.trial106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-12T06:41:28.094 DEBUG:teuthology.orchestra.run.trial106:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-12T06:41:28.158 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-12T06:41:28.158 INFO:tasks.ceph:role: osd.3 2026-02-12T06:41:28.158 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial106.front.sepia.ceph.com 2026-02-12T06:41:28.159 DEBUG:teuthology.orchestra.run.trial106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T06:41:28.223 INFO:teuthology.orchestra.run.trial106.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T06:41:28.224 INFO:teuthology.orchestra.run.trial106.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T06:41:28.224 INFO:teuthology.orchestra.run.trial106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T06:41:28.224 INFO:teuthology.orchestra.run.trial106.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T06:41:28.224 INFO:teuthology.orchestra.run.trial106.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T06:41:28.224 INFO:teuthology.orchestra.run.trial106.stdout: = sunit=0 swidth=0 blks 2026-02-12T06:41:28.224 INFO:teuthology.orchestra.run.trial106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T06:41:28.224 INFO:teuthology.orchestra.run.trial106.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T06:41:28.224 INFO:teuthology.orchestra.run.trial106.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T06:41:28.224 INFO:teuthology.orchestra.run.trial106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T06:41:28.784 INFO:teuthology.orchestra.run.trial106.stdout:Discarding blocks...Done. 2026-02-12T06:41:28.786 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial106.front.sepia.ceph.com -o noatime 2026-02-12T06:41:28.786 DEBUG:teuthology.orchestra.run.trial106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2026-02-12T06:41:28.855 DEBUG:teuthology.orchestra.run.trial106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-12T06:41:28.924 DEBUG:teuthology.orchestra.run.trial106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T06:41:29.072 INFO:teuthology.orchestra.run.trial106.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T06:41:29.129 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:29,126 seastar - Reactor backend: linux-aio 2026-02-12T06:41:29.137 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:29,134 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T06:41:29.138 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:29,134 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T06:41:29.140 INFO:teuthology.orchestra.run.trial106.stderr:==21151==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T06:41:29.196 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:29,192 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-12T06:41:29.196 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:29,192 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-12T06:41:29.196 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:29,192 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-12T06:41:29.196 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:29,192 [shard 0:main] osd - Configure option_name crimson_reactor_backend with value : linux-aio 2026-02-12T06:41:29.196 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:29,192 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-12T06:41:29.196 INFO:teuthology.orchestra.run.trial106.stderr:DEBUG 2026-02-12 06:41:29,192 [shard 0:main] seastar - reactor::drain 2026-02-12T06:41:31.249 INFO:teuthology.orchestra.run.trial106.stderr:----------------------------------------------------- 2026-02-12T06:41:31.250 INFO:teuthology.orchestra.run.trial106.stderr:Suppressions used: 2026-02-12T06:41:31.250 INFO:teuthology.orchestra.run.trial106.stderr: count bytes template 2026-02-12T06:41:31.250 INFO:teuthology.orchestra.run.trial106.stderr: 1 8 MallocExtension::Register 2026-02-12T06:41:31.250 INFO:teuthology.orchestra.run.trial106.stderr:----------------------------------------------------- 2026-02-12T06:41:31.250 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-12T06:41:31.268 INFO:teuthology.orchestra.run.trial106.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T06:41:31.268 INFO:teuthology.orchestra.run.trial106.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T06:41:31.313 INFO:teuthology.orchestra.run.trial106.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T06:41:31.313 INFO:teuthology.orchestra.run.trial106.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T06:41:31.320 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:31,317 seastar - Reactor backend: linux-aio 2026-02-12T06:41:31.333 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:31,330 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T06:41:31.334 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:31,330 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T06:41:31.337 INFO:teuthology.orchestra.run.trial106.stderr:==21149==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T06:41:31.337 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:31,334 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T06:41:31.395 INFO:teuthology.orchestra.run.trial106.stderr:DEBUG 2026-02-12 06:41:31,392 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-12T06:41:31.474 INFO:teuthology.orchestra.run.trial106.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6622 /lib64/libasan.so.8+0x157e7 0x1092cf7 0xf2fdae 0x9c70283 0x9c7074d 0x9c709c0 0x9c726e7 0x9c72c34 0x9c72e33 0x9d58155 0x9d588b0 0x9d62b3e 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:31.475 INFO:teuthology.orchestra.run.trial106.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x8eea /lib64/libasan.so.8+0xedc65 0xe1e15b 0x78a0a37 0x7bb2209 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:31.475 INFO:teuthology.orchestra.run.trial106.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff98291052 0xffffffff98f4d451 0xffffffff99000ba2 2026-02-12T06:41:31.475 INFO:teuthology.orchestra.run.trial106.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xfcb23 /lib64/libasan.so.8+0xc65f2 /lib64/libasan.so.8+0x157e7 0x1092cf7 0xf2fdae 0x9c70283 0x9c7074d 0x9c709c0 0x9c70c76 0x9c71725 0x9c71c23 0x9c72253 0x9c723bd 0x9d5272d 0x9d65530 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:31.621 INFO:teuthology.orchestra.run.trial106.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297e4 /lib64/libasan.so.8+0xc6631 /lib64/libasan.so.8+0x157e7 0x1092cf7 0xf2fdae 0x9c70450 0x9c7074d 0x9c709c0 0x9c726e7 0x9c72c34 0x9c72e33 0x9d58155 0x9d588b0 0x9d62b3e 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:31.621 INFO:teuthology.orchestra.run.trial106.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0xe075b3 0x11277c5 0xf2fda3 0x9c70450 0x9c7074d 0x9c709c0 0x9c70c76 0x9c71238 0x9c796df 0x9c79dbf 0x9d6290c 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:31.622 INFO:teuthology.orchestra.run.trial106.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7fc 0x9b44d0b 0x9bc24a6 0x9bc25bc 0x9bc2698 0x9bc2d54 0x9bc29cd 0x9bc2ebb 0x9bc32bf 0x9bc357c 0x9d65185 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:31.622 INFO:teuthology.orchestra.run.trial106.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff985a99fb 0xffffffff9865e032 0xffffffff9865e107 0xffffffff985e9091 0xffffffff985c97b4 0xffffffff985d3b7b 0xffffffff985d3fdb 0xffffffff982910d2 0xffffffff98f4d451 0xffffffff99000ba2 2026-02-12T06:41:33.786 INFO:teuthology.orchestra.run.trial106.stderr:----------------------------------------------------- 2026-02-12T06:41:33.787 INFO:teuthology.orchestra.run.trial106.stderr:Suppressions used: 2026-02-12T06:41:33.787 INFO:teuthology.orchestra.run.trial106.stderr: count bytes template 2026-02-12T06:41:33.787 INFO:teuthology.orchestra.run.trial106.stderr: 1 8 MallocExtension::Register 2026-02-12T06:41:33.787 INFO:teuthology.orchestra.run.trial106.stderr:----------------------------------------------------- 2026-02-12T06:41:33.787 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-12T06:41:33.818 DEBUG:teuthology.orchestra.run.trial106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-12T06:41:33.858 DEBUG:teuthology.orchestra.run.trial106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T06:41:34.013 INFO:teuthology.orchestra.run.trial106.stderr:INFO  osd - OSD::main: parsing early config 2026-02-12T06:41:34.075 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:34,072 seastar - Reactor backend: linux-aio 2026-02-12T06:41:34.084 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:34,081 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T06:41:34.085 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:34,081 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T06:41:34.087 INFO:teuthology.orchestra.run.trial106.stderr:==21214==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T06:41:34.142 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:34,138 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-12T06:41:34.142 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:34,138 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-12T06:41:34.143 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:34,139 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-12T06:41:34.143 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:34,139 [shard 0:main] osd - Configure option_name crimson_reactor_backend with value : linux-aio 2026-02-12T06:41:34.143 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:34,139 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-12T06:41:34.143 INFO:teuthology.orchestra.run.trial106.stderr:DEBUG 2026-02-12 06:41:34,139 [shard 0:main] seastar - reactor::drain 2026-02-12T06:41:36.232 INFO:teuthology.orchestra.run.trial106.stderr:----------------------------------------------------- 2026-02-12T06:41:36.232 INFO:teuthology.orchestra.run.trial106.stderr:Suppressions used: 2026-02-12T06:41:36.232 INFO:teuthology.orchestra.run.trial106.stderr: count bytes template 2026-02-12T06:41:36.232 INFO:teuthology.orchestra.run.trial106.stderr: 1 8 MallocExtension::Register 2026-02-12T06:41:36.232 INFO:teuthology.orchestra.run.trial106.stderr:----------------------------------------------------- 2026-02-12T06:41:36.232 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-12T06:41:36.251 INFO:teuthology.orchestra.run.trial106.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-12T06:41:36.251 INFO:teuthology.orchestra.run.trial106.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-12T06:41:36.297 INFO:teuthology.orchestra.run.trial106.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-12T06:41:36.298 INFO:teuthology.orchestra.run.trial106.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-12T06:41:36.304 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:36,301 seastar - Reactor backend: linux-aio 2026-02-12T06:41:36.321 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:36,317 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T06:41:36.321 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:36,317 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-12T06:41:36.324 INFO:teuthology.orchestra.run.trial106.stderr:==21212==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-12T06:41:36.324 INFO:teuthology.orchestra.run.trial106.stderr:INFO 2026-02-12 06:41:36,321 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-12T06:41:36.382 INFO:teuthology.orchestra.run.trial106.stderr:DEBUG 2026-02-12 06:41:36,378 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-12T06:41:36.460 INFO:teuthology.orchestra.run.trial106.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0xb6f0ee 0x9d39a7b 0x9d39c42 0x9d39cee 0x9d61e0d 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:36.460 INFO:teuthology.orchestra.run.trial106.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xeaf7e 0x3605471 0x9d427eb 0x9d42990 0x9d42d22 0x9d44309 0x9d45624 0x9d45a44 0x9d622cf 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:36.460 INFO:teuthology.orchestra.run.trial106.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/ld-linux-x86-64.so.2+0x16ec3 /lib64/libasan.so.8+0xc6611 /lib64/libasan.so.8+0x151b7 0x4d43ba2 0x9d453ab 0x9d45550 0x9d45a44 0x9d622cf 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f93ace 0x6f978cf 0x6f9d479 0x74115d6 0x7433c3e 0x7283c37 0x7283d2f 0x7354fe2 0x735509b 0x7355252 0x7433cbf 0x7283dac 0x7283e31 0x72afa7b 0x741c466 0x741c4eb 0x741c5c9 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:36.609 INFO:teuthology.orchestra.run.trial106.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0xcb11f0 0x1092bd4 0xf2fdae 0x9d53335 0x9d5367a 0x9d539fd 0x9d63b54 0x9d66fb7 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:36.610 INFO:teuthology.orchestra.run.trial106.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f 0x11a59e8 0x1092eeb 0xfe64ce 0x9bc4214 0x9d3b018 0x9d3b111 0x7bb2246 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:36.610 INFO:teuthology.orchestra.run.trial106.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54ed3 0x9e4796c 0x9e47c55 0x9ea85f3 0x9ea8de6 0x9ea9054 0x9ea919c 0x9ea965b /lib64/libc.so.6+0x3fc2f /lib64/libstdc++.so.6+0xc6247 0x316b41d 0x9c706bd 0x9c709c0 0x9c70c76 0x9c71725 0x9c71c23 0x9c72253 0x9c723bd 0x9d5272d 0x9d65530 0x9d27585 0x9d26585 0x7bb28d7 0x7bbc3a0 0x7a3ca55 0x7a7cdbd 0x7113237 0x6f3791e 0x6f39c86 0x747c276 0x729b1dd 0x729b2df 0x729b3d7 0x73541ae 0x7354267 0x735441a 0x7354552 0x73545cd 0x7354652 0x73547ad 0x741bee3 0x747c2ff 0x7282672 0x729b554 0x73a9088 0x74287fc 0x7428877 0x74288f2 0x74ec4a2 0x75da55c 0x9f024bb 0x9e56790 0x9f2ff2b 0x9f9870e 0x9fb319e 0x9fb381a 0x26ed857 0xa5c1720 /lib64/libasan.so.8+0x2a589 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-12T06:41:38.787 INFO:teuthology.orchestra.run.trial106.stderr:----------------------------------------------------- 2026-02-12T06:41:38.787 INFO:teuthology.orchestra.run.trial106.stderr:Suppressions used: 2026-02-12T06:41:38.788 INFO:teuthology.orchestra.run.trial106.stderr: count bytes template 2026-02-12T06:41:38.788 INFO:teuthology.orchestra.run.trial106.stderr: 1 8 MallocExtension::Register 2026-02-12T06:41:38.788 INFO:teuthology.orchestra.run.trial106.stderr:----------------------------------------------------- 2026-02-12T06:41:38.788 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-12T06:41:38.821 DEBUG:teuthology.orchestra.run.trial106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-12T06:41:38.846 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-12T06:41:38.846 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:41:38.847 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-12T06:41:38.873 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:41:38.874 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-12T06:41:38.938 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-12T06:41:38.938 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-12T06:41:38.964 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-12T06:41:38.965 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-12T06:41:39.028 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-12T06:41:39.029 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-12T06:41:39.096 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:41:39.096 DEBUG:teuthology.orchestra.run.trial058:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-12T06:41:39.114 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-12T06:41:39.114 DEBUG:teuthology.orchestra.run.trial106:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2026-02-12T06:41:39.152 INFO:tasks.ceph:Adding keys to all mons... 2026-02-12T06:41:39.153 DEBUG:teuthology.orchestra.run.trial058:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-12T06:41:39.177 INFO:teuthology.orchestra.run.trial058.stdout:[osd.0] 2026-02-12T06:41:39.177 INFO:teuthology.orchestra.run.trial058.stdout: key = AQAPdo1p+Y8GNBAALeB6yadjvlzxpu3WUSyg+g== 2026-02-12T06:41:39.177 INFO:teuthology.orchestra.run.trial058.stdout:[osd.1] 2026-02-12T06:41:39.177 INFO:teuthology.orchestra.run.trial058.stdout: key = AQAUdo1p75xwMRAAm03zN2pl2VMJcCCFWE4Eeg== 2026-02-12T06:41:39.177 INFO:teuthology.orchestra.run.trial058.stdout:[mgr.x] 2026-02-12T06:41:39.177 INFO:teuthology.orchestra.run.trial058.stdout: key = AQALdo1p+ZPuIhAAfxzumImkfI3mwcgP5nVu0w== 2026-02-12T06:41:39.177 INFO:teuthology.orchestra.run.trial058.stdout:[osd.2] 2026-02-12T06:41:39.178 INFO:teuthology.orchestra.run.trial058.stdout: key = AQAbdo1psiqbFxAAZVsnKf9SbN03TnFSpkyaeg== 2026-02-12T06:41:39.178 INFO:teuthology.orchestra.run.trial058.stdout:[osd.3] 2026-02-12T06:41:39.178 INFO:teuthology.orchestra.run.trial058.stdout: key = AQAgdo1pgT/OFhAAIj4xXxFhUh7ZmGt6YczN/g== 2026-02-12T06:41:39.178 INFO:teuthology.orchestra.run.trial058.stdout:[client.0] 2026-02-12T06:41:39.178 INFO:teuthology.orchestra.run.trial058.stdout: key = AQALdo1phdANJhAAO6FxTHcZVlhiu0QxOMq+Kw== 2026-02-12T06:41:39.178 INFO:teuthology.orchestra.run.trial058.stdout:[client.1] 2026-02-12T06:41:39.178 INFO:teuthology.orchestra.run.trial058.stdout: key = AQALdo1pQD3MKBAA9127n/aHPTt/M+gD1542/g== 2026-02-12T06:41:39.179 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T06:41:39.266 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T06:41:39.313 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-12T06:41:39.362 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T06:41:39.418 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T06:41:39.470 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-12T06:41:39.521 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-12T06:41:39.571 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-12T06:41:39.572 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-12T06:41:39.596 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T06:41:39.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:39.685+0000 7fdb6a433c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:39.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:39.685+0000 7fdb6a433c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:39.693 DEBUG:teuthology.orchestra.run.trial058:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-12T06:41:39.718 DEBUG:teuthology.orchestra.run.trial058:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-12T06:41:39.776 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-12T06:41:39.777 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-12T06:41:39.777 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-12T06:41:39.818 INFO:tasks.ceph.mon.a:Started 2026-02-12T06:41:39.819 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-12T06:41:39.819 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-12T06:41:39.819 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-12T06:41:39.822 INFO:tasks.ceph.mgr.x:Started 2026-02-12T06:41:39.822 DEBUG:tasks.ceph:set 0 configs 2026-02-12T06:41:39.822 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config dump 2026-02-12T06:41:39.879 INFO:tasks.ceph.mon.a.trial058.stderr:2026-02-12T06:41:39.882+0000 7f6a4a085c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:39.879 INFO:tasks.ceph.mon.a.trial058.stderr:2026-02-12T06:41:39.882+0000 7f6a4a085c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:39.879 INFO:tasks.ceph.mon.a.trial058.stderr:2026-02-12T06:41:39.882+0000 7f6a4a085c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:39.881 INFO:tasks.ceph.mgr.x.trial106.stderr:2026-02-12T06:41:39.877+0000 7f7c1962dfc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:39.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:39.896+0000 7fbca565a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:39.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:39.902+0000 7fbca565a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:39.905 INFO:tasks.ceph.mgr.x.trial106.stderr:2026-02-12T06:41:39.902+0000 7f7c1962dfc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:39.906 INFO:tasks.ceph.mgr.x.trial106.stderr:2026-02-12T06:41:39.902+0000 7f7c1962dfc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:39.931 INFO:teuthology.orchestra.run.trial058.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-12T06:41:39.939 INFO:tasks.ceph:Setting crush tunables to default 2026-02-12T06:41:39.940 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph osd crush tunables default 2026-02-12T06:41:40.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:40.013+0000 7f2ec9e06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:40.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:40.018+0000 7f2ec9e06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:40.050 INFO:teuthology.orchestra.run.trial058.stderr:adjusted tunables profile to default 2026-02-12T06:41:40.057 INFO:tasks.ceph:check_enable_crimson: True 2026-02-12T06:41:40.058 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-12T06:41:40.058 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-12T06:41:40.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:40.131+0000 7f9c7605a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:40.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:40.136+0000 7f9c7605a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:40.172 INFO:tasks.ceph.mon.a.trial058.stderr:2026-02-12T06:41:40.175+0000 7f6a417f1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-12T06:41:40.172 INFO:tasks.ceph.mon.a.trial058.stderr:Please be aware that this feature is experimental, untested, 2026-02-12T06:41:40.172 INFO:tasks.ceph.mon.a.trial058.stderr:unsupported, and may result in data corruption, data loss, 2026-02-12T06:41:40.172 INFO:tasks.ceph.mon.a.trial058.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-12T06:41:40.172 INFO:tasks.ceph.mon.a.trial058.stderr:feature with important data. 2026-02-12T06:41:40.172 INFO:tasks.ceph.mon.a.trial058.stderr: 2026-02-12T06:41:40.745 INFO:tasks.ceph.mgr.x.trial106.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-12T06:41:40.745 INFO:tasks.ceph.mgr.x.trial106.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-12T06:41:40.745 INFO:tasks.ceph.mgr.x.trial106.stderr: from numpy import show_config as show_numpy_config 2026-02-12T06:41:41.062 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-12T06:41:41.062 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:41:41.062 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-12T06:41:41.087 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:41:41.088 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-12T06:41:41.150 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-12T06:41:41.150 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-12T06:41:41.175 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-12T06:41:41.176 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-12T06:41:41.240 DEBUG:teuthology.orchestra.run.trial106:> sudo ceph --cluster ceph osd new 65efb09a-b3a9-4ea6-a3b6-cc159edef038 0 2026-02-12T06:41:41.352 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-12T06:41:41.345+0000 7f88d490b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:41.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-12T06:41:41.351+0000 7f88d3682640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:41.393 INFO:teuthology.orchestra.run.trial106.stdout:0 2026-02-12T06:41:41.402 DEBUG:teuthology.orchestra.run.trial106:> sudo ceph --cluster ceph osd new 8f3dee99-afc4-42fa-bbd5-3b890204cd09 1 2026-02-12T06:41:41.477 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-12T06:41:41.470+0000 7f517c25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:41.479 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-12T06:41:41.475+0000 7f517c25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:41.517 INFO:teuthology.orchestra.run.trial106.stdout:1 2026-02-12T06:41:41.526 DEBUG:teuthology.orchestra.run.trial106:> sudo ceph --cluster ceph osd new 0209b8d4-4241-459c-8bf6-363abfe3c98a 2 2026-02-12T06:41:41.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-12T06:41:41.592+0000 7f625701a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:41.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-12T06:41:41.598+0000 7f625701a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:41.639 INFO:teuthology.orchestra.run.trial106.stdout:2 2026-02-12T06:41:41.647 DEBUG:teuthology.orchestra.run.trial106:> sudo ceph --cluster ceph osd new d090767f-8c6b-4bdb-b42f-08bf24105f97 3 2026-02-12T06:41:41.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-12T06:41:41.715+0000 7f780d035640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:41.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-12T06:41:41.720+0000 7f780d035640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:41.762 INFO:teuthology.orchestra.run.trial106.stdout:3 2026-02-12T06:41:41.770 DEBUG:teuthology.orchestra.run.trial058:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-12T06:41:41.800 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-12T06:41:41.800 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-12T06:41:41.841 INFO:tasks.ceph.osd.0:Started 2026-02-12T06:41:41.842 DEBUG:teuthology.orchestra.run.trial058:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-12T06:41:41.869 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-12T06:41:41.870 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-12T06:41:41.912 INFO:tasks.ceph.osd.1:Started 2026-02-12T06:41:41.913 DEBUG:teuthology.orchestra.run.trial106:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-12T06:41:41.942 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-12T06:41:41.942 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-12T06:41:41.984 INFO:tasks.ceph.osd.2:Started 2026-02-12T06:41:41.984 DEBUG:teuthology.orchestra.run.trial106:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2026-02-12T06:41:42.012 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-12T06:41:42.012 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2026-02-12T06:41:42.054 INFO:tasks.ceph.osd.3:Started 2026-02-12T06:41:42.055 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T06:41:42.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:42.133+0000 7f0c38cb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:42.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:42.139+0000 7f0c38cb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:42.167 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:42.168 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":7,"fsid":"d37d84c8-e358-473e-b2a6-41c5fd7faa02","created":"2026-02-12T06:41:39.895085+0000","modified":"2026-02-12T06:41:41.766299+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T06:41:41.766299+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"65efb09a-b3a9-4ea6-a3b6-cc159edef038","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8f3dee99-afc4-42fa-bbd5-3b890204cd09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0209b8d4-4241-459c-8bf6-363abfe3c98a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d090767f-8c6b-4bdb-b42f-08bf24105f97","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T06:41:42.176 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-12T06:41:42.176 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-12T06:41:42.579 DEBUG:teuthology.orchestra.run.trial058:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T06:41:42.645 INFO:teuthology.misc.health.trial058.stderr:2026-02-12T06:41:42.646+0000 7f17708c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:42.647 INFO:teuthology.misc.health.trial058.stderr:2026-02-12T06:41:42.651+0000 7f17708c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:42.681 INFO:teuthology.misc.health.trial058.stdout: 2026-02-12T06:41:42.681 INFO:teuthology.misc.health.trial058.stdout:{"epoch":7,"fsid":"d37d84c8-e358-473e-b2a6-41c5fd7faa02","created":"2026-02-12T06:41:39.895085+0000","modified":"2026-02-12T06:41:41.766299+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T06:41:41.766299+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"65efb09a-b3a9-4ea6-a3b6-cc159edef038","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8f3dee99-afc4-42fa-bbd5-3b890204cd09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0209b8d4-4241-459c-8bf6-363abfe3c98a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d090767f-8c6b-4bdb-b42f-08bf24105f97","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T06:41:42.686 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-12T06:41:43.113 INFO:tasks.ceph.mgr.x.trial106.stderr:2026-02-12T06:41:43.109+0000 7f7b341df640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-12T06:41:49.089 DEBUG:teuthology.orchestra.run.trial058:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T06:41:49.162 INFO:teuthology.misc.health.trial058.stderr:2026-02-12T06:41:49.162+0000 7eff8bda4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:49.165 INFO:teuthology.misc.health.trial058.stderr:2026-02-12T06:41:49.167+0000 7eff8bda4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:49.275 INFO:teuthology.misc.health.trial058.stdout: 2026-02-12T06:41:49.275 INFO:teuthology.misc.health.trial058.stdout:{"epoch":11,"fsid":"d37d84c8-e358-473e-b2a6-41c5fd7faa02","created":"2026-02-12T06:41:39.895085+0000","modified":"2026-02-12T06:41:49.127662+0000","last_up_change":"2026-02-12T06:41:49.127662+0000","last_in_change":"2026-02-12T06:41:41.766299+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"65efb09a-b3a9-4ea6-a3b6-cc159edef038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6803","nonce":250796605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":250796605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":250796605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6807","nonce":250796605}]},"public_addr":"10.20.193.58:6803/250796605","cluster_addr":"10.20.193.58:6804/250796605","heartbeat_back_addr":"10.20.193.58:6806/250796605","heartbeat_front_addr":"10.20.193.58:6807/250796605","state":["exists","up"]},{"osd":1,"uuid":"8f3dee99-afc4-42fa-bbd5-3b890204cd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6801","nonce":676908965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":676908965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":676908965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6805","nonce":676908965}]},"public_addr":"10.20.193.58:6801/676908965","cluster_addr":"10.20.193.58:6800/676908965","heartbeat_back_addr":"10.20.193.58:6802/676908965","heartbeat_front_addr":"10.20.193.58:6805/676908965","state":["exists","up"]},{"osd":2,"uuid":"0209b8d4-4241-459c-8bf6-363abfe3c98a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6803","nonce":728412104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6804","nonce":728412104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6809","nonce":728412104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6808","nonce":728412104}]},"public_addr":"10.20.193.106:6803/728412104","cluster_addr":"10.20.193.106:6804/728412104","heartbeat_back_addr":"10.20.193.106:6809/728412104","heartbeat_front_addr":"10.20.193.106:6808/728412104","state":["exists","up"]},{"osd":3,"uuid":"d090767f-8c6b-4bdb-b42f-08bf24105f97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6802","nonce":3015329221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6805","nonce":3015329221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6807","nonce":3015329221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6806","nonce":3015329221}]},"public_addr":"10.20.193.106:6802/3015329221","cluster_addr":"10.20.193.106:6805/3015329221","heartbeat_back_addr":"10.20.193.106:6807/3015329221","heartbeat_front_addr":"10.20.193.106:6806/3015329221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T06:41:49.283 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-12T06:41:49.283 INFO:tasks.ceph:Creating RBD pool 2026-02-12T06:41:49.283 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-12T06:41:49.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:49.355+0000 7fbe98de4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:49.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:49.362+0000 7fbe98de4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:50.130 INFO:teuthology.orchestra.run.trial058.stderr:pool 'rbd' created 2026-02-12T06:41:50.143 DEBUG:teuthology.orchestra.run.trial058:> rbd --cluster ceph pool init rbd 2026-02-12T06:41:50.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:50.188+0000 7ffbe4a0e240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:50.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:50.188+0000 7ffbe4a0e240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:50.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:50.191+0000 7ffbe4a0e240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:53.165 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-12T06:41:53.166 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-12T06:41:53.167 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-12T06:41:53.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:53.281+0000 7f1476f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:53.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:53.287+0000 7f1476f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:53.397 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:53.408 INFO:teuthology.orchestra.run.trial058.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-12T06:41:53.409 INFO:tasks.ceph_manager:config epoch is 1 2026-02-12T06:41:53.409 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-12T06:41:53.409 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-12T06:41:53.409 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-12T06:41:53.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:53.486+0000 7f84182cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:53.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:53.491+0000 7f84182cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:53.631 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:53.641 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6800","nonce":4177292193},{"type":"v1","addr":"10.20.193.106:6801","nonce":4177292193}]},"active_addr":"10.20.193.106:6801/4177292193","active_change":"2026-02-12T06:41:42.110358+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.106:0","nonce":882189254}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.106:0","nonce":2098277480}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.106:0","nonce":853841126}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.106:0","nonce":294187785}]}]} 2026-02-12T06:41:53.645 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-12T06:41:53.645 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-12T06:41:53.645 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T06:41:53.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:53.721+0000 7f43adde4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:53.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:53.726+0000 7f43adde4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:53.841 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:53.841 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":15,"fsid":"d37d84c8-e358-473e-b2a6-41c5fd7faa02","created":"2026-02-12T06:41:39.895085+0000","modified":"2026-02-12T06:41:53.140350+0000","last_up_change":"2026-02-12T06:41:49.127662+0000","last_in_change":"2026-02-12T06:41:41.766299+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-12T06:41:49.478102+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-12T06:41:50.131015+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65efb09a-b3a9-4ea6-a3b6-cc159edef038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6803","nonce":250796605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":250796605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":250796605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6807","nonce":250796605}]},"public_addr":"10.20.193.58:6803/250796605","cluster_addr":"10.20.193.58:6804/250796605","heartbeat_back_addr":"10.20.193.58:6806/250796605","heartbeat_front_addr":"10.20.193.58:6807/250796605","state":["exists","up"]},{"osd":1,"uuid":"8f3dee99-afc4-42fa-bbd5-3b890204cd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6801","nonce":676908965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":676908965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":676908965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6805","nonce":676908965}]},"public_addr":"10.20.193.58:6801/676908965","cluster_addr":"10.20.193.58:6800/676908965","heartbeat_back_addr":"10.20.193.58:6802/676908965","heartbeat_front_addr":"10.20.193.58:6805/676908965","state":["exists","up"]},{"osd":2,"uuid":"0209b8d4-4241-459c-8bf6-363abfe3c98a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6803","nonce":728412104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6804","nonce":728412104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6809","nonce":728412104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6808","nonce":728412104}]},"public_addr":"10.20.193.106:6803/728412104","cluster_addr":"10.20.193.106:6804/728412104","heartbeat_back_addr":"10.20.193.106:6809/728412104","heartbeat_front_addr":"10.20.193.106:6808/728412104","state":["exists","up"]},{"osd":3,"uuid":"d090767f-8c6b-4bdb-b42f-08bf24105f97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6802","nonce":3015329221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6805","nonce":3015329221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6807","nonce":3015329221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6806","nonce":3015329221}]},"public_addr":"10.20.193.106:6802/3015329221","cluster_addr":"10.20.193.106:6805/3015329221","heartbeat_back_addr":"10.20.193.106:6807/3015329221","heartbeat_front_addr":"10.20.193.106:6806/3015329221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T06:41:53.853 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-12T06:41:53.854 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T06:41:53.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:53.929+0000 7f3f6637b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:53.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:53.934+0000 7f3f6637b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:54.047 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:54.047 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":15,"fsid":"d37d84c8-e358-473e-b2a6-41c5fd7faa02","created":"2026-02-12T06:41:39.895085+0000","modified":"2026-02-12T06:41:53.140350+0000","last_up_change":"2026-02-12T06:41:49.127662+0000","last_in_change":"2026-02-12T06:41:41.766299+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-12T06:41:49.478102+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-12T06:41:50.131015+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65efb09a-b3a9-4ea6-a3b6-cc159edef038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6803","nonce":250796605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":250796605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":250796605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6807","nonce":250796605}]},"public_addr":"10.20.193.58:6803/250796605","cluster_addr":"10.20.193.58:6804/250796605","heartbeat_back_addr":"10.20.193.58:6806/250796605","heartbeat_front_addr":"10.20.193.58:6807/250796605","state":["exists","up"]},{"osd":1,"uuid":"8f3dee99-afc4-42fa-bbd5-3b890204cd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6801","nonce":676908965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":676908965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":676908965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6805","nonce":676908965}]},"public_addr":"10.20.193.58:6801/676908965","cluster_addr":"10.20.193.58:6800/676908965","heartbeat_back_addr":"10.20.193.58:6802/676908965","heartbeat_front_addr":"10.20.193.58:6805/676908965","state":["exists","up"]},{"osd":2,"uuid":"0209b8d4-4241-459c-8bf6-363abfe3c98a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6803","nonce":728412104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6804","nonce":728412104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6809","nonce":728412104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6808","nonce":728412104}]},"public_addr":"10.20.193.106:6803/728412104","cluster_addr":"10.20.193.106:6804/728412104","heartbeat_back_addr":"10.20.193.106:6809/728412104","heartbeat_front_addr":"10.20.193.106:6808/728412104","state":["exists","up"]},{"osd":3,"uuid":"d090767f-8c6b-4bdb-b42f-08bf24105f97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6802","nonce":3015329221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6805","nonce":3015329221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6807","nonce":3015329221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6806","nonce":3015329221}]},"public_addr":"10.20.193.106:6802/3015329221","cluster_addr":"10.20.193.106:6805/3015329221","heartbeat_back_addr":"10.20.193.106:6807/3015329221","heartbeat_front_addr":"10.20.193.106:6806/3015329221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T06:41:54.057 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-12T06:41:54.058 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-12T06:41:54.058 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-12T06:41:54.059 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-12T06:41:54.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:54.141+0000 7f715061a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:54.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:54.141+0000 7f315125a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:54.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:54.142+0000 7f8b130c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:54.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:54.147+0000 7f315125a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:54.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:54.147+0000 7f715061a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:54.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:54.147+0000 7f8b130c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:54.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:54.143+0000 7fa44eccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:54.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:54.151+0000 7fa44eccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:54.162 INFO:teuthology.orchestra.run.trial058.stdout:47244640261 2026-02-12T06:41:54.162 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T06:41:54.164 INFO:teuthology.orchestra.run.trial058.stdout:42949672966 2026-02-12T06:41:54.164 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T06:41:54.165 INFO:teuthology.orchestra.run.trial058.stdout:47244640261 2026-02-12T06:41:54.165 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T06:41:54.168 INFO:teuthology.orchestra.run.trial058.stdout:47244640261 2026-02-12T06:41:54.168 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-12T06:41:54.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:54.242+0000 7fe9d80cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:54.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:54.248+0000 7fe9d80cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:54.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:54.289+0000 7f61dbf7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:54.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:54.289+0000 7f5c658cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:54.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:54.290+0000 7f93f78cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:54.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:54.294+0000 7f61dbf7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:54.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:54.295+0000 7f5c658cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:54.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:54.297+0000 7f93f78cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:54.361 INFO:teuthology.orchestra.run.trial058.stdout:47244640260 2026-02-12T06:41:54.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.2 2026-02-12T06:41:54.406 INFO:teuthology.orchestra.run.trial058.stdout:42949672966 2026-02-12T06:41:54.408 INFO:teuthology.orchestra.run.trial058.stdout:47244640261 2026-02-12T06:41:54.411 INFO:teuthology.orchestra.run.trial058.stdout:47244640260 2026-02-12T06:41:54.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.1 2026-02-12T06:41:54.418 DEBUG:teuthology.parallel:result is None 2026-02-12T06:41:54.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.0 2026-02-12T06:41:54.419 DEBUG:teuthology.parallel:result is None 2026-02-12T06:41:54.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.3 2026-02-12T06:41:55.374 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T06:41:55.423 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-12T06:41:55.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:55.454+0000 7f4f3f5e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:55.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:55.460+0000 7f4f3f5e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:55.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:55.499+0000 7f31df6cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:55.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:55.505+0000 7f31df6cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:55.571 INFO:teuthology.orchestra.run.trial058.stdout:47244640260 2026-02-12T06:41:55.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.2 2026-02-12T06:41:55.615 INFO:teuthology.orchestra.run.trial058.stdout:47244640260 2026-02-12T06:41:55.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.3 2026-02-12T06:41:56.583 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T06:41:56.627 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-12T06:41:56.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:56.661+0000 7f89afe8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:56.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:56.667+0000 7f89afe8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:56.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:56.701+0000 7fd5020cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:56.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:56.707+0000 7fd5020cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:56.777 INFO:teuthology.orchestra.run.trial058.stdout:47244640261 2026-02-12T06:41:56.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.2 2026-02-12T06:41:56.789 DEBUG:teuthology.parallel:result is None 2026-02-12T06:41:56.815 INFO:teuthology.orchestra.run.trial058.stdout:47244640261 2026-02-12T06:41:56.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.3 2026-02-12T06:41:56.826 DEBUG:teuthology.parallel:result is None 2026-02-12T06:41:56.826 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-12T06:41:56.826 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T06:41:56.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:56.941+0000 7f2a9b164640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:56.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:56.946+0000 7f2a9b164640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:57.053 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:57.054 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-12T06:41:57.063 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2026-02-12T06:41:56.107574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83888736,"kb_used_data":83888736,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125826400,"statfs":{"total":214748299264,"available":128846233600,"internally_reserved":0,"allocated":85902065664,"data_stored":85902065664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.954702"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.144643+0000","last_change":"2026-02-12T06:41:53.149986+0000","last_active":"2026-02-12T06:41:53.144643+0000","last_peered":"2026-02-12T06:41:53.144643+0000","last_clean":"2026-02-12T06:41:53.144643+0000","last_became_active":"2026-02-12T06:41:51.169249+0000","last_became_peered":"2026-02-12T06:41:51.169249+0000","last_unstale":"2026-02-12T06:41:53.144643+0000","last_undegraded":"2026-02-12T06:41:53.144643+0000","last_fullsized":"2026-02-12T06:41:53.144643+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.146846+0000","last_change":"2026-02-12T06:41:53.149473+0000","last_active":"2026-02-12T06:41:53.146846+0000","last_peered":"2026-02-12T06:41:53.146846+0000","last_clean":"2026-02-12T06:41:53.146846+0000","last_became_active":"2026-02-12T06:41:51.180068+0000","last_became_peered":"2026-02-12T06:41:51.180068+0000","last_unstale":"2026-02-12T06:41:53.146846+0000","last_undegraded":"2026-02-12T06:41:53.146846+0000","last_fullsized":"2026-02-12T06:41:53.146846+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.146460+0000","last_change":"2026-02-12T06:41:53.148671+0000","last_active":"2026-02-12T06:41:53.146460+0000","last_peered":"2026-02-12T06:41:53.146460+0000","last_clean":"2026-02-12T06:41:53.146460+0000","last_became_active":"2026-02-12T06:41:51.169785+0000","last_became_peered":"2026-02-12T06:41:51.169785+0000","last_unstale":"2026-02-12T06:41:53.146460+0000","last_undegraded":"2026-02-12T06:41:53.146460+0000","last_fullsized":"2026-02-12T06:41:53.146460+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.152454+0000","last_change":"2026-02-12T06:41:53.154630+0000","last_active":"2026-02-12T06:41:53.152454+0000","last_peered":"2026-02-12T06:41:53.152454+0000","last_clean":"2026-02-12T06:41:53.152454+0000","last_became_active":"2026-02-12T06:41:51.169306+0000","last_became_peered":"2026-02-12T06:41:51.169306+0000","last_unstale":"2026-02-12T06:41:53.152454+0000","last_undegraded":"2026-02-12T06:41:53.152454+0000","last_fullsized":"2026-02-12T06:41:53.152454+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":81,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.146302+0000","last_change":"2026-02-12T06:41:51.193015+0000","last_active":"2026-02-12T06:41:53.146302+0000","last_peered":"2026-02-12T06:41:53.146302+0000","last_clean":"2026-02-12T06:41:53.146302+0000","last_became_active":"2026-02-12T06:41:51.179821+0000","last_became_peered":"2026-02-12T06:41:51.179821+0000","last_unstale":"2026-02-12T06:41:53.146302+0000","last_undegraded":"2026-02-12T06:41:53.146302+0000","last_fullsized":"2026-02-12T06:41:53.146302+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.150807+0000","last_change":"2026-02-12T06:41:53.154235+0000","last_active":"2026-02-12T06:41:53.150807+0000","last_peered":"2026-02-12T06:41:53.150807+0000","last_clean":"2026-02-12T06:41:53.150807+0000","last_became_active":"2026-02-12T06:41:51.171159+0000","last_became_peered":"2026-02-12T06:41:51.171159+0000","last_unstale":"2026-02-12T06:41:53.150807+0000","last_undegraded":"2026-02-12T06:41:53.150807+0000","last_fullsized":"2026-02-12T06:41:53.150807+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.147447+0000","last_change":"2026-02-12T06:41:53.147447+0000","last_active":"2026-02-12T06:41:53.147447+0000","last_peered":"2026-02-12T06:41:53.147447+0000","last_clean":"2026-02-12T06:41:53.147447+0000","last_became_active":"2026-02-12T06:41:51.159138+0000","last_became_peered":"2026-02-12T06:41:51.159138+0000","last_unstale":"2026-02-12T06:41:53.147447+0000","last_undegraded":"2026-02-12T06:41:53.147447+0000","last_fullsized":"2026-02-12T06:41:53.147447+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.146030+0000","last_change":"2026-02-12T06:41:53.148511+0000","last_active":"2026-02-12T06:41:53.146030+0000","last_peered":"2026-02-12T06:41:53.146030+0000","last_clean":"2026-02-12T06:41:53.146030+0000","last_became_active":"2026-02-12T06:41:51.172390+0000","last_became_peered":"2026-02-12T06:41:51.172390+0000","last_unstale":"2026-02-12T06:41:53.146030+0000","last_undegraded":"2026-02-12T06:41:53.146030+0000","last_fullsized":"2026-02-12T06:41:53.146030+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.145649+0000","last_change":"2026-02-12T06:41:53.149919+0000","last_active":"2026-02-12T06:41:53.145649+0000","last_peered":"2026-02-12T06:41:53.145649+0000","last_clean":"2026-02-12T06:41:53.145649+0000","last_became_active":"2026-02-12T06:41:51.162751+0000","last_became_peered":"2026-02-12T06:41:51.162751+0000","last_unstale":"2026-02-12T06:41:53.145649+0000","last_undegraded":"2026-02-12T06:41:53.145649+0000","last_fullsized":"2026-02-12T06:41:53.145649+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96634306560,"internally_reserved":0,"allocated":64426917888,"data_stored":64426917888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972560,"kb_used_data":20972560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456224,"statfs":{"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971824,"kb_used_data":20971824,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456960,"statfs":{"total":53687074816,"available":32211927040,"internally_reserved":0,"allocated":21475147776,"data_stored":21475147776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972528,"kb_used_data":20972528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456256,"statfs":{"total":53687074816,"available":32211206144,"internally_reserved":0,"allocated":21475868672,"data_stored":21475868672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971824,"kb_used_data":20971824,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456960,"statfs":{"total":53687074816,"available":32211927040,"internally_reserved":0,"allocated":21475147776,"data_stored":21475147776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211206144,"internally_reserved":0,"allocated":21475868672,"data_stored":21475868672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211927040,"internally_reserved":0,"allocated":21475147776,"data_stored":21475147776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T06:41:57.064 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T06:41:57.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:57.140+0000 7f7f5a4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:57.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:57.145+0000 7f7f5a4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:57.253 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:57.253 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-12T06:41:57.262 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2026-02-12T06:41:56.107574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83888736,"kb_used_data":83888736,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125826400,"statfs":{"total":214748299264,"available":128846233600,"internally_reserved":0,"allocated":85902065664,"data_stored":85902065664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.954702"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.144643+0000","last_change":"2026-02-12T06:41:53.149986+0000","last_active":"2026-02-12T06:41:53.144643+0000","last_peered":"2026-02-12T06:41:53.144643+0000","last_clean":"2026-02-12T06:41:53.144643+0000","last_became_active":"2026-02-12T06:41:51.169249+0000","last_became_peered":"2026-02-12T06:41:51.169249+0000","last_unstale":"2026-02-12T06:41:53.144643+0000","last_undegraded":"2026-02-12T06:41:53.144643+0000","last_fullsized":"2026-02-12T06:41:53.144643+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.146846+0000","last_change":"2026-02-12T06:41:53.149473+0000","last_active":"2026-02-12T06:41:53.146846+0000","last_peered":"2026-02-12T06:41:53.146846+0000","last_clean":"2026-02-12T06:41:53.146846+0000","last_became_active":"2026-02-12T06:41:51.180068+0000","last_became_peered":"2026-02-12T06:41:51.180068+0000","last_unstale":"2026-02-12T06:41:53.146846+0000","last_undegraded":"2026-02-12T06:41:53.146846+0000","last_fullsized":"2026-02-12T06:41:53.146846+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.146460+0000","last_change":"2026-02-12T06:41:53.148671+0000","last_active":"2026-02-12T06:41:53.146460+0000","last_peered":"2026-02-12T06:41:53.146460+0000","last_clean":"2026-02-12T06:41:53.146460+0000","last_became_active":"2026-02-12T06:41:51.169785+0000","last_became_peered":"2026-02-12T06:41:51.169785+0000","last_unstale":"2026-02-12T06:41:53.146460+0000","last_undegraded":"2026-02-12T06:41:53.146460+0000","last_fullsized":"2026-02-12T06:41:53.146460+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.152454+0000","last_change":"2026-02-12T06:41:53.154630+0000","last_active":"2026-02-12T06:41:53.152454+0000","last_peered":"2026-02-12T06:41:53.152454+0000","last_clean":"2026-02-12T06:41:53.152454+0000","last_became_active":"2026-02-12T06:41:51.169306+0000","last_became_peered":"2026-02-12T06:41:51.169306+0000","last_unstale":"2026-02-12T06:41:53.152454+0000","last_undegraded":"2026-02-12T06:41:53.152454+0000","last_fullsized":"2026-02-12T06:41:53.152454+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":81,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.146302+0000","last_change":"2026-02-12T06:41:51.193015+0000","last_active":"2026-02-12T06:41:53.146302+0000","last_peered":"2026-02-12T06:41:53.146302+0000","last_clean":"2026-02-12T06:41:53.146302+0000","last_became_active":"2026-02-12T06:41:51.179821+0000","last_became_peered":"2026-02-12T06:41:51.179821+0000","last_unstale":"2026-02-12T06:41:53.146302+0000","last_undegraded":"2026-02-12T06:41:53.146302+0000","last_fullsized":"2026-02-12T06:41:53.146302+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.150807+0000","last_change":"2026-02-12T06:41:53.154235+0000","last_active":"2026-02-12T06:41:53.150807+0000","last_peered":"2026-02-12T06:41:53.150807+0000","last_clean":"2026-02-12T06:41:53.150807+0000","last_became_active":"2026-02-12T06:41:51.171159+0000","last_became_peered":"2026-02-12T06:41:51.171159+0000","last_unstale":"2026-02-12T06:41:53.150807+0000","last_undegraded":"2026-02-12T06:41:53.150807+0000","last_fullsized":"2026-02-12T06:41:53.150807+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.147447+0000","last_change":"2026-02-12T06:41:53.147447+0000","last_active":"2026-02-12T06:41:53.147447+0000","last_peered":"2026-02-12T06:41:53.147447+0000","last_clean":"2026-02-12T06:41:53.147447+0000","last_became_active":"2026-02-12T06:41:51.159138+0000","last_became_peered":"2026-02-12T06:41:51.159138+0000","last_unstale":"2026-02-12T06:41:53.147447+0000","last_undegraded":"2026-02-12T06:41:53.147447+0000","last_fullsized":"2026-02-12T06:41:53.147447+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.146030+0000","last_change":"2026-02-12T06:41:53.148511+0000","last_active":"2026-02-12T06:41:53.146030+0000","last_peered":"2026-02-12T06:41:53.146030+0000","last_clean":"2026-02-12T06:41:53.146030+0000","last_became_active":"2026-02-12T06:41:51.172390+0000","last_became_peered":"2026-02-12T06:41:51.172390+0000","last_unstale":"2026-02-12T06:41:53.146030+0000","last_undegraded":"2026-02-12T06:41:53.146030+0000","last_fullsized":"2026-02-12T06:41:53.146030+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-12T06:41:53.145649+0000","last_change":"2026-02-12T06:41:53.149919+0000","last_active":"2026-02-12T06:41:53.145649+0000","last_peered":"2026-02-12T06:41:53.145649+0000","last_clean":"2026-02-12T06:41:53.145649+0000","last_became_active":"2026-02-12T06:41:51.162751+0000","last_became_peered":"2026-02-12T06:41:51.162751+0000","last_unstale":"2026-02-12T06:41:53.145649+0000","last_undegraded":"2026-02-12T06:41:53.145649+0000","last_fullsized":"2026-02-12T06:41:53.145649+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96634306560,"internally_reserved":0,"allocated":64426917888,"data_stored":64426917888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972560,"kb_used_data":20972560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456224,"statfs":{"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971824,"kb_used_data":20971824,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456960,"statfs":{"total":53687074816,"available":32211927040,"internally_reserved":0,"allocated":21475147776,"data_stored":21475147776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972528,"kb_used_data":20972528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456256,"statfs":{"total":53687074816,"available":32211206144,"internally_reserved":0,"allocated":21475868672,"data_stored":21475868672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971824,"kb_used_data":20971824,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456960,"statfs":{"total":53687074816,"available":32211927040,"internally_reserved":0,"allocated":21475147776,"data_stored":21475147776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211206144,"internally_reserved":0,"allocated":21475868672,"data_stored":21475868672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211927040,"internally_reserved":0,"allocated":21475147776,"data_stored":21475147776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32211173376,"internally_reserved":0,"allocated":21475901440,"data_stored":21475901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T06:41:57.263 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-12T06:41:57.263 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-12T06:41:57.263 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-12T06:41:57.263 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-12T06:41:57.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:57.338+0000 7f408eecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:57.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:41:57.342+0000 7f408eecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:41:57.482 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:41:57.482 INFO:teuthology.orchestra.run.trial058.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-12T06:41:57.491 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-12T06:41:57.491 INFO:teuthology.run_tasks:Running task workunit... 2026-02-12T06:41:57.507 INFO:tasks.workunit:Pulling workunits from ref 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T06:41:57.507 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-12T06:41:57.507 DEBUG:teuthology.orchestra.run.trial058:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-12T06:41:57.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T06:41:57.522 INFO:teuthology.orchestra.run.trial058.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-12T06:41:57.523 DEBUG:teuthology.orchestra.run.trial058:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-12T06:41:57.578 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-12T06:41:57.578 DEBUG:teuthology.orchestra.run.trial058:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-12T06:41:57.633 INFO:tasks.workunit:timeout=3h 2026-02-12T06:41:57.633 INFO:tasks.workunit:cleanup=True 2026-02-12T06:41:57.633 DEBUG:teuthology.orchestra.run.trial058:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/mohit84/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 2026-02-12T06:41:57.696 INFO:tasks.workunit.client.0.trial058.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-12T06:42:16.415 INFO:tasks.workunit.client.0.trial058.stderr:Note: switching to '5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0'. 2026-02-12T06:42:16.415 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-12T06:42:16.415 INFO:tasks.workunit.client.0.trial058.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-12T06:42:16.415 INFO:tasks.workunit.client.0.trial058.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-12T06:42:16.415 INFO:tasks.workunit.client.0.trial058.stderr:state without impacting any branches by switching back to a branch. 2026-02-12T06:42:16.415 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-12T06:42:16.415 INFO:tasks.workunit.client.0.trial058.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-12T06:42:16.415 INFO:tasks.workunit.client.0.trial058.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-12T06:42:16.415 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-12T06:42:16.416 INFO:tasks.workunit.client.0.trial058.stderr: git switch -c 2026-02-12T06:42:16.416 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-12T06:42:16.416 INFO:tasks.workunit.client.0.trial058.stderr:Or undo this operation with: 2026-02-12T06:42:16.416 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-12T06:42:16.416 INFO:tasks.workunit.client.0.trial058.stderr: git switch - 2026-02-12T06:42:16.416 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-12T06:42:16.416 INFO:tasks.workunit.client.0.trial058.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-12T06:42:16.416 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-12T06:42:16.416 INFO:tasks.workunit.client.0.trial058.stderr:HEAD is now at 5fdb7d8f131 crimson: Support io_uring as reactor backend option 2026-02-12T06:42:16.418 DEBUG:teuthology.orchestra.run.trial058:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-12T06:42:16.476 INFO:tasks.workunit.client.0.trial058.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-12T06:42:16.478 INFO:tasks.workunit.client.0.trial058.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-12T06:42:16.478 INFO:tasks.workunit.client.0.trial058.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-12T06:42:16.575 INFO:tasks.workunit.client.0.trial058.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-12T06:42:16.608 INFO:tasks.workunit.client.0.trial058.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-12T06:42:16.634 INFO:tasks.workunit.client.0.trial058.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-12T06:42:16.635 INFO:tasks.workunit.client.0.trial058.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-12T06:42:16.635 INFO:tasks.workunit.client.0.trial058.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-12T06:42:16.665 INFO:tasks.workunit.client.0.trial058.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-12T06:42:16.668 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-12T06:42:16.668 DEBUG:teuthology.orchestra.run.trial058:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-12T06:42:16.724 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2026-02-12T06:42:16.727 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2026-02-12T06:42:16.727 DEBUG:teuthology.orchestra.run.trial058:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5fdb7d8f131dcee024b0dd7d68acdff57e55c4e0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2026-02-12T06:42:16.799 INFO:tasks.workunit.client.0.trial058.stdout:Running main() from gmock_main.cc 2026-02-12T06:42:16.799 INFO:tasks.workunit.client.0.trial058.stdout:[==========] Running 31 tests from 1 test suite. 2026-02-12T06:42:16.799 INFO:tasks.workunit.client.0.trial058.stdout:[----------] Global test environment set-up. 2026-02-12T06:42:18.185 INFO:tasks.workunit.client.0.trial058.stdout:[----------] 31 tests from CmpOmap 2026-02-12T06:42:18.185 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2026-02-12T06:42:18.342 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (157 ms) 2026-02-12T06:42:18.343 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2026-02-12T06:42:18.364 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (21 ms) 2026-02-12T06:42:18.364 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2026-02-12T06:42:18.386 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (22 ms) 2026-02-12T06:42:18.387 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2026-02-12T06:42:18.407 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (20 ms) 2026-02-12T06:42:18.407 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_vals_str 2026-02-12T06:42:18.470 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_vals_str (62 ms) 2026-02-12T06:42:18.470 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2026-02-12T06:42:18.528 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_vals_u64 (58 ms) 2026-02-12T06:42:18.528 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2026-02-12T06:42:18.548 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (19 ms) 2026-02-12T06:42:18.548 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2026-02-12T06:42:18.571 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (23 ms) 2026-02-12T06:42:18.572 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2026-02-12T06:42:18.596 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (24 ms) 2026-02-12T06:42:18.596 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2026-02-12T06:42:18.635 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (39 ms) 2026-02-12T06:42:18.635 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2026-02-12T06:42:18.636 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (0 ms) 2026-02-12T06:42:18.636 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2026-02-12T06:42:18.637 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (0 ms) 2026-02-12T06:42:18.637 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2026-02-12T06:42:18.651 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (13 ms) 2026-02-12T06:42:18.651 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2026-02-12T06:42:18.692 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (41 ms) 2026-02-12T06:42:18.693 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2026-02-12T06:42:18.707 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (14 ms) 2026-02-12T06:42:18.707 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2026-02-12T06:42:18.746 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (39 ms) 2026-02-12T06:42:18.747 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2026-02-12T06:42:18.794 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_set_vals_str (47 ms) 2026-02-12T06:42:18.794 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2026-02-12T06:42:18.843 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (48 ms) 2026-02-12T06:42:18.843 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2026-02-12T06:42:18.863 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (20 ms) 2026-02-12T06:42:18.863 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2026-02-12T06:42:18.880 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (16 ms) 2026-02-12T06:42:18.880 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2026-02-12T06:42:18.881 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (0 ms) 2026-02-12T06:42:18.881 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2026-02-12T06:42:18.881 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2026-02-12T06:42:18.882 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2026-02-12T06:42:18.896 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (14 ms) 2026-02-12T06:42:18.896 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2026-02-12T06:42:18.909 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (13 ms) 2026-02-12T06:42:18.909 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2026-02-12T06:42:18.961 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (52 ms) 2026-02-12T06:42:18.962 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2026-02-12T06:42:19.016 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (54 ms) 2026-02-12T06:42:19.016 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2026-02-12T06:42:19.033 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (17 ms) 2026-02-12T06:42:19.034 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2026-02-12T06:42:19.049 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (15 ms) 2026-02-12T06:42:19.049 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2026-02-12T06:42:19.050 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2026-02-12T06:42:19.051 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2026-02-12T06:42:19.051 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2026-02-12T06:42:19.051 INFO:tasks.workunit.client.0.trial058.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2026-02-12T06:42:19.101 INFO:tasks.workunit.client.0.trial058.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (49 ms) 2026-02-12T06:42:19.101 INFO:tasks.workunit.client.0.trial058.stdout:[----------] 31 tests from CmpOmap (916 ms total) 2026-02-12T06:42:19.102 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-12T06:42:19.102 INFO:tasks.workunit.client.0.trial058.stdout:[----------] Global test environment tear-down 2026-02-12T06:42:19.185 INFO:tasks.workunit.client.0.trial058.stdout:[==========] 31 tests from 1 test suite ran. (2385 ms total) 2026-02-12T06:42:19.185 INFO:tasks.workunit.client.0.trial058.stdout:[ PASSED ] 31 tests. 2026-02-12T06:42:19.187 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-12T06:42:19.187 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-12T06:42:19.255 INFO:tasks.workunit:Stopping ['cls/test_cls_cmpomap.sh'] on client.0... 2026-02-12T06:42:19.256 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-12T06:42:19.590 DEBUG:teuthology.parallel:result is None 2026-02-12T06:42:19.590 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-12T06:42:19.614 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-12T06:42:19.614 DEBUG:teuthology.orchestra.run.trial058:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-12T06:42:19.671 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-12T06:42:19.672 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-12T06:42:19.694 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-12T06:42:19.695 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T06:42:19.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:19.786+0000 7f76ea85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:19.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:19.791+0000 7f76ea85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:19.897 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:42:19.898 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-12T06:42:19.906 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2026-02-12T06:42:19.179480+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83889792,"kb_used_data":83889792,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125825344,"statfs":{"total":214748299264,"available":128845152256,"internally_reserved":0,"allocated":85903147008,"data_stored":85903147008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.069051"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.188976+0000","last_change":"2026-02-12T06:41:53.149986+0000","last_active":"2026-02-12T06:42:18.188976+0000","last_peered":"2026-02-12T06:42:18.188976+0000","last_clean":"2026-02-12T06:42:18.188976+0000","last_became_active":"2026-02-12T06:41:51.169249+0000","last_became_peered":"2026-02-12T06:41:51.169249+0000","last_unstale":"2026-02-12T06:42:18.188976+0000","last_undegraded":"2026-02-12T06:42:18.188976+0000","last_fullsized":"2026-02-12T06:42:18.188976+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.190757+0000","last_change":"2026-02-12T06:41:53.149473+0000","last_active":"2026-02-12T06:42:18.190757+0000","last_peered":"2026-02-12T06:42:18.190757+0000","last_clean":"2026-02-12T06:42:18.190757+0000","last_became_active":"2026-02-12T06:41:51.180068+0000","last_became_peered":"2026-02-12T06:41:51.180068+0000","last_unstale":"2026-02-12T06:42:18.190757+0000","last_undegraded":"2026-02-12T06:42:18.190757+0000","last_fullsized":"2026-02-12T06:42:18.190757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.188423+0000","last_change":"2026-02-12T06:41:53.148671+0000","last_active":"2026-02-12T06:42:18.188423+0000","last_peered":"2026-02-12T06:42:18.188423+0000","last_clean":"2026-02-12T06:42:18.188423+0000","last_became_active":"2026-02-12T06:41:51.169785+0000","last_became_peered":"2026-02-12T06:41:51.169785+0000","last_unstale":"2026-02-12T06:42:18.188423+0000","last_undegraded":"2026-02-12T06:42:18.188423+0000","last_fullsized":"2026-02-12T06:42:18.188423+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-12T06:42:17.188394+0000","last_change":"2026-02-12T06:41:53.154630+0000","last_active":"2026-02-12T06:42:17.188394+0000","last_peered":"2026-02-12T06:42:17.188394+0000","last_clean":"2026-02-12T06:42:17.188394+0000","last_became_active":"2026-02-12T06:41:51.169306+0000","last_became_peered":"2026-02-12T06:41:51.169306+0000","last_unstale":"2026-02-12T06:42:17.188394+0000","last_undegraded":"2026-02-12T06:42:17.188394+0000","last_fullsized":"2026-02-12T06:42:17.188394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":87,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.189866+0000","last_change":"2026-02-12T06:41:51.193015+0000","last_active":"2026-02-12T06:42:18.189866+0000","last_peered":"2026-02-12T06:42:18.189866+0000","last_clean":"2026-02-12T06:42:18.189866+0000","last_became_active":"2026-02-12T06:41:51.179821+0000","last_became_peered":"2026-02-12T06:41:51.179821+0000","last_unstale":"2026-02-12T06:42:18.189866+0000","last_undegraded":"2026-02-12T06:42:18.189866+0000","last_fullsized":"2026-02-12T06:42:18.189866+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-12T06:42:17.187396+0000","last_change":"2026-02-12T06:41:53.154235+0000","last_active":"2026-02-12T06:42:17.187396+0000","last_peered":"2026-02-12T06:42:17.187396+0000","last_clean":"2026-02-12T06:42:17.187396+0000","last_became_active":"2026-02-12T06:41:51.171159+0000","last_became_peered":"2026-02-12T06:41:51.171159+0000","last_unstale":"2026-02-12T06:42:17.187396+0000","last_undegraded":"2026-02-12T06:42:17.187396+0000","last_fullsized":"2026-02-12T06:42:17.187396+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.187141+0000","last_change":"2026-02-12T06:41:53.147447+0000","last_active":"2026-02-12T06:42:18.187141+0000","last_peered":"2026-02-12T06:42:18.187141+0000","last_clean":"2026-02-12T06:42:18.187141+0000","last_became_active":"2026-02-12T06:41:51.159138+0000","last_became_peered":"2026-02-12T06:41:51.159138+0000","last_unstale":"2026-02-12T06:42:18.187141+0000","last_undegraded":"2026-02-12T06:42:18.187141+0000","last_fullsized":"2026-02-12T06:42:18.187141+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.187136+0000","last_change":"2026-02-12T06:41:53.148511+0000","last_active":"2026-02-12T06:42:18.187136+0000","last_peered":"2026-02-12T06:42:18.187136+0000","last_clean":"2026-02-12T06:42:18.187136+0000","last_became_active":"2026-02-12T06:41:51.172390+0000","last_became_peered":"2026-02-12T06:41:51.172390+0000","last_unstale":"2026-02-12T06:42:18.187136+0000","last_undegraded":"2026-02-12T06:42:18.187136+0000","last_fullsized":"2026-02-12T06:42:18.187136+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.188701+0000","last_change":"2026-02-12T06:41:53.149919+0000","last_active":"2026-02-12T06:42:18.188701+0000","last_peered":"2026-02-12T06:42:18.188701+0000","last_clean":"2026-02-12T06:42:18.188701+0000","last_became_active":"2026-02-12T06:41:51.162751+0000","last_became_peered":"2026-02-12T06:41:51.162751+0000","last_unstale":"2026-02-12T06:42:18.188701+0000","last_undegraded":"2026-02-12T06:42:18.188701+0000","last_fullsized":"2026-02-12T06:42:18.188701+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210182144,"internally_reserved":0,"allocated":21476892672,"data_stored":21476892672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96632496128,"internally_reserved":0,"allocated":64428728320,"data_stored":64428728320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972816,"kb_used_data":20972816,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31455968,"statfs":{"total":53687074816,"available":32210911232,"internally_reserved":0,"allocated":21476163584,"data_stored":21476163584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971976,"kb_used_data":20971976,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456808,"statfs":{"total":53687074816,"available":32211771392,"internally_reserved":0,"allocated":21475303424,"data_stored":21475303424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972528,"kb_used_data":20972528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456256,"statfs":{"total":53687074816,"available":32211206144,"internally_reserved":0,"allocated":21475868672,"data_stored":21475868672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640286,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972472,"kb_used_data":20972472,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456312,"statfs":{"total":53687074816,"available":32211263488,"internally_reserved":0,"allocated":21475811328,"data_stored":21475811328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211132416,"internally_reserved":0,"allocated":21475942400,"data_stored":21475942400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211181568,"internally_reserved":0,"allocated":21475893248,"data_stored":21475893248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32210182144,"internally_reserved":0,"allocated":21476892672,"data_stored":21476892672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210182144,"internally_reserved":0,"allocated":21476892672,"data_stored":21476892672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T06:42:19.908 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T06:42:19.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:19.985+0000 7fb73d65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:19.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:19.989+0000 7fb73d65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:20.094 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:42:20.095 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-12T06:42:20.104 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2026-02-12T06:42:19.179480+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83889792,"kb_used_data":83889792,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125825344,"statfs":{"total":214748299264,"available":128845152256,"internally_reserved":0,"allocated":85903147008,"data_stored":85903147008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.069051"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.188976+0000","last_change":"2026-02-12T06:41:53.149986+0000","last_active":"2026-02-12T06:42:18.188976+0000","last_peered":"2026-02-12T06:42:18.188976+0000","last_clean":"2026-02-12T06:42:18.188976+0000","last_became_active":"2026-02-12T06:41:51.169249+0000","last_became_peered":"2026-02-12T06:41:51.169249+0000","last_unstale":"2026-02-12T06:42:18.188976+0000","last_undegraded":"2026-02-12T06:42:18.188976+0000","last_fullsized":"2026-02-12T06:42:18.188976+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.190757+0000","last_change":"2026-02-12T06:41:53.149473+0000","last_active":"2026-02-12T06:42:18.190757+0000","last_peered":"2026-02-12T06:42:18.190757+0000","last_clean":"2026-02-12T06:42:18.190757+0000","last_became_active":"2026-02-12T06:41:51.180068+0000","last_became_peered":"2026-02-12T06:41:51.180068+0000","last_unstale":"2026-02-12T06:42:18.190757+0000","last_undegraded":"2026-02-12T06:42:18.190757+0000","last_fullsized":"2026-02-12T06:42:18.190757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.188423+0000","last_change":"2026-02-12T06:41:53.148671+0000","last_active":"2026-02-12T06:42:18.188423+0000","last_peered":"2026-02-12T06:42:18.188423+0000","last_clean":"2026-02-12T06:42:18.188423+0000","last_became_active":"2026-02-12T06:41:51.169785+0000","last_became_peered":"2026-02-12T06:41:51.169785+0000","last_unstale":"2026-02-12T06:42:18.188423+0000","last_undegraded":"2026-02-12T06:42:18.188423+0000","last_fullsized":"2026-02-12T06:42:18.188423+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-12T06:42:17.188394+0000","last_change":"2026-02-12T06:41:53.154630+0000","last_active":"2026-02-12T06:42:17.188394+0000","last_peered":"2026-02-12T06:42:17.188394+0000","last_clean":"2026-02-12T06:42:17.188394+0000","last_became_active":"2026-02-12T06:41:51.169306+0000","last_became_peered":"2026-02-12T06:41:51.169306+0000","last_unstale":"2026-02-12T06:42:17.188394+0000","last_undegraded":"2026-02-12T06:42:17.188394+0000","last_fullsized":"2026-02-12T06:42:17.188394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":87,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.189866+0000","last_change":"2026-02-12T06:41:51.193015+0000","last_active":"2026-02-12T06:42:18.189866+0000","last_peered":"2026-02-12T06:42:18.189866+0000","last_clean":"2026-02-12T06:42:18.189866+0000","last_became_active":"2026-02-12T06:41:51.179821+0000","last_became_peered":"2026-02-12T06:41:51.179821+0000","last_unstale":"2026-02-12T06:42:18.189866+0000","last_undegraded":"2026-02-12T06:42:18.189866+0000","last_fullsized":"2026-02-12T06:42:18.189866+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-12T06:42:17.187396+0000","last_change":"2026-02-12T06:41:53.154235+0000","last_active":"2026-02-12T06:42:17.187396+0000","last_peered":"2026-02-12T06:42:17.187396+0000","last_clean":"2026-02-12T06:42:17.187396+0000","last_became_active":"2026-02-12T06:41:51.171159+0000","last_became_peered":"2026-02-12T06:41:51.171159+0000","last_unstale":"2026-02-12T06:42:17.187396+0000","last_undegraded":"2026-02-12T06:42:17.187396+0000","last_fullsized":"2026-02-12T06:42:17.187396+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.187141+0000","last_change":"2026-02-12T06:41:53.147447+0000","last_active":"2026-02-12T06:42:18.187141+0000","last_peered":"2026-02-12T06:42:18.187141+0000","last_clean":"2026-02-12T06:42:18.187141+0000","last_became_active":"2026-02-12T06:41:51.159138+0000","last_became_peered":"2026-02-12T06:41:51.159138+0000","last_unstale":"2026-02-12T06:42:18.187141+0000","last_undegraded":"2026-02-12T06:42:18.187141+0000","last_fullsized":"2026-02-12T06:42:18.187141+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.187136+0000","last_change":"2026-02-12T06:41:53.148511+0000","last_active":"2026-02-12T06:42:18.187136+0000","last_peered":"2026-02-12T06:42:18.187136+0000","last_clean":"2026-02-12T06:42:18.187136+0000","last_became_active":"2026-02-12T06:41:51.172390+0000","last_became_peered":"2026-02-12T06:41:51.172390+0000","last_unstale":"2026-02-12T06:42:18.187136+0000","last_undegraded":"2026-02-12T06:42:18.187136+0000","last_fullsized":"2026-02-12T06:42:18.187136+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.188701+0000","last_change":"2026-02-12T06:41:53.149919+0000","last_active":"2026-02-12T06:42:18.188701+0000","last_peered":"2026-02-12T06:42:18.188701+0000","last_clean":"2026-02-12T06:42:18.188701+0000","last_became_active":"2026-02-12T06:41:51.162751+0000","last_became_peered":"2026-02-12T06:41:51.162751+0000","last_unstale":"2026-02-12T06:42:18.188701+0000","last_undegraded":"2026-02-12T06:42:18.188701+0000","last_fullsized":"2026-02-12T06:42:18.188701+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210182144,"internally_reserved":0,"allocated":21476892672,"data_stored":21476892672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96632496128,"internally_reserved":0,"allocated":64428728320,"data_stored":64428728320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972816,"kb_used_data":20972816,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31455968,"statfs":{"total":53687074816,"available":32210911232,"internally_reserved":0,"allocated":21476163584,"data_stored":21476163584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971976,"kb_used_data":20971976,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456808,"statfs":{"total":53687074816,"available":32211771392,"internally_reserved":0,"allocated":21475303424,"data_stored":21475303424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972528,"kb_used_data":20972528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456256,"statfs":{"total":53687074816,"available":32211206144,"internally_reserved":0,"allocated":21475868672,"data_stored":21475868672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640286,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972472,"kb_used_data":20972472,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456312,"statfs":{"total":53687074816,"available":32211263488,"internally_reserved":0,"allocated":21475811328,"data_stored":21475811328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211132416,"internally_reserved":0,"allocated":21475942400,"data_stored":21475942400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211181568,"internally_reserved":0,"allocated":21475893248,"data_stored":21475893248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32210182144,"internally_reserved":0,"allocated":21476892672,"data_stored":21476892672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210182144,"internally_reserved":0,"allocated":21476892672,"data_stored":21476892672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T06:42:20.105 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-12T06:42:20.105 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T06:42:20.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:20.182+0000 7fc01fecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:20.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:20.188+0000 7fc01fecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:20.295 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:42:20.296 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-12T06:42:20.304 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2026-02-12T06:42:20.111937+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83889792,"kb_used_data":83889792,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125825344,"statfs":{"total":214748299264,"available":128845152256,"internally_reserved":0,"allocated":85903147008,"data_stored":85903147008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001188"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.188976+0000","last_change":"2026-02-12T06:41:53.149986+0000","last_active":"2026-02-12T06:42:18.188976+0000","last_peered":"2026-02-12T06:42:18.188976+0000","last_clean":"2026-02-12T06:42:18.188976+0000","last_became_active":"2026-02-12T06:41:51.169249+0000","last_became_peered":"2026-02-12T06:41:51.169249+0000","last_unstale":"2026-02-12T06:42:18.188976+0000","last_undegraded":"2026-02-12T06:42:18.188976+0000","last_fullsized":"2026-02-12T06:42:18.188976+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.190757+0000","last_change":"2026-02-12T06:41:53.149473+0000","last_active":"2026-02-12T06:42:18.190757+0000","last_peered":"2026-02-12T06:42:18.190757+0000","last_clean":"2026-02-12T06:42:18.190757+0000","last_became_active":"2026-02-12T06:41:51.180068+0000","last_became_peered":"2026-02-12T06:41:51.180068+0000","last_unstale":"2026-02-12T06:42:18.190757+0000","last_undegraded":"2026-02-12T06:42:18.190757+0000","last_fullsized":"2026-02-12T06:42:18.190757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.188423+0000","last_change":"2026-02-12T06:41:53.148671+0000","last_active":"2026-02-12T06:42:18.188423+0000","last_peered":"2026-02-12T06:42:18.188423+0000","last_clean":"2026-02-12T06:42:18.188423+0000","last_became_active":"2026-02-12T06:41:51.169785+0000","last_became_peered":"2026-02-12T06:41:51.169785+0000","last_unstale":"2026-02-12T06:42:18.188423+0000","last_undegraded":"2026-02-12T06:42:18.188423+0000","last_fullsized":"2026-02-12T06:42:18.188423+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-12T06:42:17.188394+0000","last_change":"2026-02-12T06:41:53.154630+0000","last_active":"2026-02-12T06:42:17.188394+0000","last_peered":"2026-02-12T06:42:17.188394+0000","last_clean":"2026-02-12T06:42:17.188394+0000","last_became_active":"2026-02-12T06:41:51.169306+0000","last_became_peered":"2026-02-12T06:41:51.169306+0000","last_unstale":"2026-02-12T06:42:17.188394+0000","last_undegraded":"2026-02-12T06:42:17.188394+0000","last_fullsized":"2026-02-12T06:42:17.188394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":87,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.189866+0000","last_change":"2026-02-12T06:41:51.193015+0000","last_active":"2026-02-12T06:42:18.189866+0000","last_peered":"2026-02-12T06:42:18.189866+0000","last_clean":"2026-02-12T06:42:18.189866+0000","last_became_active":"2026-02-12T06:41:51.179821+0000","last_became_peered":"2026-02-12T06:41:51.179821+0000","last_unstale":"2026-02-12T06:42:18.189866+0000","last_undegraded":"2026-02-12T06:42:18.189866+0000","last_fullsized":"2026-02-12T06:42:18.189866+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-12T06:42:17.187396+0000","last_change":"2026-02-12T06:41:53.154235+0000","last_active":"2026-02-12T06:42:17.187396+0000","last_peered":"2026-02-12T06:42:17.187396+0000","last_clean":"2026-02-12T06:42:17.187396+0000","last_became_active":"2026-02-12T06:41:51.171159+0000","last_became_peered":"2026-02-12T06:41:51.171159+0000","last_unstale":"2026-02-12T06:42:17.187396+0000","last_undegraded":"2026-02-12T06:42:17.187396+0000","last_fullsized":"2026-02-12T06:42:17.187396+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.187141+0000","last_change":"2026-02-12T06:41:53.147447+0000","last_active":"2026-02-12T06:42:18.187141+0000","last_peered":"2026-02-12T06:42:18.187141+0000","last_clean":"2026-02-12T06:42:18.187141+0000","last_became_active":"2026-02-12T06:41:51.159138+0000","last_became_peered":"2026-02-12T06:41:51.159138+0000","last_unstale":"2026-02-12T06:42:18.187141+0000","last_undegraded":"2026-02-12T06:42:18.187141+0000","last_fullsized":"2026-02-12T06:42:18.187141+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.187136+0000","last_change":"2026-02-12T06:41:53.148511+0000","last_active":"2026-02-12T06:42:18.187136+0000","last_peered":"2026-02-12T06:42:18.187136+0000","last_clean":"2026-02-12T06:42:18.187136+0000","last_became_active":"2026-02-12T06:41:51.172390+0000","last_became_peered":"2026-02-12T06:41:51.172390+0000","last_unstale":"2026-02-12T06:42:18.187136+0000","last_undegraded":"2026-02-12T06:42:18.187136+0000","last_fullsized":"2026-02-12T06:42:18.187136+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.188701+0000","last_change":"2026-02-12T06:41:53.149919+0000","last_active":"2026-02-12T06:42:18.188701+0000","last_peered":"2026-02-12T06:42:18.188701+0000","last_clean":"2026-02-12T06:42:18.188701+0000","last_became_active":"2026-02-12T06:41:51.162751+0000","last_became_peered":"2026-02-12T06:41:51.162751+0000","last_unstale":"2026-02-12T06:42:18.188701+0000","last_undegraded":"2026-02-12T06:42:18.188701+0000","last_fullsized":"2026-02-12T06:42:18.188701+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210182144,"internally_reserved":0,"allocated":21476892672,"data_stored":21476892672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96632496128,"internally_reserved":0,"allocated":64428728320,"data_stored":64428728320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972816,"kb_used_data":20972816,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31455968,"statfs":{"total":53687074816,"available":32210911232,"internally_reserved":0,"allocated":21476163584,"data_stored":21476163584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971976,"kb_used_data":20971976,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456808,"statfs":{"total":53687074816,"available":32211771392,"internally_reserved":0,"allocated":21475303424,"data_stored":21475303424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972528,"kb_used_data":20972528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456256,"statfs":{"total":53687074816,"available":32211206144,"internally_reserved":0,"allocated":21475868672,"data_stored":21475868672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640286,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972472,"kb_used_data":20972472,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456312,"statfs":{"total":53687074816,"available":32211263488,"internally_reserved":0,"allocated":21475811328,"data_stored":21475811328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211132416,"internally_reserved":0,"allocated":21475942400,"data_stored":21475942400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211181568,"internally_reserved":0,"allocated":21475893248,"data_stored":21475893248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32210182144,"internally_reserved":0,"allocated":21476892672,"data_stored":21476892672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210182144,"internally_reserved":0,"allocated":21476892672,"data_stored":21476892672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T06:42:20.306 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T06:42:20.382 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:20.383+0000 7f338ae5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:20.384 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:20.388+0000 7f338ae5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:20.495 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:42:20.495 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":18,"fsid":"d37d84c8-e358-473e-b2a6-41c5fd7faa02","created":"2026-02-12T06:41:39.895085+0000","modified":"2026-02-12T06:42:19.184023+0000","last_up_change":"2026-02-12T06:41:49.127662+0000","last_in_change":"2026-02-12T06:41:41.766299+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-12T06:41:49.478102+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-12T06:41:50.131015+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65efb09a-b3a9-4ea6-a3b6-cc159edef038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6803","nonce":250796605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":250796605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":250796605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6807","nonce":250796605}]},"public_addr":"10.20.193.58:6803/250796605","cluster_addr":"10.20.193.58:6804/250796605","heartbeat_back_addr":"10.20.193.58:6806/250796605","heartbeat_front_addr":"10.20.193.58:6807/250796605","state":["exists","up"]},{"osd":1,"uuid":"8f3dee99-afc4-42fa-bbd5-3b890204cd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6801","nonce":676908965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":676908965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":676908965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6805","nonce":676908965}]},"public_addr":"10.20.193.58:6801/676908965","cluster_addr":"10.20.193.58:6800/676908965","heartbeat_back_addr":"10.20.193.58:6802/676908965","heartbeat_front_addr":"10.20.193.58:6805/676908965","state":["exists","up"]},{"osd":2,"uuid":"0209b8d4-4241-459c-8bf6-363abfe3c98a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6803","nonce":728412104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6804","nonce":728412104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6809","nonce":728412104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6808","nonce":728412104}]},"public_addr":"10.20.193.106:6803/728412104","cluster_addr":"10.20.193.106:6804/728412104","heartbeat_back_addr":"10.20.193.106:6809/728412104","heartbeat_front_addr":"10.20.193.106:6808/728412104","state":["exists","up"]},{"osd":3,"uuid":"d090767f-8c6b-4bdb-b42f-08bf24105f97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6802","nonce":3015329221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6805","nonce":3015329221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6807","nonce":3015329221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6806","nonce":3015329221}]},"public_addr":"10.20.193.106:6802/3015329221","cluster_addr":"10.20.193.106:6805/3015329221","heartbeat_back_addr":"10.20.193.106:6807/3015329221","heartbeat_front_addr":"10.20.193.106:6806/3015329221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T06:42:21.506 INFO:tasks.ceph:Scrubbing osd.0 2026-02-12T06:42:21.506 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-12T06:42:21.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:21.585+0000 7f1041da4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:21.589 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:21.593+0000 7f1041da4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:21.599 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-12T06:42:21.599 INFO:teuthology.orchestra.run.trial058.stdout: "success": "" 2026-02-12T06:42:21.599 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-12T06:42:21.606 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-12T06:42:21.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:21.684+0000 7fe6fd764640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:21.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:21.690+0000 7fe6fd764640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:21.796 INFO:teuthology.orchestra.run.trial058.stderr:instructed osd(s) 0 to deep-scrub 2026-02-12T06:42:21.806 INFO:tasks.ceph:Scrubbing osd.1 2026-02-12T06:42:21.807 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-12T06:42:21.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:21.899+0000 7f96999f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:21.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:21.907+0000 7f96999f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:21.913 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-12T06:42:21.913 INFO:teuthology.orchestra.run.trial058.stdout: "success": "" 2026-02-12T06:42:21.913 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-12T06:42:21.921 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-12T06:42:21.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:22.000+0000 7f5449764640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:22.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:22.005+0000 7f5449764640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:22.112 INFO:teuthology.orchestra.run.trial058.stderr:instructed osd(s) 1 to deep-scrub 2026-02-12T06:42:22.123 INFO:tasks.ceph:Scrubbing osd.2 2026-02-12T06:42:22.123 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-12T06:42:22.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:22.200+0000 7f0418964640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:22.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:22.207+0000 7f0418964640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:22.213 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-12T06:42:22.214 INFO:teuthology.orchestra.run.trial058.stdout: "success": "" 2026-02-12T06:42:22.214 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-12T06:42:22.220 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-12T06:42:22.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:22.297+0000 7ffb3478a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:22.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:22.302+0000 7ffb3478a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:22.408 INFO:teuthology.orchestra.run.trial058.stderr:instructed osd(s) 2 to deep-scrub 2026-02-12T06:42:22.418 INFO:tasks.ceph:Scrubbing osd.3 2026-02-12T06:42:22.418 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-12T06:42:22.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:22.494+0000 7f1c6670b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:22.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:22.502+0000 7f1c6670b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:22.509 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-12T06:42:22.509 INFO:teuthology.orchestra.run.trial058.stdout: "success": "" 2026-02-12T06:42:22.509 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-12T06:42:22.517 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-12T06:42:22.593 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:22.593+0000 7f6fca10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:22.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:22.599+0000 7f6fca10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:22.709 INFO:teuthology.orchestra.run.trial058.stderr:instructed osd(s) 3 to deep-scrub 2026-02-12T06:42:22.721 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T06:42:22.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:22.798+0000 7fcccc61a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:22.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:22.803+0000 7fcccc61a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:22.912 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:42:22.912 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-12T06:42:22.921 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2026-02-12T06:42:22.112231+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83889792,"kb_used_data":83889792,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125825344,"statfs":{"total":214748299264,"available":128845152256,"internally_reserved":0,"allocated":85903147008,"data_stored":85903147008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001100"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.188976+0000","last_change":"2026-02-12T06:41:53.149986+0000","last_active":"2026-02-12T06:42:18.188976+0000","last_peered":"2026-02-12T06:42:18.188976+0000","last_clean":"2026-02-12T06:42:18.188976+0000","last_became_active":"2026-02-12T06:41:51.169249+0000","last_became_peered":"2026-02-12T06:41:51.169249+0000","last_unstale":"2026-02-12T06:42:18.188976+0000","last_undegraded":"2026-02-12T06:42:18.188976+0000","last_fullsized":"2026-02-12T06:42:18.188976+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.190757+0000","last_change":"2026-02-12T06:41:53.149473+0000","last_active":"2026-02-12T06:42:18.190757+0000","last_peered":"2026-02-12T06:42:18.190757+0000","last_clean":"2026-02-12T06:42:18.190757+0000","last_became_active":"2026-02-12T06:41:51.180068+0000","last_became_peered":"2026-02-12T06:41:51.180068+0000","last_unstale":"2026-02-12T06:42:18.190757+0000","last_undegraded":"2026-02-12T06:42:18.190757+0000","last_fullsized":"2026-02-12T06:42:18.190757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.188423+0000","last_change":"2026-02-12T06:41:53.148671+0000","last_active":"2026-02-12T06:42:18.188423+0000","last_peered":"2026-02-12T06:42:18.188423+0000","last_clean":"2026-02-12T06:42:18.188423+0000","last_became_active":"2026-02-12T06:41:51.169785+0000","last_became_peered":"2026-02-12T06:41:51.169785+0000","last_unstale":"2026-02-12T06:42:18.188423+0000","last_undegraded":"2026-02-12T06:42:18.188423+0000","last_fullsized":"2026-02-12T06:42:18.188423+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-12T06:42:17.188394+0000","last_change":"2026-02-12T06:41:53.154630+0000","last_active":"2026-02-12T06:42:17.188394+0000","last_peered":"2026-02-12T06:42:17.188394+0000","last_clean":"2026-02-12T06:42:17.188394+0000","last_became_active":"2026-02-12T06:41:51.169306+0000","last_became_peered":"2026-02-12T06:41:51.169306+0000","last_unstale":"2026-02-12T06:42:17.188394+0000","last_undegraded":"2026-02-12T06:42:17.188394+0000","last_fullsized":"2026-02-12T06:42:17.188394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":87,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.189866+0000","last_change":"2026-02-12T06:41:51.193015+0000","last_active":"2026-02-12T06:42:18.189866+0000","last_peered":"2026-02-12T06:42:18.189866+0000","last_clean":"2026-02-12T06:42:18.189866+0000","last_became_active":"2026-02-12T06:41:51.179821+0000","last_became_peered":"2026-02-12T06:41:51.179821+0000","last_unstale":"2026-02-12T06:42:18.189866+0000","last_undegraded":"2026-02-12T06:42:18.189866+0000","last_fullsized":"2026-02-12T06:42:18.189866+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-12T06:42:17.187396+0000","last_change":"2026-02-12T06:41:53.154235+0000","last_active":"2026-02-12T06:42:17.187396+0000","last_peered":"2026-02-12T06:42:17.187396+0000","last_clean":"2026-02-12T06:42:17.187396+0000","last_became_active":"2026-02-12T06:41:51.171159+0000","last_became_peered":"2026-02-12T06:41:51.171159+0000","last_unstale":"2026-02-12T06:42:17.187396+0000","last_undegraded":"2026-02-12T06:42:17.187396+0000","last_fullsized":"2026-02-12T06:42:17.187396+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.187141+0000","last_change":"2026-02-12T06:41:53.147447+0000","last_active":"2026-02-12T06:42:18.187141+0000","last_peered":"2026-02-12T06:42:18.187141+0000","last_clean":"2026-02-12T06:42:18.187141+0000","last_became_active":"2026-02-12T06:41:51.159138+0000","last_became_peered":"2026-02-12T06:41:51.159138+0000","last_unstale":"2026-02-12T06:42:18.187141+0000","last_undegraded":"2026-02-12T06:42:18.187141+0000","last_fullsized":"2026-02-12T06:42:18.187141+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.187136+0000","last_change":"2026-02-12T06:41:53.148511+0000","last_active":"2026-02-12T06:42:18.187136+0000","last_peered":"2026-02-12T06:42:18.187136+0000","last_clean":"2026-02-12T06:42:18.187136+0000","last_became_active":"2026-02-12T06:41:51.172390+0000","last_became_peered":"2026-02-12T06:41:51.172390+0000","last_unstale":"2026-02-12T06:42:18.187136+0000","last_undegraded":"2026-02-12T06:42:18.187136+0000","last_fullsized":"2026-02-12T06:42:18.187136+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-12T06:42:18.188701+0000","last_change":"2026-02-12T06:41:53.149919+0000","last_active":"2026-02-12T06:42:18.188701+0000","last_peered":"2026-02-12T06:42:18.188701+0000","last_clean":"2026-02-12T06:42:18.188701+0000","last_became_active":"2026-02-12T06:41:51.162751+0000","last_became_peered":"2026-02-12T06:41:51.162751+0000","last_unstale":"2026-02-12T06:42:18.188701+0000","last_undegraded":"2026-02-12T06:42:18.188701+0000","last_fullsized":"2026-02-12T06:42:18.188701+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:41:50.131531+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210182144,"internally_reserved":0,"allocated":21476892672,"data_stored":21476892672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96632496128,"internally_reserved":0,"allocated":64428728320,"data_stored":64428728320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972816,"kb_used_data":20972816,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31455968,"statfs":{"total":53687074816,"available":32210911232,"internally_reserved":0,"allocated":21476163584,"data_stored":21476163584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971976,"kb_used_data":20971976,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456808,"statfs":{"total":53687074816,"available":32211771392,"internally_reserved":0,"allocated":21475303424,"data_stored":21475303424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972528,"kb_used_data":20972528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456256,"statfs":{"total":53687074816,"available":32211206144,"internally_reserved":0,"allocated":21475868672,"data_stored":21475868672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640286,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972472,"kb_used_data":20972472,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456312,"statfs":{"total":53687074816,"available":32211263488,"internally_reserved":0,"allocated":21475811328,"data_stored":21475811328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211132416,"internally_reserved":0,"allocated":21475942400,"data_stored":21475942400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211181568,"internally_reserved":0,"allocated":21475893248,"data_stored":21475893248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32210182144,"internally_reserved":0,"allocated":21476892672,"data_stored":21476892672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210182144,"internally_reserved":0,"allocated":21476892672,"data_stored":21476892672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T06:42:22.924 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-12T06:41:50.131531+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=41, tm_sec=50, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=42, tm_sec=20, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T06:42:22.925 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-12T06:41:50.131531+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=41, tm_sec=50, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=42, tm_sec=20, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T06:42:22.925 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-12T06:41:50.131531+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=41, tm_sec=50, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=42, tm_sec=20, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T06:42:22.925 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-12T06:41:50.131531+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=41, tm_sec=50, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=42, tm_sec=20, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T06:42:22.925 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-12T06:41:50.131531+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=41, tm_sec=50, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=42, tm_sec=20, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T06:42:22.925 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-12T06:41:50.131531+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=41, tm_sec=50, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=42, tm_sec=20, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T06:42:22.925 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-12T06:41:50.131531+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=41, tm_sec=50, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=42, tm_sec=20, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T06:42:22.925 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-12T06:41:50.131531+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=41, tm_sec=50, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=42, tm_sec=20, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T06:42:22.925 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-12T06:41:50.131531+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=41, tm_sec=50, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=6, tm_min=42, tm_sec=20, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T06:42:22.925 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-12T06:42:42.926 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T06:42:43.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:43.004+0000 7fb173ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:43.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:43.009+0000 7fb173ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:43.116 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-12T06:42:43.117 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-12T06:42:43.126 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2026-02-12T06:42:42.115740+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83888944,"kb_used_data":83888944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125826192,"statfs":{"total":214748299264,"available":128846020608,"internally_reserved":0,"allocated":85902278656,"data_stored":85902278656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002259"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T06:42:22.708788+0000","last_change":"2026-02-12T06:42:22.720567+0000","last_active":"2026-02-12T06:42:22.708788+0000","last_peered":"2026-02-12T06:42:22.708788+0000","last_clean":"2026-02-12T06:42:22.708788+0000","last_became_active":"2026-02-12T06:41:51.169249+0000","last_became_peered":"2026-02-12T06:41:51.169249+0000","last_unstale":"2026-02-12T06:42:22.708788+0000","last_undegraded":"2026-02-12T06:42:22.708788+0000","last_fullsized":"2026-02-12T06:42:22.708788+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:42:22.720517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:42:22.720517+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T06:42:22.708425+0000","last_change":"2026-02-12T06:42:22.718707+0000","last_active":"2026-02-12T06:42:22.708425+0000","last_peered":"2026-02-12T06:42:22.708425+0000","last_clean":"2026-02-12T06:42:22.708425+0000","last_became_active":"2026-02-12T06:41:51.180068+0000","last_became_peered":"2026-02-12T06:41:51.180068+0000","last_unstale":"2026-02-12T06:42:22.708425+0000","last_undegraded":"2026-02-12T06:42:22.708425+0000","last_fullsized":"2026-02-12T06:42:22.708425+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:42:22.718631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:42:22.718631+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T06:42:22.406838+0000","last_change":"2026-02-12T06:42:22.416356+0000","last_active":"2026-02-12T06:42:22.406838+0000","last_peered":"2026-02-12T06:42:22.406838+0000","last_clean":"2026-02-12T06:42:22.406838+0000","last_became_active":"2026-02-12T06:41:51.169785+0000","last_became_peered":"2026-02-12T06:41:51.169785+0000","last_unstale":"2026-02-12T06:42:22.406838+0000","last_undegraded":"2026-02-12T06:42:22.406838+0000","last_fullsized":"2026-02-12T06:42:22.406838+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:42:22.416244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:42:22.416244+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T06:42:22.118024+0000","last_change":"2026-02-12T06:42:22.125857+0000","last_active":"2026-02-12T06:42:22.118024+0000","last_peered":"2026-02-12T06:42:22.118024+0000","last_clean":"2026-02-12T06:42:22.118024+0000","last_became_active":"2026-02-12T06:41:51.169306+0000","last_became_peered":"2026-02-12T06:41:51.169306+0000","last_unstale":"2026-02-12T06:42:22.118024+0000","last_undegraded":"2026-02-12T06:42:22.118024+0000","last_fullsized":"2026-02-12T06:42:22.118024+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:42:22.125742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:42:22.125742+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":92,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T06:42:22.710288+0000","last_change":"2026-02-12T06:42:22.729608+0000","last_active":"2026-02-12T06:42:22.710288+0000","last_peered":"2026-02-12T06:42:22.710288+0000","last_clean":"2026-02-12T06:42:22.710288+0000","last_became_active":"2026-02-12T06:41:51.179821+0000","last_became_peered":"2026-02-12T06:41:51.179821+0000","last_unstale":"2026-02-12T06:42:22.710288+0000","last_undegraded":"2026-02-12T06:42:22.710288+0000","last_fullsized":"2026-02-12T06:42:22.710288+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'52","last_scrub_stamp":"2026-02-12T06:42:22.729542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:42:22.729542+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T06:42:22.117301+0000","last_change":"2026-02-12T06:42:22.130511+0000","last_active":"2026-02-12T06:42:22.117301+0000","last_peered":"2026-02-12T06:42:22.117301+0000","last_clean":"2026-02-12T06:42:22.117301+0000","last_became_active":"2026-02-12T06:41:51.171159+0000","last_became_peered":"2026-02-12T06:41:51.171159+0000","last_unstale":"2026-02-12T06:42:22.117301+0000","last_undegraded":"2026-02-12T06:42:22.117301+0000","last_fullsized":"2026-02-12T06:42:22.117301+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2026-02-12T06:42:22.130416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:42:22.130416+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":28,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T06:42:22.406151+0000","last_change":"2026-02-12T06:42:22.419872+0000","last_active":"2026-02-12T06:42:22.406151+0000","last_peered":"2026-02-12T06:42:22.406151+0000","last_clean":"2026-02-12T06:42:22.406151+0000","last_became_active":"2026-02-12T06:41:51.159138+0000","last_became_peered":"2026-02-12T06:41:51.159138+0000","last_unstale":"2026-02-12T06:42:22.406151+0000","last_undegraded":"2026-02-12T06:42:22.406151+0000","last_fullsized":"2026-02-12T06:42:22.406151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2026-02-12T06:42:22.419780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:42:22.419780+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T06:42:22.708123+0000","last_change":"2026-02-12T06:42:22.719445+0000","last_active":"2026-02-12T06:42:22.708123+0000","last_peered":"2026-02-12T06:42:22.708123+0000","last_clean":"2026-02-12T06:42:22.708123+0000","last_became_active":"2026-02-12T06:41:51.172390+0000","last_became_peered":"2026-02-12T06:41:51.172390+0000","last_unstale":"2026-02-12T06:42:22.708123+0000","last_undegraded":"2026-02-12T06:42:22.708123+0000","last_fullsized":"2026-02-12T06:42:22.708123+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:42:22.719375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:42:22.719375+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T06:42:22.707200+0000","last_change":"2026-02-12T06:42:22.720141+0000","last_active":"2026-02-12T06:42:22.707200+0000","last_peered":"2026-02-12T06:42:22.707200+0000","last_clean":"2026-02-12T06:42:22.707200+0000","last_became_active":"2026-02-12T06:41:51.162751+0000","last_became_peered":"2026-02-12T06:41:51.162751+0000","last_unstale":"2026-02-12T06:42:22.707200+0000","last_undegraded":"2026-02-12T06:42:22.707200+0000","last_fullsized":"2026-02-12T06:42:22.707200+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T06:42:22.720091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T06:42:22.720091+0000","last_clean_scrub_stamp":"2026-02-12T06:41:50.131531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32211120128,"internally_reserved":0,"allocated":21475954688,"data_stored":21475954688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96634146816,"internally_reserved":0,"allocated":64427077632,"data_stored":64427077632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640305,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972612,"kb_used_data":20972612,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456172,"statfs":{"total":53687074816,"available":32211120128,"internally_reserved":0,"allocated":21475954688,"data_stored":21475954688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640305,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971876,"kb_used_data":20971876,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456908,"statfs":{"total":53687074816,"available":32211873792,"internally_reserved":0,"allocated":21475201024,"data_stored":21475201024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673009,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972580,"kb_used_data":20972580,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456204,"statfs":{"total":53687074816,"available":32211152896,"internally_reserved":0,"allocated":21475921920,"data_stored":21475921920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640306,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971876,"kb_used_data":20971876,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456908,"statfs":{"total":53687074816,"available":32211873792,"internally_reserved":0,"allocated":21475201024,"data_stored":21475201024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211152896,"internally_reserved":0,"allocated":21475921920,"data_stored":21475921920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211873792,"internally_reserved":0,"allocated":21475201024,"data_stored":21475201024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32211120128,"internally_reserved":0,"allocated":21475954688,"data_stored":21475954688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32211120128,"internally_reserved":0,"allocated":21475954688,"data_stored":21475954688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T06:42:43.128 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-12T06:42:43.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:43.202+0000 7fc69d10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:43.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-12T06:42:43.209+0000 7fc69d10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-12T06:42:43.330 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-12T06:42:43.330 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-12T06:42:43.331 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-12T06:42:43.331 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T06:42:43.384 INFO:tasks.ceph.osd.0:Stopped 2026-02-12T06:42:43.385 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-12T06:42:43.385 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T06:42:43.440 INFO:tasks.ceph.osd.1:Stopped 2026-02-12T06:42:43.440 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-12T06:42:43.440 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T06:42:43.490 INFO:tasks.ceph.osd.2:Stopped 2026-02-12T06:42:43.491 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-12T06:42:43.491 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T06:42:43.550 INFO:tasks.ceph.osd.3:Stopped 2026-02-12T06:42:43.551 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-12T06:42:43.551 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-12T06:42:43.551 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T06:42:43.584 INFO:tasks.ceph.mgr.x:Stopped 2026-02-12T06:42:43.584 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-12T06:42:43.585 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-12T06:42:43.585 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T06:42:43.597 INFO:tasks.ceph.mon.a:Stopped 2026-02-12T06:42:43.598 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-12T06:42:43.598 DEBUG:teuthology.orchestra.run.trial058:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | head -n 1 2026-02-12T06:42:43.663 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial058.front.sepia.ceph.com 2026-02-12T06:42:43.664 DEBUG:teuthology.orchestra.run.trial058:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-12T06:42:43.738 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial058.front.sepia.ceph.com 2026-02-12T06:42:43.738 DEBUG:teuthology.orchestra.run.trial058:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-12T06:42:43.805 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial106.front.sepia.ceph.com 2026-02-12T06:42:43.805 DEBUG:teuthology.orchestra.run.trial106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-12T06:42:43.836 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial106.front.sepia.ceph.com 2026-02-12T06:42:43.837 DEBUG:teuthology.orchestra.run.trial106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-12T06:42:43.904 INFO:tasks.ceph:Archiving mon data... 2026-02-12T06:42:43.906 DEBUG:teuthology.misc:Transferring archived files from trial058:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:23:35-crimson-rados-main-distro-debug-trial/45991/data/mon.a.tgz 2026-02-12T06:42:43.906 DEBUG:teuthology.orchestra.run.trial058:> mktemp 2026-02-12T06:42:43.925 INFO:teuthology.orchestra.run.trial058.stdout:/tmp/tmp.a58FpxlxBy 2026-02-12T06:42:43.925 DEBUG:teuthology.orchestra.run.trial058:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.a58FpxlxBy 2026-02-12T06:42:44.008 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod 0666 /tmp/tmp.a58FpxlxBy 2026-02-12T06:42:44.130 DEBUG:teuthology.orchestra.remote:trial058:/tmp/tmp.a58FpxlxBy is 172KB 2026-02-12T06:42:44.182 DEBUG:teuthology.orchestra.run.trial058:> rm -fr /tmp/tmp.a58FpxlxBy 2026-02-12T06:42:44.199 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-12T06:42:44.199 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T06:42:44.241 DEBUG:teuthology.orchestra.run.trial106:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T06:42:44.320 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T06:42:44.337 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T06:42:44.338 INFO:tasks.ceph:Archiving crash dumps... 2026-02-12T06:42:44.340 DEBUG:teuthology.misc:Transferring archived files from trial058:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:23:35-crimson-rados-main-distro-debug-trial/45991/remote/trial058/crash 2026-02-12T06:42:44.341 DEBUG:teuthology.orchestra.run.trial058:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T06:42:44.387 DEBUG:teuthology.misc:Transferring archived files from trial106:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:23:35-crimson-rados-main-distro-debug-trial/45991/remote/trial106/crash 2026-02-12T06:42:44.388 DEBUG:teuthology.orchestra.run.trial106:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T06:42:44.414 INFO:tasks.ceph:Compressing logs... 2026-02-12T06:42:44.414 DEBUG:teuthology.orchestra.run.trial058:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T06:42:44.434 DEBUG:teuthology.orchestra.run.trial106:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T06:42:44.470 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23352.log 2026-02-12T06:42:44.471 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-12T06:42:44.471 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.23352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21822.log 2026-02-12T06:42:44.471 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23352.log.gz 2026-02-12T06:42:44.471 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22199.log 2026-02-12T06:42:44.471 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.21822.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-12T06:42:44.471 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.21822.log.gz 2026-02-12T06:42:44.471 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22150.log 2026-02-12T06:42:44.471 INFO:teuthology.orchestra.run.trial058.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22199.log.gz 2026-02-12T06:42:44.472 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23548.log 2026-02-12T06:42:44.472 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23499.log 2026-02-12T06:42:44.472 INFO:teuthology.orchestra.run.trial058.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22150.log.gz 2026-02-12T06:42:44.472 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.23548.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23548.log.gzgzip 2026-02-12T06:42:44.472 INFO:teuthology.orchestra.run.trial058.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22525.log 2026-02-12T06:42:44.472 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.23499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23646.log 2026-02-12T06:42:44.472 INFO:teuthology.orchestra.run.trial058.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23499.log.gz 2026-02-12T06:42:44.472 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22836.log 2026-02-12T06:42:44.472 INFO:teuthology.orchestra.run.trial058.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22525.log.gz 2026-02-12T06:42:44.472 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.23646.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20394.log 2026-02-12T06:42:44.472 INFO:teuthology.orchestra.run.trial058.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23646.log.gz 2026-02-12T06:42:44.472 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22836.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22836.log.gz 2026-02-12T06:42:44.473 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22522.log 2026-02-12T06:42:44.473 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph.tmp-client.admin.20394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21588.log 2026-02-12T06:42:44.473 INFO:teuthology.orchestra.run.trial058.stderr: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20394.log.gz 2026-02-12T06:42:44.473 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21882.log 2026-02-12T06:42:44.473 INFO:teuthology.orchestra.run.trial058.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22522.log.gz 2026-02-12T06:42:44.473 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.21588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23597.log 2026-02-12T06:42:44.473 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.21588.log.gz 2026-02-12T06:42:44.473 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.21882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22934.log 2026-02-12T06:42:44.473 INFO:teuthology.orchestra.run.trial058.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.21882.log.gz 2026-02-12T06:42:44.473 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.23597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22326.log 2026-02-12T06:42:44.473 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23597.log.gz 2026-02-12T06:42:44.473 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22885.log 2026-02-12T06:42:44.474 INFO:teuthology.orchestra.run.trial058.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22934.log.gz 2026-02-12T06:42:44.474 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22328.log 2026-02-12T06:42:44.474 INFO:teuthology.orchestra.run.trial058.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22326.log.gz 2026-02-12T06:42:44.474 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23940.log 2026-02-12T06:42:44.474 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22885.log.gz 2026-02-12T06:42:44.474 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21952.log 2026-02-12T06:42:44.474 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22328.log.gz 2026-02-12T06:42:44.474 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.23940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23401.log 2026-02-12T06:42:44.474 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23940.log.gz 2026-02-12T06:42:44.474 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.21952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21979.log 2026-02-12T06:42:44.474 INFO:teuthology.orchestra.run.trial058.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.21952.log.gz 2026-02-12T06:42:44.474 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.23401.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23401.log.gz 2026-02-12T06:42:44.475 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23744.log 2026-02-12T06:42:44.475 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.21979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21455.log 2026-02-12T06:42:44.475 INFO:teuthology.orchestra.run.trial058.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.21979.log.gz 2026-02-12T06:42:44.475 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.23744.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23744.log.gz 2026-02-12T06:42:44.475 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23990.log 2026-02-12T06:42:44.475 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.21455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23695.log 2026-02-12T06:42:44.475 INFO:teuthology.orchestra.run.trial058.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.21455.log.gz 2026-02-12T06:42:44.475 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.23990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22526.log 2026-02-12T06:42:44.475 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23990.log.gz 2026-02-12T06:42:44.475 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.23695.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23695.log.gz 2026-02-12T06:42:44.475 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22329.log 2026-02-12T06:42:44.475 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22526.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-12T06:42:44.475 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22526.log.gz 2026-02-12T06:42:44.476 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22640.log 50.0% 2026-02-12T06:42:44.476 INFO:teuthology.orchestra.run.trial058.stderr: -- replaced with /var/log/ceph/ceph-client.admin.22329.log.gz 2026-02-12T06:42:44.476 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22052.log 2026-02-12T06:42:44.476 INFO:teuthology.orchestra.run.trial058.stderr: 87.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-12T06:42:44.476 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21796.log 2026-02-12T06:42:44.476 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22640.log.gz 2026-02-12T06:42:44.476 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24037.log 2026-02-12T06:42:44.476 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22052.log.gz 2026-02-12T06:42:44.476 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.21796.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-12T06:42:44.476 INFO:teuthology.orchestra.run.trial058.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.21796.log.gz 2026-02-12T06:42:44.476 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.24037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23450.log 2026-02-12T06:42:44.476 INFO:teuthology.orchestra.run.trial058.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.24037.log.gz 2026-02-12T06:42:44.477 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22738.log 2026-02-12T06:42:44.477 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.23450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23842.log 2026-02-12T06:42:44.477 INFO:teuthology.orchestra.run.trial058.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23450.log.gz 2026-02-12T06:42:44.477 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22738.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22738.log.gz 2026-02-12T06:42:44.477 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22668.log 2026-02-12T06:42:44.477 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5/var/log/ceph/ceph-client.admin.23842.log: --verbose -- /var/log/ceph/ceph-client.admin.21541.log 2026-02-12T06:42:44.477 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23842.log.gz 2026-02-12T06:42:44.477 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22101.log 2026-02-12T06:42:44.477 INFO:teuthology.orchestra.run.trial058.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22668.log.gz 2026-02-12T06:42:44.477 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.21541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23891.log 2026-02-12T06:42:44.477 INFO:teuthology.orchestra.run.trial058.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.21541.log.gz 2026-02-12T06:42:44.477 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23209.log 2026-02-12T06:42:44.477 INFO:teuthology.orchestra.run.trial058.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22101.log.gz 2026-02-12T06:42:44.478 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.23891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22444.log 2026-02-12T06:42:44.478 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23891.log.gz 2026-02-12T06:42:44.478 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.23209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22327.log 2026-02-12T06:42:44.478 INFO:teuthology.orchestra.run.trial058.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23209.log.gz 2026-02-12T06:42:44.478 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22444.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-12T06:42:44.478 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22444.log.gz 2026-02-12T06:42:44.478 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22765.log 2026-02-12T06:42:44.478 INFO:teuthology.orchestra.run.trial058.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22327.log.gz 2026-02-12T06:42:44.478 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23793.log 2026-02-12T06:42:44.478 INFO:teuthology.orchestra.run.trial058.stderr: 82.9% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-12T06:42:44.478 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.22765.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22765.log.gz 2026-02-12T06:42:44.478 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.23793.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23793.log.gz 2026-02-12T06:42:44.480 INFO:teuthology.orchestra.run.trial058.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-12T06:42:44.486 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-12T06:42:44.487 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21574.log 2026-02-12T06:42:44.487 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-12T06:42:44.488 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.21574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21628.log 2026-02-12T06:42:44.489 INFO:teuthology.orchestra.run.trial106.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.21574.log.gz 2026-02-12T06:42:44.489 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21476.log 2026-02-12T06:42:44.489 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.21628.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-12T06:42:44.489 INFO:teuthology.orchestra.run.trial106.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.21628.log.gz 2026-02-12T06:42:44.489 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.21476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21523.log 2026-02-12T06:42:44.489 INFO:teuthology.orchestra.run.trial106.stderr: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.21476.log.gz 2026-02-12T06:42:44.489 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.21523.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.21523.log.gz 2026-02-12T06:42:44.495 INFO:teuthology.orchestra.run.trial106.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-12T06:42:44.509 INFO:teuthology.orchestra.run.trial058.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-12T06:42:44.528 INFO:teuthology.orchestra.run.trial058.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-12T06:42:44.530 INFO:teuthology.orchestra.run.trial058.stderr: 2026-02-12T06:42:44.531 INFO:teuthology.orchestra.run.trial058.stderr:real 0m0.083s 2026-02-12T06:42:44.531 INFO:teuthology.orchestra.run.trial058.stderr:user 0m0.152s 2026-02-12T06:42:44.531 INFO:teuthology.orchestra.run.trial058.stderr:sys 0m0.039s 2026-02-12T06:42:44.543 INFO:teuthology.orchestra.run.trial106.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-12T06:42:44.595 INFO:teuthology.orchestra.run.trial106.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-12T06:42:44.596 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-12T06:42:44.596 INFO:teuthology.orchestra.run.trial106.stderr:real 0m0.118s 2026-02-12T06:42:44.596 INFO:teuthology.orchestra.run.trial106.stderr:user 0m0.177s 2026-02-12T06:42:44.596 INFO:teuthology.orchestra.run.trial106.stderr:sys 0m0.017s 2026-02-12T06:42:44.597 INFO:tasks.ceph:Archiving logs... 2026-02-12T06:42:44.598 DEBUG:teuthology.misc:Transferring archived files from trial058:/var/log/ceph to /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:23:35-crimson-rados-main-distro-debug-trial/45991/remote/trial058/log 2026-02-12T06:42:44.599 DEBUG:teuthology.orchestra.run.trial058:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T06:42:44.740 DEBUG:teuthology.misc:Transferring archived files from trial106:/var/log/ceph to /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:23:35-crimson-rados-main-distro-debug-trial/45991/remote/trial106/log 2026-02-12T06:42:44.741 DEBUG:teuthology.orchestra.run.trial106:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T06:42:44.837 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T06:42:44.986 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T06:42:44.997 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-12T06:42:44.997 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T06:42:44.999 DEBUG:teuthology.orchestra.run.trial106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T06:42:45.024 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-12T06:42:45.035 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-12T06:42:45.035 DEBUG:teuthology.orchestra.run.trial058:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T06:42:45.063 DEBUG:teuthology.orchestra.run.trial106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T06:42:45.077 INFO:teuthology.orchestra.run.trial058.stderr:bash: line 1: ntpq: command not found 2026-02-12T06:42:45.080 INFO:teuthology.orchestra.run.trial106.stderr:bash: line 1: ntpq: command not found 2026-02-12T06:42:45.120 INFO:teuthology.orchestra.run.trial058.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T06:42:45.120 INFO:teuthology.orchestra.run.trial058.stdout:=============================================================================== 2026-02-12T06:42:45.120 INFO:teuthology.orchestra.run.trial058.stdout:^- 172-234-37-140.ip.linode> 2 6 377 40 +24ms[ +23ms] +/- 84ms 2026-02-12T06:42:45.120 INFO:teuthology.orchestra.run.trial058.stdout:^+ 144.202.41.38.vultruserc> 2 6 377 40 +5675us[+5675us] +/- 35ms 2026-02-12T06:42:45.120 INFO:teuthology.orchestra.run.trial058.stdout:^* 144.202.62.209.vultruser> 2 6 377 40 -1507us[-2077us] +/- 15ms 2026-02-12T06:42:45.120 INFO:teuthology.orchestra.run.trial058.stdout:^- 23-95-35-34-host.colocro> 2 6 377 40 +3716us[+3147us] +/- 46ms 2026-02-12T06:42:45.135 INFO:teuthology.orchestra.run.trial106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T06:42:45.135 INFO:teuthology.orchestra.run.trial106.stdout:=============================================================================== 2026-02-12T06:42:45.135 INFO:teuthology.orchestra.run.trial106.stdout:^- 172-232-15-202.ip.linode> 2 6 377 40 -8853us[-8853us] +/- 77ms 2026-02-12T06:42:45.135 INFO:teuthology.orchestra.run.trial106.stdout:^- arm1.maxhost.io 2 6 37 35 -2570us[-2570us] +/- 55ms 2026-02-12T06:42:45.135 INFO:teuthology.orchestra.run.trial106.stdout:^* time.ecansol.net 1 6 377 40 +1531us[+1655us] +/- 16ms 2026-02-12T06:42:45.135 INFO:teuthology.orchestra.run.trial106.stdout:^+ time2.trtnw.net 2 6 377 40 -3249us[-3249us] +/- 41ms 2026-02-12T06:42:45.136 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-12T06:42:45.149 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-12T06:42:45.150 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-12T06:42:45.166 DEBUG:teuthology.orchestra.run.trial058:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T06:42:45.209 DEBUG:teuthology.orchestra.run.trial106:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T06:42:45.252 DEBUG:teuthology.orchestra.run.trial058:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T06:42:45.279 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T06:42:45.280 DEBUG:teuthology.orchestra.run.trial106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T06:42:45.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T06:42:45.317 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-12T06:42:45.335 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-12T06:42:45.351 INFO:teuthology.task.internal:Duration was 374.317964 seconds 2026-02-12T06:42:45.351 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-12T06:42:45.368 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-12T06:42:45.368 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T06:42:45.373 DEBUG:teuthology.orchestra.run.trial106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T06:42:45.408 INFO:teuthology.orchestra.run.trial058.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T06:42:45.412 INFO:teuthology.orchestra.run.trial106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T06:42:45.775 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-12T06:42:45.776 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial058.front.sepia.ceph.com 2026-02-12T06:42:45.776 DEBUG:teuthology.orchestra.run.trial058:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T06:42:45.836 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial106.front.sepia.ceph.com 2026-02-12T06:42:45.836 DEBUG:teuthology.orchestra.run.trial106:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T06:42:45.856 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-12T06:42:45.857 DEBUG:teuthology.orchestra.run.trial058:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T06:42:45.878 DEBUG:teuthology.orchestra.run.trial106:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T06:42:45.939 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-12T06:42:45.940 DEBUG:teuthology.orchestra.run.trial058:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T06:42:45.961 DEBUG:teuthology.orchestra.run.trial106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T06:42:45.981 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T06:42:45.983 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T06:42:45.983 INFO:teuthology.orchestra.run.trial058.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T06:42:45.984 INFO:teuthology.orchestra.run.trial058.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T06:42:45.984 INFO:teuthology.orchestra.run.trial058.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T06:42:45.986 INFO:teuthology.orchestra.run.trial058.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T06:42:46.003 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T06:42:46.004 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T06:42:46.004 INFO:teuthology.orchestra.run.trial106.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T06:42:46.004 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T06:42:46.004 INFO:teuthology.orchestra.run.trial106.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T06:42:46.008 INFO:teuthology.orchestra.run.trial106.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T06:42:46.010 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-12T06:42:46.028 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-12T06:42:46.029 DEBUG:teuthology.orchestra.run.trial058:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T06:42:46.052 DEBUG:teuthology.orchestra.run.trial106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T06:42:46.077 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-12T06:42:46.094 DEBUG:teuthology.orchestra.run.trial058:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T06:42:46.097 DEBUG:teuthology.orchestra.run.trial106:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T06:42:46.118 INFO:teuthology.orchestra.run.trial058.stdout:kernel.core_pattern = core 2026-02-12T06:42:46.142 INFO:teuthology.orchestra.run.trial106.stdout:kernel.core_pattern = core 2026-02-12T06:42:46.160 DEBUG:teuthology.orchestra.run.trial058:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T06:42:46.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T06:42:46.188 DEBUG:teuthology.orchestra.run.trial106:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T06:42:46.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T06:42:46.216 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-12T06:42:46.232 INFO:teuthology.task.internal:Transferring archived files... 2026-02-12T06:42:46.233 DEBUG:teuthology.misc:Transferring archived files from trial058:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:23:35-crimson-rados-main-distro-debug-trial/45991/remote/trial058 2026-02-12T06:42:46.234 DEBUG:teuthology.orchestra.run.trial058:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T06:42:46.268 DEBUG:teuthology.misc:Transferring archived files from trial106:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:23:35-crimson-rados-main-distro-debug-trial/45991/remote/trial106 2026-02-12T06:42:46.269 DEBUG:teuthology.orchestra.run.trial106:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T06:42:46.302 INFO:teuthology.task.internal:Removing archive directory... 2026-02-12T06:42:46.303 DEBUG:teuthology.orchestra.run.trial058:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T06:42:46.305 DEBUG:teuthology.orchestra.run.trial106:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T06:42:46.352 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-12T06:42:46.370 INFO:teuthology.task.internal:Not uploading archives. 2026-02-12T06:42:46.370 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-12T06:42:46.386 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-12T06:42:46.386 DEBUG:teuthology.orchestra.run.trial058:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T06:42:46.388 DEBUG:teuthology.orchestra.run.trial106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T06:42:46.402 INFO:teuthology.orchestra.run.trial058.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 06:42 /home/ubuntu/cephtest 2026-02-12T06:42:46.407 INFO:teuthology.orchestra.run.trial106.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 06:42 /home/ubuntu/cephtest 2026-02-12T06:42:46.409 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T06:42:46.426 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T06:42:46.462 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/cls} duration: 374.31796407699585 flavor: debug owner: scheduled_moagrawa@soko04.front.sepia.ceph.com success: true 2026-02-12T06:42:46.463 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:42:46.571 INFO:teuthology.run:pass